Dec 01 19:10:52 user nova-compute[75066]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75066) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75066) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75066) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Dec 01 19:10:52 user nova-compute[75066]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:10:52 user nova-compute[75066]: INFO nova.virt.driver [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] Loading compute driver 'libvirt.LibvirtDriver'
Dec 01 19:10:52 user nova-compute[75066]: INFO nova.compute.provider_config [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] Acquiring lock "singleton_lock" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] Acquired lock "singleton_lock" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] Releasing lock "singleton_lock" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] Full set of CONF: {{(pid=75066) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] ******************************************************************************** {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] Configuration options gathered from: {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] ================================================================================ {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] allow_resize_to_same_host      = True {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] arq_binding_timeout            = 300 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] backdoor_port                  = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] backdoor_socket                = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] block_device_allocate_retries  = 300 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] block_device_allocate_retries_interval = 5 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cert                           = self.pem {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] compute_monitors               = [] {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] config_dir                     = [] {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] config_drive_format            = iso9660 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] config_source                  = [] {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] console_host                   = user {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] control_exchange               = nova {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cpu_allocation_ratio           = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] daemon                         = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] debug                          = True {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] default_access_ip_network_name = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] default_availability_zone      = nova {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] default_ephemeral_format       = ext4 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] default_green_pool_size        = 1000 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] default_schedule_zone          = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] disk_allocation_ratio          = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] enable_new_services            = True {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] enabled_apis                   = ['osapi_compute'] {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] enabled_ssl_apis               = [] {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] flat_injected                  = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] force_config_drive             = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] force_raw_images               = True {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] graceful_shutdown_timeout      = 5 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] heal_instance_info_cache_interval = 60 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] host                           = user {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] instance_build_timeout         = 0 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] instance_delete_interval       = 300 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] instance_format                = [instance: %(uuid)s]  {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] instance_name_template         = instance-%08x {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] instance_usage_audit           = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] instance_usage_audit_period    = month {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] internal_service_availability_zone = internal {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] key                            = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] live_migration_retry_count     = 30 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] log_config_append              = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] log_dir                        = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] log_file                       = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] log_options                    = True {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] log_rotate_interval            = 1 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] log_rotate_interval_type       = days {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] log_rotation_type              = none {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] long_rpc_timeout               = 1800 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] max_concurrent_builds          = 10 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] max_concurrent_live_migrations = 1 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] max_concurrent_snapshots       = 5 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] max_local_block_devices        = 3 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] max_logfile_count              = 30 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] max_logfile_size_mb            = 200 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] maximum_instance_delete_attempts = 5 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] metadata_listen                = 0.0.0.0 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] metadata_listen_port           = 8775 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] metadata_workers               = 3 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] migrate_max_retries            = -1 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] mkisofs_cmd                    = genisoimage {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] my_ip                          = 10.0.0.210 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] network_allocate_retries       = 0 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] osapi_compute_listen_port      = 8774 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] osapi_compute_unique_server_name_scope =  {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] osapi_compute_workers          = 3 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] password_length                = 12 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] periodic_enable                = True {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] periodic_fuzzy_delay           = 60 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] pointer_model                  = ps2mouse {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] preallocate_images             = none {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] publish_errors                 = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] pybasedir                      = /opt/stack/nova {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] ram_allocation_ratio           = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] rate_limit_burst               = 0 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] rate_limit_except_level        = CRITICAL {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] rate_limit_interval            = 0 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] reboot_timeout                 = 0 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] reclaim_instance_interval      = 0 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] record                         = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] reimage_timeout_per_gb         = 60 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] report_interval                = 120 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] rescue_timeout                 = 0 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] reserved_host_cpus             = 0 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] reserved_host_disk_mb          = 0 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] reserved_host_memory_mb        = 512 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] reserved_huge_pages            = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] resize_confirm_window          = 0 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] resize_fs_using_block_device   = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] resume_guests_state_on_host_boot = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] rpc_response_timeout           = 60 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] run_external_periodic_tasks    = True {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] running_deleted_instance_action = reap {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] running_deleted_instance_poll_interval = 1800 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] running_deleted_instance_timeout = 0 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] scheduler_instance_sync_interval = 120 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] service_down_time              = 720 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] servicegroup_driver            = db {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] shelved_offload_time           = 0 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] shelved_poll_interval          = 3600 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] shutdown_timeout               = 0 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] source_is_ipv6                 = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] ssl_only                       = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] state_path                     = /opt/stack/data/nova {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] sync_power_state_interval      = 600 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] sync_power_state_pool_size     = 1000 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] syslog_log_facility            = LOG_USER {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] tempdir                        = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] timeout_nbd                    = 10 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] transport_url                  = **** {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] update_resources_interval      = 0 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] use_cow_images                 = True {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] use_eventlog                   = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] use_journal                    = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] use_json                       = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] use_rootwrap_daemon            = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] use_stderr                     = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] use_syslog                     = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vcpu_pin_set                   = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vif_plugging_is_fatal          = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vif_plugging_timeout           = 0 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] virt_mkfs                      = [] {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] volume_usage_poll_interval     = 0 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] watch_log_file                 = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] web                            = /usr/share/spice-html5 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_concurrency.disable_process_locking = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] api.auth_strategy              = keystone {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] api.compute_link_prefix        = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] api.dhcp_domain                = novalocal {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] api.enable_instance_password   = True {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] api.glance_link_prefix         = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] api.instance_list_per_project_cells = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] api.list_records_by_skipping_down_cells = True {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] api.local_metadata_per_cell    = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] api.max_limit                  = 1000 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] api.metadata_cache_expiration  = 15 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] api.neutron_default_tenant_id  = default {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] api.use_forwarded_for          = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] api.use_neutron_default_nets   = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] api.vendordata_dynamic_targets = [] {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] api.vendordata_jsonfile_path   = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cache.backend                  = dogpile.cache.memcached {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cache.backend_argument         = **** {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cache.config_prefix            = cache.oslo {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cache.dead_timeout             = 60.0 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cache.debug_cache_backend      = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cache.enable_retry_client      = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cache.enable_socket_keepalive  = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cache.enabled                  = True {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cache.expiration_time          = 600 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cache.hashclient_retry_attempts = 2 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cache.memcache_dead_retry      = 300 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cache.memcache_password        =  {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cache.memcache_pool_maxsize    = 10 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cache.memcache_sasl_enabled    = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cache.memcache_username        =  {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cache.proxies                  = [] {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cache.retry_attempts           = 2 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cache.retry_delay              = 0.0 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cache.socket_keepalive_count   = 1 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cache.socket_keepalive_idle    = 1 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cache.socket_keepalive_interval = 1 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cache.tls_allowed_ciphers      = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cache.tls_cafile               = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cache.tls_certfile             = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cache.tls_enabled              = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cache.tls_keyfile              = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cinder.auth_section            = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cinder.auth_type               = password {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cinder.cafile                  = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cinder.certfile                = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cinder.collect_timing          = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cinder.cross_az_attach         = True {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cinder.debug                   = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cinder.endpoint_template       = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cinder.http_retries            = 3 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cinder.insecure                = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cinder.keyfile                 = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cinder.os_region_name          = RegionOne {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cinder.split_loggers           = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cinder.timeout                 = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] compute.cpu_dedicated_set      = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] compute.cpu_shared_set         = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] compute.image_type_exclude_list = [] {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] compute.max_concurrent_disk_ops = 0 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] compute.max_disk_devices_to_attach = -1 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] compute.resource_provider_association_refresh = 300 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] compute.shutdown_retry_interval = 10 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] conductor.workers              = 3 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] console.allowed_origins        = [] {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] console.ssl_ciphers            = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] console.ssl_minimum_version    = default {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] consoleauth.token_ttl          = 600 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cyborg.cafile                  = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cyborg.certfile                = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cyborg.collect_timing          = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cyborg.connect_retries         = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cyborg.connect_retry_delay     = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cyborg.endpoint_override       = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cyborg.insecure                = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cyborg.keyfile                 = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cyborg.max_version             = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cyborg.min_version             = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cyborg.region_name             = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cyborg.service_name            = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cyborg.service_type            = accelerator {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cyborg.split_loggers           = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cyborg.status_code_retries     = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cyborg.status_code_retry_delay = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cyborg.timeout                 = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] cyborg.version                 = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] database.backend               = sqlalchemy {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] database.connection            = **** {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] database.connection_debug      = 0 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] database.connection_parameters =  {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] database.connection_recycle_time = 3600 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] database.connection_trace      = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] database.db_inc_retry_interval = True {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] database.db_max_retries        = 20 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] database.db_max_retry_interval = 10 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] database.db_retry_interval     = 1 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] database.max_overflow          = 50 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] database.max_pool_size         = 5 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] database.max_retries           = 10 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] database.mysql_wsrep_sync_wait = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] database.pool_timeout          = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] database.retry_interval        = 10 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] database.slave_connection      = **** {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] database.sqlite_synchronous    = True {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] api_database.backend           = sqlalchemy {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] api_database.connection        = **** {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] api_database.connection_debug  = 0 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] api_database.connection_parameters =  {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] api_database.connection_recycle_time = 3600 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] api_database.connection_trace  = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] api_database.db_inc_retry_interval = True {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] api_database.db_max_retries    = 20 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] api_database.db_max_retry_interval = 10 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] api_database.db_retry_interval = 1 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] api_database.max_overflow      = 50 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] api_database.max_pool_size     = 5 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] api_database.max_retries       = 10 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] api_database.pool_timeout      = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] api_database.retry_interval    = 10 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] api_database.slave_connection  = **** {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] api_database.sqlite_synchronous = True {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] devices.enabled_mdev_types     = [] {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] ephemeral_storage_encryption.enabled = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] glance.api_servers             = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] glance.cafile                  = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] glance.certfile                = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] glance.collect_timing          = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] glance.connect_retries         = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] glance.connect_retry_delay     = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] glance.debug                   = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] glance.default_trusted_certificate_ids = [] {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] glance.enable_certificate_validation = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] glance.enable_rbd_download     = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] glance.endpoint_override       = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] glance.insecure                = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] glance.keyfile                 = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] glance.max_version             = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] glance.min_version             = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] glance.num_retries             = 3 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] glance.rbd_ceph_conf           =  {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] glance.rbd_connect_timeout     = 5 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] glance.rbd_pool                =  {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] glance.rbd_user                =  {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] glance.region_name             = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] glance.service_name            = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] glance.service_type            = image {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] glance.split_loggers           = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] glance.status_code_retries     = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] glance.status_code_retry_delay = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] glance.timeout                 = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] glance.verify_glance_signatures = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] glance.version                 = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] guestfs.debug                  = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] hyperv.config_drive_cdrom      = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] hyperv.config_drive_inject_password = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] hyperv.enable_instance_metrics_collection = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] hyperv.enable_remotefx         = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] hyperv.instances_path_share    =  {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] hyperv.iscsi_initiator_list    = [] {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] hyperv.limit_cpu_features      = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] hyperv.power_state_check_timeframe = 60 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] hyperv.use_multipath_io        = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] hyperv.volume_attach_retry_count = 10 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] hyperv.vswitch_name            = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] mks.enabled                    = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] image_cache.manager_interval   = 2400 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] image_cache.precache_concurrency = 1 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] image_cache.remove_unused_base_images = True {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] image_cache.subdirectory_name  = _base {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] ironic.api_max_retries         = 60 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] ironic.api_retry_interval      = 2 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] ironic.auth_section            = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] ironic.auth_type               = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] ironic.cafile                  = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] ironic.certfile                = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] ironic.collect_timing          = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] ironic.conductor_group         = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] ironic.connect_retries         = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] ironic.connect_retry_delay     = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] ironic.endpoint_override       = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] ironic.insecure                = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] ironic.keyfile                 = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] ironic.max_version             = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] ironic.min_version             = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] ironic.peer_list               = [] {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] ironic.region_name             = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] ironic.serial_console_state_timeout = 10 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] ironic.service_name            = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] ironic.service_type            = baremetal {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] ironic.split_loggers           = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] ironic.status_code_retries     = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] ironic.status_code_retry_delay = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] ironic.timeout                 = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] ironic.version                 = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] key_manager.fixed_key          = **** {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] barbican.barbican_api_version  = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] barbican.barbican_endpoint     = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] barbican.barbican_endpoint_type = public {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] barbican.barbican_region_name  = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] barbican.cafile                = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] barbican.certfile              = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] barbican.collect_timing        = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] barbican.insecure              = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] barbican.keyfile               = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] barbican.number_of_retries     = 60 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] barbican.retry_delay           = 1 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] barbican.send_service_user_token = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] barbican.split_loggers         = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] barbican.timeout               = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] barbican.verify_ssl            = True {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] barbican.verify_ssl_path       = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] barbican_service_user.auth_section = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] barbican_service_user.auth_type = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] barbican_service_user.cafile   = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] barbican_service_user.certfile = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] barbican_service_user.collect_timing = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] barbican_service_user.insecure = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] barbican_service_user.keyfile  = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] barbican_service_user.split_loggers = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] barbican_service_user.timeout  = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vault.approle_role_id          = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vault.approle_secret_id        = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vault.cafile                   = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vault.certfile                 = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vault.collect_timing           = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vault.insecure                 = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vault.keyfile                  = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vault.kv_mountpoint            = secret {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vault.kv_path                  = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vault.kv_version               = 2 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vault.namespace                = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vault.root_token_id            = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vault.split_loggers            = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vault.ssl_ca_crt_file          = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vault.timeout                  = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vault.use_ssl                  = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] keystone.auth_section          = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] keystone.auth_type             = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] keystone.cafile                = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] keystone.certfile              = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] keystone.collect_timing        = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] keystone.connect_retries       = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] keystone.connect_retry_delay   = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] keystone.endpoint_override     = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] keystone.insecure              = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] keystone.keyfile               = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] keystone.max_version           = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] keystone.min_version           = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] keystone.region_name           = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] keystone.service_name          = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] keystone.service_type          = identity {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] keystone.split_loggers         = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] keystone.status_code_retries   = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] keystone.status_code_retry_delay = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] keystone.timeout               = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] keystone.version               = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.connection_uri         =  {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.cpu_mode               = custom {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: WARNING oslo_config.cfg [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.cpu_power_governor_high = performance {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.cpu_power_governor_low = powersave {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.cpu_power_management   = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.device_detach_attempts = 8 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.device_detach_timeout  = 20 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.disk_cachemodes        = [] {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.disk_prefix            = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.enabled_perf_events    = [] {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.file_backed_memory     = 0 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.gid_maps               = [] {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.hw_disk_discard        = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.hw_machine_type        = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.images_rbd_glance_store_name =  {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.images_rbd_pool        = rbd {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.images_type            = default {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.images_volume_group    = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.inject_key             = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.inject_partition       = -2 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.inject_password        = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.iscsi_iface            = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.iser_use_multipath     = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.live_migration_bandwidth = 0 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.live_migration_downtime = 500 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.live_migration_inbound_addr = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.live_migration_permit_post_copy = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.live_migration_scheme  = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.live_migration_timeout_action = abort {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.live_migration_tunnelled = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: WARNING oslo_config.cfg [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Dec 01 19:10:52 user nova-compute[75066]: live_migration_uri is deprecated for removal in favor of two other options that
Dec 01 19:10:52 user nova-compute[75066]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Dec 01 19:10:52 user nova-compute[75066]: and ``live_migration_inbound_addr`` respectively.
Dec 01 19:10:52 user nova-compute[75066]: ).  Its value may be silently ignored in the future.
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.live_migration_with_native_tls = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.max_queues             = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.nfs_mount_options      = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.num_memory_encrypted_guests = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.num_pcie_ports         = 0 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.pmem_namespaces        = [] {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.quobyte_client_cfg     = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.rbd_secret_uuid        = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.rbd_user               = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.remote_filesystem_transport = ssh {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.rescue_image_id        = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.rescue_kernel_id       = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.rescue_ramdisk_id      = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.rx_queue_size          = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.smbfs_mount_options    =  {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.snapshot_compression   = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.snapshot_image_format  = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.sparse_logical_volumes = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.swtpm_enabled          = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.swtpm_group            = tss {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.swtpm_user             = tss {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.sysinfo_serial         = unique {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.tb_cache_size          = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.tx_queue_size          = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.uid_maps               = [] {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.use_virtio_for_bridges = True {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.virt_type              = kvm {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.volume_clear           = zero {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.volume_clear_size      = 0 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.volume_use_multipath   = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.vzstorage_cache_path   = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.vzstorage_mount_user   = stack {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] neutron.auth_section           = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] neutron.auth_type              = password {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] neutron.cafile                 = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] neutron.certfile               = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] neutron.collect_timing         = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] neutron.connect_retries        = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] neutron.connect_retry_delay    = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] neutron.default_floating_pool  = public {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] neutron.endpoint_override      = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] neutron.extension_sync_interval = 600 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] neutron.http_retries           = 3 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] neutron.insecure               = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] neutron.keyfile                = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] neutron.max_version            = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] neutron.min_version            = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] neutron.ovs_bridge             = br-int {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] neutron.physnets               = [] {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] neutron.region_name            = RegionOne {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] neutron.service_metadata_proxy = True {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] neutron.service_name           = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] neutron.service_type           = network {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] neutron.split_loggers          = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] neutron.status_code_retries    = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] neutron.status_code_retry_delay = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] neutron.timeout                = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] neutron.version                = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] notifications.bdms_in_notifications = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] notifications.default_level    = INFO {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] notifications.notification_format = unversioned {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] notifications.notify_on_state_change = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] pci.alias                      = [] {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] pci.device_spec                = [] {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] pci.report_in_placement        = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] placement.auth_section         = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] placement.auth_type            = password {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] placement.cafile               = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] placement.certfile             = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] placement.collect_timing       = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] placement.connect_retries      = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] placement.connect_retry_delay  = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] placement.default_domain_id    = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] placement.default_domain_name  = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] placement.domain_id            = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] placement.domain_name          = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] placement.endpoint_override    = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] placement.insecure             = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] placement.keyfile              = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] placement.max_version          = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] placement.min_version          = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] placement.password             = **** {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] placement.project_domain_id    = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] placement.project_domain_name  = Default {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] placement.project_id           = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] placement.project_name         = service {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] placement.region_name          = RegionOne {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] placement.service_name         = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] placement.service_type         = placement {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] placement.split_loggers        = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] placement.status_code_retries  = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] placement.status_code_retry_delay = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] placement.system_scope         = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] placement.timeout              = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] placement.trust_id             = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] placement.user_domain_id       = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] placement.user_domain_name     = Default {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] placement.user_id              = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] placement.username             = placement {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] placement.version              = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] quota.cores                    = 20 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] quota.count_usage_from_placement = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] quota.injected_file_content_bytes = 10240 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] quota.injected_file_path_length = 255 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] quota.injected_files           = 5 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] quota.instances                = 10 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] quota.key_pairs                = 100 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] quota.metadata_items           = 128 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] quota.ram                      = 51200 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] quota.recheck_quota            = True {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] quota.server_group_members     = 10 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] quota.server_groups            = 10 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] rdp.enabled                    = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] scheduler.image_metadata_prefilter = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] scheduler.max_attempts         = 3 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] scheduler.max_placement_results = 1000 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] scheduler.query_placement_for_image_type_support = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] scheduler.workers              = 3 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] filter_scheduler.host_subset_size = 1 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] filter_scheduler.isolated_hosts = [] {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] filter_scheduler.isolated_images = [] {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] filter_scheduler.pci_in_placement = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] filter_scheduler.track_instance_changes = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] metrics.required               = True {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] metrics.weight_multiplier      = 1.0 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] metrics.weight_setting         = [] {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] serial_console.enabled         = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] serial_console.port_range      = 10000:20000 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] serial_console.serialproxy_port = 6083 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] service_user.auth_section      = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] service_user.auth_type         = password {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] service_user.cafile            = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] service_user.certfile          = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] service_user.collect_timing    = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] service_user.insecure          = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] service_user.keyfile           = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] service_user.send_service_user_token = True {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] service_user.split_loggers     = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] service_user.timeout           = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] spice.agent_enabled            = True {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] spice.enabled                  = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] spice.html5proxy_port          = 6082 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] spice.image_compression        = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] spice.jpeg_compression         = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] spice.playback_compression     = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] spice.server_listen            = 127.0.0.1 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] spice.streaming_mode           = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] spice.zlib_compression         = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] upgrade_levels.baseapi         = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] upgrade_levels.compute         = auto {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] upgrade_levels.conductor       = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] upgrade_levels.scheduler       = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vendordata_dynamic_auth.auth_section = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vendordata_dynamic_auth.auth_type = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vendordata_dynamic_auth.cafile = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vendordata_dynamic_auth.certfile = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vendordata_dynamic_auth.insecure = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vendordata_dynamic_auth.keyfile = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vendordata_dynamic_auth.timeout = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vmware.api_retry_count         = 10 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vmware.ca_file                 = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vmware.cache_prefix            = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vmware.cluster_name            = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vmware.connection_pool_size    = 10 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vmware.console_delay_seconds   = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vmware.datastore_regex         = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vmware.host_ip                 = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vmware.host_password           = **** {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vmware.host_port               = 443 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vmware.host_username           = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vmware.insecure                = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vmware.integration_bridge      = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vmware.maximum_objects         = 100 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vmware.pbm_default_policy      = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vmware.pbm_enabled             = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vmware.pbm_wsdl_location       = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vmware.serial_port_proxy_uri   = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vmware.serial_port_service_uri = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vmware.task_poll_interval      = 0.5 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vmware.use_linked_clone        = True {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vmware.vnc_keymap              = en-us {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vmware.vnc_port                = 5900 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vmware.vnc_port_total          = 10000 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vnc.auth_schemes               = ['none'] {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vnc.enabled                    = True {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vnc.novncproxy_port            = 6080 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vnc.server_listen              = 0.0.0.0 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vnc.vencrypt_ca_certs          = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vnc.vencrypt_client_cert       = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vnc.vencrypt_client_key        = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] workarounds.disable_rootwrap   = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] workarounds.enable_numa_live_migration = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] workarounds.libvirt_disable_apic = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] wsgi.client_socket_timeout     = 900 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] wsgi.default_pool_size         = 1000 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] wsgi.keep_alive                = True {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] wsgi.max_header_line           = 16384 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] wsgi.ssl_ca_file               = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] wsgi.ssl_cert_file             = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] wsgi.ssl_key_file              = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] wsgi.tcp_keepidle              = 600 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] zvm.ca_file                    = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] zvm.cloud_connector_url        = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] zvm.reachable_timeout          = 300 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_policy.enforce_new_defaults = True {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_policy.enforce_scope      = True {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_policy.policy_default_rule = default {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_policy.policy_file        = policy.yaml {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] profiler.connection_string     = messaging:// {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] profiler.enabled               = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] profiler.es_doc_type           = notification {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] profiler.es_scroll_size        = 10000 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] profiler.es_scroll_time        = 2m {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] profiler.filter_error_trace    = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] profiler.hmac_keys             = **** {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] profiler.sentinel_service_name = mymaster {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] profiler.socket_timeout        = 0.1 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] profiler.trace_requests        = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] profiler.trace_sqlalchemy      = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] profiler_jaeger.process_tags   = {} {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] profiler_jaeger.service_name_prefix = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] profiler_otlp.service_name_prefix = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] remote_debug.host              = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] remote_debug.port              = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_messaging_rabbit.ssl      = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_messaging_notifications.retry = -1 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_limit.auth_section        = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_limit.auth_type           = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_limit.cafile              = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_limit.certfile            = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_limit.collect_timing      = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_limit.connect_retries     = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_limit.connect_retry_delay = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_limit.endpoint_id         = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_limit.endpoint_override   = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_limit.insecure            = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_limit.keyfile             = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_limit.max_version         = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_limit.min_version         = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_limit.region_name         = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_limit.service_name        = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_limit.service_type        = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_limit.split_loggers       = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_limit.status_code_retries = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_limit.status_code_retry_delay = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_limit.timeout             = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_limit.valid_interfaces    = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_limit.version             = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_reports.file_event_handler = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] oslo_reports.log_dir           = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vif_plug_ovs_privileged.group  = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] vif_plug_ovs_privileged.user   = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] os_vif_linux_bridge.flat_interface = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] os_vif_ovs.isolate_vif         = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] os_vif_ovs.per_port_bridge     = False {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] os_brick.lock_path             = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] privsep_osbrick.capabilities   = [21] {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] privsep_osbrick.group          = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] privsep_osbrick.helper_command = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] privsep_osbrick.user           = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] nova_sys_admin.group           = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] nova_sys_admin.helper_command  = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] nova_sys_admin.user            = None {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG oslo_service.service [None req-9a8edf76-3f4c-4d69-88a9-6aec58fa0399 None None] ******************************************************************************** {{(pid=75066) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Dec 01 19:10:52 user nova-compute[75066]: INFO nova.service [-] Starting compute node (version 0.0.0)
Dec 01 19:10:52 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Connecting to libvirt: qemu:///system {{(pid=75066) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:508}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f91a1dc65f0> {{(pid=75066) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:514}}
Dec 01 19:10:52 user nova-compute[75066]: libvirt:  error : internal error: could not initialize domain event timer
Dec 01 19:10:52 user nova-compute[75066]: WARNING nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Dec 01 19:10:52 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f91a1dc65f0> {{(pid=75066) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:535}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Starting native event thread {{(pid=75066) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:494}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Starting green dispatch thread {{(pid=75066) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:500}}
Dec 01 19:10:52 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Starting connection event dispatch thread {{(pid=75066) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Dec 01 19:10:52 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Connection event '1' reason 'None'
Dec 01 19:10:52 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Dec 01 19:10:52 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.mount [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Initialising _HostMountState generation 0 {{(pid=75066) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Dec 01 19:11:00 user nova-compute[75066]: INFO nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Libvirt host capabilities <capabilities>
Dec 01 19:11:00 user nova-compute[75066]:   <host>
Dec 01 19:11:00 user nova-compute[75066]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Dec 01 19:11:00 user nova-compute[75066]:     <cpu>
Dec 01 19:11:00 user nova-compute[75066]:       <arch>x86_64</arch>
Dec 01 19:11:00 user nova-compute[75066]:       <model>IvyBridge-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <vendor>Intel</vendor>
Dec 01 19:11:00 user nova-compute[75066]:       <microcode version='1070'/>
Dec 01 19:11:00 user nova-compute[75066]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Dec 01 19:11:00 user nova-compute[75066]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature name='ss'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature name='vmx'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature name='pcid'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature name='osxsave'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature name='hypervisor'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature name='arat'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature name='tsc_adjust'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature name='md-clear'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature name='stibp'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature name='arch-capabilities'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature name='ssbd'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature name='invtsc'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature name='rsba'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature name='skip-l1dfl-vmentry'/>
Dec 01 19:11:00 user nova-compute[75066]:       <pages unit='KiB' size='4'/>
Dec 01 19:11:00 user nova-compute[75066]:       <pages unit='KiB' size='2048'/>
Dec 01 19:11:00 user nova-compute[75066]:     </cpu>
Dec 01 19:11:00 user nova-compute[75066]:     <power_management>
Dec 01 19:11:00 user nova-compute[75066]:       <suspend_mem/>
Dec 01 19:11:00 user nova-compute[75066]:       <suspend_disk/>
Dec 01 19:11:00 user nova-compute[75066]:       <suspend_hybrid/>
Dec 01 19:11:00 user nova-compute[75066]:     </power_management>
Dec 01 19:11:00 user nova-compute[75066]:     <iommu support='no'/>
Dec 01 19:11:00 user nova-compute[75066]:     <migration_features>
Dec 01 19:11:00 user nova-compute[75066]:       <live/>
Dec 01 19:11:00 user nova-compute[75066]:       <uri_transports>
Dec 01 19:11:00 user nova-compute[75066]:         <uri_transport>tcp</uri_transport>
Dec 01 19:11:00 user nova-compute[75066]:         <uri_transport>rdma</uri_transport>
Dec 01 19:11:00 user nova-compute[75066]:       </uri_transports>
Dec 01 19:11:00 user nova-compute[75066]:     </migration_features>
Dec 01 19:11:00 user nova-compute[75066]:     <topology>
Dec 01 19:11:00 user nova-compute[75066]:       <cells num='2'>
Dec 01 19:11:00 user nova-compute[75066]:         <cell id='0'>
Dec 01 19:11:00 user nova-compute[75066]:           <memory unit='KiB'>8140616</memory>
Dec 01 19:11:00 user nova-compute[75066]:           <pages unit='KiB' size='4'>2035154</pages>
Dec 01 19:11:00 user nova-compute[75066]:           <pages unit='KiB' size='2048'>0</pages>
Dec 01 19:11:00 user nova-compute[75066]:           <distances>
Dec 01 19:11:00 user nova-compute[75066]:             <sibling id='0' value='10'/>
Dec 01 19:11:00 user nova-compute[75066]:             <sibling id='1' value='20'/>
Dec 01 19:11:00 user nova-compute[75066]:           </distances>
Dec 01 19:11:00 user nova-compute[75066]:           <cpus num='6'>
Dec 01 19:11:00 user nova-compute[75066]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Dec 01 19:11:00 user nova-compute[75066]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Dec 01 19:11:00 user nova-compute[75066]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Dec 01 19:11:00 user nova-compute[75066]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Dec 01 19:11:00 user nova-compute[75066]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Dec 01 19:11:00 user nova-compute[75066]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Dec 01 19:11:00 user nova-compute[75066]:           </cpus>
Dec 01 19:11:00 user nova-compute[75066]:         </cell>
Dec 01 19:11:00 user nova-compute[75066]:         <cell id='1'>
Dec 01 19:11:00 user nova-compute[75066]:           <memory unit='KiB'>8255068</memory>
Dec 01 19:11:00 user nova-compute[75066]:           <pages unit='KiB' size='4'>2063767</pages>
Dec 01 19:11:00 user nova-compute[75066]:           <pages unit='KiB' size='2048'>0</pages>
Dec 01 19:11:00 user nova-compute[75066]:           <distances>
Dec 01 19:11:00 user nova-compute[75066]:             <sibling id='0' value='20'/>
Dec 01 19:11:00 user nova-compute[75066]:             <sibling id='1' value='10'/>
Dec 01 19:11:00 user nova-compute[75066]:           </distances>
Dec 01 19:11:00 user nova-compute[75066]:           <cpus num='6'>
Dec 01 19:11:00 user nova-compute[75066]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Dec 01 19:11:00 user nova-compute[75066]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Dec 01 19:11:00 user nova-compute[75066]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Dec 01 19:11:00 user nova-compute[75066]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Dec 01 19:11:00 user nova-compute[75066]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Dec 01 19:11:00 user nova-compute[75066]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Dec 01 19:11:00 user nova-compute[75066]:           </cpus>
Dec 01 19:11:00 user nova-compute[75066]:         </cell>
Dec 01 19:11:00 user nova-compute[75066]:       </cells>
Dec 01 19:11:00 user nova-compute[75066]:     </topology>
Dec 01 19:11:00 user nova-compute[75066]:     <cache>
Dec 01 19:11:00 user nova-compute[75066]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Dec 01 19:11:00 user nova-compute[75066]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Dec 01 19:11:00 user nova-compute[75066]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Dec 01 19:11:00 user nova-compute[75066]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Dec 01 19:11:00 user nova-compute[75066]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Dec 01 19:11:00 user nova-compute[75066]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Dec 01 19:11:00 user nova-compute[75066]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Dec 01 19:11:00 user nova-compute[75066]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Dec 01 19:11:00 user nova-compute[75066]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Dec 01 19:11:00 user nova-compute[75066]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Dec 01 19:11:00 user nova-compute[75066]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Dec 01 19:11:00 user nova-compute[75066]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Dec 01 19:11:00 user nova-compute[75066]:     </cache>
Dec 01 19:11:00 user nova-compute[75066]:     <secmodel>
Dec 01 19:11:00 user nova-compute[75066]:       <model>apparmor</model>
Dec 01 19:11:00 user nova-compute[75066]:       <doi>0</doi>
Dec 01 19:11:00 user nova-compute[75066]:     </secmodel>
Dec 01 19:11:00 user nova-compute[75066]:     <secmodel>
Dec 01 19:11:00 user nova-compute[75066]:       <model>dac</model>
Dec 01 19:11:00 user nova-compute[75066]:       <doi>0</doi>
Dec 01 19:11:00 user nova-compute[75066]:       <baselabel type='kvm'>+64055:+108</baselabel>
Dec 01 19:11:00 user nova-compute[75066]:       <baselabel type='qemu'>+64055:+108</baselabel>
Dec 01 19:11:00 user nova-compute[75066]:     </secmodel>
Dec 01 19:11:00 user nova-compute[75066]:   </host>
Dec 01 19:11:00 user nova-compute[75066]:   <guest>
Dec 01 19:11:00 user nova-compute[75066]:     <os_type>hvm</os_type>
Dec 01 19:11:00 user nova-compute[75066]:     <arch name='alpha'>
Dec 01 19:11:00 user nova-compute[75066]:       <wordsize>64</wordsize>
Dec 01 19:11:00 user nova-compute[75066]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='4'>clipper</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <domain type='qemu'/>
Dec 01 19:11:00 user nova-compute[75066]:     </arch>
Dec 01 19:11:00 user nova-compute[75066]:     <features>
Dec 01 19:11:00 user nova-compute[75066]:       <cpuselection/>
Dec 01 19:11:00 user nova-compute[75066]:       <deviceboot/>
Dec 01 19:11:00 user nova-compute[75066]:       <disksnapshot default='on' toggle='no'/>
Dec 01 19:11:00 user nova-compute[75066]:     </features>
Dec 01 19:11:00 user nova-compute[75066]:   </guest>
Dec 01 19:11:00 user nova-compute[75066]:   <guest>
Dec 01 19:11:00 user nova-compute[75066]:     <os_type>hvm</os_type>
Dec 01 19:11:00 user nova-compute[75066]:     <arch name='armv6l'>
Dec 01 19:11:00 user nova-compute[75066]:       <wordsize>32</wordsize>
Dec 01 19:11:00 user nova-compute[75066]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>integratorcp</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2'>ast2600-evb</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>borzoi</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>spitz</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>virt-2.7</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2'>nuri</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>romulus-bmc</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='512'>virt-3.0</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='512'>virt-5.0</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2'>npcm750-evb</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>virt-2.10</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2'>rainier-bmc</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>mps3-an547</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2'>musca-b1</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>versatileab</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>kzm</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>virt-2.8</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2'>musca-a</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='512'>virt-3.1</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='512'>virt-5.1</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2'>smdkc210</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>sx1</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>virt-2.11</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>imx25-pdk</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>virt-2.9</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='4'>orangepi-pc</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>z2</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='512'>virt-5.2</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>tosa</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>mps2-an500</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>virt-2.12</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2'>mps2-an521</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='4'>sabrelite</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>mps2-an511</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>canon-a1100</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>realview-eb</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>emcraft-sf2</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>realview-pb-a8</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='512'>virt-4.0</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>raspi1ap</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>palmetto-bmc</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>sx1-v1</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>n810</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>g220a-bmc</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>n800</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2'>tacoma-bmc</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='512'>virt-4.1</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2'>quanta-gsj</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>versatilepb</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>terrier</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>mainstone</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='512'>virt-4.2</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2'>mps3-an524</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2'>kudo-bmc</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='4'>vexpress-a9</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='4'>midway</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>musicpal</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>lm3s811evb</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>lm3s6965evb</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>microbit</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>mps2-an505</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>mps2-an385</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='512'>virt-6.0</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>cubieboard</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>verdex</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>netduino2</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>mps2-an386</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='512'>virt-6.1</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='4'>raspi2b</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='4'>vexpress-a15</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2'>fuji-bmc</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='512'>virt-6.2</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>cheetah</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>virt-2.6</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>ast2500-evb</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='4'>highbank</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>akita</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>connex</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>netduinoplus2</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>collie</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>raspi0</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <domain type='qemu'/>
Dec 01 19:11:00 user nova-compute[75066]:     </arch>
Dec 01 19:11:00 user nova-compute[75066]:     <features>
Dec 01 19:11:00 user nova-compute[75066]:       <cpuselection/>
Dec 01 19:11:00 user nova-compute[75066]:       <deviceboot/>
Dec 01 19:11:00 user nova-compute[75066]:       <disksnapshot default='on' toggle='no'/>
Dec 01 19:11:00 user nova-compute[75066]:     </features>
Dec 01 19:11:00 user nova-compute[75066]:   </guest>
Dec 01 19:11:00 user nova-compute[75066]:   <guest>
Dec 01 19:11:00 user nova-compute[75066]:     <os_type>hvm</os_type>
Dec 01 19:11:00 user nova-compute[75066]:     <arch name='armv7l'>
Dec 01 19:11:00 user nova-compute[75066]:       <wordsize>32</wordsize>
Dec 01 19:11:00 user nova-compute[75066]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>integratorcp</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2'>ast2600-evb</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>borzoi</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>spitz</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>virt-2.7</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2'>nuri</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>romulus-bmc</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='512'>virt-3.0</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='512'>virt-5.0</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2'>npcm750-evb</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>virt-2.10</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2'>rainier-bmc</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>mps3-an547</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2'>musca-b1</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>versatileab</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>kzm</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>virt-2.8</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2'>musca-a</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='512'>virt-3.1</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='512'>virt-5.1</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2'>smdkc210</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>sx1</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>virt-2.11</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>imx25-pdk</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>virt-2.9</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='4'>orangepi-pc</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>z2</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='512'>virt-5.2</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>tosa</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>mps2-an500</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>virt-2.12</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2'>mps2-an521</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='4'>sabrelite</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>mps2-an511</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>canon-a1100</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>realview-eb</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>emcraft-sf2</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>realview-pb-a8</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='512'>virt-4.0</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>raspi1ap</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>palmetto-bmc</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>sx1-v1</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>n810</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>g220a-bmc</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>n800</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2'>tacoma-bmc</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='512'>virt-4.1</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2'>quanta-gsj</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>versatilepb</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>terrier</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>mainstone</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='512'>virt-4.2</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2'>mps3-an524</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2'>kudo-bmc</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='4'>vexpress-a9</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='4'>midway</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>musicpal</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>lm3s811evb</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>lm3s6965evb</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>microbit</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>mps2-an505</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>mps2-an385</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='512'>virt-6.0</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>cubieboard</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>verdex</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>netduino2</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>mps2-an386</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='512'>virt-6.1</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='4'>raspi2b</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='4'>vexpress-a15</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2'>fuji-bmc</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='512'>virt-6.2</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>cheetah</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>virt-2.6</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>ast2500-evb</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='4'>highbank</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>akita</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>connex</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>netduinoplus2</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>collie</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>raspi0</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <domain type='qemu'/>
Dec 01 19:11:00 user nova-compute[75066]:     </arch>
Dec 01 19:11:00 user nova-compute[75066]:     <features>
Dec 01 19:11:00 user nova-compute[75066]:       <cpuselection/>
Dec 01 19:11:00 user nova-compute[75066]:       <deviceboot/>
Dec 01 19:11:00 user nova-compute[75066]:       <disksnapshot default='on' toggle='no'/>
Dec 01 19:11:00 user nova-compute[75066]:     </features>
Dec 01 19:11:00 user nova-compute[75066]:   </guest>
Dec 01 19:11:00 user nova-compute[75066]:   <guest>
Dec 01 19:11:00 user nova-compute[75066]:     <os_type>hvm</os_type>
Dec 01 19:11:00 user nova-compute[75066]:     <arch name='aarch64'>
Dec 01 19:11:00 user nova-compute[75066]:       <wordsize>64</wordsize>
Dec 01 19:11:00 user nova-compute[75066]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>integratorcp</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2'>ast2600-evb</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>borzoi</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>spitz</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>virt-2.7</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2'>nuri</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>romulus-bmc</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='512'>virt-3.0</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='512'>virt-5.0</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2'>npcm750-evb</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>virt-2.10</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2'>rainier-bmc</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>mps3-an547</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>virt-2.8</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2'>musca-b1</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>versatileab</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>kzm</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2'>musca-a</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='512'>virt-3.1</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='512'>virt-5.1</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2'>smdkc210</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>sx1</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>virt-2.11</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>imx25-pdk</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>virt-2.9</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='4'>orangepi-pc</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>z2</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='512'>virt-5.2</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>tosa</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>mps2-an500</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>virt-2.12</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2'>mps2-an521</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='4'>sabrelite</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>mps2-an511</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>canon-a1100</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>realview-eb</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>emcraft-sf2</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>realview-pb-a8</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='512'>sbsa-ref</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='512'>virt-4.0</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>raspi1ap</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>palmetto-bmc</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>sx1-v1</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>n810</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>g220a-bmc</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>n800</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2'>tacoma-bmc</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='512'>virt-4.1</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2'>quanta-gsj</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>versatilepb</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>terrier</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>mainstone</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='512'>virt-4.2</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2'>mps3-an524</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2'>kudo-bmc</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='4'>vexpress-a9</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='4'>midway</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>musicpal</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>lm3s811evb</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>lm3s6965evb</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>microbit</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>mps2-an505</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>mps2-an385</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='512'>virt-6.0</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='4'>raspi3ap</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>cubieboard</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>verdex</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>netduino2</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>mps2-an386</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='512'>virt-6.1</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='4'>raspi3b</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='4'>raspi2b</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='4'>vexpress-a15</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2'>fuji-bmc</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='512'>virt-6.2</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>cheetah</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>virt-2.6</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>ast2500-evb</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='4'>highbank</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>akita</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>connex</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>netduinoplus2</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>collie</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>raspi0</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <domain type='qemu'/>
Dec 01 19:11:00 user nova-compute[75066]:     </arch>
Dec 01 19:11:00 user nova-compute[75066]:     <features>
Dec 01 19:11:00 user nova-compute[75066]:       <acpi default='on' toggle='yes'/>
Dec 01 19:11:00 user nova-compute[75066]:       <cpuselection/>
Dec 01 19:11:00 user nova-compute[75066]:       <deviceboot/>
Dec 01 19:11:00 user nova-compute[75066]:       <disksnapshot default='on' toggle='no'/>
Dec 01 19:11:00 user nova-compute[75066]:     </features>
Dec 01 19:11:00 user nova-compute[75066]:   </guest>
Dec 01 19:11:00 user nova-compute[75066]:   <guest>
Dec 01 19:11:00 user nova-compute[75066]:     <os_type>hvm</os_type>
Dec 01 19:11:00 user nova-compute[75066]:     <arch name='cris'>
Dec 01 19:11:00 user nova-compute[75066]:       <wordsize>32</wordsize>
Dec 01 19:11:00 user nova-compute[75066]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>axis-dev88</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <domain type='qemu'/>
Dec 01 19:11:00 user nova-compute[75066]:     </arch>
Dec 01 19:11:00 user nova-compute[75066]:     <features>
Dec 01 19:11:00 user nova-compute[75066]:       <cpuselection/>
Dec 01 19:11:00 user nova-compute[75066]:       <deviceboot/>
Dec 01 19:11:00 user nova-compute[75066]:       <disksnapshot default='on' toggle='no'/>
Dec 01 19:11:00 user nova-compute[75066]:     </features>
Dec 01 19:11:00 user nova-compute[75066]:   </guest>
Dec 01 19:11:00 user nova-compute[75066]:   <guest>
Dec 01 19:11:00 user nova-compute[75066]:     <os_type>hvm</os_type>
Dec 01 19:11:00 user nova-compute[75066]:     <arch name='i686'>
Dec 01 19:11:00 user nova-compute[75066]:       <wordsize>32</wordsize>
Dec 01 19:11:00 user nova-compute[75066]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-artful</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>x-remote</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>isapc</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-disco</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-impish</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-focal</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>microvm</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <domain type='qemu'/>
Dec 01 19:11:00 user nova-compute[75066]:       <domain type='kvm'/>
Dec 01 19:11:00 user nova-compute[75066]:     </arch>
Dec 01 19:11:00 user nova-compute[75066]:     <features>
Dec 01 19:11:00 user nova-compute[75066]:       <pae/>
Dec 01 19:11:00 user nova-compute[75066]:       <nonpae/>
Dec 01 19:11:00 user nova-compute[75066]:       <acpi default='on' toggle='yes'/>
Dec 01 19:11:00 user nova-compute[75066]:       <apic default='on' toggle='no'/>
Dec 01 19:11:00 user nova-compute[75066]:       <cpuselection/>
Dec 01 19:11:00 user nova-compute[75066]:       <deviceboot/>
Dec 01 19:11:00 user nova-compute[75066]:       <disksnapshot default='on' toggle='no'/>
Dec 01 19:11:00 user nova-compute[75066]:     </features>
Dec 01 19:11:00 user nova-compute[75066]:   </guest>
Dec 01 19:11:00 user nova-compute[75066]:   <guest>
Dec 01 19:11:00 user nova-compute[75066]:     <os_type>hvm</os_type>
Dec 01 19:11:00 user nova-compute[75066]:     <arch name='m68k'>
Dec 01 19:11:00 user nova-compute[75066]:       <wordsize>32</wordsize>
Dec 01 19:11:00 user nova-compute[75066]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>mcf5208evb</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>an5206</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>virt-6.0</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>q800</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>virt-6.2</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>next-cube</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>virt-6.1</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <domain type='qemu'/>
Dec 01 19:11:00 user nova-compute[75066]:     </arch>
Dec 01 19:11:00 user nova-compute[75066]:     <features>
Dec 01 19:11:00 user nova-compute[75066]:       <cpuselection/>
Dec 01 19:11:00 user nova-compute[75066]:       <deviceboot/>
Dec 01 19:11:00 user nova-compute[75066]:       <disksnapshot default='on' toggle='no'/>
Dec 01 19:11:00 user nova-compute[75066]:     </features>
Dec 01 19:11:00 user nova-compute[75066]:   </guest>
Dec 01 19:11:00 user nova-compute[75066]:   <guest>
Dec 01 19:11:00 user nova-compute[75066]:     <os_type>hvm</os_type>
Dec 01 19:11:00 user nova-compute[75066]:     <arch name='microblaze'>
Dec 01 19:11:00 user nova-compute[75066]:       <wordsize>32</wordsize>
Dec 01 19:11:00 user nova-compute[75066]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>petalogix-ml605</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <domain type='qemu'/>
Dec 01 19:11:00 user nova-compute[75066]:     </arch>
Dec 01 19:11:00 user nova-compute[75066]:     <features>
Dec 01 19:11:00 user nova-compute[75066]:       <cpuselection/>
Dec 01 19:11:00 user nova-compute[75066]:       <deviceboot/>
Dec 01 19:11:00 user nova-compute[75066]:       <disksnapshot default='on' toggle='no'/>
Dec 01 19:11:00 user nova-compute[75066]:     </features>
Dec 01 19:11:00 user nova-compute[75066]:   </guest>
Dec 01 19:11:00 user nova-compute[75066]:   <guest>
Dec 01 19:11:00 user nova-compute[75066]:     <os_type>hvm</os_type>
Dec 01 19:11:00 user nova-compute[75066]:     <arch name='microblazeel'>
Dec 01 19:11:00 user nova-compute[75066]:       <wordsize>32</wordsize>
Dec 01 19:11:00 user nova-compute[75066]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>petalogix-ml605</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <domain type='qemu'/>
Dec 01 19:11:00 user nova-compute[75066]:     </arch>
Dec 01 19:11:00 user nova-compute[75066]:     <features>
Dec 01 19:11:00 user nova-compute[75066]:       <cpuselection/>
Dec 01 19:11:00 user nova-compute[75066]:       <deviceboot/>
Dec 01 19:11:00 user nova-compute[75066]:       <disksnapshot default='on' toggle='no'/>
Dec 01 19:11:00 user nova-compute[75066]:     </features>
Dec 01 19:11:00 user nova-compute[75066]:   </guest>
Dec 01 19:11:00 user nova-compute[75066]:   <guest>
Dec 01 19:11:00 user nova-compute[75066]:     <os_type>hvm</os_type>
Dec 01 19:11:00 user nova-compute[75066]:     <arch name='mips'>
Dec 01 19:11:00 user nova-compute[75066]:       <wordsize>32</wordsize>
Dec 01 19:11:00 user nova-compute[75066]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='16'>malta</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>mipssim</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <domain type='qemu'/>
Dec 01 19:11:00 user nova-compute[75066]:     </arch>
Dec 01 19:11:00 user nova-compute[75066]:     <features>
Dec 01 19:11:00 user nova-compute[75066]:       <cpuselection/>
Dec 01 19:11:00 user nova-compute[75066]:       <deviceboot/>
Dec 01 19:11:00 user nova-compute[75066]:       <disksnapshot default='on' toggle='no'/>
Dec 01 19:11:00 user nova-compute[75066]:     </features>
Dec 01 19:11:00 user nova-compute[75066]:   </guest>
Dec 01 19:11:00 user nova-compute[75066]:   <guest>
Dec 01 19:11:00 user nova-compute[75066]:     <os_type>hvm</os_type>
Dec 01 19:11:00 user nova-compute[75066]:     <arch name='mipsel'>
Dec 01 19:11:00 user nova-compute[75066]:       <wordsize>32</wordsize>
Dec 01 19:11:00 user nova-compute[75066]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='16'>malta</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>mipssim</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <domain type='qemu'/>
Dec 01 19:11:00 user nova-compute[75066]:     </arch>
Dec 01 19:11:00 user nova-compute[75066]:     <features>
Dec 01 19:11:00 user nova-compute[75066]:       <cpuselection/>
Dec 01 19:11:00 user nova-compute[75066]:       <deviceboot/>
Dec 01 19:11:00 user nova-compute[75066]:       <disksnapshot default='on' toggle='no'/>
Dec 01 19:11:00 user nova-compute[75066]:     </features>
Dec 01 19:11:00 user nova-compute[75066]:   </guest>
Dec 01 19:11:00 user nova-compute[75066]:   <guest>
Dec 01 19:11:00 user nova-compute[75066]:     <os_type>hvm</os_type>
Dec 01 19:11:00 user nova-compute[75066]:     <arch name='mips64'>
Dec 01 19:11:00 user nova-compute[75066]:       <wordsize>64</wordsize>
Dec 01 19:11:00 user nova-compute[75066]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='16'>malta</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>mipssim</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>pica61</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>magnum</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <domain type='qemu'/>
Dec 01 19:11:00 user nova-compute[75066]:     </arch>
Dec 01 19:11:00 user nova-compute[75066]:     <features>
Dec 01 19:11:00 user nova-compute[75066]:       <cpuselection/>
Dec 01 19:11:00 user nova-compute[75066]:       <deviceboot/>
Dec 01 19:11:00 user nova-compute[75066]:       <disksnapshot default='on' toggle='no'/>
Dec 01 19:11:00 user nova-compute[75066]:     </features>
Dec 01 19:11:00 user nova-compute[75066]:   </guest>
Dec 01 19:11:00 user nova-compute[75066]:   <guest>
Dec 01 19:11:00 user nova-compute[75066]:     <os_type>hvm</os_type>
Dec 01 19:11:00 user nova-compute[75066]:     <arch name='mips64el'>
Dec 01 19:11:00 user nova-compute[75066]:       <wordsize>64</wordsize>
Dec 01 19:11:00 user nova-compute[75066]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='16'>malta</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='16'>loongson3-virt</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>mipssim</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>pica61</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>magnum</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='16'>boston</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>fuloong2e</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <domain type='qemu'/>
Dec 01 19:11:00 user nova-compute[75066]:     </arch>
Dec 01 19:11:00 user nova-compute[75066]:     <features>
Dec 01 19:11:00 user nova-compute[75066]:       <cpuselection/>
Dec 01 19:11:00 user nova-compute[75066]:       <deviceboot/>
Dec 01 19:11:00 user nova-compute[75066]:       <disksnapshot default='on' toggle='no'/>
Dec 01 19:11:00 user nova-compute[75066]:     </features>
Dec 01 19:11:00 user nova-compute[75066]:   </guest>
Dec 01 19:11:00 user nova-compute[75066]:   <guest>
Dec 01 19:11:00 user nova-compute[75066]:     <os_type>hvm</os_type>
Dec 01 19:11:00 user nova-compute[75066]:     <arch name='ppc'>
Dec 01 19:11:00 user nova-compute[75066]:       <wordsize>32</wordsize>
Dec 01 19:11:00 user nova-compute[75066]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>g3beige</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>virtex-ml507</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>mac99</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='32'>ppce500</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>pegasos2</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>sam460ex</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>bamboo</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>40p</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>ref405ep</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='15'>mpc8544ds</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>taihu</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <domain type='qemu'/>
Dec 01 19:11:00 user nova-compute[75066]:     </arch>
Dec 01 19:11:00 user nova-compute[75066]:     <features>
Dec 01 19:11:00 user nova-compute[75066]:       <cpuselection/>
Dec 01 19:11:00 user nova-compute[75066]:       <deviceboot/>
Dec 01 19:11:00 user nova-compute[75066]:       <disksnapshot default='on' toggle='no'/>
Dec 01 19:11:00 user nova-compute[75066]:     </features>
Dec 01 19:11:00 user nova-compute[75066]:   </guest>
Dec 01 19:11:00 user nova-compute[75066]:   <guest>
Dec 01 19:11:00 user nova-compute[75066]:     <os_type>hvm</os_type>
Dec 01 19:11:00 user nova-compute[75066]:     <arch name='ppc64'>
Dec 01 19:11:00 user nova-compute[75066]:       <wordsize>64</wordsize>
Dec 01 19:11:00 user nova-compute[75066]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2048'>powernv9</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>taihu</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='15'>mpc8544ds</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2048'>powernv10</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='32'>ppce500</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>40p</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>pegasos2</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>bamboo</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>g3beige</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>virtex-ml507</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>mac99</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>sam460ex</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>ref405ep</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2048'>powernv8</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <domain type='qemu'/>
Dec 01 19:11:00 user nova-compute[75066]:     </arch>
Dec 01 19:11:00 user nova-compute[75066]:     <features>
Dec 01 19:11:00 user nova-compute[75066]:       <cpuselection/>
Dec 01 19:11:00 user nova-compute[75066]:       <deviceboot/>
Dec 01 19:11:00 user nova-compute[75066]:       <disksnapshot default='on' toggle='no'/>
Dec 01 19:11:00 user nova-compute[75066]:     </features>
Dec 01 19:11:00 user nova-compute[75066]:   </guest>
Dec 01 19:11:00 user nova-compute[75066]:   <guest>
Dec 01 19:11:00 user nova-compute[75066]:     <os_type>hvm</os_type>
Dec 01 19:11:00 user nova-compute[75066]:     <arch name='ppc64le'>
Dec 01 19:11:00 user nova-compute[75066]:       <wordsize>64</wordsize>
Dec 01 19:11:00 user nova-compute[75066]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2048'>powernv9</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>taihu</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='15'>mpc8544ds</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2048'>powernv10</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='32'>ppce500</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>40p</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>pegasos2</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>bamboo</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>g3beige</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>virtex-ml507</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>mac99</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>sam460ex</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>ref405ep</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2048'>powernv8</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <domain type='qemu'/>
Dec 01 19:11:00 user nova-compute[75066]:     </arch>
Dec 01 19:11:00 user nova-compute[75066]:     <features>
Dec 01 19:11:00 user nova-compute[75066]:       <cpuselection/>
Dec 01 19:11:00 user nova-compute[75066]:       <deviceboot/>
Dec 01 19:11:00 user nova-compute[75066]:       <disksnapshot default='on' toggle='no'/>
Dec 01 19:11:00 user nova-compute[75066]:     </features>
Dec 01 19:11:00 user nova-compute[75066]:   </guest>
Dec 01 19:11:00 user nova-compute[75066]:   <guest>
Dec 01 19:11:00 user nova-compute[75066]:     <os_type>hvm</os_type>
Dec 01 19:11:00 user nova-compute[75066]:     <arch name='riscv32'>
Dec 01 19:11:00 user nova-compute[75066]:       <wordsize>32</wordsize>
Dec 01 19:11:00 user nova-compute[75066]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='8'>spike</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>opentitan</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='5'>sifive_u</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>sifive_e</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='8'>virt</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <domain type='qemu'/>
Dec 01 19:11:00 user nova-compute[75066]:     </arch>
Dec 01 19:11:00 user nova-compute[75066]:     <features>
Dec 01 19:11:00 user nova-compute[75066]:       <cpuselection/>
Dec 01 19:11:00 user nova-compute[75066]:       <deviceboot/>
Dec 01 19:11:00 user nova-compute[75066]:       <disksnapshot default='on' toggle='no'/>
Dec 01 19:11:00 user nova-compute[75066]:     </features>
Dec 01 19:11:00 user nova-compute[75066]:   </guest>
Dec 01 19:11:00 user nova-compute[75066]:   <guest>
Dec 01 19:11:00 user nova-compute[75066]:     <os_type>hvm</os_type>
Dec 01 19:11:00 user nova-compute[75066]:     <arch name='riscv64'>
Dec 01 19:11:00 user nova-compute[75066]:       <wordsize>64</wordsize>
Dec 01 19:11:00 user nova-compute[75066]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='8'>spike</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='5'>sifive_u</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>shakti_c</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>sifive_e</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='8'>virt</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <domain type='qemu'/>
Dec 01 19:11:00 user nova-compute[75066]:     </arch>
Dec 01 19:11:00 user nova-compute[75066]:     <features>
Dec 01 19:11:00 user nova-compute[75066]:       <cpuselection/>
Dec 01 19:11:00 user nova-compute[75066]:       <deviceboot/>
Dec 01 19:11:00 user nova-compute[75066]:       <disksnapshot default='on' toggle='no'/>
Dec 01 19:11:00 user nova-compute[75066]:     </features>
Dec 01 19:11:00 user nova-compute[75066]:   </guest>
Dec 01 19:11:00 user nova-compute[75066]:   <guest>
Dec 01 19:11:00 user nova-compute[75066]:     <os_type>hvm</os_type>
Dec 01 19:11:00 user nova-compute[75066]:     <arch name='s390x'>
Dec 01 19:11:00 user nova-compute[75066]:       <wordsize>64</wordsize>
Dec 01 19:11:00 user nova-compute[75066]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <domain type='qemu'/>
Dec 01 19:11:00 user nova-compute[75066]:     </arch>
Dec 01 19:11:00 user nova-compute[75066]:     <features>
Dec 01 19:11:00 user nova-compute[75066]:       <cpuselection/>
Dec 01 19:11:00 user nova-compute[75066]:       <deviceboot/>
Dec 01 19:11:00 user nova-compute[75066]:       <disksnapshot default='on' toggle='no'/>
Dec 01 19:11:00 user nova-compute[75066]:     </features>
Dec 01 19:11:00 user nova-compute[75066]:   </guest>
Dec 01 19:11:00 user nova-compute[75066]:   <guest>
Dec 01 19:11:00 user nova-compute[75066]:     <os_type>hvm</os_type>
Dec 01 19:11:00 user nova-compute[75066]:     <arch name='sh4'>
Dec 01 19:11:00 user nova-compute[75066]:       <wordsize>32</wordsize>
Dec 01 19:11:00 user nova-compute[75066]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>shix</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>r2d</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <domain type='qemu'/>
Dec 01 19:11:00 user nova-compute[75066]:     </arch>
Dec 01 19:11:00 user nova-compute[75066]:     <features>
Dec 01 19:11:00 user nova-compute[75066]:       <cpuselection/>
Dec 01 19:11:00 user nova-compute[75066]:       <deviceboot/>
Dec 01 19:11:00 user nova-compute[75066]:       <disksnapshot default='on' toggle='no'/>
Dec 01 19:11:00 user nova-compute[75066]:     </features>
Dec 01 19:11:00 user nova-compute[75066]:   </guest>
Dec 01 19:11:00 user nova-compute[75066]:   <guest>
Dec 01 19:11:00 user nova-compute[75066]:     <os_type>hvm</os_type>
Dec 01 19:11:00 user nova-compute[75066]:     <arch name='sh4eb'>
Dec 01 19:11:00 user nova-compute[75066]:       <wordsize>64</wordsize>
Dec 01 19:11:00 user nova-compute[75066]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>shix</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>r2d</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <domain type='qemu'/>
Dec 01 19:11:00 user nova-compute[75066]:     </arch>
Dec 01 19:11:00 user nova-compute[75066]:     <features>
Dec 01 19:11:00 user nova-compute[75066]:       <cpuselection/>
Dec 01 19:11:00 user nova-compute[75066]:       <deviceboot/>
Dec 01 19:11:00 user nova-compute[75066]:       <disksnapshot default='on' toggle='no'/>
Dec 01 19:11:00 user nova-compute[75066]:     </features>
Dec 01 19:11:00 user nova-compute[75066]:   </guest>
Dec 01 19:11:00 user nova-compute[75066]:   <guest>
Dec 01 19:11:00 user nova-compute[75066]:     <os_type>hvm</os_type>
Dec 01 19:11:00 user nova-compute[75066]:     <arch name='sparc'>
Dec 01 19:11:00 user nova-compute[75066]:       <wordsize>32</wordsize>
Dec 01 19:11:00 user nova-compute[75066]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>SS-5</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='4'>SS-20</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>LX</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>SPARCClassic</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>leon3_generic</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>SPARCbook</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>SS-4</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='4'>SS-600MP</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='4'>SS-10</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>Voyager</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <domain type='qemu'/>
Dec 01 19:11:00 user nova-compute[75066]:     </arch>
Dec 01 19:11:00 user nova-compute[75066]:     <features>
Dec 01 19:11:00 user nova-compute[75066]:       <cpuselection/>
Dec 01 19:11:00 user nova-compute[75066]:       <deviceboot/>
Dec 01 19:11:00 user nova-compute[75066]:       <disksnapshot default='on' toggle='no'/>
Dec 01 19:11:00 user nova-compute[75066]:     </features>
Dec 01 19:11:00 user nova-compute[75066]:   </guest>
Dec 01 19:11:00 user nova-compute[75066]:   <guest>
Dec 01 19:11:00 user nova-compute[75066]:     <os_type>hvm</os_type>
Dec 01 19:11:00 user nova-compute[75066]:     <arch name='sparc64'>
Dec 01 19:11:00 user nova-compute[75066]:       <wordsize>64</wordsize>
Dec 01 19:11:00 user nova-compute[75066]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>sun4u</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>niagara</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>sun4v</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <domain type='qemu'/>
Dec 01 19:11:00 user nova-compute[75066]:     </arch>
Dec 01 19:11:00 user nova-compute[75066]:     <features>
Dec 01 19:11:00 user nova-compute[75066]:       <cpuselection/>
Dec 01 19:11:00 user nova-compute[75066]:       <deviceboot/>
Dec 01 19:11:00 user nova-compute[75066]:       <disksnapshot default='on' toggle='no'/>
Dec 01 19:11:00 user nova-compute[75066]:     </features>
Dec 01 19:11:00 user nova-compute[75066]:   </guest>
Dec 01 19:11:00 user nova-compute[75066]:   <guest>
Dec 01 19:11:00 user nova-compute[75066]:     <os_type>hvm</os_type>
Dec 01 19:11:00 user nova-compute[75066]:     <arch name='x86_64'>
Dec 01 19:11:00 user nova-compute[75066]:       <wordsize>64</wordsize>
Dec 01 19:11:00 user nova-compute[75066]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-artful</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>x-remote</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='1'>isapc</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-disco</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-impish</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-focal</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>microvm</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <domain type='qemu'/>
Dec 01 19:11:00 user nova-compute[75066]:       <domain type='kvm'/>
Dec 01 19:11:00 user nova-compute[75066]:     </arch>
Dec 01 19:11:00 user nova-compute[75066]:     <features>
Dec 01 19:11:00 user nova-compute[75066]:       <acpi default='on' toggle='yes'/>
Dec 01 19:11:00 user nova-compute[75066]:       <apic default='on' toggle='no'/>
Dec 01 19:11:00 user nova-compute[75066]:       <cpuselection/>
Dec 01 19:11:00 user nova-compute[75066]:       <deviceboot/>
Dec 01 19:11:00 user nova-compute[75066]:       <disksnapshot default='on' toggle='no'/>
Dec 01 19:11:00 user nova-compute[75066]:     </features>
Dec 01 19:11:00 user nova-compute[75066]:   </guest>
Dec 01 19:11:00 user nova-compute[75066]:   <guest>
Dec 01 19:11:00 user nova-compute[75066]:     <os_type>hvm</os_type>
Dec 01 19:11:00 user nova-compute[75066]:     <arch name='xtensa'>
Dec 01 19:11:00 user nova-compute[75066]:       <wordsize>32</wordsize>
Dec 01 19:11:00 user nova-compute[75066]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='4'>sim</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='32'>kc705</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='32'>ml605</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='32'>ml605-nommu</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='32'>virt</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='32'>lx60-nommu</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='32'>lx200</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='32'>lx200-nommu</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='32'>lx60</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='32'>kc705-nommu</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <domain type='qemu'/>
Dec 01 19:11:00 user nova-compute[75066]:     </arch>
Dec 01 19:11:00 user nova-compute[75066]:     <features>
Dec 01 19:11:00 user nova-compute[75066]:       <cpuselection/>
Dec 01 19:11:00 user nova-compute[75066]:       <deviceboot/>
Dec 01 19:11:00 user nova-compute[75066]:       <disksnapshot default='on' toggle='no'/>
Dec 01 19:11:00 user nova-compute[75066]:     </features>
Dec 01 19:11:00 user nova-compute[75066]:   </guest>
Dec 01 19:11:00 user nova-compute[75066]:   <guest>
Dec 01 19:11:00 user nova-compute[75066]:     <os_type>hvm</os_type>
Dec 01 19:11:00 user nova-compute[75066]:     <arch name='xtensaeb'>
Dec 01 19:11:00 user nova-compute[75066]:       <wordsize>32</wordsize>
Dec 01 19:11:00 user nova-compute[75066]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='4'>sim</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='32'>kc705</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='32'>ml605</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='32'>ml605-nommu</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='32'>virt</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='32'>lx60-nommu</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='32'>lx200</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='32'>lx200-nommu</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='32'>lx60</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <machine maxCpus='32'>kc705-nommu</machine>
Dec 01 19:11:00 user nova-compute[75066]:       <domain type='qemu'/>
Dec 01 19:11:00 user nova-compute[75066]:     </arch>
Dec 01 19:11:00 user nova-compute[75066]:     <features>
Dec 01 19:11:00 user nova-compute[75066]:       <cpuselection/>
Dec 01 19:11:00 user nova-compute[75066]:       <deviceboot/>
Dec 01 19:11:00 user nova-compute[75066]:       <disksnapshot default='on' toggle='no'/>
Dec 01 19:11:00 user nova-compute[75066]:     </features>
Dec 01 19:11:00 user nova-compute[75066]:   </guest>
Dec 01 19:11:00 user nova-compute[75066]: </capabilities>
Dec 01 19:11:00 user nova-compute[75066]: 
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75066) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75066) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=75066) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75066) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75066) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75066) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75066) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75066) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75066) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75066) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75066) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'q35', 'pc', 'ubuntu-q35'} {{(pid=75066) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Dec 01 19:11:00 user nova-compute[75066]: <domainCapabilities>
Dec 01 19:11:00 user nova-compute[75066]:   <path>/usr/bin/qemu-system-i386</path>
Dec 01 19:11:00 user nova-compute[75066]:   <domain>kvm</domain>
Dec 01 19:11:00 user nova-compute[75066]:   <machine>pc-i440fx-jammy</machine>
Dec 01 19:11:00 user nova-compute[75066]:   <arch>i686</arch>
Dec 01 19:11:00 user nova-compute[75066]:   <vcpu max='255'/>
Dec 01 19:11:00 user nova-compute[75066]:   <iothreads supported='yes'/>
Dec 01 19:11:00 user nova-compute[75066]:   <os supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:     <enum name='firmware'/>
Dec 01 19:11:00 user nova-compute[75066]:     <loader supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Dec 01 19:11:00 user nova-compute[75066]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Dec 01 19:11:00 user nova-compute[75066]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Dec 01 19:11:00 user nova-compute[75066]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Dec 01 19:11:00 user nova-compute[75066]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='type'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>rom</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>pflash</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='readonly'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>yes</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>no</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='secure'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>no</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </loader>
Dec 01 19:11:00 user nova-compute[75066]:   </os>
Dec 01 19:11:00 user nova-compute[75066]:   <cpu>
Dec 01 19:11:00 user nova-compute[75066]:     <mode name='host-passthrough' supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='hostPassthroughMigratable'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>off</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </mode>
Dec 01 19:11:00 user nova-compute[75066]:     <mode name='maximum' supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='maximumMigratable'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>on</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>off</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </mode>
Dec 01 19:11:00 user nova-compute[75066]:     <mode name='host-model' supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <vendor>Intel</vendor>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='ss'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='vmx'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='pcid'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='hypervisor'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='arat'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='tsc_adjust'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='umip'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='md-clear'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='stibp'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='arch-capabilities'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='ssbd'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='ibpb'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='ibrs'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='amd-stibp'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='amd-ssbd'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='disable' name='erms'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='disable' name='xsaveopt'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='disable' name='lm'/>
Dec 01 19:11:00 user nova-compute[75066]:     </mode>
Dec 01 19:11:00 user nova-compute[75066]:     <mode name='custom' supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>qemu64</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>qemu32</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>phenom</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>pentium3</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>pentium2</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>pentium</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>n270</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>kvm64</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>kvm32</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>coreduo</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>core2duo</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>athlon</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Westmere-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Westmere</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Snowridge</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Skylake-Server</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Skylake-Client</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>SandyBridge</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Penryn</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Opteron_G5</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Opteron_G4</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Opteron_G3</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Opteron_G2</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Opteron_G1</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Nehalem-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Nehalem</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>IvyBridge</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Icelake-Server</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Haswell-noTSX</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Haswell-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Haswell</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>EPYC-Rome</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>EPYC-Milan</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>EPYC-IBPB</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>EPYC</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Dhyana</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Cooperlake</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Conroe</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Cascadelake-Server</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Broadwell-noTSX</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Broadwell-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Broadwell</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>486</model>
Dec 01 19:11:00 user nova-compute[75066]:     </mode>
Dec 01 19:11:00 user nova-compute[75066]:   </cpu>
Dec 01 19:11:00 user nova-compute[75066]:   <memoryBacking supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:     <enum name='sourceType'>
Dec 01 19:11:00 user nova-compute[75066]:       <value>file</value>
Dec 01 19:11:00 user nova-compute[75066]:       <value>anonymous</value>
Dec 01 19:11:00 user nova-compute[75066]:       <value>memfd</value>
Dec 01 19:11:00 user nova-compute[75066]:     </enum>
Dec 01 19:11:00 user nova-compute[75066]:   </memoryBacking>
Dec 01 19:11:00 user nova-compute[75066]:   <devices>
Dec 01 19:11:00 user nova-compute[75066]:     <disk supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='diskDevice'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>disk</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>cdrom</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>floppy</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>lun</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='bus'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>ide</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>fdc</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>scsi</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtio</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>usb</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>sata</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='model'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtio</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtio-transitional</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtio-non-transitional</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </disk>
Dec 01 19:11:00 user nova-compute[75066]:     <graphics supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='type'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>sdl</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>vnc</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>spice</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>egl-headless</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </graphics>
Dec 01 19:11:00 user nova-compute[75066]:     <video supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='modelType'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>vga</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>cirrus</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>vmvga</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>qxl</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtio</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>none</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>bochs</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>ramfb</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </video>
Dec 01 19:11:00 user nova-compute[75066]:     <hostdev supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='mode'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>subsystem</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='startupPolicy'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>default</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>mandatory</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>requisite</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>optional</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='subsysType'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>usb</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>pci</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>scsi</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='capsType'/>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='pciBackend'/>
Dec 01 19:11:00 user nova-compute[75066]:     </hostdev>
Dec 01 19:11:00 user nova-compute[75066]:     <rng supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='model'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtio</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtio-transitional</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtio-non-transitional</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='backendModel'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>random</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>egd</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>builtin</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </rng>
Dec 01 19:11:00 user nova-compute[75066]:     <filesystem supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='driverType'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>path</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>handle</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtiofs</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </filesystem>
Dec 01 19:11:00 user nova-compute[75066]:     <tpm supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='model'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>tpm-tis</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>tpm-crb</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='backendModel'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>passthrough</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>emulator</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </tpm>
Dec 01 19:11:00 user nova-compute[75066]:   </devices>
Dec 01 19:11:00 user nova-compute[75066]:   <features>
Dec 01 19:11:00 user nova-compute[75066]:     <gic supported='no'/>
Dec 01 19:11:00 user nova-compute[75066]:     <vmcoreinfo supported='yes'/>
Dec 01 19:11:00 user nova-compute[75066]:     <genid supported='yes'/>
Dec 01 19:11:00 user nova-compute[75066]:     <backingStoreInput supported='yes'/>
Dec 01 19:11:00 user nova-compute[75066]:     <backup supported='yes'/>
Dec 01 19:11:00 user nova-compute[75066]:     <sev supported='no'/>
Dec 01 19:11:00 user nova-compute[75066]:   </features>
Dec 01 19:11:00 user nova-compute[75066]: </domainCapabilities>
Dec 01 19:11:00 user nova-compute[75066]:  {{(pid=75066) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Dec 01 19:11:00 user nova-compute[75066]: <domainCapabilities>
Dec 01 19:11:00 user nova-compute[75066]:   <path>/usr/bin/qemu-system-i386</path>
Dec 01 19:11:00 user nova-compute[75066]:   <domain>kvm</domain>
Dec 01 19:11:00 user nova-compute[75066]:   <machine>pc-q35-6.2</machine>
Dec 01 19:11:00 user nova-compute[75066]:   <arch>i686</arch>
Dec 01 19:11:00 user nova-compute[75066]:   <vcpu max='288'/>
Dec 01 19:11:00 user nova-compute[75066]:   <iothreads supported='yes'/>
Dec 01 19:11:00 user nova-compute[75066]:   <os supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:     <enum name='firmware'/>
Dec 01 19:11:00 user nova-compute[75066]:     <loader supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Dec 01 19:11:00 user nova-compute[75066]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Dec 01 19:11:00 user nova-compute[75066]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Dec 01 19:11:00 user nova-compute[75066]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Dec 01 19:11:00 user nova-compute[75066]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='type'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>rom</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>pflash</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='readonly'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>yes</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>no</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='secure'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>no</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </loader>
Dec 01 19:11:00 user nova-compute[75066]:   </os>
Dec 01 19:11:00 user nova-compute[75066]:   <cpu>
Dec 01 19:11:00 user nova-compute[75066]:     <mode name='host-passthrough' supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='hostPassthroughMigratable'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>off</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </mode>
Dec 01 19:11:00 user nova-compute[75066]:     <mode name='maximum' supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='maximumMigratable'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>on</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>off</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </mode>
Dec 01 19:11:00 user nova-compute[75066]:     <mode name='host-model' supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <vendor>Intel</vendor>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='ss'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='vmx'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='pcid'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='hypervisor'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='arat'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='tsc_adjust'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='umip'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='md-clear'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='stibp'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='arch-capabilities'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='ssbd'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='ibpb'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='ibrs'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='amd-stibp'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='amd-ssbd'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='disable' name='erms'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='disable' name='xsaveopt'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='disable' name='lm'/>
Dec 01 19:11:00 user nova-compute[75066]:     </mode>
Dec 01 19:11:00 user nova-compute[75066]:     <mode name='custom' supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>qemu64</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>qemu32</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>phenom</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>pentium3</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>pentium2</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>pentium</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>n270</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>kvm64</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>kvm32</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>coreduo</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>core2duo</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>athlon</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Westmere-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Westmere</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Snowridge</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Skylake-Server</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Skylake-Client</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>SandyBridge</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Penryn</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Opteron_G5</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Opteron_G4</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Opteron_G3</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Opteron_G2</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Opteron_G1</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Nehalem-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Nehalem</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>IvyBridge</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Icelake-Server</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Haswell-noTSX</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Haswell-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Haswell</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>EPYC-Rome</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>EPYC-Milan</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>EPYC-IBPB</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>EPYC</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Dhyana</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Cooperlake</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Conroe</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Cascadelake-Server</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Broadwell-noTSX</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Broadwell-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Broadwell</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>486</model>
Dec 01 19:11:00 user nova-compute[75066]:     </mode>
Dec 01 19:11:00 user nova-compute[75066]:   </cpu>
Dec 01 19:11:00 user nova-compute[75066]:   <memoryBacking supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:     <enum name='sourceType'>
Dec 01 19:11:00 user nova-compute[75066]:       <value>file</value>
Dec 01 19:11:00 user nova-compute[75066]:       <value>anonymous</value>
Dec 01 19:11:00 user nova-compute[75066]:       <value>memfd</value>
Dec 01 19:11:00 user nova-compute[75066]:     </enum>
Dec 01 19:11:00 user nova-compute[75066]:   </memoryBacking>
Dec 01 19:11:00 user nova-compute[75066]:   <devices>
Dec 01 19:11:00 user nova-compute[75066]:     <disk supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='diskDevice'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>disk</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>cdrom</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>floppy</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>lun</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='bus'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>fdc</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>scsi</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtio</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>usb</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>sata</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='model'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtio</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtio-transitional</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtio-non-transitional</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </disk>
Dec 01 19:11:00 user nova-compute[75066]:     <graphics supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='type'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>sdl</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>vnc</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>spice</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>egl-headless</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </graphics>
Dec 01 19:11:00 user nova-compute[75066]:     <video supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='modelType'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>vga</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>cirrus</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>vmvga</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>qxl</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtio</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>none</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>bochs</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>ramfb</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </video>
Dec 01 19:11:00 user nova-compute[75066]:     <hostdev supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='mode'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>subsystem</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='startupPolicy'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>default</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>mandatory</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>requisite</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>optional</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='subsysType'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>usb</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>pci</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>scsi</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='capsType'/>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='pciBackend'/>
Dec 01 19:11:00 user nova-compute[75066]:     </hostdev>
Dec 01 19:11:00 user nova-compute[75066]:     <rng supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='model'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtio</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtio-transitional</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtio-non-transitional</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='backendModel'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>random</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>egd</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>builtin</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </rng>
Dec 01 19:11:00 user nova-compute[75066]:     <filesystem supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='driverType'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>path</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>handle</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtiofs</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </filesystem>
Dec 01 19:11:00 user nova-compute[75066]:     <tpm supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='model'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>tpm-tis</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>tpm-crb</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='backendModel'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>passthrough</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>emulator</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </tpm>
Dec 01 19:11:00 user nova-compute[75066]:   </devices>
Dec 01 19:11:00 user nova-compute[75066]:   <features>
Dec 01 19:11:00 user nova-compute[75066]:     <gic supported='no'/>
Dec 01 19:11:00 user nova-compute[75066]:     <vmcoreinfo supported='yes'/>
Dec 01 19:11:00 user nova-compute[75066]:     <genid supported='yes'/>
Dec 01 19:11:00 user nova-compute[75066]:     <backingStoreInput supported='yes'/>
Dec 01 19:11:00 user nova-compute[75066]:     <backup supported='yes'/>
Dec 01 19:11:00 user nova-compute[75066]:     <sev supported='no'/>
Dec 01 19:11:00 user nova-compute[75066]:   </features>
Dec 01 19:11:00 user nova-compute[75066]: </domainCapabilities>
Dec 01 19:11:00 user nova-compute[75066]:  {{(pid=75066) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Dec 01 19:11:00 user nova-compute[75066]: <domainCapabilities>
Dec 01 19:11:00 user nova-compute[75066]:   <path>/usr/bin/qemu-system-i386</path>
Dec 01 19:11:00 user nova-compute[75066]:   <domain>kvm</domain>
Dec 01 19:11:00 user nova-compute[75066]:   <machine>pc-i440fx-6.2</machine>
Dec 01 19:11:00 user nova-compute[75066]:   <arch>i686</arch>
Dec 01 19:11:00 user nova-compute[75066]:   <vcpu max='255'/>
Dec 01 19:11:00 user nova-compute[75066]:   <iothreads supported='yes'/>
Dec 01 19:11:00 user nova-compute[75066]:   <os supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:     <enum name='firmware'/>
Dec 01 19:11:00 user nova-compute[75066]:     <loader supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Dec 01 19:11:00 user nova-compute[75066]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Dec 01 19:11:00 user nova-compute[75066]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Dec 01 19:11:00 user nova-compute[75066]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Dec 01 19:11:00 user nova-compute[75066]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='type'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>rom</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>pflash</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='readonly'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>yes</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>no</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='secure'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>no</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </loader>
Dec 01 19:11:00 user nova-compute[75066]:   </os>
Dec 01 19:11:00 user nova-compute[75066]:   <cpu>
Dec 01 19:11:00 user nova-compute[75066]:     <mode name='host-passthrough' supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='hostPassthroughMigratable'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>off</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </mode>
Dec 01 19:11:00 user nova-compute[75066]:     <mode name='maximum' supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='maximumMigratable'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>on</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>off</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </mode>
Dec 01 19:11:00 user nova-compute[75066]:     <mode name='host-model' supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <vendor>Intel</vendor>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='ss'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='vmx'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='pcid'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='hypervisor'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='arat'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='tsc_adjust'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='umip'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='md-clear'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='stibp'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='arch-capabilities'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='ssbd'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='ibpb'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='ibrs'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='amd-stibp'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='amd-ssbd'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='disable' name='erms'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='disable' name='xsaveopt'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='disable' name='lm'/>
Dec 01 19:11:00 user nova-compute[75066]:     </mode>
Dec 01 19:11:00 user nova-compute[75066]:     <mode name='custom' supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>qemu64</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>qemu32</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>phenom</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>pentium3</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>pentium2</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>pentium</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>n270</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>kvm64</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>kvm32</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>coreduo</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>core2duo</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>athlon</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Westmere-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Westmere</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Snowridge</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Skylake-Server</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Skylake-Client</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>SandyBridge</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Penryn</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Opteron_G5</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Opteron_G4</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Opteron_G3</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Opteron_G2</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Opteron_G1</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Nehalem-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Nehalem</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>IvyBridge</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Icelake-Server</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Haswell-noTSX</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Haswell-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Haswell</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>EPYC-Rome</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>EPYC-Milan</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>EPYC-IBPB</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>EPYC</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Dhyana</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Cooperlake</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Conroe</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Cascadelake-Server</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Broadwell-noTSX</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Broadwell-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Broadwell</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>486</model>
Dec 01 19:11:00 user nova-compute[75066]:     </mode>
Dec 01 19:11:00 user nova-compute[75066]:   </cpu>
Dec 01 19:11:00 user nova-compute[75066]:   <memoryBacking supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:     <enum name='sourceType'>
Dec 01 19:11:00 user nova-compute[75066]:       <value>file</value>
Dec 01 19:11:00 user nova-compute[75066]:       <value>anonymous</value>
Dec 01 19:11:00 user nova-compute[75066]:       <value>memfd</value>
Dec 01 19:11:00 user nova-compute[75066]:     </enum>
Dec 01 19:11:00 user nova-compute[75066]:   </memoryBacking>
Dec 01 19:11:00 user nova-compute[75066]:   <devices>
Dec 01 19:11:00 user nova-compute[75066]:     <disk supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='diskDevice'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>disk</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>cdrom</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>floppy</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>lun</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='bus'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>ide</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>fdc</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>scsi</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtio</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>usb</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>sata</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='model'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtio</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtio-transitional</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtio-non-transitional</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </disk>
Dec 01 19:11:00 user nova-compute[75066]:     <graphics supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='type'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>sdl</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>vnc</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>spice</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>egl-headless</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </graphics>
Dec 01 19:11:00 user nova-compute[75066]:     <video supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='modelType'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>vga</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>cirrus</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>vmvga</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>qxl</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtio</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>none</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>bochs</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>ramfb</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </video>
Dec 01 19:11:00 user nova-compute[75066]:     <hostdev supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='mode'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>subsystem</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='startupPolicy'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>default</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>mandatory</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>requisite</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>optional</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='subsysType'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>usb</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>pci</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>scsi</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='capsType'/>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='pciBackend'/>
Dec 01 19:11:00 user nova-compute[75066]:     </hostdev>
Dec 01 19:11:00 user nova-compute[75066]:     <rng supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='model'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtio</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtio-transitional</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtio-non-transitional</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='backendModel'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>random</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>egd</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>builtin</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </rng>
Dec 01 19:11:00 user nova-compute[75066]:     <filesystem supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='driverType'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>path</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>handle</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtiofs</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </filesystem>
Dec 01 19:11:00 user nova-compute[75066]:     <tpm supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='model'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>tpm-tis</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>tpm-crb</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='backendModel'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>passthrough</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>emulator</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </tpm>
Dec 01 19:11:00 user nova-compute[75066]:   </devices>
Dec 01 19:11:00 user nova-compute[75066]:   <features>
Dec 01 19:11:00 user nova-compute[75066]:     <gic supported='no'/>
Dec 01 19:11:00 user nova-compute[75066]:     <vmcoreinfo supported='yes'/>
Dec 01 19:11:00 user nova-compute[75066]:     <genid supported='yes'/>
Dec 01 19:11:00 user nova-compute[75066]:     <backingStoreInput supported='yes'/>
Dec 01 19:11:00 user nova-compute[75066]:     <backup supported='yes'/>
Dec 01 19:11:00 user nova-compute[75066]:     <sev supported='no'/>
Dec 01 19:11:00 user nova-compute[75066]:   </features>
Dec 01 19:11:00 user nova-compute[75066]: </domainCapabilities>
Dec 01 19:11:00 user nova-compute[75066]:  {{(pid=75066) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Dec 01 19:11:00 user nova-compute[75066]: <domainCapabilities>
Dec 01 19:11:00 user nova-compute[75066]:   <path>/usr/bin/qemu-system-i386</path>
Dec 01 19:11:00 user nova-compute[75066]:   <domain>kvm</domain>
Dec 01 19:11:00 user nova-compute[75066]:   <machine>pc-q35-jammy</machine>
Dec 01 19:11:00 user nova-compute[75066]:   <arch>i686</arch>
Dec 01 19:11:00 user nova-compute[75066]:   <vcpu max='288'/>
Dec 01 19:11:00 user nova-compute[75066]:   <iothreads supported='yes'/>
Dec 01 19:11:00 user nova-compute[75066]:   <os supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:     <enum name='firmware'/>
Dec 01 19:11:00 user nova-compute[75066]:     <loader supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Dec 01 19:11:00 user nova-compute[75066]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Dec 01 19:11:00 user nova-compute[75066]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Dec 01 19:11:00 user nova-compute[75066]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Dec 01 19:11:00 user nova-compute[75066]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='type'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>rom</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>pflash</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='readonly'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>yes</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>no</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='secure'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>no</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </loader>
Dec 01 19:11:00 user nova-compute[75066]:   </os>
Dec 01 19:11:00 user nova-compute[75066]:   <cpu>
Dec 01 19:11:00 user nova-compute[75066]:     <mode name='host-passthrough' supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='hostPassthroughMigratable'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>off</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </mode>
Dec 01 19:11:00 user nova-compute[75066]:     <mode name='maximum' supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='maximumMigratable'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>on</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>off</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </mode>
Dec 01 19:11:00 user nova-compute[75066]:     <mode name='host-model' supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <vendor>Intel</vendor>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='ss'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='vmx'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='pcid'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='hypervisor'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='arat'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='tsc_adjust'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='umip'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='md-clear'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='stibp'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='arch-capabilities'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='ssbd'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='ibpb'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='ibrs'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='amd-stibp'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='amd-ssbd'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='disable' name='erms'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='disable' name='xsaveopt'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='disable' name='lm'/>
Dec 01 19:11:00 user nova-compute[75066]:     </mode>
Dec 01 19:11:00 user nova-compute[75066]:     <mode name='custom' supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>qemu64</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>qemu32</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>phenom</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>pentium3</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>pentium2</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>pentium</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>n270</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>kvm64</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>kvm32</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>coreduo</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>core2duo</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>athlon</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Westmere-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Westmere</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Snowridge</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Skylake-Server</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Skylake-Client</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>SandyBridge</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Penryn</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Opteron_G5</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Opteron_G4</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Opteron_G3</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Opteron_G2</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Opteron_G1</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Nehalem-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Nehalem</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>IvyBridge</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Icelake-Server</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Haswell-noTSX</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Haswell-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Haswell</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>EPYC-Rome</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>EPYC-Milan</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>EPYC-IBPB</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>EPYC</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Dhyana</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Cooperlake</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Conroe</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Cascadelake-Server</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Broadwell-noTSX</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Broadwell-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Broadwell</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>486</model>
Dec 01 19:11:00 user nova-compute[75066]:     </mode>
Dec 01 19:11:00 user nova-compute[75066]:   </cpu>
Dec 01 19:11:00 user nova-compute[75066]:   <memoryBacking supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:     <enum name='sourceType'>
Dec 01 19:11:00 user nova-compute[75066]:       <value>file</value>
Dec 01 19:11:00 user nova-compute[75066]:       <value>anonymous</value>
Dec 01 19:11:00 user nova-compute[75066]:       <value>memfd</value>
Dec 01 19:11:00 user nova-compute[75066]:     </enum>
Dec 01 19:11:00 user nova-compute[75066]:   </memoryBacking>
Dec 01 19:11:00 user nova-compute[75066]:   <devices>
Dec 01 19:11:00 user nova-compute[75066]:     <disk supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='diskDevice'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>disk</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>cdrom</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>floppy</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>lun</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='bus'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>fdc</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>scsi</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtio</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>usb</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>sata</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='model'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtio</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtio-transitional</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtio-non-transitional</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </disk>
Dec 01 19:11:00 user nova-compute[75066]:     <graphics supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='type'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>sdl</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>vnc</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>spice</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>egl-headless</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </graphics>
Dec 01 19:11:00 user nova-compute[75066]:     <video supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='modelType'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>vga</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>cirrus</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>vmvga</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>qxl</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtio</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>none</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>bochs</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>ramfb</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </video>
Dec 01 19:11:00 user nova-compute[75066]:     <hostdev supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='mode'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>subsystem</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='startupPolicy'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>default</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>mandatory</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>requisite</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>optional</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='subsysType'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>usb</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>pci</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>scsi</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='capsType'/>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='pciBackend'/>
Dec 01 19:11:00 user nova-compute[75066]:     </hostdev>
Dec 01 19:11:00 user nova-compute[75066]:     <rng supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='model'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtio</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtio-transitional</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtio-non-transitional</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='backendModel'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>random</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>egd</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>builtin</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </rng>
Dec 01 19:11:00 user nova-compute[75066]:     <filesystem supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='driverType'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>path</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>handle</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtiofs</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </filesystem>
Dec 01 19:11:00 user nova-compute[75066]:     <tpm supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='model'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>tpm-tis</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>tpm-crb</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='backendModel'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>passthrough</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>emulator</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </tpm>
Dec 01 19:11:00 user nova-compute[75066]:   </devices>
Dec 01 19:11:00 user nova-compute[75066]:   <features>
Dec 01 19:11:00 user nova-compute[75066]:     <gic supported='no'/>
Dec 01 19:11:00 user nova-compute[75066]:     <vmcoreinfo supported='yes'/>
Dec 01 19:11:00 user nova-compute[75066]:     <genid supported='yes'/>
Dec 01 19:11:00 user nova-compute[75066]:     <backingStoreInput supported='yes'/>
Dec 01 19:11:00 user nova-compute[75066]:     <backup supported='yes'/>
Dec 01 19:11:00 user nova-compute[75066]:     <sev supported='no'/>
Dec 01 19:11:00 user nova-compute[75066]:   </features>
Dec 01 19:11:00 user nova-compute[75066]: </domainCapabilities>
Dec 01 19:11:00 user nova-compute[75066]:  {{(pid=75066) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=75066) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75066) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75066) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75066) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75066) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75066) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75066) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75066) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75066) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75066) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75066) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75066) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75066) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75066) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75066) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75066) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75066) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', None, 'pseries'} {{(pid=75066) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75066) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75066) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75066) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=75066) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75066) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75066) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75066) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75066) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75066) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75066) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75066) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75066) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75066) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75066) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75066) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75066) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75066) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75066) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75066) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75066) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'q35', 'pc', 'ubuntu-q35'} {{(pid=75066) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Dec 01 19:11:00 user nova-compute[75066]: <domainCapabilities>
Dec 01 19:11:00 user nova-compute[75066]:   <path>/usr/bin/qemu-system-x86_64</path>
Dec 01 19:11:00 user nova-compute[75066]:   <domain>kvm</domain>
Dec 01 19:11:00 user nova-compute[75066]:   <machine>pc-i440fx-jammy</machine>
Dec 01 19:11:00 user nova-compute[75066]:   <arch>x86_64</arch>
Dec 01 19:11:00 user nova-compute[75066]:   <vcpu max='255'/>
Dec 01 19:11:00 user nova-compute[75066]:   <iothreads supported='yes'/>
Dec 01 19:11:00 user nova-compute[75066]:   <os supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:     <enum name='firmware'>
Dec 01 19:11:00 user nova-compute[75066]:       <value>efi</value>
Dec 01 19:11:00 user nova-compute[75066]:     </enum>
Dec 01 19:11:00 user nova-compute[75066]:     <loader supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='type'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>rom</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>pflash</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='readonly'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>yes</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>no</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='secure'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>no</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </loader>
Dec 01 19:11:00 user nova-compute[75066]:   </os>
Dec 01 19:11:00 user nova-compute[75066]:   <cpu>
Dec 01 19:11:00 user nova-compute[75066]:     <mode name='host-passthrough' supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='hostPassthroughMigratable'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>on</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>off</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </mode>
Dec 01 19:11:00 user nova-compute[75066]:     <mode name='maximum' supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='maximumMigratable'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>on</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>off</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </mode>
Dec 01 19:11:00 user nova-compute[75066]:     <mode name='host-model' supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <vendor>Intel</vendor>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='ss'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='vmx'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='pcid'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='hypervisor'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='arat'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='tsc_adjust'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='umip'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='md-clear'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='stibp'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='arch-capabilities'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='ssbd'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='invtsc'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='ibpb'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='ibrs'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='amd-stibp'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='amd-ssbd'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='rsba'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='pschange-mc-no'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='disable' name='erms'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='disable' name='xsaveopt'/>
Dec 01 19:11:00 user nova-compute[75066]:     </mode>
Dec 01 19:11:00 user nova-compute[75066]:     <mode name='custom' supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>qemu64</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>qemu32</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>phenom</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>pentium3</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>pentium2</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>pentium</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>n270</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>kvm64</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>kvm32</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>coreduo</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>core2duo</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>athlon</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>Westmere-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>Westmere</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Snowridge</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Skylake-Server</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Skylake-Client</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>SandyBridge</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>Penryn</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Opteron_G5</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Opteron_G4</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Opteron_G3</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Opteron_G2</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>Opteron_G1</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>Nehalem-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>Nehalem</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>IvyBridge</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Icelake-Server</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Haswell-noTSX</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Haswell-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Haswell</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>EPYC-Rome</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>EPYC-Milan</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>EPYC-IBPB</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>EPYC</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Dhyana</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Cooperlake</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>Conroe</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Cascadelake-Server</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Broadwell-noTSX</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Broadwell-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Broadwell</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>486</model>
Dec 01 19:11:00 user nova-compute[75066]:     </mode>
Dec 01 19:11:00 user nova-compute[75066]:   </cpu>
Dec 01 19:11:00 user nova-compute[75066]:   <memoryBacking supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:     <enum name='sourceType'>
Dec 01 19:11:00 user nova-compute[75066]:       <value>file</value>
Dec 01 19:11:00 user nova-compute[75066]:       <value>anonymous</value>
Dec 01 19:11:00 user nova-compute[75066]:       <value>memfd</value>
Dec 01 19:11:00 user nova-compute[75066]:     </enum>
Dec 01 19:11:00 user nova-compute[75066]:   </memoryBacking>
Dec 01 19:11:00 user nova-compute[75066]:   <devices>
Dec 01 19:11:00 user nova-compute[75066]:     <disk supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='diskDevice'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>disk</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>cdrom</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>floppy</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>lun</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='bus'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>ide</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>fdc</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>scsi</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtio</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>usb</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>sata</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='model'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtio</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtio-transitional</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtio-non-transitional</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </disk>
Dec 01 19:11:00 user nova-compute[75066]:     <graphics supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='type'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>sdl</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>vnc</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>spice</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>egl-headless</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </graphics>
Dec 01 19:11:00 user nova-compute[75066]:     <video supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='modelType'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>vga</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>cirrus</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>vmvga</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>qxl</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtio</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>none</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>bochs</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>ramfb</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </video>
Dec 01 19:11:00 user nova-compute[75066]:     <hostdev supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='mode'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>subsystem</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='startupPolicy'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>default</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>mandatory</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>requisite</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>optional</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='subsysType'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>usb</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>pci</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>scsi</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='capsType'/>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='pciBackend'/>
Dec 01 19:11:00 user nova-compute[75066]:     </hostdev>
Dec 01 19:11:00 user nova-compute[75066]:     <rng supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='model'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtio</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtio-transitional</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtio-non-transitional</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='backendModel'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>random</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>egd</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>builtin</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </rng>
Dec 01 19:11:00 user nova-compute[75066]:     <filesystem supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='driverType'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>path</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>handle</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtiofs</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </filesystem>
Dec 01 19:11:00 user nova-compute[75066]:     <tpm supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='model'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>tpm-tis</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>tpm-crb</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='backendModel'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>passthrough</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>emulator</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </tpm>
Dec 01 19:11:00 user nova-compute[75066]:   </devices>
Dec 01 19:11:00 user nova-compute[75066]:   <features>
Dec 01 19:11:00 user nova-compute[75066]:     <gic supported='no'/>
Dec 01 19:11:00 user nova-compute[75066]:     <vmcoreinfo supported='yes'/>
Dec 01 19:11:00 user nova-compute[75066]:     <genid supported='yes'/>
Dec 01 19:11:00 user nova-compute[75066]:     <backingStoreInput supported='yes'/>
Dec 01 19:11:00 user nova-compute[75066]:     <backup supported='yes'/>
Dec 01 19:11:00 user nova-compute[75066]:     <sev supported='no'/>
Dec 01 19:11:00 user nova-compute[75066]:   </features>
Dec 01 19:11:00 user nova-compute[75066]: </domainCapabilities>
Dec 01 19:11:00 user nova-compute[75066]:  {{(pid=75066) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Dec 01 19:11:00 user nova-compute[75066]: <domainCapabilities>
Dec 01 19:11:00 user nova-compute[75066]:   <path>/usr/bin/qemu-system-x86_64</path>
Dec 01 19:11:00 user nova-compute[75066]:   <domain>kvm</domain>
Dec 01 19:11:00 user nova-compute[75066]:   <machine>pc-q35-6.2</machine>
Dec 01 19:11:00 user nova-compute[75066]:   <arch>x86_64</arch>
Dec 01 19:11:00 user nova-compute[75066]:   <vcpu max='288'/>
Dec 01 19:11:00 user nova-compute[75066]:   <iothreads supported='yes'/>
Dec 01 19:11:00 user nova-compute[75066]:   <os supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:     <enum name='firmware'>
Dec 01 19:11:00 user nova-compute[75066]:       <value>efi</value>
Dec 01 19:11:00 user nova-compute[75066]:     </enum>
Dec 01 19:11:00 user nova-compute[75066]:     <loader supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Dec 01 19:11:00 user nova-compute[75066]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Dec 01 19:11:00 user nova-compute[75066]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='type'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>rom</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>pflash</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='readonly'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>yes</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>no</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='secure'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>yes</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>no</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </loader>
Dec 01 19:11:00 user nova-compute[75066]:   </os>
Dec 01 19:11:00 user nova-compute[75066]:   <cpu>
Dec 01 19:11:00 user nova-compute[75066]:     <mode name='host-passthrough' supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='hostPassthroughMigratable'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>on</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>off</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </mode>
Dec 01 19:11:00 user nova-compute[75066]:     <mode name='maximum' supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='maximumMigratable'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>on</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>off</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </mode>
Dec 01 19:11:00 user nova-compute[75066]:     <mode name='host-model' supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <vendor>Intel</vendor>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='ss'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='vmx'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='pcid'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='hypervisor'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='arat'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='tsc_adjust'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='umip'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='md-clear'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='stibp'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='arch-capabilities'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='ssbd'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='invtsc'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='ibpb'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='ibrs'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='amd-stibp'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='amd-ssbd'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='rsba'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='pschange-mc-no'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='disable' name='erms'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='disable' name='xsaveopt'/>
Dec 01 19:11:00 user nova-compute[75066]:     </mode>
Dec 01 19:11:00 user nova-compute[75066]:     <mode name='custom' supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>qemu64</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>qemu32</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>phenom</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>pentium3</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>pentium2</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>pentium</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>n270</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>kvm64</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>kvm32</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>coreduo</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>core2duo</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>athlon</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>Westmere-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>Westmere</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Snowridge</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Skylake-Server</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Skylake-Client</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>SandyBridge</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>Penryn</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Opteron_G5</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Opteron_G4</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Opteron_G3</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Opteron_G2</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>Opteron_G1</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>Nehalem-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>Nehalem</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>IvyBridge</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Icelake-Server</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Haswell-noTSX</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Haswell-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Haswell</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>EPYC-Rome</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>EPYC-Milan</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>EPYC-IBPB</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>EPYC</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Dhyana</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Cooperlake</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>Conroe</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Cascadelake-Server</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Broadwell-noTSX</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Broadwell-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Broadwell</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>486</model>
Dec 01 19:11:00 user nova-compute[75066]:     </mode>
Dec 01 19:11:00 user nova-compute[75066]:   </cpu>
Dec 01 19:11:00 user nova-compute[75066]:   <memoryBacking supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:     <enum name='sourceType'>
Dec 01 19:11:00 user nova-compute[75066]:       <value>file</value>
Dec 01 19:11:00 user nova-compute[75066]:       <value>anonymous</value>
Dec 01 19:11:00 user nova-compute[75066]:       <value>memfd</value>
Dec 01 19:11:00 user nova-compute[75066]:     </enum>
Dec 01 19:11:00 user nova-compute[75066]:   </memoryBacking>
Dec 01 19:11:00 user nova-compute[75066]:   <devices>
Dec 01 19:11:00 user nova-compute[75066]:     <disk supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='diskDevice'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>disk</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>cdrom</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>floppy</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>lun</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='bus'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>fdc</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>scsi</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtio</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>usb</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>sata</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='model'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtio</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtio-transitional</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtio-non-transitional</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </disk>
Dec 01 19:11:00 user nova-compute[75066]:     <graphics supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='type'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>sdl</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>vnc</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>spice</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>egl-headless</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </graphics>
Dec 01 19:11:00 user nova-compute[75066]:     <video supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='modelType'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>vga</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>cirrus</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>vmvga</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>qxl</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtio</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>none</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>bochs</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>ramfb</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </video>
Dec 01 19:11:00 user nova-compute[75066]:     <hostdev supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='mode'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>subsystem</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='startupPolicy'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>default</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>mandatory</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>requisite</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>optional</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='subsysType'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>usb</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>pci</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>scsi</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='capsType'/>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='pciBackend'/>
Dec 01 19:11:00 user nova-compute[75066]:     </hostdev>
Dec 01 19:11:00 user nova-compute[75066]:     <rng supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='model'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtio</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtio-transitional</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtio-non-transitional</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='backendModel'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>random</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>egd</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>builtin</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </rng>
Dec 01 19:11:00 user nova-compute[75066]:     <filesystem supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='driverType'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>path</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>handle</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtiofs</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </filesystem>
Dec 01 19:11:00 user nova-compute[75066]:     <tpm supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='model'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>tpm-tis</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>tpm-crb</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='backendModel'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>passthrough</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>emulator</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </tpm>
Dec 01 19:11:00 user nova-compute[75066]:   </devices>
Dec 01 19:11:00 user nova-compute[75066]:   <features>
Dec 01 19:11:00 user nova-compute[75066]:     <gic supported='no'/>
Dec 01 19:11:00 user nova-compute[75066]:     <vmcoreinfo supported='yes'/>
Dec 01 19:11:00 user nova-compute[75066]:     <genid supported='yes'/>
Dec 01 19:11:00 user nova-compute[75066]:     <backingStoreInput supported='yes'/>
Dec 01 19:11:00 user nova-compute[75066]:     <backup supported='yes'/>
Dec 01 19:11:00 user nova-compute[75066]:     <sev supported='no'/>
Dec 01 19:11:00 user nova-compute[75066]:   </features>
Dec 01 19:11:00 user nova-compute[75066]: </domainCapabilities>
Dec 01 19:11:00 user nova-compute[75066]:  {{(pid=75066) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Dec 01 19:11:00 user nova-compute[75066]: <domainCapabilities>
Dec 01 19:11:00 user nova-compute[75066]:   <path>/usr/bin/qemu-system-x86_64</path>
Dec 01 19:11:00 user nova-compute[75066]:   <domain>kvm</domain>
Dec 01 19:11:00 user nova-compute[75066]:   <machine>pc-i440fx-6.2</machine>
Dec 01 19:11:00 user nova-compute[75066]:   <arch>x86_64</arch>
Dec 01 19:11:00 user nova-compute[75066]:   <vcpu max='255'/>
Dec 01 19:11:00 user nova-compute[75066]:   <iothreads supported='yes'/>
Dec 01 19:11:00 user nova-compute[75066]:   <os supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:     <enum name='firmware'>
Dec 01 19:11:00 user nova-compute[75066]:       <value>efi</value>
Dec 01 19:11:00 user nova-compute[75066]:     </enum>
Dec 01 19:11:00 user nova-compute[75066]:     <loader supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='type'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>rom</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>pflash</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='readonly'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>yes</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>no</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='secure'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>no</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </loader>
Dec 01 19:11:00 user nova-compute[75066]:   </os>
Dec 01 19:11:00 user nova-compute[75066]:   <cpu>
Dec 01 19:11:00 user nova-compute[75066]:     <mode name='host-passthrough' supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='hostPassthroughMigratable'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>on</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>off</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </mode>
Dec 01 19:11:00 user nova-compute[75066]:     <mode name='maximum' supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='maximumMigratable'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>on</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>off</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </mode>
Dec 01 19:11:00 user nova-compute[75066]:     <mode name='host-model' supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <vendor>Intel</vendor>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='ss'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='vmx'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='pcid'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='hypervisor'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='arat'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='tsc_adjust'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='umip'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='md-clear'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='stibp'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='arch-capabilities'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='ssbd'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='invtsc'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='ibpb'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='ibrs'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='amd-stibp'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='amd-ssbd'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='rsba'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='pschange-mc-no'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='disable' name='erms'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='disable' name='xsaveopt'/>
Dec 01 19:11:00 user nova-compute[75066]:     </mode>
Dec 01 19:11:00 user nova-compute[75066]:     <mode name='custom' supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>qemu64</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>qemu32</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>phenom</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>pentium3</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>pentium2</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>pentium</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>n270</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>kvm64</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>kvm32</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>coreduo</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>core2duo</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>athlon</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>Westmere-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>Westmere</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Snowridge</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Skylake-Server</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Skylake-Client</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>SandyBridge</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>Penryn</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Opteron_G5</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Opteron_G4</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Opteron_G3</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Opteron_G2</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>Opteron_G1</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>Nehalem-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>Nehalem</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>IvyBridge</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Icelake-Server</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Haswell-noTSX</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Haswell-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Haswell</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>EPYC-Rome</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>EPYC-Milan</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>EPYC-IBPB</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>EPYC</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Dhyana</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Cooperlake</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>Conroe</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Cascadelake-Server</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Broadwell-noTSX</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Broadwell-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Broadwell</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>486</model>
Dec 01 19:11:00 user nova-compute[75066]:     </mode>
Dec 01 19:11:00 user nova-compute[75066]:   </cpu>
Dec 01 19:11:00 user nova-compute[75066]:   <memoryBacking supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:     <enum name='sourceType'>
Dec 01 19:11:00 user nova-compute[75066]:       <value>file</value>
Dec 01 19:11:00 user nova-compute[75066]:       <value>anonymous</value>
Dec 01 19:11:00 user nova-compute[75066]:       <value>memfd</value>
Dec 01 19:11:00 user nova-compute[75066]:     </enum>
Dec 01 19:11:00 user nova-compute[75066]:   </memoryBacking>
Dec 01 19:11:00 user nova-compute[75066]:   <devices>
Dec 01 19:11:00 user nova-compute[75066]:     <disk supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='diskDevice'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>disk</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>cdrom</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>floppy</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>lun</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='bus'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>ide</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>fdc</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>scsi</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtio</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>usb</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>sata</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='model'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtio</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtio-transitional</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtio-non-transitional</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </disk>
Dec 01 19:11:00 user nova-compute[75066]:     <graphics supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='type'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>sdl</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>vnc</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>spice</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>egl-headless</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </graphics>
Dec 01 19:11:00 user nova-compute[75066]:     <video supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='modelType'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>vga</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>cirrus</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>vmvga</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>qxl</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtio</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>none</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>bochs</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>ramfb</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </video>
Dec 01 19:11:00 user nova-compute[75066]:     <hostdev supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='mode'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>subsystem</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='startupPolicy'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>default</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>mandatory</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>requisite</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>optional</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='subsysType'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>usb</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>pci</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>scsi</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='capsType'/>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='pciBackend'/>
Dec 01 19:11:00 user nova-compute[75066]:     </hostdev>
Dec 01 19:11:00 user nova-compute[75066]:     <rng supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='model'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtio</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtio-transitional</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtio-non-transitional</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='backendModel'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>random</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>egd</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>builtin</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </rng>
Dec 01 19:11:00 user nova-compute[75066]:     <filesystem supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='driverType'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>path</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>handle</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtiofs</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </filesystem>
Dec 01 19:11:00 user nova-compute[75066]:     <tpm supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='model'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>tpm-tis</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>tpm-crb</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='backendModel'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>passthrough</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>emulator</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </tpm>
Dec 01 19:11:00 user nova-compute[75066]:   </devices>
Dec 01 19:11:00 user nova-compute[75066]:   <features>
Dec 01 19:11:00 user nova-compute[75066]:     <gic supported='no'/>
Dec 01 19:11:00 user nova-compute[75066]:     <vmcoreinfo supported='yes'/>
Dec 01 19:11:00 user nova-compute[75066]:     <genid supported='yes'/>
Dec 01 19:11:00 user nova-compute[75066]:     <backingStoreInput supported='yes'/>
Dec 01 19:11:00 user nova-compute[75066]:     <backup supported='yes'/>
Dec 01 19:11:00 user nova-compute[75066]:     <sev supported='no'/>
Dec 01 19:11:00 user nova-compute[75066]:   </features>
Dec 01 19:11:00 user nova-compute[75066]: </domainCapabilities>
Dec 01 19:11:00 user nova-compute[75066]:  {{(pid=75066) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Dec 01 19:11:00 user nova-compute[75066]: <domainCapabilities>
Dec 01 19:11:00 user nova-compute[75066]:   <path>/usr/bin/qemu-system-x86_64</path>
Dec 01 19:11:00 user nova-compute[75066]:   <domain>kvm</domain>
Dec 01 19:11:00 user nova-compute[75066]:   <machine>pc-q35-jammy</machine>
Dec 01 19:11:00 user nova-compute[75066]:   <arch>x86_64</arch>
Dec 01 19:11:00 user nova-compute[75066]:   <vcpu max='288'/>
Dec 01 19:11:00 user nova-compute[75066]:   <iothreads supported='yes'/>
Dec 01 19:11:00 user nova-compute[75066]:   <os supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:     <enum name='firmware'>
Dec 01 19:11:00 user nova-compute[75066]:       <value>efi</value>
Dec 01 19:11:00 user nova-compute[75066]:     </enum>
Dec 01 19:11:00 user nova-compute[75066]:     <loader supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Dec 01 19:11:00 user nova-compute[75066]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Dec 01 19:11:00 user nova-compute[75066]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='type'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>rom</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>pflash</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='readonly'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>yes</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>no</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='secure'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>yes</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>no</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </loader>
Dec 01 19:11:00 user nova-compute[75066]:   </os>
Dec 01 19:11:00 user nova-compute[75066]:   <cpu>
Dec 01 19:11:00 user nova-compute[75066]:     <mode name='host-passthrough' supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='hostPassthroughMigratable'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>on</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>off</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </mode>
Dec 01 19:11:00 user nova-compute[75066]:     <mode name='maximum' supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='maximumMigratable'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>on</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>off</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </mode>
Dec 01 19:11:00 user nova-compute[75066]:     <mode name='host-model' supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <vendor>Intel</vendor>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='ss'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='vmx'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='pcid'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='hypervisor'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='arat'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='tsc_adjust'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='umip'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='md-clear'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='stibp'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='arch-capabilities'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='ssbd'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='invtsc'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='ibpb'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='ibrs'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='amd-stibp'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='amd-ssbd'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='rsba'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='require' name='pschange-mc-no'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='disable' name='erms'/>
Dec 01 19:11:00 user nova-compute[75066]:       <feature policy='disable' name='xsaveopt'/>
Dec 01 19:11:00 user nova-compute[75066]:     </mode>
Dec 01 19:11:00 user nova-compute[75066]:     <mode name='custom' supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>qemu64</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>qemu32</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>phenom</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>pentium3</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>pentium2</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>pentium</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>n270</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>kvm64</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>kvm32</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>coreduo</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>core2duo</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>athlon</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>Westmere-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>Westmere</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Snowridge</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Skylake-Server-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Skylake-Server</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Skylake-Client-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Skylake-Client</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>SandyBridge-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>SandyBridge</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>Penryn</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Opteron_G5</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Opteron_G4</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Opteron_G3</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Opteron_G2</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>Opteron_G1</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>Nehalem-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>Nehalem</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>IvyBridge-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>IvyBridge</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Icelake-Server-noTSX</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Icelake-Server</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Haswell-noTSX</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Haswell-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Haswell</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>EPYC-Rome</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>EPYC-Milan</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>EPYC-IBPB</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>EPYC</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Dhyana</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Cooperlake</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>Conroe</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Cascadelake-Server</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Broadwell-noTSX</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Broadwell-IBRS</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='no'>Broadwell</model>
Dec 01 19:11:00 user nova-compute[75066]:       <model usable='yes'>486</model>
Dec 01 19:11:00 user nova-compute[75066]:     </mode>
Dec 01 19:11:00 user nova-compute[75066]:   </cpu>
Dec 01 19:11:00 user nova-compute[75066]:   <memoryBacking supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:     <enum name='sourceType'>
Dec 01 19:11:00 user nova-compute[75066]:       <value>file</value>
Dec 01 19:11:00 user nova-compute[75066]:       <value>anonymous</value>
Dec 01 19:11:00 user nova-compute[75066]:       <value>memfd</value>
Dec 01 19:11:00 user nova-compute[75066]:     </enum>
Dec 01 19:11:00 user nova-compute[75066]:   </memoryBacking>
Dec 01 19:11:00 user nova-compute[75066]:   <devices>
Dec 01 19:11:00 user nova-compute[75066]:     <disk supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='diskDevice'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>disk</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>cdrom</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>floppy</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>lun</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='bus'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>fdc</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>scsi</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtio</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>usb</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>sata</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='model'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtio</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtio-transitional</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtio-non-transitional</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </disk>
Dec 01 19:11:00 user nova-compute[75066]:     <graphics supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='type'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>sdl</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>vnc</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>spice</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>egl-headless</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </graphics>
Dec 01 19:11:00 user nova-compute[75066]:     <video supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='modelType'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>vga</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>cirrus</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>vmvga</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>qxl</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtio</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>none</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>bochs</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>ramfb</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </video>
Dec 01 19:11:00 user nova-compute[75066]:     <hostdev supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='mode'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>subsystem</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='startupPolicy'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>default</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>mandatory</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>requisite</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>optional</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='subsysType'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>usb</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>pci</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>scsi</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='capsType'/>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='pciBackend'/>
Dec 01 19:11:00 user nova-compute[75066]:     </hostdev>
Dec 01 19:11:00 user nova-compute[75066]:     <rng supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='model'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtio</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtio-transitional</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtio-non-transitional</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='backendModel'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>random</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>egd</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>builtin</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </rng>
Dec 01 19:11:00 user nova-compute[75066]:     <filesystem supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='driverType'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>path</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>handle</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>virtiofs</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </filesystem>
Dec 01 19:11:00 user nova-compute[75066]:     <tpm supported='yes'>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='model'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>tpm-tis</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>tpm-crb</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:       <enum name='backendModel'>
Dec 01 19:11:00 user nova-compute[75066]:         <value>passthrough</value>
Dec 01 19:11:00 user nova-compute[75066]:         <value>emulator</value>
Dec 01 19:11:00 user nova-compute[75066]:       </enum>
Dec 01 19:11:00 user nova-compute[75066]:     </tpm>
Dec 01 19:11:00 user nova-compute[75066]:   </devices>
Dec 01 19:11:00 user nova-compute[75066]:   <features>
Dec 01 19:11:00 user nova-compute[75066]:     <gic supported='no'/>
Dec 01 19:11:00 user nova-compute[75066]:     <vmcoreinfo supported='yes'/>
Dec 01 19:11:00 user nova-compute[75066]:     <genid supported='yes'/>
Dec 01 19:11:00 user nova-compute[75066]:     <backingStoreInput supported='yes'/>
Dec 01 19:11:00 user nova-compute[75066]:     <backup supported='yes'/>
Dec 01 19:11:00 user nova-compute[75066]:     <sev supported='no'/>
Dec 01 19:11:00 user nova-compute[75066]:   </features>
Dec 01 19:11:00 user nova-compute[75066]: </domainCapabilities>
Dec 01 19:11:00 user nova-compute[75066]:  {{(pid=75066) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1039}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75066) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75066) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75066) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:954}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75066) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:993}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Checking secure boot support for host arch (x86_64) {{(pid=75066) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Checking secure boot support for host arch (x86_64) {{(pid=75066) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Checking secure boot support for host arch (x86_64) {{(pid=75066) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1781}}
Dec 01 19:11:00 user nova-compute[75066]: INFO nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Secure Boot support detected
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] cpu compare xml: <cpu match="exact">
Dec 01 19:11:00 user nova-compute[75066]:   <model>Nehalem</model>
Dec 01 19:11:00 user nova-compute[75066]: </cpu>
Dec 01 19:11:00 user nova-compute[75066]:  {{(pid=75066) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10017}}
Dec 01 19:11:00 user nova-compute[75066]: INFO nova.virt.node [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Generated node identity 8f57eb82-1921-43e1-b4a8-f85f2894ae62
Dec 01 19:11:00 user nova-compute[75066]: INFO nova.virt.node [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Wrote node identity 8f57eb82-1921-43e1-b4a8-f85f2894ae62 to /opt/stack/data/nova/compute_id
Dec 01 19:11:00 user nova-compute[75066]: WARNING nova.compute.manager [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Compute nodes ['8f57eb82-1921-43e1-b4a8-f85f2894ae62'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Dec 01 19:11:00 user nova-compute[75066]: INFO nova.compute.manager [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Dec 01 19:11:00 user nova-compute[75066]: WARNING nova.compute.manager [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Dec 01 19:11:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Auditing locally available compute resources for user (node: user) {{(pid=75066) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 19:11:00 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:11:00 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:11:00 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Hypervisor/Node resource view: name=user free_ram=10979MB free_disk=25.983890533447266GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75066) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:11:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:11:00 user nova-compute[75066]: WARNING nova.compute.resource_tracker [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] No compute node record for user:8f57eb82-1921-43e1-b4a8-f85f2894ae62: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 8f57eb82-1921-43e1-b4a8-f85f2894ae62 could not be found.
Dec 01 19:11:01 user nova-compute[75066]: INFO nova.compute.resource_tracker [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Compute node record created for user:user with uuid: 8f57eb82-1921-43e1-b4a8-f85f2894ae62
Dec 01 19:11:01 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 19:11:01 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 19:11:01 user nova-compute[75066]: INFO nova.scheduler.client.report [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] [req-6e89bdc7-07c3-44c2-bcd7-bbf8177608c0] Created resource provider record via placement API for resource provider with UUID 8f57eb82-1921-43e1-b4a8-f85f2894ae62 and name user.
Dec 01 19:11:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75066) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1797}}
Dec 01 19:11:01 user nova-compute[75066]: INFO nova.virt.libvirt.host [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] kernel doesn't support AMD SEV
Dec 01 19:11:01 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Updating inventory in ProviderTree for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 01 19:11:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:11:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Libvirt baseline CPU <cpu>
Dec 01 19:11:01 user nova-compute[75066]:   <arch>x86_64</arch>
Dec 01 19:11:01 user nova-compute[75066]:   <model>Nehalem</model>
Dec 01 19:11:01 user nova-compute[75066]:   <vendor>Intel</vendor>
Dec 01 19:11:01 user nova-compute[75066]:   <topology sockets="6" cores="1" threads="1"/>
Dec 01 19:11:01 user nova-compute[75066]: </cpu>
Dec 01 19:11:01 user nova-compute[75066]:  {{(pid=75066) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12515}}
Dec 01 19:11:01 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Updated inventory for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Dec 01 19:11:01 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Updating resource provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 generation from 0 to 1 during operation: update_inventory {{(pid=75066) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Dec 01 19:11:01 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Updating inventory in ProviderTree for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 01 19:11:01 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Updating resource provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 generation from 1 to 2 during operation: update_traits {{(pid=75066) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Dec 01 19:11:01 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Compute_service record updated for user:user {{(pid=75066) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 19:11:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.610s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:11:01 user nova-compute[75066]: DEBUG nova.service [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Creating RPC server for service compute {{(pid=75066) start /opt/stack/nova/nova/service.py:182}}
Dec 01 19:11:01 user nova-compute[75066]: DEBUG nova.service [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] Join ServiceGroup membership for this service compute {{(pid=75066) start /opt/stack/nova/nova/service.py:199}}
Dec 01 19:11:01 user nova-compute[75066]: DEBUG nova.servicegroup.drivers.db [None req-bcba535d-6417-42bd-b7ef-743ca1815188 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75066) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Dec 01 19:11:54 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:11:54 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:11:54 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Starting heal instance info cache {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 19:11:54 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Rebuilding the list of instances to heal {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 19:11:54 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Didn't find any instances for network info cache update. {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 01 19:11:54 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:11:54 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:11:54 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:11:54 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:11:54 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:11:54 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:11:54 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:11:54 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75066) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 19:11:54 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:11:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:11:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:11:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:11:54 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75066) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 19:11:54 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:11:54 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:11:54 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Hypervisor/Node resource view: name=user free_ram=10328MB free_disk=25.88753890991211GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75066) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 19:11:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:11:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:11:55 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 19:11:55 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 19:11:55 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:11:55 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:11:55 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Compute_service record updated for user:user {{(pid=75066) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 19:11:55 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.133s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:11:55 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:12:52 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:12:52 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:12:53 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:12:53 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:12:53 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Starting heal instance info cache {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 19:12:53 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Rebuilding the list of instances to heal {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 19:12:53 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Didn't find any instances for network info cache update. {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 01 19:12:53 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:12:53 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:12:53 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:12:54 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:12:54 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:12:54 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75066) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 19:12:54 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:12:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:12:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:12:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:12:54 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75066) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 19:12:54 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:12:54 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:12:54 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Hypervisor/Node resource view: name=user free_ram=10333MB free_disk=25.952228546142578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75066) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 19:12:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:12:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:12:54 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 19:12:54 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 19:12:54 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:12:54 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:12:54 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Compute_service record updated for user:user {{(pid=75066) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 19:12:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.140s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:13:52 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:13:53 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:13:54 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:13:54 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Starting heal instance info cache {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 19:13:54 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Rebuilding the list of instances to heal {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 19:13:54 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Didn't find any instances for network info cache update. {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 01 19:13:55 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:13:55 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:13:55 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:13:55 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:13:55 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:13:55 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:13:55 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:13:55 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75066) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 19:13:55 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:13:55 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:13:55 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Hypervisor/Node resource view: name=user free_ram=10364MB free_disk=25.70440673828125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75066) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 19:13:55 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:13:55 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:13:55 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 19:13:55 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 19:13:55 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:13:55 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:13:55 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Compute_service record updated for user:user {{(pid=75066) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 19:13:55 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.126s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:13:56 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:13:56 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:13:56 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75066) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 19:14:53 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:14:54 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:14:54 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Starting heal instance info cache {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 19:14:54 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Rebuilding the list of instances to heal {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 19:14:54 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Didn't find any instances for network info cache update. {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 01 19:14:54 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:14:55 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:14:56 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:14:56 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:14:56 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:14:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:14:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:14:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:14:56 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75066) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 19:14:56 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:14:56 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:14:56 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Hypervisor/Node resource view: name=user free_ram=9662MB free_disk=25.724567413330078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75066) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 19:14:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:14:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:14:56 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 19:14:56 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 19:14:56 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:14:56 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:14:56 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Compute_service record updated for user:user {{(pid=75066) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 19:14:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.138s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:14:57 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:14:57 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:14:58 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:14:58 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75066) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 19:15:03 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Acquiring lock "67c5dd7c-88aa-4f2f-8f62-a9af0480c38e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:15:03 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Lock "67c5dd7c-88aa-4f2f-8f62-a9af0480c38e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:15:03 user nova-compute[75066]: DEBUG nova.compute.manager [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Starting instance... {{(pid=75066) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 19:15:03 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:15:03 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:15:03 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75066) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 19:15:03 user nova-compute[75066]: INFO nova.compute.claims [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Claim successful on node user
Dec 01 19:15:04 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:15:04 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:15:04 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.807s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:15:04 user nova-compute[75066]: DEBUG nova.compute.manager [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Start building networks asynchronously for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 19:15:04 user nova-compute[75066]: DEBUG nova.compute.manager [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Allocating IP information in the background. {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 19:15:04 user nova-compute[75066]: DEBUG nova.network.neutron [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] allocate_for_instance() {{(pid=75066) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 19:15:04 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 19:15:04 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Acquiring lock "b6c46e8d-982f-4169-af80-96274a165b02" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:15:04 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Lock "b6c46e8d-982f-4169-af80-96274a165b02" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:15:04 user nova-compute[75066]: DEBUG nova.compute.manager [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] [instance: b6c46e8d-982f-4169-af80-96274a165b02] Starting instance... {{(pid=75066) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 19:15:04 user nova-compute[75066]: DEBUG nova.compute.manager [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Start building block device mappings for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 19:15:04 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:15:04 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:15:04 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75066) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 19:15:04 user nova-compute[75066]: INFO nova.compute.claims [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] [instance: b6c46e8d-982f-4169-af80-96274a165b02] Claim successful on node user
Dec 01 19:15:04 user nova-compute[75066]: DEBUG nova.compute.manager [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Start spawning the instance on the hypervisor. {{(pid=75066) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 19:15:04 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Creating instance directory {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 19:15:04 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Creating image(s)
Dec 01 19:15:04 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Acquiring lock "/opt/stack/data/nova/instances/67c5dd7c-88aa-4f2f-8f62-a9af0480c38e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:15:04 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Lock "/opt/stack/data/nova/instances/67c5dd7c-88aa-4f2f-8f62-a9af0480c38e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:15:04 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Lock "/opt/stack/data/nova/instances/67c5dd7c-88aa-4f2f-8f62-a9af0480c38e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:15:04 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Acquiring lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:15:04 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:15:05 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:15:05 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:15:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.283s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:15:05 user nova-compute[75066]: DEBUG nova.compute.manager [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] [instance: b6c46e8d-982f-4169-af80-96274a165b02] Start building networks asynchronously for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 19:15:05 user nova-compute[75066]: DEBUG nova.policy [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1fbd6bed08164f359471592ccc78a43d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '306d3049e90647fa9f1c90a104eac0e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75066) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 19:15:05 user nova-compute[75066]: DEBUG nova.compute.manager [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] [instance: b6c46e8d-982f-4169-af80-96274a165b02] Allocating IP information in the background. {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 19:15:05 user nova-compute[75066]: DEBUG nova.network.neutron [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] [instance: b6c46e8d-982f-4169-af80-96274a165b02] allocate_for_instance() {{(pid=75066) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 19:15:05 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] [instance: b6c46e8d-982f-4169-af80-96274a165b02] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 19:15:05 user nova-compute[75066]: DEBUG nova.compute.manager [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] [instance: b6c46e8d-982f-4169-af80-96274a165b02] Start building block device mappings for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 19:15:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d.part --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:15:06 user nova-compute[75066]: DEBUG nova.policy [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '009206429ab7462c8ff29cb4c2bf7d09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a0c442a2ec3a41bfa602949a1aeb1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75066) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 19:15:06 user nova-compute[75066]: DEBUG nova.compute.manager [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] [instance: b6c46e8d-982f-4169-af80-96274a165b02] Start spawning the instance on the hypervisor. {{(pid=75066) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 19:15:06 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] [instance: b6c46e8d-982f-4169-af80-96274a165b02] Creating instance directory {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 19:15:06 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] [instance: b6c46e8d-982f-4169-af80-96274a165b02] Creating image(s)
Dec 01 19:15:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Acquiring lock "/opt/stack/data/nova/instances/b6c46e8d-982f-4169-af80-96274a165b02/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:15:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Lock "/opt/stack/data/nova/instances/b6c46e8d-982f-4169-af80-96274a165b02/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:15:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Lock "/opt/stack/data/nova/instances/b6c46e8d-982f-4169-af80-96274a165b02/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.025s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:15:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Acquiring lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:15:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d.part --force-share --output=json" returned: 0 in 0.181s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:15:06 user nova-compute[75066]: DEBUG nova.virt.images [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] 900b237b-e99c-4fdd-a44f-dcb7a08baa86 was qcow2, converting to raw {{(pid=75066) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 01 19:15:06 user nova-compute[75066]: DEBUG nova.privsep.utils [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75066) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 01 19:15:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d.part /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d.converted {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:15:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d.part /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d.converted" returned: 0 in 0.239s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:15:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d.converted --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:15:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d.converted --force-share --output=json" returned: 0 in 0.176s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:15:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.601s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:15:06 user nova-compute[75066]: INFO oslo.privsep.daemon [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpa70_iyj9/privsep.sock']
Dec 01 19:15:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.553s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:15:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:15:06 user sudo[84305]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpa70_iyj9/privsep.sock
Dec 01 19:15:06 user sudo[84305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Dec 01 19:15:08 user sudo[84305]: pam_unix(sudo:session): session closed for user root
Dec 01 19:15:08 user nova-compute[75066]: INFO oslo.privsep.daemon [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Spawned new privsep daemon via rootwrap
Dec 01 19:15:08 user nova-compute[75066]: INFO oslo.privsep.daemon [-] privsep daemon starting
Dec 01 19:15:08 user nova-compute[75066]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Dec 01 19:15:08 user nova-compute[75066]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Dec 01 19:15:08 user nova-compute[75066]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84310
Dec 01 19:15:08 user nova-compute[75066]: WARNING oslo_privsep.priv_context [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] privsep daemon already running
Dec 01 19:15:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:15:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:15:08 user nova-compute[75066]: DEBUG nova.network.neutron [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] [instance: b6c46e8d-982f-4169-af80-96274a165b02] Successfully created port: 6853aa2a-6a9e-471a-ade8-f29f1064c006 {{(pid=75066) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 19:15:08 user nova-compute[75066]: DEBUG nova.network.neutron [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Successfully created port: 73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2 {{(pid=75066) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 19:15:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.196s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:15:08 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Acquiring lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:15:08 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:15:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:15:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.188s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:15:08 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Acquiring lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:15:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.202s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:15:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/67c5dd7c-88aa-4f2f-8f62-a9af0480c38e/disk 1073741824 {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:15:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/67c5dd7c-88aa-4f2f-8f62-a9af0480c38e/disk 1073741824" returned: 0 in 0.046s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:15:08 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:15:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:15:08 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.257s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:15:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:15:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.184s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:15:08 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Checking if we can resize image /opt/stack/data/nova/instances/67c5dd7c-88aa-4f2f-8f62-a9af0480c38e/disk. size=1073741824 {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 19:15:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67c5dd7c-88aa-4f2f-8f62-a9af0480c38e/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:15:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.190s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:15:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/b6c46e8d-982f-4169-af80-96274a165b02/disk 1073741824 {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:15:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/b6c46e8d-982f-4169-af80-96274a165b02/disk 1073741824" returned: 0 in 0.067s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:15:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:15:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:15:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67c5dd7c-88aa-4f2f-8f62-a9af0480c38e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:15:09 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Cannot resize image /opt/stack/data/nova/instances/67c5dd7c-88aa-4f2f-8f62-a9af0480c38e/disk to a smaller size. {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 19:15:09 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Created local disks {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 19:15:09 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Ensure instance console log exists: /opt/stack/data/nova/instances/67c5dd7c-88aa-4f2f-8f62-a9af0480c38e/console.log {{(pid=75066) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 19:15:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:15:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:15:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:15:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Acquiring lock "c223be70-8b9c-46d4-9b5a-3b83dfc05a17" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:15:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "c223be70-8b9c-46d4-9b5a-3b83dfc05a17" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:15:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.203s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:15:09 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b6c46e8d-982f-4169-af80-96274a165b02/disk. size=1073741824 {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 19:15:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6c46e8d-982f-4169-af80-96274a165b02/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:15:09 user nova-compute[75066]: DEBUG nova.compute.manager [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Starting instance... {{(pid=75066) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 19:15:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6c46e8d-982f-4169-af80-96274a165b02/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:15:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:15:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:15:09 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Cannot resize image /opt/stack/data/nova/instances/b6c46e8d-982f-4169-af80-96274a165b02/disk to a smaller size. {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 19:15:09 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] [instance: b6c46e8d-982f-4169-af80-96274a165b02] Created local disks {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 19:15:09 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] [instance: b6c46e8d-982f-4169-af80-96274a165b02] Ensure instance console log exists: /opt/stack/data/nova/instances/b6c46e8d-982f-4169-af80-96274a165b02/console.log {{(pid=75066) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 19:15:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:15:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:15:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:15:09 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75066) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 19:15:09 user nova-compute[75066]: INFO nova.compute.claims [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Claim successful on node user
Dec 01 19:15:09 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:15:09 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:15:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.336s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:15:09 user nova-compute[75066]: DEBUG nova.compute.manager [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Start building networks asynchronously for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 19:15:09 user nova-compute[75066]: DEBUG nova.compute.manager [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Allocating IP information in the background. {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 19:15:09 user nova-compute[75066]: DEBUG nova.network.neutron [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] allocate_for_instance() {{(pid=75066) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 19:15:09 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 19:15:09 user nova-compute[75066]: DEBUG nova.compute.manager [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Start building block device mappings for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 19:15:10 user nova-compute[75066]: DEBUG nova.compute.manager [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Start spawning the instance on the hypervisor. {{(pid=75066) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 19:15:10 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Creating instance directory {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 19:15:10 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Creating image(s)
Dec 01 19:15:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Acquiring lock "/opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:15:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "/opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:15:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "/opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:15:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:15:10 user nova-compute[75066]: DEBUG nova.policy [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cfb3e7b4b0444223af282b16da9bd919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0f7516d1db4dd5bc7d77a0bd1d44d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75066) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 19:15:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.165s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:15:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Acquiring lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:15:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:15:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:15:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.210s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:15:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk 1073741824 {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:15:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk 1073741824" returned: 0 in 0.042s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:15:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:15:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:15:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.193s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:15:10 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk. size=1073741824 {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 19:15:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:15:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:15:10 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Cannot resize image /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk to a smaller size. {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 19:15:10 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Created local disks {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 19:15:10 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Ensure instance console log exists: /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/console.log {{(pid=75066) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 19:15:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:15:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:15:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:15:10 user nova-compute[75066]: DEBUG nova.network.neutron [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] [instance: b6c46e8d-982f-4169-af80-96274a165b02] Successfully updated port: 6853aa2a-6a9e-471a-ade8-f29f1064c006 {{(pid=75066) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 19:15:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Acquiring lock "refresh_cache-b6c46e8d-982f-4169-af80-96274a165b02" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:15:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Acquired lock "refresh_cache-b6c46e8d-982f-4169-af80-96274a165b02" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:15:10 user nova-compute[75066]: DEBUG nova.network.neutron [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] [instance: b6c46e8d-982f-4169-af80-96274a165b02] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:15:11 user nova-compute[75066]: DEBUG nova.network.neutron [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Successfully updated port: 73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2 {{(pid=75066) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 19:15:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Acquiring lock "refresh_cache-67c5dd7c-88aa-4f2f-8f62-a9af0480c38e" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:15:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Acquired lock "refresh_cache-67c5dd7c-88aa-4f2f-8f62-a9af0480c38e" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:15:11 user nova-compute[75066]: DEBUG nova.network.neutron [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:15:11 user nova-compute[75066]: DEBUG nova.network.neutron [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] [instance: b6c46e8d-982f-4169-af80-96274a165b02] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:15:11 user nova-compute[75066]: DEBUG nova.network.neutron [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:15:11 user nova-compute[75066]: DEBUG nova.compute.manager [req-b33c57ae-0fe7-46ea-93be-00f7788c301c req-2637016a-f6f2-4ff4-8e2b-e97708dbd6da service nova] [instance: b6c46e8d-982f-4169-af80-96274a165b02] Received event network-changed-6853aa2a-6a9e-471a-ade8-f29f1064c006 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:15:11 user nova-compute[75066]: DEBUG nova.compute.manager [req-b33c57ae-0fe7-46ea-93be-00f7788c301c req-2637016a-f6f2-4ff4-8e2b-e97708dbd6da service nova] [instance: b6c46e8d-982f-4169-af80-96274a165b02] Refreshing instance network info cache due to event network-changed-6853aa2a-6a9e-471a-ade8-f29f1064c006. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:15:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-b33c57ae-0fe7-46ea-93be-00f7788c301c req-2637016a-f6f2-4ff4-8e2b-e97708dbd6da service nova] Acquiring lock "refresh_cache-b6c46e8d-982f-4169-af80-96274a165b02" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:15:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Acquiring lock "c3ceeca4-c16c-4cf5-adfd-7d5a2925f435" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:15:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "c3ceeca4-c16c-4cf5-adfd-7d5a2925f435" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:15:11 user nova-compute[75066]: DEBUG nova.compute.manager [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Starting instance... {{(pid=75066) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 19:15:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:15:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:15:11 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75066) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 19:15:11 user nova-compute[75066]: INFO nova.compute.claims [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Claim successful on node user
Dec 01 19:15:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Acquiring lock "dd546862-fcd5-4b69-8ea3-a8fa4859a489" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:15:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Lock "dd546862-fcd5-4b69-8ea3-a8fa4859a489" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:15:11 user nova-compute[75066]: DEBUG nova.compute.manager [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Starting instance... {{(pid=75066) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.network.neutron [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Updating instance_info_cache with network_info: [{"id": "73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2", "address": "fa:16:3e:5a:73:a4", "network": {"id": "fdb3c017-aafb-4c3e-a08c-a73a68be9f70", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1696445417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "306d3049e90647fa9f1c90a104eac0e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bdff9a-3a", "ovs_interfaceid": "73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.348s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.compute.manager [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Start building networks asynchronously for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.network.neutron [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] [instance: b6c46e8d-982f-4169-af80-96274a165b02] Updating instance_info_cache with network_info: [{"id": "6853aa2a-6a9e-471a-ade8-f29f1064c006", "address": "fa:16:3e:0e:a0:20", "network": {"id": "30057e96-0f86-466d-bf3f-e3cf15d9e5af", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-383866239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0c442a2ec3a41bfa602949a1aeb1e1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6853aa2a-6a", "ovs_interfaceid": "6853aa2a-6a9e-471a-ade8-f29f1064c006", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.124s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75066) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 19:15:12 user nova-compute[75066]: INFO nova.compute.claims [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Claim successful on node user
Dec 01 19:15:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Releasing lock "refresh_cache-67c5dd7c-88aa-4f2f-8f62-a9af0480c38e" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.compute.manager [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Instance network_info: |[{"id": "73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2", "address": "fa:16:3e:5a:73:a4", "network": {"id": "fdb3c017-aafb-4c3e-a08c-a73a68be9f70", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1696445417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "306d3049e90647fa9f1c90a104eac0e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bdff9a-3a", "ovs_interfaceid": "73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Start _get_guest_xml network_info=[{"id": "73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2", "address": "fa:16:3e:5a:73:a4", "network": {"id": "fdb3c017-aafb-4c3e-a08c-a73a68be9f70", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1696445417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "306d3049e90647fa9f1c90a104eac0e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bdff9a-3a", "ovs_interfaceid": "73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'image_id': '900b237b-e99c-4fdd-a44f-dcb7a08baa86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Releasing lock "refresh_cache-b6c46e8d-982f-4169-af80-96274a165b02" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.compute.manager [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] [instance: b6c46e8d-982f-4169-af80-96274a165b02] Instance network_info: |[{"id": "6853aa2a-6a9e-471a-ade8-f29f1064c006", "address": "fa:16:3e:0e:a0:20", "network": {"id": "30057e96-0f86-466d-bf3f-e3cf15d9e5af", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-383866239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0c442a2ec3a41bfa602949a1aeb1e1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6853aa2a-6a", "ovs_interfaceid": "6853aa2a-6a9e-471a-ade8-f29f1064c006", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-b33c57ae-0fe7-46ea-93be-00f7788c301c req-2637016a-f6f2-4ff4-8e2b-e97708dbd6da service nova] Acquired lock "refresh_cache-b6c46e8d-982f-4169-af80-96274a165b02" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.network.neutron [req-b33c57ae-0fe7-46ea-93be-00f7788c301c req-2637016a-f6f2-4ff4-8e2b-e97708dbd6da service nova] [instance: b6c46e8d-982f-4169-af80-96274a165b02] Refreshing network info cache for port 6853aa2a-6a9e-471a-ade8-f29f1064c006 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] [instance: b6c46e8d-982f-4169-af80-96274a165b02] Start _get_guest_xml network_info=[{"id": "6853aa2a-6a9e-471a-ade8-f29f1064c006", "address": "fa:16:3e:0e:a0:20", "network": {"id": "30057e96-0f86-466d-bf3f-e3cf15d9e5af", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-383866239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0c442a2ec3a41bfa602949a1aeb1e1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6853aa2a-6a", "ovs_interfaceid": "6853aa2a-6a9e-471a-ade8-f29f1064c006", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'image_id': '900b237b-e99c-4fdd-a44f-dcb7a08baa86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:15:12 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:15:12 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.privsep.utils [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75066) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:15:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-116335834',display_name='tempest-ServerStableDeviceRescueTest-server-116335834',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-116335834',id=1,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNNwUw2DY7Q5YGZ9SklK7Yt6zDNAMAKbqWf0bjfGOIr+Bf73P/Vb8HVUq1DDGOQfShaQxirLaBE1zWK7StLIdvMV/O9laZqIqcEwHqJJUVd7PEVzmYYja/8XpEumf+mt5Q==',key_name='tempest-keypair-572874473',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='306d3049e90647fa9f1c90a104eac0e7',ramdisk_id='',reservation_id='r-vlwek4pb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1936445064',owner_user_name='tempest-ServerStableDeviceRescueTest-1936445064-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:15:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fbd6bed08164f359471592ccc78a43d',uuid=67c5dd7c-88aa-4f2f-8f62-a9af0480c38e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2", "address": "fa:16:3e:5a:73:a4", "network": {"id": "fdb3c017-aafb-4c3e-a08c-a73a68be9f70", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1696445417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "306d3049e90647fa9f1c90a104eac0e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bdff9a-3a", "ovs_interfaceid": "73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Converting VIF {"id": "73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2", "address": "fa:16:3e:5a:73:a4", "network": {"id": "fdb3c017-aafb-4c3e-a08c-a73a68be9f70", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1696445417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "306d3049e90647fa9f1c90a104eac0e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bdff9a-3a", "ovs_interfaceid": "73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:73:a4,bridge_name='br-int',has_traffic_filtering=True,id=73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2,network=Network(fdb3c017-aafb-4c3e-a08c-a73a68be9f70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73bdff9a-3a') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.objects.instance [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Lazy-loading 'pci_devices' on Instance uuid 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:15:12 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:15:12 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:15:12 user nova-compute[75066]:   <uuid>67c5dd7c-88aa-4f2f-8f62-a9af0480c38e</uuid>
Dec 01 19:15:12 user nova-compute[75066]:   <name>instance-00000001</name>
Dec 01 19:15:12 user nova-compute[75066]:   <memory>524288</memory>
Dec 01 19:15:12 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:15:12 user nova-compute[75066]:   <metadata>
Dec 01 19:15:12 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:15:12 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:15:12 user nova-compute[75066]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-116335834</nova:name>
Dec 01 19:15:12 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:15:12</nova:creationTime>
Dec 01 19:15:12 user nova-compute[75066]:       <nova:flavor name="m1.tiny">
Dec 01 19:15:12 user nova-compute[75066]:         <nova:memory>512</nova:memory>
Dec 01 19:15:12 user nova-compute[75066]:         <nova:disk>1</nova:disk>
Dec 01 19:15:12 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:15:12 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:15:12 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:15:12 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:15:12 user nova-compute[75066]:       <nova:owner>
Dec 01 19:15:12 user nova-compute[75066]:         <nova:user uuid="1fbd6bed08164f359471592ccc78a43d">tempest-ServerStableDeviceRescueTest-1936445064-project-member</nova:user>
Dec 01 19:15:12 user nova-compute[75066]:         <nova:project uuid="306d3049e90647fa9f1c90a104eac0e7">tempest-ServerStableDeviceRescueTest-1936445064</nova:project>
Dec 01 19:15:12 user nova-compute[75066]:       </nova:owner>
Dec 01 19:15:12 user nova-compute[75066]:       <nova:root type="image" uuid="900b237b-e99c-4fdd-a44f-dcb7a08baa86"/>
Dec 01 19:15:12 user nova-compute[75066]:       <nova:ports>
Dec 01 19:15:12 user nova-compute[75066]:         <nova:port uuid="73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2">
Dec 01 19:15:12 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Dec 01 19:15:12 user nova-compute[75066]:         </nova:port>
Dec 01 19:15:12 user nova-compute[75066]:       </nova:ports>
Dec 01 19:15:12 user nova-compute[75066]:     </nova:instance>
Dec 01 19:15:12 user nova-compute[75066]:   </metadata>
Dec 01 19:15:12 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:15:12 user nova-compute[75066]:     <system>
Dec 01 19:15:12 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:15:12 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:15:12 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:15:12 user nova-compute[75066]:       <entry name="serial">67c5dd7c-88aa-4f2f-8f62-a9af0480c38e</entry>
Dec 01 19:15:12 user nova-compute[75066]:       <entry name="uuid">67c5dd7c-88aa-4f2f-8f62-a9af0480c38e</entry>
Dec 01 19:15:12 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:15:12 user nova-compute[75066]:     </system>
Dec 01 19:15:12 user nova-compute[75066]:   </sysinfo>
Dec 01 19:15:12 user nova-compute[75066]:   <os>
Dec 01 19:15:12 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:15:12 user nova-compute[75066]:     <boot dev="hd"/>
Dec 01 19:15:12 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:15:12 user nova-compute[75066]:   </os>
Dec 01 19:15:12 user nova-compute[75066]:   <features>
Dec 01 19:15:12 user nova-compute[75066]:     <acpi/>
Dec 01 19:15:12 user nova-compute[75066]:     <apic/>
Dec 01 19:15:12 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:15:12 user nova-compute[75066]:   </features>
Dec 01 19:15:12 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:15:12 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:15:12 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:15:12 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:15:12 user nova-compute[75066]:   </clock>
Dec 01 19:15:12 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:15:12 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:15:12 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:15:12 user nova-compute[75066]:   </cpu>
Dec 01 19:15:12 user nova-compute[75066]:   <devices>
Dec 01 19:15:12 user nova-compute[75066]:     <disk type="file" device="disk">
Dec 01 19:15:12 user nova-compute[75066]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 19:15:12 user nova-compute[75066]:       <source file="/opt/stack/data/nova/instances/67c5dd7c-88aa-4f2f-8f62-a9af0480c38e/disk"/>
Dec 01 19:15:12 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:15:12 user nova-compute[75066]:     </disk>
Dec 01 19:15:12 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:15:12 user nova-compute[75066]:       <mac address="fa:16:3e:5a:73:a4"/>
Dec 01 19:15:12 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:15:12 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:15:12 user nova-compute[75066]:       <target dev="tap73bdff9a-3a"/>
Dec 01 19:15:12 user nova-compute[75066]:     </interface>
Dec 01 19:15:12 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:15:12 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/67c5dd7c-88aa-4f2f-8f62-a9af0480c38e/console.log" append="off"/>
Dec 01 19:15:12 user nova-compute[75066]:     </serial>
Dec 01 19:15:12 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:15:12 user nova-compute[75066]:     <video>
Dec 01 19:15:12 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:15:12 user nova-compute[75066]:     </video>
Dec 01 19:15:12 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:15:12 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:15:12 user nova-compute[75066]:     </rng>
Dec 01 19:15:12 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:15:12 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:15:12 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:15:12 user nova-compute[75066]:     </memballoon>
Dec 01 19:15:12 user nova-compute[75066]:   </devices>
Dec 01 19:15:12 user nova-compute[75066]: </domain>
Dec 01 19:15:12 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:15:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-116335834',display_name='tempest-ServerStableDeviceRescueTest-server-116335834',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-116335834',id=1,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNNwUw2DY7Q5YGZ9SklK7Yt6zDNAMAKbqWf0bjfGOIr+Bf73P/Vb8HVUq1DDGOQfShaQxirLaBE1zWK7StLIdvMV/O9laZqIqcEwHqJJUVd7PEVzmYYja/8XpEumf+mt5Q==',key_name='tempest-keypair-572874473',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='306d3049e90647fa9f1c90a104eac0e7',ramdisk_id='',reservation_id='r-vlwek4pb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1936445064',owner_user_name='tempest-ServerStableDeviceRescueTest-1936445064-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:15:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fbd6bed08164f359471592ccc78a43d',uuid=67c5dd7c-88aa-4f2f-8f62-a9af0480c38e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2", "address": "fa:16:3e:5a:73:a4", "network": {"id": "fdb3c017-aafb-4c3e-a08c-a73a68be9f70", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1696445417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "306d3049e90647fa9f1c90a104eac0e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bdff9a-3a", "ovs_interfaceid": "73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Converting VIF {"id": "73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2", "address": "fa:16:3e:5a:73:a4", "network": {"id": "fdb3c017-aafb-4c3e-a08c-a73a68be9f70", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1696445417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "306d3049e90647fa9f1c90a104eac0e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bdff9a-3a", "ovs_interfaceid": "73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:73:a4,bridge_name='br-int',has_traffic_filtering=True,id=73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2,network=Network(fdb3c017-aafb-4c3e-a08c-a73a68be9f70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73bdff9a-3a') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG os_vif [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:73:a4,bridge_name='br-int',has_traffic_filtering=True,id=73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2,network=Network(fdb3c017-aafb-4c3e-a08c-a73a68be9f70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73bdff9a-3a') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Created schema index Interface.name {{(pid=75066) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Created schema index Port.name {{(pid=75066) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Created schema index Bridge.name {{(pid=75066) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [POLLOUT] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.compute.manager [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Allocating IP information in the background. {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.network.neutron [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] allocate_for_instance() {{(pid=75066) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:15:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1490091229',display_name='tempest-DeleteServersTestJSON-server-1490091229',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1490091229',id=2,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0c442a2ec3a41bfa602949a1aeb1e1b',ramdisk_id='',reservation_id='r-0wwuhxqb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-88724826',owner_user_name='tempest-DeleteServersTestJSON-88724826-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:15:06Z,user_data=None,user_id='009206429ab7462c8ff29cb4c2bf7d09',uuid=b6c46e8d-982f-4169-af80-96274a165b02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6853aa2a-6a9e-471a-ade8-f29f1064c006", "address": "fa:16:3e:0e:a0:20", "network": {"id": "30057e96-0f86-466d-bf3f-e3cf15d9e5af", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-383866239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0c442a2ec3a41bfa602949a1aeb1e1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6853aa2a-6a", "ovs_interfaceid": "6853aa2a-6a9e-471a-ade8-f29f1064c006", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Converting VIF {"id": "6853aa2a-6a9e-471a-ade8-f29f1064c006", "address": "fa:16:3e:0e:a0:20", "network": {"id": "30057e96-0f86-466d-bf3f-e3cf15d9e5af", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-383866239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0c442a2ec3a41bfa602949a1aeb1e1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6853aa2a-6a", "ovs_interfaceid": "6853aa2a-6a9e-471a-ade8-f29f1064c006", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:a0:20,bridge_name='br-int',has_traffic_filtering=True,id=6853aa2a-6a9e-471a-ade8-f29f1064c006,network=Network(30057e96-0f86-466d-bf3f-e3cf15d9e5af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6853aa2a-6a') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.objects.instance [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Lazy-loading 'pci_devices' on Instance uuid b6c46e8d-982f-4169-af80-96274a165b02 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:15:12 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 19:15:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] [instance: b6c46e8d-982f-4169-af80-96274a165b02] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:15:12 user nova-compute[75066]:   <uuid>b6c46e8d-982f-4169-af80-96274a165b02</uuid>
Dec 01 19:15:12 user nova-compute[75066]:   <name>instance-00000002</name>
Dec 01 19:15:12 user nova-compute[75066]:   <memory>524288</memory>
Dec 01 19:15:12 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:15:12 user nova-compute[75066]:   <metadata>
Dec 01 19:15:12 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:15:12 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:15:12 user nova-compute[75066]:       <nova:name>tempest-DeleteServersTestJSON-server-1490091229</nova:name>
Dec 01 19:15:12 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:15:12</nova:creationTime>
Dec 01 19:15:12 user nova-compute[75066]:       <nova:flavor name="m1.tiny">
Dec 01 19:15:12 user nova-compute[75066]:         <nova:memory>512</nova:memory>
Dec 01 19:15:12 user nova-compute[75066]:         <nova:disk>1</nova:disk>
Dec 01 19:15:12 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:15:12 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:15:12 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:15:12 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:15:12 user nova-compute[75066]:       <nova:owner>
Dec 01 19:15:12 user nova-compute[75066]:         <nova:user uuid="009206429ab7462c8ff29cb4c2bf7d09">tempest-DeleteServersTestJSON-88724826-project-member</nova:user>
Dec 01 19:15:12 user nova-compute[75066]:         <nova:project uuid="a0c442a2ec3a41bfa602949a1aeb1e1b">tempest-DeleteServersTestJSON-88724826</nova:project>
Dec 01 19:15:12 user nova-compute[75066]:       </nova:owner>
Dec 01 19:15:12 user nova-compute[75066]:       <nova:root type="image" uuid="900b237b-e99c-4fdd-a44f-dcb7a08baa86"/>
Dec 01 19:15:12 user nova-compute[75066]:       <nova:ports>
Dec 01 19:15:12 user nova-compute[75066]:         <nova:port uuid="6853aa2a-6a9e-471a-ade8-f29f1064c006">
Dec 01 19:15:12 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Dec 01 19:15:12 user nova-compute[75066]:         </nova:port>
Dec 01 19:15:12 user nova-compute[75066]:       </nova:ports>
Dec 01 19:15:12 user nova-compute[75066]:     </nova:instance>
Dec 01 19:15:12 user nova-compute[75066]:   </metadata>
Dec 01 19:15:12 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:15:12 user nova-compute[75066]:     <system>
Dec 01 19:15:12 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:15:12 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:15:12 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:15:12 user nova-compute[75066]:       <entry name="serial">b6c46e8d-982f-4169-af80-96274a165b02</entry>
Dec 01 19:15:12 user nova-compute[75066]:       <entry name="uuid">b6c46e8d-982f-4169-af80-96274a165b02</entry>
Dec 01 19:15:12 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:15:12 user nova-compute[75066]:     </system>
Dec 01 19:15:12 user nova-compute[75066]:   </sysinfo>
Dec 01 19:15:12 user nova-compute[75066]:   <os>
Dec 01 19:15:12 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:15:12 user nova-compute[75066]:     <boot dev="hd"/>
Dec 01 19:15:12 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:15:12 user nova-compute[75066]:   </os>
Dec 01 19:15:12 user nova-compute[75066]:   <features>
Dec 01 19:15:12 user nova-compute[75066]:     <acpi/>
Dec 01 19:15:12 user nova-compute[75066]:     <apic/>
Dec 01 19:15:12 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:15:12 user nova-compute[75066]:   </features>
Dec 01 19:15:12 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:15:12 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:15:12 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:15:12 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:15:12 user nova-compute[75066]:   </clock>
Dec 01 19:15:12 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:15:12 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:15:12 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:15:12 user nova-compute[75066]:   </cpu>
Dec 01 19:15:12 user nova-compute[75066]:   <devices>
Dec 01 19:15:12 user nova-compute[75066]:     <disk type="file" device="disk">
Dec 01 19:15:12 user nova-compute[75066]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 19:15:12 user nova-compute[75066]:       <source file="/opt/stack/data/nova/instances/b6c46e8d-982f-4169-af80-96274a165b02/disk"/>
Dec 01 19:15:12 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:15:12 user nova-compute[75066]:     </disk>
Dec 01 19:15:12 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:15:12 user nova-compute[75066]:       <mac address="fa:16:3e:0e:a0:20"/>
Dec 01 19:15:12 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:15:12 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:15:12 user nova-compute[75066]:       <target dev="tap6853aa2a-6a"/>
Dec 01 19:15:12 user nova-compute[75066]:     </interface>
Dec 01 19:15:12 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:15:12 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/b6c46e8d-982f-4169-af80-96274a165b02/console.log" append="off"/>
Dec 01 19:15:12 user nova-compute[75066]:     </serial>
Dec 01 19:15:12 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:15:12 user nova-compute[75066]:     <video>
Dec 01 19:15:12 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:15:12 user nova-compute[75066]:     </video>
Dec 01 19:15:12 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:15:12 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:15:12 user nova-compute[75066]:     </rng>
Dec 01 19:15:12 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:15:12 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:15:12 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:15:12 user nova-compute[75066]:     </memballoon>
Dec 01 19:15:12 user nova-compute[75066]:   </devices>
Dec 01 19:15:12 user nova-compute[75066]: </domain>
Dec 01 19:15:12 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:15:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1490091229',display_name='tempest-DeleteServersTestJSON-server-1490091229',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1490091229',id=2,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a0c442a2ec3a41bfa602949a1aeb1e1b',ramdisk_id='',reservation_id='r-0wwuhxqb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-88724826',owner_user_name='tempest-DeleteServersTestJSON-88724826-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:15:06Z,user_data=None,user_id='009206429ab7462c8ff29cb4c2bf7d09',uuid=b6c46e8d-982f-4169-af80-96274a165b02,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6853aa2a-6a9e-471a-ade8-f29f1064c006", "address": "fa:16:3e:0e:a0:20", "network": {"id": "30057e96-0f86-466d-bf3f-e3cf15d9e5af", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-383866239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0c442a2ec3a41bfa602949a1aeb1e1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6853aa2a-6a", "ovs_interfaceid": "6853aa2a-6a9e-471a-ade8-f29f1064c006", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Converting VIF {"id": "6853aa2a-6a9e-471a-ade8-f29f1064c006", "address": "fa:16:3e:0e:a0:20", "network": {"id": "30057e96-0f86-466d-bf3f-e3cf15d9e5af", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-383866239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0c442a2ec3a41bfa602949a1aeb1e1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6853aa2a-6a", "ovs_interfaceid": "6853aa2a-6a9e-471a-ade8-f29f1064c006", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:a0:20,bridge_name='br-int',has_traffic_filtering=True,id=6853aa2a-6a9e-471a-ade8-f29f1064c006,network=Network(30057e96-0f86-466d-bf3f-e3cf15d9e5af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6853aa2a-6a') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG os_vif [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:a0:20,bridge_name='br-int',has_traffic_filtering=True,id=6853aa2a-6a9e-471a-ade8-f29f1064c006,network=Network(30057e96-0f86-466d-bf3f-e3cf15d9e5af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6853aa2a-6a') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.compute.manager [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Start building block device mappings for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] [POLLIN] on fd 29 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] tcp:127.0.0.1:6640: entering BACKOFF {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] schema index <ovs.db.idl.IdlTable object at 0x7f91a0095600>.name already exists {{(pid=75066) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:102}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] schema index <ovs.db.idl.IdlTable object at 0x7f91a00a2fe0>.name already exists {{(pid=75066) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:102}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] schema index <ovs.db.idl.IdlTable object at 0x7f91a00a2470>.name already exists {{(pid=75066) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:102}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.network.neutron [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Successfully created port: 2698607a-e8b6-4da8-bfc7-90dc528ade6b {{(pid=75066) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3934077b-e4ef-5d30-ba0e-c1d7599fa34e', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:12 user nova-compute[75066]: INFO oslo.privsep.daemon [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmplugd7_hn/privsep.sock']
Dec 01 19:15:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f0f925b8-190e-51f9-9c06-e441ea5658c7', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:12 user sudo[84370]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmplugd7_hn/privsep.sock
Dec 01 19:15:12 user sudo[84370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.compute.manager [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Start spawning the instance on the hypervisor. {{(pid=75066) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Creating instance directory {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 19:15:12 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Creating image(s)
Dec 01 19:15:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Acquiring lock "/opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "/opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "/opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.policy [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2e047112719c414d900ccb2adccf963a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492e0b2da61e4e4f9ea991df15531e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75066) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.682s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG nova.compute.manager [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Start building networks asynchronously for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.184s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Acquiring lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:15:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:15:13 user nova-compute[75066]: DEBUG nova.compute.manager [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Allocating IP information in the background. {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 19:15:13 user nova-compute[75066]: DEBUG nova.network.neutron [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] allocate_for_instance() {{(pid=75066) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 19:15:13 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 19:15:13 user nova-compute[75066]: DEBUG nova.compute.manager [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Start building block device mappings for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 19:15:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.220s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:15:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk 1073741824 {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:15:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk 1073741824" returned: 0 in 0.049s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:15:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:15:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:15:13 user nova-compute[75066]: DEBUG nova.compute.manager [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Start spawning the instance on the hypervisor. {{(pid=75066) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 19:15:13 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Creating instance directory {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 19:15:13 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Creating image(s)
Dec 01 19:15:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Acquiring lock "/opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:15:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Lock "/opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:15:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Lock "/opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:15:13 user nova-compute[75066]: DEBUG nova.policy [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e363b559098f48d4bc5478c657d7de6a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2830de7697db4d5e8b9c358dab7f4368', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75066) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 19:15:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:15:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.200s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:15:13 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk. size=1073741824 {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 19:15:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:15:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.182s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:15:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Acquiring lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:15:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:15:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:15:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:15:13 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Cannot resize image /opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk to a smaller size. {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 19:15:13 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Created local disks {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 19:15:13 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Ensure instance console log exists: /opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/console.log {{(pid=75066) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 19:15:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:15:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:15:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:15:13 user nova-compute[75066]: DEBUG nova.compute.manager [req-7abfc791-b1f8-4b11-89f2-bc6573939523 req-157ab97b-77db-44d5-b750-f3d50bae7535 service nova] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Received event network-changed-73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:15:13 user nova-compute[75066]: DEBUG nova.compute.manager [req-7abfc791-b1f8-4b11-89f2-bc6573939523 req-157ab97b-77db-44d5-b750-f3d50bae7535 service nova] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Refreshing instance network info cache due to event network-changed-73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:15:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-7abfc791-b1f8-4b11-89f2-bc6573939523 req-157ab97b-77db-44d5-b750-f3d50bae7535 service nova] Acquiring lock "refresh_cache-67c5dd7c-88aa-4f2f-8f62-a9af0480c38e" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:15:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-7abfc791-b1f8-4b11-89f2-bc6573939523 req-157ab97b-77db-44d5-b750-f3d50bae7535 service nova] Acquired lock "refresh_cache-67c5dd7c-88aa-4f2f-8f62-a9af0480c38e" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:15:13 user nova-compute[75066]: DEBUG nova.network.neutron [req-7abfc791-b1f8-4b11-89f2-bc6573939523 req-157ab97b-77db-44d5-b750-f3d50bae7535 service nova] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Refreshing network info cache for port 73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:15:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.226s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:15:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489/disk 1073741824 {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:15:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489/disk 1073741824" returned: 0 in 0.063s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:15:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.294s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:15:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:15:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:13 user nova-compute[75066]: DEBUG nova.network.neutron [req-b33c57ae-0fe7-46ea-93be-00f7788c301c req-2637016a-f6f2-4ff4-8e2b-e97708dbd6da service nova] [instance: b6c46e8d-982f-4169-af80-96274a165b02] Updated VIF entry in instance network info cache for port 6853aa2a-6a9e-471a-ade8-f29f1064c006. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:15:13 user nova-compute[75066]: DEBUG nova.network.neutron [req-b33c57ae-0fe7-46ea-93be-00f7788c301c req-2637016a-f6f2-4ff4-8e2b-e97708dbd6da service nova] [instance: b6c46e8d-982f-4169-af80-96274a165b02] Updating instance_info_cache with network_info: [{"id": "6853aa2a-6a9e-471a-ade8-f29f1064c006", "address": "fa:16:3e:0e:a0:20", "network": {"id": "30057e96-0f86-466d-bf3f-e3cf15d9e5af", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-383866239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0c442a2ec3a41bfa602949a1aeb1e1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6853aa2a-6a", "ovs_interfaceid": "6853aa2a-6a9e-471a-ade8-f29f1064c006", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:15:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-b33c57ae-0fe7-46ea-93be-00f7788c301c req-2637016a-f6f2-4ff4-8e2b-e97708dbd6da service nova] Releasing lock "refresh_cache-b6c46e8d-982f-4169-af80-96274a165b02" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:15:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.225s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:15:14 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489/disk. size=1073741824 {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 19:15:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:15:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:15:14 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Cannot resize image /opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489/disk to a smaller size. {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 19:15:14 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Created local disks {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 19:15:14 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Ensure instance console log exists: /opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489/console.log {{(pid=75066) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 19:15:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:15:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:15:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:15:14 user sudo[84370]: pam_unix(sudo:session): session closed for user root
Dec 01 19:15:14 user nova-compute[75066]: INFO oslo.privsep.daemon [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Spawned new privsep daemon via rootwrap
Dec 01 19:15:14 user nova-compute[75066]: INFO oslo.privsep.daemon [-] privsep daemon starting
Dec 01 19:15:14 user nova-compute[75066]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Dec 01 19:15:14 user nova-compute[75066]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Dec 01 19:15:14 user nova-compute[75066]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84400
Dec 01 19:15:14 user nova-compute[75066]: WARNING oslo_privsep.priv_context [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] privsep daemon already running
Dec 01 19:15:14 user nova-compute[75066]: DEBUG nova.network.neutron [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Successfully updated port: 2698607a-e8b6-4da8-bfc7-90dc528ade6b {{(pid=75066) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 19:15:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Acquiring lock "refresh_cache-c223be70-8b9c-46d4-9b5a-3b83dfc05a17" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:15:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Acquired lock "refresh_cache-c223be70-8b9c-46d4-9b5a-3b83dfc05a17" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:15:14 user nova-compute[75066]: DEBUG nova.network.neutron [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:15:14 user nova-compute[75066]: DEBUG nova.network.neutron [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Successfully created port: c9353199-d4a3-488f-857d-b0ebdb31a68f {{(pid=75066) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 19:15:14 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:14 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:14 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap73bdff9a-3a, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:15:14 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap73bdff9a-3a, col_values=(('qos', UUID('56c9896f-4f04-4ebe-a87b-a5142661d271')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:15:14 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap73bdff9a-3a, col_values=(('external_ids', {'iface-id': '73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:73:a4', 'vm-uuid': '67c5dd7c-88aa-4f2f-8f62-a9af0480c38e'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:15:14 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:14 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:15:14 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:14 user nova-compute[75066]: INFO os_vif [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:73:a4,bridge_name='br-int',has_traffic_filtering=True,id=73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2,network=Network(fdb3c017-aafb-4c3e-a08c-a73a68be9f70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73bdff9a-3a')
Dec 01 19:15:14 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:14 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6853aa2a-6a, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:15:14 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6853aa2a-6a, col_values=(('qos', UUID('2b96b96a-e0f5-46ae-b29d-b88098b70c15')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:15:14 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6853aa2a-6a, col_values=(('external_ids', {'iface-id': '6853aa2a-6a9e-471a-ade8-f29f1064c006', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:a0:20', 'vm-uuid': 'b6c46e8d-982f-4169-af80-96274a165b02'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:15:14 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:14 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:15:14 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:14 user nova-compute[75066]: INFO os_vif [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:a0:20,bridge_name='br-int',has_traffic_filtering=True,id=6853aa2a-6a9e-471a-ade8-f29f1064c006,network=Network(30057e96-0f86-466d-bf3f-e3cf15d9e5af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6853aa2a-6a')
Dec 01 19:15:14 user nova-compute[75066]: DEBUG nova.network.neutron [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:15:14 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:15:14 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] No VIF found with MAC fa:16:3e:5a:73:a4, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:15:14 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:15:14 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] No VIF found with MAC fa:16:3e:0e:a0:20, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:15:15 user nova-compute[75066]: DEBUG nova.compute.manager [req-dda3203f-b5d8-4df6-9c98-65ff810e6b3a req-c42b5baf-84b9-473a-87a9-184d808aa692 service nova] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Received event network-changed-2698607a-e8b6-4da8-bfc7-90dc528ade6b {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:15:15 user nova-compute[75066]: DEBUG nova.compute.manager [req-dda3203f-b5d8-4df6-9c98-65ff810e6b3a req-c42b5baf-84b9-473a-87a9-184d808aa692 service nova] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Refreshing instance network info cache due to event network-changed-2698607a-e8b6-4da8-bfc7-90dc528ade6b. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:15:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-dda3203f-b5d8-4df6-9c98-65ff810e6b3a req-c42b5baf-84b9-473a-87a9-184d808aa692 service nova] Acquiring lock "refresh_cache-c223be70-8b9c-46d4-9b5a-3b83dfc05a17" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:15:15 user nova-compute[75066]: DEBUG nova.network.neutron [req-7abfc791-b1f8-4b11-89f2-bc6573939523 req-157ab97b-77db-44d5-b750-f3d50bae7535 service nova] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Updated VIF entry in instance network info cache for port 73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:15:15 user nova-compute[75066]: DEBUG nova.network.neutron [req-7abfc791-b1f8-4b11-89f2-bc6573939523 req-157ab97b-77db-44d5-b750-f3d50bae7535 service nova] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Updating instance_info_cache with network_info: [{"id": "73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2", "address": "fa:16:3e:5a:73:a4", "network": {"id": "fdb3c017-aafb-4c3e-a08c-a73a68be9f70", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1696445417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "306d3049e90647fa9f1c90a104eac0e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bdff9a-3a", "ovs_interfaceid": "73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:15:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-7abfc791-b1f8-4b11-89f2-bc6573939523 req-157ab97b-77db-44d5-b750-f3d50bae7535 service nova] Releasing lock "refresh_cache-67c5dd7c-88aa-4f2f-8f62-a9af0480c38e" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:15:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:15 user nova-compute[75066]: DEBUG nova.network.neutron [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Updating instance_info_cache with network_info: [{"id": "2698607a-e8b6-4da8-bfc7-90dc528ade6b", "address": "fa:16:3e:52:d6:e9", "network": {"id": "9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-696310557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0f7516d1db4dd5bc7d77a0bd1d44d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2698607a-e8", "ovs_interfaceid": "2698607a-e8b6-4da8-bfc7-90dc528ade6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:15:16 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Releasing lock "refresh_cache-c223be70-8b9c-46d4-9b5a-3b83dfc05a17" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:15:16 user nova-compute[75066]: DEBUG nova.compute.manager [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Instance network_info: |[{"id": "2698607a-e8b6-4da8-bfc7-90dc528ade6b", "address": "fa:16:3e:52:d6:e9", "network": {"id": "9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-696310557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0f7516d1db4dd5bc7d77a0bd1d44d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2698607a-e8", "ovs_interfaceid": "2698607a-e8b6-4da8-bfc7-90dc528ade6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 19:15:16 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-dda3203f-b5d8-4df6-9c98-65ff810e6b3a req-c42b5baf-84b9-473a-87a9-184d808aa692 service nova] Acquired lock "refresh_cache-c223be70-8b9c-46d4-9b5a-3b83dfc05a17" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:15:16 user nova-compute[75066]: DEBUG nova.network.neutron [req-dda3203f-b5d8-4df6-9c98-65ff810e6b3a req-c42b5baf-84b9-473a-87a9-184d808aa692 service nova] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Refreshing network info cache for port 2698607a-e8b6-4da8-bfc7-90dc528ade6b {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:15:16 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Start _get_guest_xml network_info=[{"id": "2698607a-e8b6-4da8-bfc7-90dc528ade6b", "address": "fa:16:3e:52:d6:e9", "network": {"id": "9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-696310557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0f7516d1db4dd5bc7d77a0bd1d44d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2698607a-e8", "ovs_interfaceid": "2698607a-e8b6-4da8-bfc7-90dc528ade6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'image_id': '900b237b-e99c-4fdd-a44f-dcb7a08baa86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:15:16 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:15:16 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:15:16 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:15:16 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:15:16 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:15:16 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:15:16 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:15:16 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:15:16 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:15:16 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:15:16 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:15:16 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:15:16 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:15:16 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:15:16 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:15:16 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:15:16 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:15:16 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:15:16 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:15:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1950181567',display_name='tempest-ServerActionsTestOtherA-server-1950181567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1950181567',id=3,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAjcDJi5RJTCazFFAj7dx2qLuKSEoyASrqNDKgiQGRQPewzJhIu6lQd3yuH2207H2lpqZiyuqBj2lXvz5vQM52pZXpO90p/UH43nVMO2RrMH5S7NUl16+at0nkGQGj24ng==',key_name='tempest-keypair-1092575275',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb0f7516d1db4dd5bc7d77a0bd1d44d7',ramdisk_id='',reservation_id='r-en4ny5yt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1700253921',owner_user_name='tempest-ServerActionsTestOtherA-1700253921-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:15:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfb3e7b4b0444223af282b16da9bd919',uuid=c223be70-8b9c-46d4-9b5a-3b83dfc05a17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2698607a-e8b6-4da8-bfc7-90dc528ade6b", "address": "fa:16:3e:52:d6:e9", "network": {"id": "9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-696310557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0f7516d1db4dd5bc7d77a0bd1d44d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2698607a-e8", "ovs_interfaceid": "2698607a-e8b6-4da8-bfc7-90dc528ade6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:15:16 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Converting VIF {"id": "2698607a-e8b6-4da8-bfc7-90dc528ade6b", "address": "fa:16:3e:52:d6:e9", "network": {"id": "9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-696310557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0f7516d1db4dd5bc7d77a0bd1d44d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2698607a-e8", "ovs_interfaceid": "2698607a-e8b6-4da8-bfc7-90dc528ade6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:15:16 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:d6:e9,bridge_name='br-int',has_traffic_filtering=True,id=2698607a-e8b6-4da8-bfc7-90dc528ade6b,network=Network(9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2698607a-e8') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:15:16 user nova-compute[75066]: DEBUG nova.objects.instance [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lazy-loading 'pci_devices' on Instance uuid c223be70-8b9c-46d4-9b5a-3b83dfc05a17 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:15:16 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:15:16 user nova-compute[75066]:   <uuid>c223be70-8b9c-46d4-9b5a-3b83dfc05a17</uuid>
Dec 01 19:15:16 user nova-compute[75066]:   <name>instance-00000003</name>
Dec 01 19:15:16 user nova-compute[75066]:   <memory>524288</memory>
Dec 01 19:15:16 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:15:16 user nova-compute[75066]:   <metadata>
Dec 01 19:15:16 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:15:16 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:15:16 user nova-compute[75066]:       <nova:name>tempest-ServerActionsTestOtherA-server-1950181567</nova:name>
Dec 01 19:15:16 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:15:16</nova:creationTime>
Dec 01 19:15:16 user nova-compute[75066]:       <nova:flavor name="m1.tiny">
Dec 01 19:15:16 user nova-compute[75066]:         <nova:memory>512</nova:memory>
Dec 01 19:15:16 user nova-compute[75066]:         <nova:disk>1</nova:disk>
Dec 01 19:15:16 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:15:16 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:15:16 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:15:16 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:15:16 user nova-compute[75066]:       <nova:owner>
Dec 01 19:15:16 user nova-compute[75066]:         <nova:user uuid="cfb3e7b4b0444223af282b16da9bd919">tempest-ServerActionsTestOtherA-1700253921-project-member</nova:user>
Dec 01 19:15:16 user nova-compute[75066]:         <nova:project uuid="fb0f7516d1db4dd5bc7d77a0bd1d44d7">tempest-ServerActionsTestOtherA-1700253921</nova:project>
Dec 01 19:15:16 user nova-compute[75066]:       </nova:owner>
Dec 01 19:15:16 user nova-compute[75066]:       <nova:root type="image" uuid="900b237b-e99c-4fdd-a44f-dcb7a08baa86"/>
Dec 01 19:15:16 user nova-compute[75066]:       <nova:ports>
Dec 01 19:15:16 user nova-compute[75066]:         <nova:port uuid="2698607a-e8b6-4da8-bfc7-90dc528ade6b">
Dec 01 19:15:16 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Dec 01 19:15:16 user nova-compute[75066]:         </nova:port>
Dec 01 19:15:16 user nova-compute[75066]:       </nova:ports>
Dec 01 19:15:16 user nova-compute[75066]:     </nova:instance>
Dec 01 19:15:16 user nova-compute[75066]:   </metadata>
Dec 01 19:15:16 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:15:16 user nova-compute[75066]:     <system>
Dec 01 19:15:16 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:15:16 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:15:16 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:15:16 user nova-compute[75066]:       <entry name="serial">c223be70-8b9c-46d4-9b5a-3b83dfc05a17</entry>
Dec 01 19:15:16 user nova-compute[75066]:       <entry name="uuid">c223be70-8b9c-46d4-9b5a-3b83dfc05a17</entry>
Dec 01 19:15:16 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:15:16 user nova-compute[75066]:     </system>
Dec 01 19:15:16 user nova-compute[75066]:   </sysinfo>
Dec 01 19:15:16 user nova-compute[75066]:   <os>
Dec 01 19:15:16 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:15:16 user nova-compute[75066]:     <boot dev="hd"/>
Dec 01 19:15:16 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:15:16 user nova-compute[75066]:   </os>
Dec 01 19:15:16 user nova-compute[75066]:   <features>
Dec 01 19:15:16 user nova-compute[75066]:     <acpi/>
Dec 01 19:15:16 user nova-compute[75066]:     <apic/>
Dec 01 19:15:16 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:15:16 user nova-compute[75066]:   </features>
Dec 01 19:15:16 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:15:16 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:15:16 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:15:16 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:15:16 user nova-compute[75066]:   </clock>
Dec 01 19:15:16 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:15:16 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:15:16 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:15:16 user nova-compute[75066]:   </cpu>
Dec 01 19:15:16 user nova-compute[75066]:   <devices>
Dec 01 19:15:16 user nova-compute[75066]:     <disk type="file" device="disk">
Dec 01 19:15:16 user nova-compute[75066]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 19:15:16 user nova-compute[75066]:       <source file="/opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk"/>
Dec 01 19:15:16 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:15:16 user nova-compute[75066]:     </disk>
Dec 01 19:15:16 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:15:16 user nova-compute[75066]:       <mac address="fa:16:3e:52:d6:e9"/>
Dec 01 19:15:16 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:15:16 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:15:16 user nova-compute[75066]:       <target dev="tap2698607a-e8"/>
Dec 01 19:15:16 user nova-compute[75066]:     </interface>
Dec 01 19:15:16 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:15:16 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/console.log" append="off"/>
Dec 01 19:15:16 user nova-compute[75066]:     </serial>
Dec 01 19:15:16 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:15:16 user nova-compute[75066]:     <video>
Dec 01 19:15:16 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:15:16 user nova-compute[75066]:     </video>
Dec 01 19:15:16 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:15:16 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:15:16 user nova-compute[75066]:     </rng>
Dec 01 19:15:16 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:15:16 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:15:16 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:15:16 user nova-compute[75066]:     </memballoon>
Dec 01 19:15:16 user nova-compute[75066]:   </devices>
Dec 01 19:15:16 user nova-compute[75066]: </domain>
Dec 01 19:15:16 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:15:16 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:15:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1950181567',display_name='tempest-ServerActionsTestOtherA-server-1950181567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1950181567',id=3,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAjcDJi5RJTCazFFAj7dx2qLuKSEoyASrqNDKgiQGRQPewzJhIu6lQd3yuH2207H2lpqZiyuqBj2lXvz5vQM52pZXpO90p/UH43nVMO2RrMH5S7NUl16+at0nkGQGj24ng==',key_name='tempest-keypair-1092575275',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb0f7516d1db4dd5bc7d77a0bd1d44d7',ramdisk_id='',reservation_id='r-en4ny5yt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1700253921',owner_user_name='tempest-ServerActionsTestOtherA-1700253921-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:15:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfb3e7b4b0444223af282b16da9bd919',uuid=c223be70-8b9c-46d4-9b5a-3b83dfc05a17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2698607a-e8b6-4da8-bfc7-90dc528ade6b", "address": "fa:16:3e:52:d6:e9", "network": {"id": "9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-696310557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0f7516d1db4dd5bc7d77a0bd1d44d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2698607a-e8", "ovs_interfaceid": "2698607a-e8b6-4da8-bfc7-90dc528ade6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:15:16 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Converting VIF {"id": "2698607a-e8b6-4da8-bfc7-90dc528ade6b", "address": "fa:16:3e:52:d6:e9", "network": {"id": "9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-696310557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0f7516d1db4dd5bc7d77a0bd1d44d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2698607a-e8", "ovs_interfaceid": "2698607a-e8b6-4da8-bfc7-90dc528ade6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:15:16 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:d6:e9,bridge_name='br-int',has_traffic_filtering=True,id=2698607a-e8b6-4da8-bfc7-90dc528ade6b,network=Network(9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2698607a-e8') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:15:16 user nova-compute[75066]: DEBUG os_vif [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:d6:e9,bridge_name='br-int',has_traffic_filtering=True,id=2698607a-e8b6-4da8-bfc7-90dc528ade6b,network=Network(9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2698607a-e8') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:15:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:15:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:15:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4627d919-ea2e-5bf4-9d7e-714104363945', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:15:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:15:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2698607a-e8, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:15:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2698607a-e8, col_values=(('qos', UUID('db091d4f-0d42-4a01-9539-99b1728ca6c4')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:15:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2698607a-e8, col_values=(('external_ids', {'iface-id': '2698607a-e8b6-4da8-bfc7-90dc528ade6b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:d6:e9', 'vm-uuid': 'c223be70-8b9c-46d4-9b5a-3b83dfc05a17'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:15:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:15:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:16 user nova-compute[75066]: INFO os_vif [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:d6:e9,bridge_name='br-int',has_traffic_filtering=True,id=2698607a-e8b6-4da8-bfc7-90dc528ade6b,network=Network(9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2698607a-e8')
Dec 01 19:15:16 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:15:16 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] No VIF found with MAC fa:16:3e:52:d6:e9, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:15:16 user nova-compute[75066]: DEBUG nova.network.neutron [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Successfully created port: 478e7aea-9546-4659-bdac-09213bd9cb82 {{(pid=75066) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 19:15:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:16 user nova-compute[75066]: DEBUG nova.network.neutron [req-dda3203f-b5d8-4df6-9c98-65ff810e6b3a req-c42b5baf-84b9-473a-87a9-184d808aa692 service nova] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Updated VIF entry in instance network info cache for port 2698607a-e8b6-4da8-bfc7-90dc528ade6b. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:15:16 user nova-compute[75066]: DEBUG nova.network.neutron [req-dda3203f-b5d8-4df6-9c98-65ff810e6b3a req-c42b5baf-84b9-473a-87a9-184d808aa692 service nova] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Updating instance_info_cache with network_info: [{"id": "2698607a-e8b6-4da8-bfc7-90dc528ade6b", "address": "fa:16:3e:52:d6:e9", "network": {"id": "9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-696310557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0f7516d1db4dd5bc7d77a0bd1d44d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2698607a-e8", "ovs_interfaceid": "2698607a-e8b6-4da8-bfc7-90dc528ade6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:15:16 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-dda3203f-b5d8-4df6-9c98-65ff810e6b3a req-c42b5baf-84b9-473a-87a9-184d808aa692 service nova] Releasing lock "refresh_cache-c223be70-8b9c-46d4-9b5a-3b83dfc05a17" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:15:17 user nova-compute[75066]: DEBUG nova.network.neutron [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Successfully updated port: c9353199-d4a3-488f-857d-b0ebdb31a68f {{(pid=75066) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 19:15:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Acquiring lock "refresh_cache-c3ceeca4-c16c-4cf5-adfd-7d5a2925f435" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:15:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Acquired lock "refresh_cache-c3ceeca4-c16c-4cf5-adfd-7d5a2925f435" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:15:17 user nova-compute[75066]: DEBUG nova.network.neutron [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:15:17 user nova-compute[75066]: DEBUG nova.compute.manager [req-a9a7da8a-d8e6-495b-b748-aec60ddfaaf7 req-9609a29a-b6e7-4205-9f1d-6850a6137207 service nova] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Received event network-changed-c9353199-d4a3-488f-857d-b0ebdb31a68f {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:15:17 user nova-compute[75066]: DEBUG nova.compute.manager [req-a9a7da8a-d8e6-495b-b748-aec60ddfaaf7 req-9609a29a-b6e7-4205-9f1d-6850a6137207 service nova] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Refreshing instance network info cache due to event network-changed-c9353199-d4a3-488f-857d-b0ebdb31a68f. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:15:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a9a7da8a-d8e6-495b-b748-aec60ddfaaf7 req-9609a29a-b6e7-4205-9f1d-6850a6137207 service nova] Acquiring lock "refresh_cache-c3ceeca4-c16c-4cf5-adfd-7d5a2925f435" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:15:17 user nova-compute[75066]: DEBUG nova.network.neutron [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:15:18 user nova-compute[75066]: DEBUG nova.network.neutron [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Updating instance_info_cache with network_info: [{"id": "c9353199-d4a3-488f-857d-b0ebdb31a68f", "address": "fa:16:3e:d4:7c:91", "network": {"id": "4a6c6c26-4d29-486c-b11e-fc53769083ea", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1139388453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "492e0b2da61e4e4f9ea991df15531e24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9353199-d4", "ovs_interfaceid": "c9353199-d4a3-488f-857d-b0ebdb31a68f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:15:18 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Releasing lock "refresh_cache-c3ceeca4-c16c-4cf5-adfd-7d5a2925f435" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:15:18 user nova-compute[75066]: DEBUG nova.compute.manager [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Instance network_info: |[{"id": "c9353199-d4a3-488f-857d-b0ebdb31a68f", "address": "fa:16:3e:d4:7c:91", "network": {"id": "4a6c6c26-4d29-486c-b11e-fc53769083ea", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1139388453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "492e0b2da61e4e4f9ea991df15531e24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9353199-d4", "ovs_interfaceid": "c9353199-d4a3-488f-857d-b0ebdb31a68f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 19:15:18 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a9a7da8a-d8e6-495b-b748-aec60ddfaaf7 req-9609a29a-b6e7-4205-9f1d-6850a6137207 service nova] Acquired lock "refresh_cache-c3ceeca4-c16c-4cf5-adfd-7d5a2925f435" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:15:18 user nova-compute[75066]: DEBUG nova.network.neutron [req-a9a7da8a-d8e6-495b-b748-aec60ddfaaf7 req-9609a29a-b6e7-4205-9f1d-6850a6137207 service nova] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Refreshing network info cache for port c9353199-d4a3-488f-857d-b0ebdb31a68f {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:15:18 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Start _get_guest_xml network_info=[{"id": "c9353199-d4a3-488f-857d-b0ebdb31a68f", "address": "fa:16:3e:d4:7c:91", "network": {"id": "4a6c6c26-4d29-486c-b11e-fc53769083ea", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1139388453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "492e0b2da61e4e4f9ea991df15531e24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9353199-d4", "ovs_interfaceid": "c9353199-d4a3-488f-857d-b0ebdb31a68f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'image_id': '900b237b-e99c-4fdd-a44f-dcb7a08baa86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:15:18 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:15:18 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:15:18 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:15:18 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:15:18 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:15:18 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:15:18 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:15:18 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:15:18 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:15:18 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:15:18 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:15:18 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:15:18 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:15:18 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:15:18 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:15:18 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:15:18 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:15:18 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:15:18 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:15:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-24114443',display_name='tempest-AttachVolumeTestJSON-server-24114443',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-24114443',id=4,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGLScdrbjNBUKzk1xw2/kR+RAsIU9zFWMcYM+4wt8kIDoD28bEQj/IZzhB52jLd7ItVSKAdt9hCSnaKdaqoB8QmfEIsszcxk4SoK4okQhg235yQ27ClCZrLdhVk+g2LNPw==',key_name='tempest-keypair-1548189004',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='492e0b2da61e4e4f9ea991df15531e24',ramdisk_id='',reservation_id='r-f8zkyh7r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1914192398',owner_user_name='tempest-AttachVolumeTestJSON-1914192398-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:15:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e047112719c414d900ccb2adccf963a',uuid=c3ceeca4-c16c-4cf5-adfd-7d5a2925f435,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9353199-d4a3-488f-857d-b0ebdb31a68f", "address": "fa:16:3e:d4:7c:91", "network": {"id": "4a6c6c26-4d29-486c-b11e-fc53769083ea", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1139388453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "492e0b2da61e4e4f9ea991df15531e24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9353199-d4", "ovs_interfaceid": "c9353199-d4a3-488f-857d-b0ebdb31a68f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:15:18 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Converting VIF {"id": "c9353199-d4a3-488f-857d-b0ebdb31a68f", "address": "fa:16:3e:d4:7c:91", "network": {"id": "4a6c6c26-4d29-486c-b11e-fc53769083ea", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1139388453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "492e0b2da61e4e4f9ea991df15531e24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9353199-d4", "ovs_interfaceid": "c9353199-d4a3-488f-857d-b0ebdb31a68f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:15:18 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:7c:91,bridge_name='br-int',has_traffic_filtering=True,id=c9353199-d4a3-488f-857d-b0ebdb31a68f,network=Network(4a6c6c26-4d29-486c-b11e-fc53769083ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9353199-d4') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:15:18 user nova-compute[75066]: DEBUG nova.objects.instance [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lazy-loading 'pci_devices' on Instance uuid c3ceeca4-c16c-4cf5-adfd-7d5a2925f435 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:15:18 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:15:18 user nova-compute[75066]:   <uuid>c3ceeca4-c16c-4cf5-adfd-7d5a2925f435</uuid>
Dec 01 19:15:18 user nova-compute[75066]:   <name>instance-00000004</name>
Dec 01 19:15:18 user nova-compute[75066]:   <memory>524288</memory>
Dec 01 19:15:18 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:15:18 user nova-compute[75066]:   <metadata>
Dec 01 19:15:18 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:15:18 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:15:18 user nova-compute[75066]:       <nova:name>tempest-AttachVolumeTestJSON-server-24114443</nova:name>
Dec 01 19:15:18 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:15:18</nova:creationTime>
Dec 01 19:15:18 user nova-compute[75066]:       <nova:flavor name="m1.tiny">
Dec 01 19:15:18 user nova-compute[75066]:         <nova:memory>512</nova:memory>
Dec 01 19:15:18 user nova-compute[75066]:         <nova:disk>1</nova:disk>
Dec 01 19:15:18 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:15:18 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:15:18 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:15:18 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:15:18 user nova-compute[75066]:       <nova:owner>
Dec 01 19:15:18 user nova-compute[75066]:         <nova:user uuid="2e047112719c414d900ccb2adccf963a">tempest-AttachVolumeTestJSON-1914192398-project-member</nova:user>
Dec 01 19:15:18 user nova-compute[75066]:         <nova:project uuid="492e0b2da61e4e4f9ea991df15531e24">tempest-AttachVolumeTestJSON-1914192398</nova:project>
Dec 01 19:15:18 user nova-compute[75066]:       </nova:owner>
Dec 01 19:15:18 user nova-compute[75066]:       <nova:root type="image" uuid="900b237b-e99c-4fdd-a44f-dcb7a08baa86"/>
Dec 01 19:15:18 user nova-compute[75066]:       <nova:ports>
Dec 01 19:15:18 user nova-compute[75066]:         <nova:port uuid="c9353199-d4a3-488f-857d-b0ebdb31a68f">
Dec 01 19:15:18 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 01 19:15:18 user nova-compute[75066]:         </nova:port>
Dec 01 19:15:18 user nova-compute[75066]:       </nova:ports>
Dec 01 19:15:18 user nova-compute[75066]:     </nova:instance>
Dec 01 19:15:18 user nova-compute[75066]:   </metadata>
Dec 01 19:15:18 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:15:18 user nova-compute[75066]:     <system>
Dec 01 19:15:18 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:15:18 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:15:18 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:15:18 user nova-compute[75066]:       <entry name="serial">c3ceeca4-c16c-4cf5-adfd-7d5a2925f435</entry>
Dec 01 19:15:18 user nova-compute[75066]:       <entry name="uuid">c3ceeca4-c16c-4cf5-adfd-7d5a2925f435</entry>
Dec 01 19:15:18 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:15:18 user nova-compute[75066]:     </system>
Dec 01 19:15:18 user nova-compute[75066]:   </sysinfo>
Dec 01 19:15:18 user nova-compute[75066]:   <os>
Dec 01 19:15:18 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:15:18 user nova-compute[75066]:     <boot dev="hd"/>
Dec 01 19:15:18 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:15:18 user nova-compute[75066]:   </os>
Dec 01 19:15:18 user nova-compute[75066]:   <features>
Dec 01 19:15:18 user nova-compute[75066]:     <acpi/>
Dec 01 19:15:18 user nova-compute[75066]:     <apic/>
Dec 01 19:15:18 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:15:18 user nova-compute[75066]:   </features>
Dec 01 19:15:18 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:15:18 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:15:18 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:15:18 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:15:18 user nova-compute[75066]:   </clock>
Dec 01 19:15:18 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:15:18 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:15:18 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:15:18 user nova-compute[75066]:   </cpu>
Dec 01 19:15:18 user nova-compute[75066]:   <devices>
Dec 01 19:15:18 user nova-compute[75066]:     <disk type="file" device="disk">
Dec 01 19:15:18 user nova-compute[75066]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 19:15:18 user nova-compute[75066]:       <source file="/opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk"/>
Dec 01 19:15:18 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:15:18 user nova-compute[75066]:     </disk>
Dec 01 19:15:18 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:15:18 user nova-compute[75066]:       <mac address="fa:16:3e:d4:7c:91"/>
Dec 01 19:15:18 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:15:18 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:15:18 user nova-compute[75066]:       <target dev="tapc9353199-d4"/>
Dec 01 19:15:18 user nova-compute[75066]:     </interface>
Dec 01 19:15:18 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:15:18 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/console.log" append="off"/>
Dec 01 19:15:18 user nova-compute[75066]:     </serial>
Dec 01 19:15:18 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:15:18 user nova-compute[75066]:     <video>
Dec 01 19:15:18 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:15:18 user nova-compute[75066]:     </video>
Dec 01 19:15:18 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:15:18 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:15:18 user nova-compute[75066]:     </rng>
Dec 01 19:15:18 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:15:18 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:15:18 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:15:18 user nova-compute[75066]:     </memballoon>
Dec 01 19:15:18 user nova-compute[75066]:   </devices>
Dec 01 19:15:18 user nova-compute[75066]: </domain>
Dec 01 19:15:18 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:15:18 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:15:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-24114443',display_name='tempest-AttachVolumeTestJSON-server-24114443',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-24114443',id=4,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGLScdrbjNBUKzk1xw2/kR+RAsIU9zFWMcYM+4wt8kIDoD28bEQj/IZzhB52jLd7ItVSKAdt9hCSnaKdaqoB8QmfEIsszcxk4SoK4okQhg235yQ27ClCZrLdhVk+g2LNPw==',key_name='tempest-keypair-1548189004',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='492e0b2da61e4e4f9ea991df15531e24',ramdisk_id='',reservation_id='r-f8zkyh7r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1914192398',owner_user_name='tempest-AttachVolumeTestJSON-1914192398-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:15:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e047112719c414d900ccb2adccf963a',uuid=c3ceeca4-c16c-4cf5-adfd-7d5a2925f435,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9353199-d4a3-488f-857d-b0ebdb31a68f", "address": "fa:16:3e:d4:7c:91", "network": {"id": "4a6c6c26-4d29-486c-b11e-fc53769083ea", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1139388453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "492e0b2da61e4e4f9ea991df15531e24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9353199-d4", "ovs_interfaceid": "c9353199-d4a3-488f-857d-b0ebdb31a68f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:15:18 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Converting VIF {"id": "c9353199-d4a3-488f-857d-b0ebdb31a68f", "address": "fa:16:3e:d4:7c:91", "network": {"id": "4a6c6c26-4d29-486c-b11e-fc53769083ea", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1139388453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "492e0b2da61e4e4f9ea991df15531e24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9353199-d4", "ovs_interfaceid": "c9353199-d4a3-488f-857d-b0ebdb31a68f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:15:18 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:7c:91,bridge_name='br-int',has_traffic_filtering=True,id=c9353199-d4a3-488f-857d-b0ebdb31a68f,network=Network(4a6c6c26-4d29-486c-b11e-fc53769083ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9353199-d4') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:15:18 user nova-compute[75066]: DEBUG os_vif [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:7c:91,bridge_name='br-int',has_traffic_filtering=True,id=c9353199-d4a3-488f-857d-b0ebdb31a68f,network=Network(4a6c6c26-4d29-486c-b11e-fc53769083ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9353199-d4') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:15:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:15:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:15:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0408b5d0-0c90-551f-96b6-b0660c946d93', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:15:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:15:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc9353199-d4, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:15:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc9353199-d4, col_values=(('qos', UUID('a1b1b3bf-fa8c-4a78-bdea-2a52c55c759a')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:15:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc9353199-d4, col_values=(('external_ids', {'iface-id': 'c9353199-d4a3-488f-857d-b0ebdb31a68f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:7c:91', 'vm-uuid': 'c3ceeca4-c16c-4cf5-adfd-7d5a2925f435'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:15:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:15:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:18 user nova-compute[75066]: INFO os_vif [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:7c:91,bridge_name='br-int',has_traffic_filtering=True,id=c9353199-d4a3-488f-857d-b0ebdb31a68f,network=Network(4a6c6c26-4d29-486c-b11e-fc53769083ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9353199-d4')
Dec 01 19:15:18 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:15:18 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] No VIF found with MAC fa:16:3e:d4:7c:91, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:15:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:18 user nova-compute[75066]: DEBUG nova.network.neutron [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Successfully updated port: 478e7aea-9546-4659-bdac-09213bd9cb82 {{(pid=75066) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 19:15:18 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Acquiring lock "refresh_cache-dd546862-fcd5-4b69-8ea3-a8fa4859a489" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:15:18 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Acquired lock "refresh_cache-dd546862-fcd5-4b69-8ea3-a8fa4859a489" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:15:18 user nova-compute[75066]: DEBUG nova.network.neutron [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:15:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:18 user nova-compute[75066]: DEBUG nova.network.neutron [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:15:19 user nova-compute[75066]: DEBUG nova.network.neutron [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Updating instance_info_cache with network_info: [{"id": "478e7aea-9546-4659-bdac-09213bd9cb82", "address": "fa:16:3e:9a:26:f6", "network": {"id": "d182d3d1-113a-4bf5-b325-f073247f0547", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-325272674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2830de7697db4d5e8b9c358dab7f4368", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap478e7aea-95", "ovs_interfaceid": "478e7aea-9546-4659-bdac-09213bd9cb82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:15:19 user nova-compute[75066]: DEBUG nova.compute.manager [req-f691a49b-0f51-4488-a0e9-844a2cfd0c63 req-32dc019a-d67c-4637-92ab-2c2655c76e21 service nova] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Received event network-changed-478e7aea-9546-4659-bdac-09213bd9cb82 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:15:19 user nova-compute[75066]: DEBUG nova.compute.manager [req-f691a49b-0f51-4488-a0e9-844a2cfd0c63 req-32dc019a-d67c-4637-92ab-2c2655c76e21 service nova] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Refreshing instance network info cache due to event network-changed-478e7aea-9546-4659-bdac-09213bd9cb82. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:15:19 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-f691a49b-0f51-4488-a0e9-844a2cfd0c63 req-32dc019a-d67c-4637-92ab-2c2655c76e21 service nova] Acquiring lock "refresh_cache-dd546862-fcd5-4b69-8ea3-a8fa4859a489" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:15:19 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Releasing lock "refresh_cache-dd546862-fcd5-4b69-8ea3-a8fa4859a489" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:15:19 user nova-compute[75066]: DEBUG nova.compute.manager [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Instance network_info: |[{"id": "478e7aea-9546-4659-bdac-09213bd9cb82", "address": "fa:16:3e:9a:26:f6", "network": {"id": "d182d3d1-113a-4bf5-b325-f073247f0547", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-325272674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2830de7697db4d5e8b9c358dab7f4368", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap478e7aea-95", "ovs_interfaceid": "478e7aea-9546-4659-bdac-09213bd9cb82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 19:15:19 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-f691a49b-0f51-4488-a0e9-844a2cfd0c63 req-32dc019a-d67c-4637-92ab-2c2655c76e21 service nova] Acquired lock "refresh_cache-dd546862-fcd5-4b69-8ea3-a8fa4859a489" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:15:19 user nova-compute[75066]: DEBUG nova.network.neutron [req-f691a49b-0f51-4488-a0e9-844a2cfd0c63 req-32dc019a-d67c-4637-92ab-2c2655c76e21 service nova] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Refreshing network info cache for port 478e7aea-9546-4659-bdac-09213bd9cb82 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:15:19 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Start _get_guest_xml network_info=[{"id": "478e7aea-9546-4659-bdac-09213bd9cb82", "address": "fa:16:3e:9a:26:f6", "network": {"id": "d182d3d1-113a-4bf5-b325-f073247f0547", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-325272674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2830de7697db4d5e8b9c358dab7f4368", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap478e7aea-95", "ovs_interfaceid": "478e7aea-9546-4659-bdac-09213bd9cb82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'image_id': '900b237b-e99c-4fdd-a44f-dcb7a08baa86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:15:19 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:15:19 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:15:19 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:15:19 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:15:19 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:15:19 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:15:19 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:15:19 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:15:19 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:15:19 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:15:19 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:15:19 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:15:19 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:15:19 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:15:19 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:15:19 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:15:19 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:15:19 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:15:19 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:15:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-360735581',display_name='tempest-ServerActionsTestOtherB-server-360735581',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-360735581',id=5,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOGqD/77ZPXT6+uFjy9YkzZfO6BpJHbV+zzx/mIYY08bckUat50Cdx1l30v4s1jcybtm106xn+eO4W484wI5lg1LoXDJHliGvHVijdeGBF2TMVA7/KP/EGT4mweXKritFQ==',key_name='tempest-keypair-842148615',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2830de7697db4d5e8b9c358dab7f4368',ramdisk_id='',reservation_id='r-tl7vmif9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-2122210178',owner_user_name='tempest-ServerActionsTestOtherB-2122210178-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:15:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e363b559098f48d4bc5478c657d7de6a',uuid=dd546862-fcd5-4b69-8ea3-a8fa4859a489,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "478e7aea-9546-4659-bdac-09213bd9cb82", "address": "fa:16:3e:9a:26:f6", "network": {"id": "d182d3d1-113a-4bf5-b325-f073247f0547", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-325272674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2830de7697db4d5e8b9c358dab7f4368", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap478e7aea-95", "ovs_interfaceid": "478e7aea-9546-4659-bdac-09213bd9cb82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:15:19 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Converting VIF {"id": "478e7aea-9546-4659-bdac-09213bd9cb82", "address": "fa:16:3e:9a:26:f6", "network": {"id": "d182d3d1-113a-4bf5-b325-f073247f0547", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-325272674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2830de7697db4d5e8b9c358dab7f4368", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap478e7aea-95", "ovs_interfaceid": "478e7aea-9546-4659-bdac-09213bd9cb82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:15:19 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:26:f6,bridge_name='br-int',has_traffic_filtering=True,id=478e7aea-9546-4659-bdac-09213bd9cb82,network=Network(d182d3d1-113a-4bf5-b325-f073247f0547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap478e7aea-95') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:15:19 user nova-compute[75066]: DEBUG nova.objects.instance [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Lazy-loading 'pci_devices' on Instance uuid dd546862-fcd5-4b69-8ea3-a8fa4859a489 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:15:19 user nova-compute[75066]: DEBUG nova.network.neutron [req-a9a7da8a-d8e6-495b-b748-aec60ddfaaf7 req-9609a29a-b6e7-4205-9f1d-6850a6137207 service nova] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Updated VIF entry in instance network info cache for port c9353199-d4a3-488f-857d-b0ebdb31a68f. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:15:19 user nova-compute[75066]: DEBUG nova.network.neutron [req-a9a7da8a-d8e6-495b-b748-aec60ddfaaf7 req-9609a29a-b6e7-4205-9f1d-6850a6137207 service nova] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Updating instance_info_cache with network_info: [{"id": "c9353199-d4a3-488f-857d-b0ebdb31a68f", "address": "fa:16:3e:d4:7c:91", "network": {"id": "4a6c6c26-4d29-486c-b11e-fc53769083ea", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1139388453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "492e0b2da61e4e4f9ea991df15531e24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9353199-d4", "ovs_interfaceid": "c9353199-d4a3-488f-857d-b0ebdb31a68f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:15:19 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:15:19 user nova-compute[75066]:   <uuid>dd546862-fcd5-4b69-8ea3-a8fa4859a489</uuid>
Dec 01 19:15:19 user nova-compute[75066]:   <name>instance-00000005</name>
Dec 01 19:15:19 user nova-compute[75066]:   <memory>524288</memory>
Dec 01 19:15:19 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:15:19 user nova-compute[75066]:   <metadata>
Dec 01 19:15:19 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:15:19 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:15:19 user nova-compute[75066]:       <nova:name>tempest-ServerActionsTestOtherB-server-360735581</nova:name>
Dec 01 19:15:19 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:15:19</nova:creationTime>
Dec 01 19:15:19 user nova-compute[75066]:       <nova:flavor name="m1.tiny">
Dec 01 19:15:19 user nova-compute[75066]:         <nova:memory>512</nova:memory>
Dec 01 19:15:19 user nova-compute[75066]:         <nova:disk>1</nova:disk>
Dec 01 19:15:19 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:15:19 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:15:19 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:15:19 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:15:19 user nova-compute[75066]:       <nova:owner>
Dec 01 19:15:19 user nova-compute[75066]:         <nova:user uuid="e363b559098f48d4bc5478c657d7de6a">tempest-ServerActionsTestOtherB-2122210178-project-member</nova:user>
Dec 01 19:15:19 user nova-compute[75066]:         <nova:project uuid="2830de7697db4d5e8b9c358dab7f4368">tempest-ServerActionsTestOtherB-2122210178</nova:project>
Dec 01 19:15:19 user nova-compute[75066]:       </nova:owner>
Dec 01 19:15:19 user nova-compute[75066]:       <nova:root type="image" uuid="900b237b-e99c-4fdd-a44f-dcb7a08baa86"/>
Dec 01 19:15:19 user nova-compute[75066]:       <nova:ports>
Dec 01 19:15:19 user nova-compute[75066]:         <nova:port uuid="478e7aea-9546-4659-bdac-09213bd9cb82">
Dec 01 19:15:19 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 01 19:15:19 user nova-compute[75066]:         </nova:port>
Dec 01 19:15:19 user nova-compute[75066]:       </nova:ports>
Dec 01 19:15:19 user nova-compute[75066]:     </nova:instance>
Dec 01 19:15:19 user nova-compute[75066]:   </metadata>
Dec 01 19:15:19 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:15:19 user nova-compute[75066]:     <system>
Dec 01 19:15:19 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:15:19 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:15:19 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:15:19 user nova-compute[75066]:       <entry name="serial">dd546862-fcd5-4b69-8ea3-a8fa4859a489</entry>
Dec 01 19:15:19 user nova-compute[75066]:       <entry name="uuid">dd546862-fcd5-4b69-8ea3-a8fa4859a489</entry>
Dec 01 19:15:19 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:15:19 user nova-compute[75066]:     </system>
Dec 01 19:15:19 user nova-compute[75066]:   </sysinfo>
Dec 01 19:15:19 user nova-compute[75066]:   <os>
Dec 01 19:15:19 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:15:19 user nova-compute[75066]:     <boot dev="hd"/>
Dec 01 19:15:19 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:15:19 user nova-compute[75066]:   </os>
Dec 01 19:15:19 user nova-compute[75066]:   <features>
Dec 01 19:15:19 user nova-compute[75066]:     <acpi/>
Dec 01 19:15:19 user nova-compute[75066]:     <apic/>
Dec 01 19:15:19 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:15:19 user nova-compute[75066]:   </features>
Dec 01 19:15:19 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:15:19 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:15:19 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:15:19 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:15:19 user nova-compute[75066]:   </clock>
Dec 01 19:15:19 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:15:19 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:15:19 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:15:19 user nova-compute[75066]:   </cpu>
Dec 01 19:15:19 user nova-compute[75066]:   <devices>
Dec 01 19:15:19 user nova-compute[75066]:     <disk type="file" device="disk">
Dec 01 19:15:19 user nova-compute[75066]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 19:15:19 user nova-compute[75066]:       <source file="/opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489/disk"/>
Dec 01 19:15:19 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:15:19 user nova-compute[75066]:     </disk>
Dec 01 19:15:19 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:15:19 user nova-compute[75066]:       <mac address="fa:16:3e:9a:26:f6"/>
Dec 01 19:15:19 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:15:19 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:15:19 user nova-compute[75066]:       <target dev="tap478e7aea-95"/>
Dec 01 19:15:19 user nova-compute[75066]:     </interface>
Dec 01 19:15:19 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:15:19 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489/console.log" append="off"/>
Dec 01 19:15:19 user nova-compute[75066]:     </serial>
Dec 01 19:15:19 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:15:19 user nova-compute[75066]:     <video>
Dec 01 19:15:19 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:15:19 user nova-compute[75066]:     </video>
Dec 01 19:15:19 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:15:19 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:15:19 user nova-compute[75066]:     </rng>
Dec 01 19:15:19 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:15:19 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:15:19 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:15:19 user nova-compute[75066]:     </memballoon>
Dec 01 19:15:19 user nova-compute[75066]:   </devices>
Dec 01 19:15:19 user nova-compute[75066]: </domain>
Dec 01 19:15:19 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:15:19 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:15:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-360735581',display_name='tempest-ServerActionsTestOtherB-server-360735581',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-360735581',id=5,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOGqD/77ZPXT6+uFjy9YkzZfO6BpJHbV+zzx/mIYY08bckUat50Cdx1l30v4s1jcybtm106xn+eO4W484wI5lg1LoXDJHliGvHVijdeGBF2TMVA7/KP/EGT4mweXKritFQ==',key_name='tempest-keypair-842148615',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2830de7697db4d5e8b9c358dab7f4368',ramdisk_id='',reservation_id='r-tl7vmif9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-2122210178',owner_user_name='tempest-ServerActionsTestOtherB-2122210178-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:15:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e363b559098f48d4bc5478c657d7de6a',uuid=dd546862-fcd5-4b69-8ea3-a8fa4859a489,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "478e7aea-9546-4659-bdac-09213bd9cb82", "address": "fa:16:3e:9a:26:f6", "network": {"id": "d182d3d1-113a-4bf5-b325-f073247f0547", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-325272674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2830de7697db4d5e8b9c358dab7f4368", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap478e7aea-95", "ovs_interfaceid": "478e7aea-9546-4659-bdac-09213bd9cb82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:15:19 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Converting VIF {"id": "478e7aea-9546-4659-bdac-09213bd9cb82", "address": "fa:16:3e:9a:26:f6", "network": {"id": "d182d3d1-113a-4bf5-b325-f073247f0547", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-325272674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2830de7697db4d5e8b9c358dab7f4368", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap478e7aea-95", "ovs_interfaceid": "478e7aea-9546-4659-bdac-09213bd9cb82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:15:19 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:26:f6,bridge_name='br-int',has_traffic_filtering=True,id=478e7aea-9546-4659-bdac-09213bd9cb82,network=Network(d182d3d1-113a-4bf5-b325-f073247f0547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap478e7aea-95') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:15:19 user nova-compute[75066]: DEBUG os_vif [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:26:f6,bridge_name='br-int',has_traffic_filtering=True,id=478e7aea-9546-4659-bdac-09213bd9cb82,network=Network(d182d3d1-113a-4bf5-b325-f073247f0547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap478e7aea-95') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:15:19 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:19 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:15:19 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:15:19 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:19 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8df8152a-87d1-5502-b08a-0d94887ddb2c', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:15:19 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:19 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a9a7da8a-d8e6-495b-b748-aec60ddfaaf7 req-9609a29a-b6e7-4205-9f1d-6850a6137207 service nova] Releasing lock "refresh_cache-c3ceeca4-c16c-4cf5-adfd-7d5a2925f435" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:15:19 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:15:19 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:19 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:19 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap478e7aea-95, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:15:19 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap478e7aea-95, col_values=(('qos', UUID('4c7ef5aa-be20-411d-b7d2-e1e49cf04630')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:15:19 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap478e7aea-95, col_values=(('external_ids', {'iface-id': '478e7aea-9546-4659-bdac-09213bd9cb82', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:26:f6', 'vm-uuid': 'dd546862-fcd5-4b69-8ea3-a8fa4859a489'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:15:19 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:19 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:15:19 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:19 user nova-compute[75066]: INFO os_vif [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:26:f6,bridge_name='br-int',has_traffic_filtering=True,id=478e7aea-9546-4659-bdac-09213bd9cb82,network=Network(d182d3d1-113a-4bf5-b325-f073247f0547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap478e7aea-95')
Dec 01 19:15:19 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:15:19 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] No VIF found with MAC fa:16:3e:9a:26:f6, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:15:19 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:19 user nova-compute[75066]: DEBUG nova.network.neutron [req-f691a49b-0f51-4488-a0e9-844a2cfd0c63 req-32dc019a-d67c-4637-92ab-2c2655c76e21 service nova] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Updated VIF entry in instance network info cache for port 478e7aea-9546-4659-bdac-09213bd9cb82. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:15:19 user nova-compute[75066]: DEBUG nova.network.neutron [req-f691a49b-0f51-4488-a0e9-844a2cfd0c63 req-32dc019a-d67c-4637-92ab-2c2655c76e21 service nova] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Updating instance_info_cache with network_info: [{"id": "478e7aea-9546-4659-bdac-09213bd9cb82", "address": "fa:16:3e:9a:26:f6", "network": {"id": "d182d3d1-113a-4bf5-b325-f073247f0547", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-325272674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2830de7697db4d5e8b9c358dab7f4368", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap478e7aea-95", "ovs_interfaceid": "478e7aea-9546-4659-bdac-09213bd9cb82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:15:19 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-f691a49b-0f51-4488-a0e9-844a2cfd0c63 req-32dc019a-d67c-4637-92ab-2c2655c76e21 service nova] Releasing lock "refresh_cache-dd546862-fcd5-4b69-8ea3-a8fa4859a489" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:15:21 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:21 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:21 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:21 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:21 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:22 user nova-compute[75066]: DEBUG nova.compute.manager [req-5605d095-f762-482c-a05e-e3697b2b62c7 req-dd1c7e9b-dcd5-476d-a693-a74a0161e293 service nova] [instance: b6c46e8d-982f-4169-af80-96274a165b02] Received event network-vif-plugged-6853aa2a-6a9e-471a-ade8-f29f1064c006 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:15:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-5605d095-f762-482c-a05e-e3697b2b62c7 req-dd1c7e9b-dcd5-476d-a693-a74a0161e293 service nova] Acquiring lock "b6c46e8d-982f-4169-af80-96274a165b02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:15:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-5605d095-f762-482c-a05e-e3697b2b62c7 req-dd1c7e9b-dcd5-476d-a693-a74a0161e293 service nova] Lock "b6c46e8d-982f-4169-af80-96274a165b02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:15:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-5605d095-f762-482c-a05e-e3697b2b62c7 req-dd1c7e9b-dcd5-476d-a693-a74a0161e293 service nova] Lock "b6c46e8d-982f-4169-af80-96274a165b02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:15:22 user nova-compute[75066]: DEBUG nova.compute.manager [req-5605d095-f762-482c-a05e-e3697b2b62c7 req-dd1c7e9b-dcd5-476d-a693-a74a0161e293 service nova] [instance: b6c46e8d-982f-4169-af80-96274a165b02] No waiting events found dispatching network-vif-plugged-6853aa2a-6a9e-471a-ade8-f29f1064c006 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:15:22 user nova-compute[75066]: WARNING nova.compute.manager [req-5605d095-f762-482c-a05e-e3697b2b62c7 req-dd1c7e9b-dcd5-476d-a693-a74a0161e293 service nova] [instance: b6c46e8d-982f-4169-af80-96274a165b02] Received unexpected event network-vif-plugged-6853aa2a-6a9e-471a-ade8-f29f1064c006 for instance with vm_state building and task_state spawning.
Dec 01 19:15:22 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:22 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:22 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:22 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:22 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:22 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:22 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:22 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:24 user nova-compute[75066]: DEBUG nova.compute.manager [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Instance event wait completed in 0 seconds for  {{(pid=75066) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 19:15:24 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Guest created on hypervisor {{(pid=75066) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 19:15:24 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Instance spawned successfully.
Dec 01 19:15:24 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 19:15:24 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Found default for hw_cdrom_bus of ide {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:15:24 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Found default for hw_disk_bus of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:15:24 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Found default for hw_input_bus of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:15:24 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Found default for hw_pointer_model of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:15:24 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Found default for hw_video_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:15:24 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Found default for hw_vif_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:15:24 user nova-compute[75066]: DEBUG nova.compute.manager [req-8b1ab5e8-8831-4471-a64a-a1e334b331cf req-25ceb440-9b3f-4183-8dad-942eb4ea1299 service nova] [instance: b6c46e8d-982f-4169-af80-96274a165b02] Received event network-vif-plugged-6853aa2a-6a9e-471a-ade8-f29f1064c006 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:15:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-8b1ab5e8-8831-4471-a64a-a1e334b331cf req-25ceb440-9b3f-4183-8dad-942eb4ea1299 service nova] Acquiring lock "b6c46e8d-982f-4169-af80-96274a165b02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:15:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-8b1ab5e8-8831-4471-a64a-a1e334b331cf req-25ceb440-9b3f-4183-8dad-942eb4ea1299 service nova] Lock "b6c46e8d-982f-4169-af80-96274a165b02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:15:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-8b1ab5e8-8831-4471-a64a-a1e334b331cf req-25ceb440-9b3f-4183-8dad-942eb4ea1299 service nova] Lock "b6c46e8d-982f-4169-af80-96274a165b02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:15:24 user nova-compute[75066]: DEBUG nova.compute.manager [req-8b1ab5e8-8831-4471-a64a-a1e334b331cf req-25ceb440-9b3f-4183-8dad-942eb4ea1299 service nova] [instance: b6c46e8d-982f-4169-af80-96274a165b02] No waiting events found dispatching network-vif-plugged-6853aa2a-6a9e-471a-ade8-f29f1064c006 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:15:24 user nova-compute[75066]: WARNING nova.compute.manager [req-8b1ab5e8-8831-4471-a64a-a1e334b331cf req-25ceb440-9b3f-4183-8dad-942eb4ea1299 service nova] [instance: b6c46e8d-982f-4169-af80-96274a165b02] Received unexpected event network-vif-plugged-6853aa2a-6a9e-471a-ade8-f29f1064c006 for instance with vm_state building and task_state spawning.
Dec 01 19:15:24 user nova-compute[75066]: DEBUG nova.compute.manager [req-8b1ab5e8-8831-4471-a64a-a1e334b331cf req-25ceb440-9b3f-4183-8dad-942eb4ea1299 service nova] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Received event network-vif-plugged-c9353199-d4a3-488f-857d-b0ebdb31a68f {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:15:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-8b1ab5e8-8831-4471-a64a-a1e334b331cf req-25ceb440-9b3f-4183-8dad-942eb4ea1299 service nova] Acquiring lock "c3ceeca4-c16c-4cf5-adfd-7d5a2925f435-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:15:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-8b1ab5e8-8831-4471-a64a-a1e334b331cf req-25ceb440-9b3f-4183-8dad-942eb4ea1299 service nova] Lock "c3ceeca4-c16c-4cf5-adfd-7d5a2925f435-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:15:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-8b1ab5e8-8831-4471-a64a-a1e334b331cf req-25ceb440-9b3f-4183-8dad-942eb4ea1299 service nova] Lock "c3ceeca4-c16c-4cf5-adfd-7d5a2925f435-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:15:24 user nova-compute[75066]: DEBUG nova.compute.manager [req-8b1ab5e8-8831-4471-a64a-a1e334b331cf req-25ceb440-9b3f-4183-8dad-942eb4ea1299 service nova] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] No waiting events found dispatching network-vif-plugged-c9353199-d4a3-488f-857d-b0ebdb31a68f {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:15:24 user nova-compute[75066]: WARNING nova.compute.manager [req-8b1ab5e8-8831-4471-a64a-a1e334b331cf req-25ceb440-9b3f-4183-8dad-942eb4ea1299 service nova] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Received unexpected event network-vif-plugged-c9353199-d4a3-488f-857d-b0ebdb31a68f for instance with vm_state building and task_state spawning.
Dec 01 19:15:24 user nova-compute[75066]: DEBUG nova.compute.manager [req-8b1ab5e8-8831-4471-a64a-a1e334b331cf req-25ceb440-9b3f-4183-8dad-942eb4ea1299 service nova] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Received event network-vif-plugged-c9353199-d4a3-488f-857d-b0ebdb31a68f {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:15:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-8b1ab5e8-8831-4471-a64a-a1e334b331cf req-25ceb440-9b3f-4183-8dad-942eb4ea1299 service nova] Acquiring lock "c3ceeca4-c16c-4cf5-adfd-7d5a2925f435-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:15:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-8b1ab5e8-8831-4471-a64a-a1e334b331cf req-25ceb440-9b3f-4183-8dad-942eb4ea1299 service nova] Lock "c3ceeca4-c16c-4cf5-adfd-7d5a2925f435-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:15:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-8b1ab5e8-8831-4471-a64a-a1e334b331cf req-25ceb440-9b3f-4183-8dad-942eb4ea1299 service nova] Lock "c3ceeca4-c16c-4cf5-adfd-7d5a2925f435-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:15:24 user nova-compute[75066]: DEBUG nova.compute.manager [req-8b1ab5e8-8831-4471-a64a-a1e334b331cf req-25ceb440-9b3f-4183-8dad-942eb4ea1299 service nova] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] No waiting events found dispatching network-vif-plugged-c9353199-d4a3-488f-857d-b0ebdb31a68f {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:15:24 user nova-compute[75066]: WARNING nova.compute.manager [req-8b1ab5e8-8831-4471-a64a-a1e334b331cf req-25ceb440-9b3f-4183-8dad-942eb4ea1299 service nova] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Received unexpected event network-vif-plugged-c9353199-d4a3-488f-857d-b0ebdb31a68f for instance with vm_state building and task_state spawning.
Dec 01 19:15:24 user nova-compute[75066]: INFO nova.compute.manager [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Took 19.31 seconds to spawn the instance on the hypervisor.
Dec 01 19:15:24 user nova-compute[75066]: DEBUG nova.compute.manager [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:15:24 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:24 user nova-compute[75066]: INFO nova.compute.manager [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Took 20.80 seconds to build instance.
Dec 01 19:15:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-490019cb-c84e-46b7-94ba-e4984ac7722f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Lock "67c5dd7c-88aa-4f2f-8f62-a9af0480c38e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.101s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:15:24 user nova-compute[75066]: DEBUG nova.compute.manager [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] [instance: b6c46e8d-982f-4169-af80-96274a165b02] Instance event wait completed in 0 seconds for  {{(pid=75066) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 19:15:24 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] [instance: b6c46e8d-982f-4169-af80-96274a165b02] Guest created on hypervisor {{(pid=75066) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 19:15:24 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: b6c46e8d-982f-4169-af80-96274a165b02] Instance spawned successfully.
Dec 01 19:15:24 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] [instance: b6c46e8d-982f-4169-af80-96274a165b02] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 19:15:24 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] [instance: b6c46e8d-982f-4169-af80-96274a165b02] Found default for hw_cdrom_bus of ide {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:15:24 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] [instance: b6c46e8d-982f-4169-af80-96274a165b02] Found default for hw_disk_bus of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:15:24 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] [instance: b6c46e8d-982f-4169-af80-96274a165b02] Found default for hw_input_bus of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:15:24 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] [instance: b6c46e8d-982f-4169-af80-96274a165b02] Found default for hw_pointer_model of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:15:24 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] [instance: b6c46e8d-982f-4169-af80-96274a165b02] Found default for hw_video_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:15:24 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] [instance: b6c46e8d-982f-4169-af80-96274a165b02] Found default for hw_vif_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:15:25 user nova-compute[75066]: INFO nova.compute.manager [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] [instance: b6c46e8d-982f-4169-af80-96274a165b02] Took 19.10 seconds to spawn the instance on the hypervisor.
Dec 01 19:15:25 user nova-compute[75066]: DEBUG nova.compute.manager [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] [instance: b6c46e8d-982f-4169-af80-96274a165b02] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:15:25 user nova-compute[75066]: INFO nova.compute.manager [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] [instance: b6c46e8d-982f-4169-af80-96274a165b02] Took 20.43 seconds to build instance.
Dec 01 19:15:25 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b4432f83-45d5-4a70-821f-33da0281d88a tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Lock "b6c46e8d-982f-4169-af80-96274a165b02" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.588s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:15:25 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:25 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:25 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:25 user nova-compute[75066]: DEBUG nova.compute.manager [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Instance event wait completed in 0 seconds for  {{(pid=75066) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 19:15:25 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Guest created on hypervisor {{(pid=75066) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 19:15:25 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Instance spawned successfully.
Dec 01 19:15:25 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 19:15:25 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Found default for hw_cdrom_bus of ide {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:15:25 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Found default for hw_disk_bus of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:15:25 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Found default for hw_input_bus of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:15:25 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Found default for hw_pointer_model of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:15:25 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Found default for hw_video_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:15:25 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Found default for hw_vif_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:15:26 user nova-compute[75066]: INFO nova.compute.manager [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Took 16.05 seconds to spawn the instance on the hypervisor.
Dec 01 19:15:26 user nova-compute[75066]: DEBUG nova.compute.manager [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:15:26 user nova-compute[75066]: DEBUG nova.compute.manager [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Instance event wait completed in 0 seconds for  {{(pid=75066) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 19:15:26 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Guest created on hypervisor {{(pid=75066) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 19:15:26 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Instance spawned successfully.
Dec 01 19:15:26 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:26 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 19:15:26 user nova-compute[75066]: DEBUG nova.compute.manager [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Instance event wait completed in 0 seconds for  {{(pid=75066) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 19:15:26 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Guest created on hypervisor {{(pid=75066) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 19:15:26 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Instance spawned successfully.
Dec 01 19:15:26 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 19:15:26 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Found default for hw_cdrom_bus of ide {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:15:26 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Found default for hw_disk_bus of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:15:26 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Found default for hw_input_bus of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:15:26 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Found default for hw_pointer_model of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:15:26 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Found default for hw_video_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:15:26 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Found default for hw_vif_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:15:26 user nova-compute[75066]: INFO nova.compute.manager [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Took 16.91 seconds to build instance.
Dec 01 19:15:26 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Found default for hw_cdrom_bus of ide {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:15:26 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Found default for hw_disk_bus of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:15:26 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Found default for hw_input_bus of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:15:26 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Found default for hw_pointer_model of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:15:26 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Found default for hw_video_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:15:26 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Found default for hw_vif_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:15:26 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b83f605c-5836-4ede-812e-d5ed1054c333 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "c223be70-8b9c-46d4-9b5a-3b83dfc05a17" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.111s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:15:26 user nova-compute[75066]: INFO nova.compute.manager [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Took 13.72 seconds to spawn the instance on the hypervisor.
Dec 01 19:15:26 user nova-compute[75066]: DEBUG nova.compute.manager [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:15:26 user nova-compute[75066]: INFO nova.compute.manager [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Took 13.23 seconds to spawn the instance on the hypervisor.
Dec 01 19:15:26 user nova-compute[75066]: DEBUG nova.compute.manager [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:15:26 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:26 user nova-compute[75066]: INFO nova.compute.manager [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Took 14.89 seconds to build instance.
Dec 01 19:15:26 user nova-compute[75066]: INFO nova.compute.manager [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Took 14.70 seconds to build instance.
Dec 01 19:15:26 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-40241923-b2a0-44e4-ac83-7247df3ec238 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "c3ceeca4-c16c-4cf5-adfd-7d5a2925f435" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.044s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:15:26 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-7c83db02-6681-4a98-98c2-4063b910825e tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Lock "dd546862-fcd5-4b69-8ea3-a8fa4859a489" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.867s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:15:27 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:27 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:27 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:27 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Acquiring lock "f253bb0a-6cd0-4e62-8bcb-898537ce8c0b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:15:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Lock "f253bb0a-6cd0-4e62-8bcb-898537ce8c0b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:15:29 user nova-compute[75066]: DEBUG nova.compute.manager [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] Starting instance... {{(pid=75066) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 19:15:29 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:15:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:15:29 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75066) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 19:15:29 user nova-compute[75066]: INFO nova.compute.claims [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] Claim successful on node user
Dec 01 19:15:29 user nova-compute[75066]: DEBUG nova.compute.manager [req-e368d324-672e-4a70-af3f-44d9680f5cce req-23460e92-18fc-4a74-b743-2d8e6fb31ec0 service nova] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Received event network-vif-plugged-73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:15:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-e368d324-672e-4a70-af3f-44d9680f5cce req-23460e92-18fc-4a74-b743-2d8e6fb31ec0 service nova] Acquiring lock "67c5dd7c-88aa-4f2f-8f62-a9af0480c38e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:15:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-e368d324-672e-4a70-af3f-44d9680f5cce req-23460e92-18fc-4a74-b743-2d8e6fb31ec0 service nova] Lock "67c5dd7c-88aa-4f2f-8f62-a9af0480c38e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:15:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-e368d324-672e-4a70-af3f-44d9680f5cce req-23460e92-18fc-4a74-b743-2d8e6fb31ec0 service nova] Lock "67c5dd7c-88aa-4f2f-8f62-a9af0480c38e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:15:29 user nova-compute[75066]: DEBUG nova.compute.manager [req-e368d324-672e-4a70-af3f-44d9680f5cce req-23460e92-18fc-4a74-b743-2d8e6fb31ec0 service nova] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] No waiting events found dispatching network-vif-plugged-73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:15:29 user nova-compute[75066]: WARNING nova.compute.manager [req-e368d324-672e-4a70-af3f-44d9680f5cce req-23460e92-18fc-4a74-b743-2d8e6fb31ec0 service nova] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Received unexpected event network-vif-plugged-73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2 for instance with vm_state active and task_state None.
Dec 01 19:15:29 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:29 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:29 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:30 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:15:30 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:15:30 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.850s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:15:30 user nova-compute[75066]: DEBUG nova.compute.manager [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] Start building networks asynchronously for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 19:15:30 user nova-compute[75066]: DEBUG nova.compute.manager [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] Allocating IP information in the background. {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 19:15:30 user nova-compute[75066]: DEBUG nova.network.neutron [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] allocate_for_instance() {{(pid=75066) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 19:15:30 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Dec 01 19:15:30 user nova-compute[75066]: DEBUG nova.compute.manager [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] Start building block device mappings for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 19:15:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:30 user nova-compute[75066]: DEBUG nova.compute.manager [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] Start spawning the instance on the hypervisor. {{(pid=75066) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 19:15:30 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] Creating instance directory {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 19:15:30 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] Creating image(s)
Dec 01 19:15:30 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Acquiring lock "/opt/stack/data/nova/instances/f253bb0a-6cd0-4e62-8bcb-898537ce8c0b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:15:30 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Lock "/opt/stack/data/nova/instances/f253bb0a-6cd0-4e62-8bcb-898537ce8c0b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:15:30 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Lock "/opt/stack/data/nova/instances/f253bb0a-6cd0-4e62-8bcb-898537ce8c0b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:15:30 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Acquiring lock "581b586cd6cae0145eb5a17c0c2e449e5d91efe7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:15:30 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Lock "581b586cd6cae0145eb5a17c0c2e449e5d91efe7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:15:31 user nova-compute[75066]: DEBUG nova.policy [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'be27c8b080da4a00886a5cf78bdabed1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'da44764312b448268176827b746f5c21', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75066) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 19:15:31 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/581b586cd6cae0145eb5a17c0c2e449e5d91efe7.part --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:15:31 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:31 user nova-compute[75066]: DEBUG nova.compute.manager [req-da555bcf-45db-4203-b1b1-e036183b1a2e req-99177b22-ef98-42b2-9e3f-60e7c21ad819 service nova] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Received event network-vif-plugged-73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:15:31 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-da555bcf-45db-4203-b1b1-e036183b1a2e req-99177b22-ef98-42b2-9e3f-60e7c21ad819 service nova] Acquiring lock "67c5dd7c-88aa-4f2f-8f62-a9af0480c38e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:15:31 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-da555bcf-45db-4203-b1b1-e036183b1a2e req-99177b22-ef98-42b2-9e3f-60e7c21ad819 service nova] Lock "67c5dd7c-88aa-4f2f-8f62-a9af0480c38e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.010s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:15:31 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-da555bcf-45db-4203-b1b1-e036183b1a2e req-99177b22-ef98-42b2-9e3f-60e7c21ad819 service nova] Lock "67c5dd7c-88aa-4f2f-8f62-a9af0480c38e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:15:31 user nova-compute[75066]: DEBUG nova.compute.manager [req-da555bcf-45db-4203-b1b1-e036183b1a2e req-99177b22-ef98-42b2-9e3f-60e7c21ad819 service nova] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] No waiting events found dispatching network-vif-plugged-73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:15:31 user nova-compute[75066]: WARNING nova.compute.manager [req-da555bcf-45db-4203-b1b1-e036183b1a2e req-99177b22-ef98-42b2-9e3f-60e7c21ad819 service nova] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Received unexpected event network-vif-plugged-73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2 for instance with vm_state active and task_state None.
Dec 01 19:15:32 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/581b586cd6cae0145eb5a17c0c2e449e5d91efe7.part --force-share --output=json" returned: 0 in 0.381s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:15:32 user nova-compute[75066]: DEBUG nova.virt.images [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] d98f3a9d-0cc8-43f1-ad6a-f6fccc79c8d5 was qcow2, converting to raw {{(pid=75066) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 01 19:15:32 user nova-compute[75066]: DEBUG nova.privsep.utils [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75066) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 01 19:15:32 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/581b586cd6cae0145eb5a17c0c2e449e5d91efe7.part /opt/stack/data/nova/instances/_base/581b586cd6cae0145eb5a17c0c2e449e5d91efe7.converted {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:15:32 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/581b586cd6cae0145eb5a17c0c2e449e5d91efe7.part /opt/stack/data/nova/instances/_base/581b586cd6cae0145eb5a17c0c2e449e5d91efe7.converted" returned: 0 in 0.343s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:15:32 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/581b586cd6cae0145eb5a17c0c2e449e5d91efe7.converted --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:15:32 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/581b586cd6cae0145eb5a17c0c2e449e5d91efe7.converted --force-share --output=json" returned: 0 in 0.315s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:15:32 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Lock "581b586cd6cae0145eb5a17c0c2e449e5d91efe7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.829s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:15:32 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/581b586cd6cae0145eb5a17c0c2e449e5d91efe7 --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:15:33 user nova-compute[75066]: DEBUG nova.network.neutron [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] Successfully created port: ba7d09a3-d2cc-43ca-a1e8-278f841ae513 {{(pid=75066) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 19:15:33 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/581b586cd6cae0145eb5a17c0c2e449e5d91efe7 --force-share --output=json" returned: 0 in 0.303s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:15:33 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Acquiring lock "581b586cd6cae0145eb5a17c0c2e449e5d91efe7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:15:33 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Lock "581b586cd6cae0145eb5a17c0c2e449e5d91efe7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:15:33 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/581b586cd6cae0145eb5a17c0c2e449e5d91efe7 --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:15:33 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/581b586cd6cae0145eb5a17c0c2e449e5d91efe7 --force-share --output=json" returned: 0 in 0.305s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:15:33 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/581b586cd6cae0145eb5a17c0c2e449e5d91efe7,backing_fmt=raw /opt/stack/data/nova/instances/f253bb0a-6cd0-4e62-8bcb-898537ce8c0b/disk 1073741824 {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:15:33 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/581b586cd6cae0145eb5a17c0c2e449e5d91efe7,backing_fmt=raw /opt/stack/data/nova/instances/f253bb0a-6cd0-4e62-8bcb-898537ce8c0b/disk 1073741824" returned: 0 in 0.120s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:15:33 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Lock "581b586cd6cae0145eb5a17c0c2e449e5d91efe7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.440s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:15:33 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/581b586cd6cae0145eb5a17c0c2e449e5d91efe7 --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:15:34 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/581b586cd6cae0145eb5a17c0c2e449e5d91efe7 --force-share --output=json" returned: 0 in 0.474s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:15:34 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f253bb0a-6cd0-4e62-8bcb-898537ce8c0b/disk. size=1073741824 {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 19:15:34 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f253bb0a-6cd0-4e62-8bcb-898537ce8c0b/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:15:34 user nova-compute[75066]: DEBUG nova.network.neutron [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] Successfully updated port: ba7d09a3-d2cc-43ca-a1e8-278f841ae513 {{(pid=75066) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 19:15:34 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Acquiring lock "refresh_cache-f253bb0a-6cd0-4e62-8bcb-898537ce8c0b" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:15:34 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Acquired lock "refresh_cache-f253bb0a-6cd0-4e62-8bcb-898537ce8c0b" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:15:34 user nova-compute[75066]: DEBUG nova.network.neutron [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:15:34 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:34 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f253bb0a-6cd0-4e62-8bcb-898537ce8c0b/disk --force-share --output=json" returned: 0 in 0.554s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:15:34 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Cannot resize image /opt/stack/data/nova/instances/f253bb0a-6cd0-4e62-8bcb-898537ce8c0b/disk to a smaller size. {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 19:15:34 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] Created local disks {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 19:15:34 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] Ensure instance console log exists: /opt/stack/data/nova/instances/f253bb0a-6cd0-4e62-8bcb-898537ce8c0b/console.log {{(pid=75066) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 19:15:34 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:15:34 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:15:34 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:15:34 user nova-compute[75066]: DEBUG nova.compute.manager [req-d9390594-b1bf-4f5c-ae04-8bf2f7ed3f18 req-8798be3e-63e3-4fb3-9361-799fd3734323 service nova] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] Received event network-changed-ba7d09a3-d2cc-43ca-a1e8-278f841ae513 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:15:34 user nova-compute[75066]: DEBUG nova.compute.manager [req-d9390594-b1bf-4f5c-ae04-8bf2f7ed3f18 req-8798be3e-63e3-4fb3-9361-799fd3734323 service nova] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] Refreshing instance network info cache due to event network-changed-ba7d09a3-d2cc-43ca-a1e8-278f841ae513. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:15:34 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d9390594-b1bf-4f5c-ae04-8bf2f7ed3f18 req-8798be3e-63e3-4fb3-9361-799fd3734323 service nova] Acquiring lock "refresh_cache-f253bb0a-6cd0-4e62-8bcb-898537ce8c0b" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:15:34 user nova-compute[75066]: DEBUG nova.network.neutron [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:15:35 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Acquiring lock "dd67db6c-8bd1-402e-93ce-9b2d7a405a6e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:15:35 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Lock "dd67db6c-8bd1-402e-93ce-9b2d7a405a6e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:15:35 user nova-compute[75066]: DEBUG nova.compute.manager [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Starting instance... {{(pid=75066) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 19:15:35 user nova-compute[75066]: DEBUG nova.network.neutron [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] Updating instance_info_cache with network_info: [{"id": "ba7d09a3-d2cc-43ca-a1e8-278f841ae513", "address": "fa:16:3e:88:28:51", "network": {"id": "69bb86af-79ca-4a0b-a0f7-8580fb07e2ce", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1708610135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da44764312b448268176827b746f5c21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba7d09a3-d2", "ovs_interfaceid": "ba7d09a3-d2cc-43ca-a1e8-278f841ae513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:15:35 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Releasing lock "refresh_cache-f253bb0a-6cd0-4e62-8bcb-898537ce8c0b" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:15:35 user nova-compute[75066]: DEBUG nova.compute.manager [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] Instance network_info: |[{"id": "ba7d09a3-d2cc-43ca-a1e8-278f841ae513", "address": "fa:16:3e:88:28:51", "network": {"id": "69bb86af-79ca-4a0b-a0f7-8580fb07e2ce", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1708610135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da44764312b448268176827b746f5c21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba7d09a3-d2", "ovs_interfaceid": "ba7d09a3-d2cc-43ca-a1e8-278f841ae513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 19:15:35 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d9390594-b1bf-4f5c-ae04-8bf2f7ed3f18 req-8798be3e-63e3-4fb3-9361-799fd3734323 service nova] Acquired lock "refresh_cache-f253bb0a-6cd0-4e62-8bcb-898537ce8c0b" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:15:35 user nova-compute[75066]: DEBUG nova.network.neutron [req-d9390594-b1bf-4f5c-ae04-8bf2f7ed3f18 req-8798be3e-63e3-4fb3-9361-799fd3734323 service nova] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] Refreshing network info cache for port ba7d09a3-d2cc-43ca-a1e8-278f841ae513 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:15:35 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] Start _get_guest_xml network_info=[{"id": "ba7d09a3-d2cc-43ca-a1e8-278f841ae513", "address": "fa:16:3e:88:28:51", "network": {"id": "69bb86af-79ca-4a0b-a0f7-8580fb07e2ce", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1708610135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da44764312b448268176827b746f5c21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba7d09a3-d2", "ovs_interfaceid": "ba7d09a3-d2cc-43ca-a1e8-278f841ae513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:15:21Z,direct_url=<?>,disk_format='qcow2',id=d98f3a9d-0cc8-43f1-ad6a-f6fccc79c8d5,min_disk=0,min_ram=0,name='',owner='2ee374cca9dc4bda87545117d6b84c43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:15:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'scsi', 'device_name': '/dev/sda', 'encryption_options': None, 'device_type': 'disk', 'image_id': 'd98f3a9d-0cc8-43f1-ad6a-f6fccc79c8d5'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:15:35 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:15:35 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:15:35 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:15:35 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:15:35 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:15:35 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:15:35 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75066) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 19:15:35 user nova-compute[75066]: INFO nova.compute.claims [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Claim successful on node user
Dec 01 19:15:35 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:15:35 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:15:35 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:15:35 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:15:21Z,direct_url=<?>,disk_format='qcow2',id=d98f3a9d-0cc8-43f1-ad6a-f6fccc79c8d5,min_disk=0,min_ram=0,name='',owner='2ee374cca9dc4bda87545117d6b84c43',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:15:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:15:35 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:15:35 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:15:35 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:15:35 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:15:35 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:15:35 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:15:35 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:15:35 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:15:35 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:15:35 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:15:35 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T19:15:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-511699554',display_name='tempest-AttachSCSIVolumeTestJSON-server-511699554',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-511699554',id=6,image_ref='d98f3a9d-0cc8-43f1-ad6a-f6fccc79c8d5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/5y/+onwNQ0yQUF1C0+0Cg+L5t4fs8Z3P82IsbLznyyWhPH2ZJmMqnzlby9bZjF42g59vlyD8yof59OqWJscTlSmjo0sVCtaPmrTeHN9CdFhFpfaASkvM+C9pN33Q8/Q==',key_name='tempest-keypair-266429772',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='da44764312b448268176827b746f5c21',ramdisk_id='',reservation_id='r-6y0x0o6c',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d98f3a9d-0cc8-43f1-ad6a-f6fccc79c8d5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-879061882',owner_user_name='tempest-AttachSCSIVolumeTestJSON-879061882-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:15:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be27c8b080da4a00886a5cf78bdabed1',uuid=f253bb0a-6cd0-4e62-8bcb-898537ce8c0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba7d09a3-d2cc-43ca-a1e8-278f841ae513", "address": "fa:16:3e:88:28:51", "network": {"id": "69bb86af-79ca-4a0b-a0f7-8580fb07e2ce", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1708610135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da44764312b448268176827b746f5c21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba7d09a3-d2", "ovs_interfaceid": "ba7d09a3-d2cc-43ca-a1e8-278f841ae513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:15:35 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Converting VIF {"id": "ba7d09a3-d2cc-43ca-a1e8-278f841ae513", "address": "fa:16:3e:88:28:51", "network": {"id": "69bb86af-79ca-4a0b-a0f7-8580fb07e2ce", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1708610135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da44764312b448268176827b746f5c21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba7d09a3-d2", "ovs_interfaceid": "ba7d09a3-d2cc-43ca-a1e8-278f841ae513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:15:35 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:28:51,bridge_name='br-int',has_traffic_filtering=True,id=ba7d09a3-d2cc-43ca-a1e8-278f841ae513,network=Network(69bb86af-79ca-4a0b-a0f7-8580fb07e2ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba7d09a3-d2') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:15:35 user nova-compute[75066]: DEBUG nova.objects.instance [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Lazy-loading 'pci_devices' on Instance uuid f253bb0a-6cd0-4e62-8bcb-898537ce8c0b {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:15:35 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:15:35 user nova-compute[75066]:   <uuid>f253bb0a-6cd0-4e62-8bcb-898537ce8c0b</uuid>
Dec 01 19:15:35 user nova-compute[75066]:   <name>instance-00000006</name>
Dec 01 19:15:35 user nova-compute[75066]:   <memory>524288</memory>
Dec 01 19:15:35 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:15:35 user nova-compute[75066]:   <metadata>
Dec 01 19:15:35 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:15:35 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:15:35 user nova-compute[75066]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-511699554</nova:name>
Dec 01 19:15:35 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:15:35</nova:creationTime>
Dec 01 19:15:35 user nova-compute[75066]:       <nova:flavor name="m1.tiny">
Dec 01 19:15:35 user nova-compute[75066]:         <nova:memory>512</nova:memory>
Dec 01 19:15:35 user nova-compute[75066]:         <nova:disk>1</nova:disk>
Dec 01 19:15:35 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:15:35 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:15:35 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:15:35 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:15:35 user nova-compute[75066]:       <nova:owner>
Dec 01 19:15:35 user nova-compute[75066]:         <nova:user uuid="be27c8b080da4a00886a5cf78bdabed1">tempest-AttachSCSIVolumeTestJSON-879061882-project-member</nova:user>
Dec 01 19:15:35 user nova-compute[75066]:         <nova:project uuid="da44764312b448268176827b746f5c21">tempest-AttachSCSIVolumeTestJSON-879061882</nova:project>
Dec 01 19:15:35 user nova-compute[75066]:       </nova:owner>
Dec 01 19:15:35 user nova-compute[75066]:       <nova:root type="image" uuid="d98f3a9d-0cc8-43f1-ad6a-f6fccc79c8d5"/>
Dec 01 19:15:35 user nova-compute[75066]:       <nova:ports>
Dec 01 19:15:35 user nova-compute[75066]:         <nova:port uuid="ba7d09a3-d2cc-43ca-a1e8-278f841ae513">
Dec 01 19:15:35 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Dec 01 19:15:35 user nova-compute[75066]:         </nova:port>
Dec 01 19:15:35 user nova-compute[75066]:       </nova:ports>
Dec 01 19:15:35 user nova-compute[75066]:     </nova:instance>
Dec 01 19:15:35 user nova-compute[75066]:   </metadata>
Dec 01 19:15:35 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:15:35 user nova-compute[75066]:     <system>
Dec 01 19:15:35 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:15:35 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:15:35 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:15:35 user nova-compute[75066]:       <entry name="serial">f253bb0a-6cd0-4e62-8bcb-898537ce8c0b</entry>
Dec 01 19:15:35 user nova-compute[75066]:       <entry name="uuid">f253bb0a-6cd0-4e62-8bcb-898537ce8c0b</entry>
Dec 01 19:15:35 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:15:35 user nova-compute[75066]:     </system>
Dec 01 19:15:35 user nova-compute[75066]:   </sysinfo>
Dec 01 19:15:35 user nova-compute[75066]:   <os>
Dec 01 19:15:35 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:15:35 user nova-compute[75066]:     <boot dev="hd"/>
Dec 01 19:15:35 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:15:35 user nova-compute[75066]:   </os>
Dec 01 19:15:35 user nova-compute[75066]:   <features>
Dec 01 19:15:35 user nova-compute[75066]:     <acpi/>
Dec 01 19:15:35 user nova-compute[75066]:     <apic/>
Dec 01 19:15:35 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:15:35 user nova-compute[75066]:   </features>
Dec 01 19:15:35 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:15:35 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:15:35 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:15:35 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:15:35 user nova-compute[75066]:   </clock>
Dec 01 19:15:35 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:15:35 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:15:35 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:15:35 user nova-compute[75066]:   </cpu>
Dec 01 19:15:35 user nova-compute[75066]:   <devices>
Dec 01 19:15:35 user nova-compute[75066]:     <disk type="file" device="disk">
Dec 01 19:15:35 user nova-compute[75066]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 19:15:35 user nova-compute[75066]:       <source file="/opt/stack/data/nova/instances/f253bb0a-6cd0-4e62-8bcb-898537ce8c0b/disk"/>
Dec 01 19:15:35 user nova-compute[75066]:       <target dev="sda" bus="scsi"/>
Dec 01 19:15:35 user nova-compute[75066]:       <address type="drive" controller="0" unit="0"/>
Dec 01 19:15:35 user nova-compute[75066]:     </disk>
Dec 01 19:15:35 user nova-compute[75066]:     <disk type="file" device="cdrom">
Dec 01 19:15:35 user nova-compute[75066]:       <driver name="qemu" type="raw" cache="none"/>
Dec 01 19:15:35 user nova-compute[75066]:       <source file="/opt/stack/data/nova/instances/f253bb0a-6cd0-4e62-8bcb-898537ce8c0b/disk.config"/>
Dec 01 19:15:35 user nova-compute[75066]:       <target dev="sdb" bus="scsi"/>
Dec 01 19:15:35 user nova-compute[75066]:       <address type="drive" controller="0" unit="1"/>
Dec 01 19:15:35 user nova-compute[75066]:     </disk>
Dec 01 19:15:35 user nova-compute[75066]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Dec 01 19:15:35 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:15:35 user nova-compute[75066]:       <mac address="fa:16:3e:88:28:51"/>
Dec 01 19:15:35 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:15:35 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:15:35 user nova-compute[75066]:       <target dev="tapba7d09a3-d2"/>
Dec 01 19:15:35 user nova-compute[75066]:     </interface>
Dec 01 19:15:35 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:15:35 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/f253bb0a-6cd0-4e62-8bcb-898537ce8c0b/console.log" append="off"/>
Dec 01 19:15:35 user nova-compute[75066]:     </serial>
Dec 01 19:15:35 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:15:35 user nova-compute[75066]:     <video>
Dec 01 19:15:35 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:15:35 user nova-compute[75066]:     </video>
Dec 01 19:15:35 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:15:35 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:15:35 user nova-compute[75066]:     </rng>
Dec 01 19:15:35 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:15:35 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:15:35 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:15:35 user nova-compute[75066]:     </memballoon>
Dec 01 19:15:35 user nova-compute[75066]:   </devices>
Dec 01 19:15:35 user nova-compute[75066]: </domain>
Dec 01 19:15:35 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:15:35 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T19:15:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-511699554',display_name='tempest-AttachSCSIVolumeTestJSON-server-511699554',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-511699554',id=6,image_ref='d98f3a9d-0cc8-43f1-ad6a-f6fccc79c8d5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/5y/+onwNQ0yQUF1C0+0Cg+L5t4fs8Z3P82IsbLznyyWhPH2ZJmMqnzlby9bZjF42g59vlyD8yof59OqWJscTlSmjo0sVCtaPmrTeHN9CdFhFpfaASkvM+C9pN33Q8/Q==',key_name='tempest-keypair-266429772',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='da44764312b448268176827b746f5c21',ramdisk_id='',reservation_id='r-6y0x0o6c',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d98f3a9d-0cc8-43f1-ad6a-f6fccc79c8d5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-879061882',owner_user_name='tempest-AttachSCSIVolumeTestJSON-879061882-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:15:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be27c8b080da4a00886a5cf78bdabed1',uuid=f253bb0a-6cd0-4e62-8bcb-898537ce8c0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba7d09a3-d2cc-43ca-a1e8-278f841ae513", "address": "fa:16:3e:88:28:51", "network": {"id": "69bb86af-79ca-4a0b-a0f7-8580fb07e2ce", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1708610135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da44764312b448268176827b746f5c21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba7d09a3-d2", "ovs_interfaceid": "ba7d09a3-d2cc-43ca-a1e8-278f841ae513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:15:35 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Converting VIF {"id": "ba7d09a3-d2cc-43ca-a1e8-278f841ae513", "address": "fa:16:3e:88:28:51", "network": {"id": "69bb86af-79ca-4a0b-a0f7-8580fb07e2ce", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1708610135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da44764312b448268176827b746f5c21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba7d09a3-d2", "ovs_interfaceid": "ba7d09a3-d2cc-43ca-a1e8-278f841ae513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:15:35 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:28:51,bridge_name='br-int',has_traffic_filtering=True,id=ba7d09a3-d2cc-43ca-a1e8-278f841ae513,network=Network(69bb86af-79ca-4a0b-a0f7-8580fb07e2ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba7d09a3-d2') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:15:35 user nova-compute[75066]: DEBUG os_vif [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:28:51,bridge_name='br-int',has_traffic_filtering=True,id=ba7d09a3-d2cc-43ca-a1e8-278f841ae513,network=Network(69bb86af-79ca-4a0b-a0f7-8580fb07e2ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba7d09a3-d2') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:15:35 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:35 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:15:35 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:15:35 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:35 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f8743491-538a-50aa-9fe1-237892a58b7d', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:15:35 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:35 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:15:35 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:35 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapba7d09a3-d2, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:15:35 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapba7d09a3-d2, col_values=(('qos', UUID('33cf4dfb-db82-4de8-a0ed-e0dd7b51804b')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:15:35 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapba7d09a3-d2, col_values=(('external_ids', {'iface-id': 'ba7d09a3-d2cc-43ca-a1e8-278f841ae513', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:28:51', 'vm-uuid': 'f253bb0a-6cd0-4e62-8bcb-898537ce8c0b'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:15:35 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:35 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:35 user nova-compute[75066]: INFO os_vif [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:28:51,bridge_name='br-int',has_traffic_filtering=True,id=ba7d09a3-d2cc-43ca-a1e8-278f841ae513,network=Network(69bb86af-79ca-4a0b-a0f7-8580fb07e2ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba7d09a3-d2')
Dec 01 19:15:35 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] No BDM found with device name sda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:15:35 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:15:35 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] No VIF found with MAC fa:16:3e:88:28:51, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:15:35 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] Using config drive
Dec 01 19:15:35 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:15:36 user nova-compute[75066]: DEBUG nova.network.neutron [req-d9390594-b1bf-4f5c-ae04-8bf2f7ed3f18 req-8798be3e-63e3-4fb3-9361-799fd3734323 service nova] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] Updated VIF entry in instance network info cache for port ba7d09a3-d2cc-43ca-a1e8-278f841ae513. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:15:36 user nova-compute[75066]: DEBUG nova.network.neutron [req-d9390594-b1bf-4f5c-ae04-8bf2f7ed3f18 req-8798be3e-63e3-4fb3-9361-799fd3734323 service nova] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] Updating instance_info_cache with network_info: [{"id": "ba7d09a3-d2cc-43ca-a1e8-278f841ae513", "address": "fa:16:3e:88:28:51", "network": {"id": "69bb86af-79ca-4a0b-a0f7-8580fb07e2ce", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1708610135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da44764312b448268176827b746f5c21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba7d09a3-d2", "ovs_interfaceid": "ba7d09a3-d2cc-43ca-a1e8-278f841ae513", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:15:36 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:15:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d9390594-b1bf-4f5c-ae04-8bf2f7ed3f18 req-8798be3e-63e3-4fb3-9361-799fd3734323 service nova] Releasing lock "refresh_cache-f253bb0a-6cd0-4e62-8bcb-898537ce8c0b" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:15:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.812s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:15:36 user nova-compute[75066]: DEBUG nova.compute.manager [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Start building networks asynchronously for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 19:15:36 user nova-compute[75066]: DEBUG nova.compute.manager [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Allocating IP information in the background. {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 19:15:36 user nova-compute[75066]: DEBUG nova.network.neutron [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] allocate_for_instance() {{(pid=75066) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 19:15:36 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] Creating config drive at /opt/stack/data/nova/instances/f253bb0a-6cd0-4e62-8bcb-898537ce8c0b/disk.config
Dec 01 19:15:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f253bb0a-6cd0-4e62-8bcb-898537ce8c0b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp4v4u2___ {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:15:36 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 19:15:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f253bb0a-6cd0-4e62-8bcb-898537ce8c0b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp4v4u2___" returned: 0 in 0.074s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:15:36 user nova-compute[75066]: DEBUG nova.compute.manager [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Start building block device mappings for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 19:15:36 user nova-compute[75066]: DEBUG nova.policy [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '87b72f05df6847889abed27a497addf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '163a9f68fa59476290f11dd2de613d79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75066) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 19:15:36 user nova-compute[75066]: DEBUG nova.compute.manager [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Start spawning the instance on the hypervisor. {{(pid=75066) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 19:15:36 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Creating instance directory {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 19:15:36 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Creating image(s)
Dec 01 19:15:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Acquiring lock "/opt/stack/data/nova/instances/dd67db6c-8bd1-402e-93ce-9b2d7a405a6e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:15:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Lock "/opt/stack/data/nova/instances/dd67db6c-8bd1-402e-93ce-9b2d7a405a6e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:15:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Lock "/opt/stack/data/nova/instances/dd67db6c-8bd1-402e-93ce-9b2d7a405a6e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:15:36 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:15:36 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:37 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.285s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:15:37 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Acquiring lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:15:37 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.033s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:15:37 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:15:37 user nova-compute[75066]: DEBUG nova.compute.manager [req-b0f95703-29e0-40ee-8f23-e2854f98ed6e req-e9ba7d1d-0aaf-4f33-836b-68a018b4f63b service nova] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Received event network-vif-plugged-2698607a-e8b6-4da8-bfc7-90dc528ade6b {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:15:37 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-b0f95703-29e0-40ee-8f23-e2854f98ed6e req-e9ba7d1d-0aaf-4f33-836b-68a018b4f63b service nova] Acquiring lock "c223be70-8b9c-46d4-9b5a-3b83dfc05a17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:15:37 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-b0f95703-29e0-40ee-8f23-e2854f98ed6e req-e9ba7d1d-0aaf-4f33-836b-68a018b4f63b service nova] Lock "c223be70-8b9c-46d4-9b5a-3b83dfc05a17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:15:37 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-b0f95703-29e0-40ee-8f23-e2854f98ed6e req-e9ba7d1d-0aaf-4f33-836b-68a018b4f63b service nova] Lock "c223be70-8b9c-46d4-9b5a-3b83dfc05a17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:15:37 user nova-compute[75066]: DEBUG nova.compute.manager [req-b0f95703-29e0-40ee-8f23-e2854f98ed6e req-e9ba7d1d-0aaf-4f33-836b-68a018b4f63b service nova] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] No waiting events found dispatching network-vif-plugged-2698607a-e8b6-4da8-bfc7-90dc528ade6b {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:15:37 user nova-compute[75066]: WARNING nova.compute.manager [req-b0f95703-29e0-40ee-8f23-e2854f98ed6e req-e9ba7d1d-0aaf-4f33-836b-68a018b4f63b service nova] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Received unexpected event network-vif-plugged-2698607a-e8b6-4da8-bfc7-90dc528ade6b for instance with vm_state active and task_state None.
Dec 01 19:15:37 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.382s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:15:37 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/dd67db6c-8bd1-402e-93ce-9b2d7a405a6e/disk 1073741824 {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:15:37 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/dd67db6c-8bd1-402e-93ce-9b2d7a405a6e/disk 1073741824" returned: 0 in 0.146s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:15:37 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.556s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:15:37 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:15:37 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.274s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:15:37 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dd67db6c-8bd1-402e-93ce-9b2d7a405a6e/disk. size=1073741824 {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 19:15:37 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd67db6c-8bd1-402e-93ce-9b2d7a405a6e/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:15:38 user nova-compute[75066]: DEBUG nova.network.neutron [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Successfully created port: 0a73848e-3c30-4e3a-a8ef-3092afe91d25 {{(pid=75066) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 19:15:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:38 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Acquiring lock "00ff7dfa-1da6-4e32-a227-0c194a5aa28f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:15:38 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Lock "00ff7dfa-1da6-4e32-a227-0c194a5aa28f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:15:38 user nova-compute[75066]: DEBUG nova.compute.manager [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Starting instance... {{(pid=75066) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 19:15:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:38 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd67db6c-8bd1-402e-93ce-9b2d7a405a6e/disk --force-share --output=json" returned: 0 in 0.365s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:15:38 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Cannot resize image /opt/stack/data/nova/instances/dd67db6c-8bd1-402e-93ce-9b2d7a405a6e/disk to a smaller size. {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 19:15:38 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Created local disks {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 19:15:38 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Ensure instance console log exists: /opt/stack/data/nova/instances/dd67db6c-8bd1-402e-93ce-9b2d7a405a6e/console.log {{(pid=75066) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 19:15:38 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:15:38 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:15:38 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:15:38 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:15:38 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:15:38 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75066) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 19:15:38 user nova-compute[75066]: INFO nova.compute.claims [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Claim successful on node user
Dec 01 19:15:39 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:15:39 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:15:39 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.068s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:15:39 user nova-compute[75066]: DEBUG nova.compute.manager [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Start building networks asynchronously for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 19:15:39 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:39 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:39 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:39 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:39 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:39 user nova-compute[75066]: DEBUG nova.compute.manager [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Allocating IP information in the background. {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 19:15:39 user nova-compute[75066]: DEBUG nova.network.neutron [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] allocate_for_instance() {{(pid=75066) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 19:15:39 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 19:15:39 user nova-compute[75066]: DEBUG nova.compute.manager [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Start building block device mappings for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 19:15:39 user nova-compute[75066]: DEBUG nova.policy [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7aa029cbe5094890bcc390ad6b8dc477', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '212e84a5aed6451fb2aa40a87de287d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75066) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 19:15:39 user nova-compute[75066]: DEBUG nova.compute.manager [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Start spawning the instance on the hypervisor. {{(pid=75066) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 19:15:39 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Creating instance directory {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 19:15:39 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Creating image(s)
Dec 01 19:15:39 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Acquiring lock "/opt/stack/data/nova/instances/00ff7dfa-1da6-4e32-a227-0c194a5aa28f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:15:39 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Lock "/opt/stack/data/nova/instances/00ff7dfa-1da6-4e32-a227-0c194a5aa28f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:15:39 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Lock "/opt/stack/data/nova/instances/00ff7dfa-1da6-4e32-a227-0c194a5aa28f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:15:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:15:39 user nova-compute[75066]: DEBUG nova.compute.manager [req-9a00dcff-c642-4d89-8e15-6dd394cd7097 req-9f23c409-7923-48e9-82ae-f831ef2d2eba service nova] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Received event network-vif-plugged-2698607a-e8b6-4da8-bfc7-90dc528ade6b {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:15:39 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-9a00dcff-c642-4d89-8e15-6dd394cd7097 req-9f23c409-7923-48e9-82ae-f831ef2d2eba service nova] Acquiring lock "c223be70-8b9c-46d4-9b5a-3b83dfc05a17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:15:39 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-9a00dcff-c642-4d89-8e15-6dd394cd7097 req-9f23c409-7923-48e9-82ae-f831ef2d2eba service nova] Lock "c223be70-8b9c-46d4-9b5a-3b83dfc05a17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:15:39 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-9a00dcff-c642-4d89-8e15-6dd394cd7097 req-9f23c409-7923-48e9-82ae-f831ef2d2eba service nova] Lock "c223be70-8b9c-46d4-9b5a-3b83dfc05a17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:15:39 user nova-compute[75066]: DEBUG nova.compute.manager [req-9a00dcff-c642-4d89-8e15-6dd394cd7097 req-9f23c409-7923-48e9-82ae-f831ef2d2eba service nova] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] No waiting events found dispatching network-vif-plugged-2698607a-e8b6-4da8-bfc7-90dc528ade6b {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:15:39 user nova-compute[75066]: WARNING nova.compute.manager [req-9a00dcff-c642-4d89-8e15-6dd394cd7097 req-9f23c409-7923-48e9-82ae-f831ef2d2eba service nova] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Received unexpected event network-vif-plugged-2698607a-e8b6-4da8-bfc7-90dc528ade6b for instance with vm_state active and task_state None.
Dec 01 19:15:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.254s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:15:40 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Acquiring lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:15:40 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:15:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:15:40 user nova-compute[75066]: DEBUG nova.network.neutron [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Successfully updated port: 0a73848e-3c30-4e3a-a8ef-3092afe91d25 {{(pid=75066) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 19:15:40 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Acquiring lock "refresh_cache-dd67db6c-8bd1-402e-93ce-9b2d7a405a6e" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:15:40 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Acquired lock "refresh_cache-dd67db6c-8bd1-402e-93ce-9b2d7a405a6e" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:15:40 user nova-compute[75066]: DEBUG nova.network.neutron [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:15:40 user nova-compute[75066]: DEBUG nova.network.neutron [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:15:40 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.340s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:15:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/00ff7dfa-1da6-4e32-a227-0c194a5aa28f/disk 1073741824 {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:15:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/00ff7dfa-1da6-4e32-a227-0c194a5aa28f/disk 1073741824" returned: 0 in 0.112s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:15:40 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.459s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:15:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:15:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.242s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:15:40 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Checking if we can resize image /opt/stack/data/nova/instances/00ff7dfa-1da6-4e32-a227-0c194a5aa28f/disk. size=1073741824 {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 19:15:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00ff7dfa-1da6-4e32-a227-0c194a5aa28f/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:15:40 user nova-compute[75066]: DEBUG nova.network.neutron [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Updating instance_info_cache with network_info: [{"id": "0a73848e-3c30-4e3a-a8ef-3092afe91d25", "address": "fa:16:3e:14:de:da", "network": {"id": "8ab1e58c-73ec-479c-9da7-3fbb9b968fd7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-579378626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "163a9f68fa59476290f11dd2de613d79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a73848e-3c", "ovs_interfaceid": "0a73848e-3c30-4e3a-a8ef-3092afe91d25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:15:40 user nova-compute[75066]: DEBUG nova.network.neutron [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Successfully created port: a6d11620-ab4c-4475-a3c6-3e2354955f95 {{(pid=75066) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 19:15:40 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Releasing lock "refresh_cache-dd67db6c-8bd1-402e-93ce-9b2d7a405a6e" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:15:40 user nova-compute[75066]: DEBUG nova.compute.manager [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Instance network_info: |[{"id": "0a73848e-3c30-4e3a-a8ef-3092afe91d25", "address": "fa:16:3e:14:de:da", "network": {"id": "8ab1e58c-73ec-479c-9da7-3fbb9b968fd7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-579378626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "163a9f68fa59476290f11dd2de613d79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a73848e-3c", "ovs_interfaceid": "0a73848e-3c30-4e3a-a8ef-3092afe91d25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 19:15:40 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Start _get_guest_xml network_info=[{"id": "0a73848e-3c30-4e3a-a8ef-3092afe91d25", "address": "fa:16:3e:14:de:da", "network": {"id": "8ab1e58c-73ec-479c-9da7-3fbb9b968fd7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-579378626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "163a9f68fa59476290f11dd2de613d79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a73848e-3c", "ovs_interfaceid": "0a73848e-3c30-4e3a-a8ef-3092afe91d25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'image_id': '900b237b-e99c-4fdd-a44f-dcb7a08baa86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:15:40 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:15:40 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:15:41 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:15:41 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:15:41 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:15:41 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:15:41 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:15:41 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:15:41 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:15:41 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:15:41 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:15:41 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:15:41 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:15:41 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:15:41 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:15:41 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:15:41 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:15:41 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:15:41 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:15:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-900353537',display_name='tempest-TestVolumeSwap-server-900353537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-900353537',id=7,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFiW2QbPGRYvL2NqqQbQ6Y9GMFMiDePQw5kKWCdg0HsDib5pR/cZzbwkv86TmgVdgocEJzjGsYBabIUT5Ho+tIh8QbuHUA8NfI3kz6OsX0wXzopjfW6SdnRuMw4HF0ZB6A==',key_name='tempest-keypair-65114224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='163a9f68fa59476290f11dd2de613d79',ramdisk_id='',reservation_id='r-91mlod53',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1546773416',owner_user_name='tempest-TestVolumeSwap-1546773416-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:15:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='87b72f05df6847889abed27a497addf8',uuid=dd67db6c-8bd1-402e-93ce-9b2d7a405a6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a73848e-3c30-4e3a-a8ef-3092afe91d25", "address": "fa:16:3e:14:de:da", "network": {"id": "8ab1e58c-73ec-479c-9da7-3fbb9b968fd7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-579378626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "163a9f68fa59476290f11dd2de613d79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a73848e-3c", "ovs_interfaceid": "0a73848e-3c30-4e3a-a8ef-3092afe91d25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:15:41 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Converting VIF {"id": "0a73848e-3c30-4e3a-a8ef-3092afe91d25", "address": "fa:16:3e:14:de:da", "network": {"id": "8ab1e58c-73ec-479c-9da7-3fbb9b968fd7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-579378626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "163a9f68fa59476290f11dd2de613d79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a73848e-3c", "ovs_interfaceid": "0a73848e-3c30-4e3a-a8ef-3092afe91d25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:15:41 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:de:da,bridge_name='br-int',has_traffic_filtering=True,id=0a73848e-3c30-4e3a-a8ef-3092afe91d25,network=Network(8ab1e58c-73ec-479c-9da7-3fbb9b968fd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a73848e-3c') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:15:41 user nova-compute[75066]: DEBUG nova.objects.instance [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Lazy-loading 'pci_devices' on Instance uuid dd67db6c-8bd1-402e-93ce-9b2d7a405a6e {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:15:41 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00ff7dfa-1da6-4e32-a227-0c194a5aa28f/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:15:41 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Cannot resize image /opt/stack/data/nova/instances/00ff7dfa-1da6-4e32-a227-0c194a5aa28f/disk to a smaller size. {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 19:15:41 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Created local disks {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 19:15:41 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Ensure instance console log exists: /opt/stack/data/nova/instances/00ff7dfa-1da6-4e32-a227-0c194a5aa28f/console.log {{(pid=75066) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 19:15:41 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:15:41 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:15:41 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:15:41 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:15:41 user nova-compute[75066]:   <uuid>dd67db6c-8bd1-402e-93ce-9b2d7a405a6e</uuid>
Dec 01 19:15:41 user nova-compute[75066]:   <name>instance-00000007</name>
Dec 01 19:15:41 user nova-compute[75066]:   <memory>524288</memory>
Dec 01 19:15:41 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:15:41 user nova-compute[75066]:   <metadata>
Dec 01 19:15:41 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:15:41 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:15:41 user nova-compute[75066]:       <nova:name>tempest-TestVolumeSwap-server-900353537</nova:name>
Dec 01 19:15:41 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:15:40</nova:creationTime>
Dec 01 19:15:41 user nova-compute[75066]:       <nova:flavor name="m1.tiny">
Dec 01 19:15:41 user nova-compute[75066]:         <nova:memory>512</nova:memory>
Dec 01 19:15:41 user nova-compute[75066]:         <nova:disk>1</nova:disk>
Dec 01 19:15:41 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:15:41 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:15:41 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:15:41 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:15:41 user nova-compute[75066]:       <nova:owner>
Dec 01 19:15:41 user nova-compute[75066]:         <nova:user uuid="87b72f05df6847889abed27a497addf8">tempest-TestVolumeSwap-1546773416-project-member</nova:user>
Dec 01 19:15:41 user nova-compute[75066]:         <nova:project uuid="163a9f68fa59476290f11dd2de613d79">tempest-TestVolumeSwap-1546773416</nova:project>
Dec 01 19:15:41 user nova-compute[75066]:       </nova:owner>
Dec 01 19:15:41 user nova-compute[75066]:       <nova:root type="image" uuid="900b237b-e99c-4fdd-a44f-dcb7a08baa86"/>
Dec 01 19:15:41 user nova-compute[75066]:       <nova:ports>
Dec 01 19:15:41 user nova-compute[75066]:         <nova:port uuid="0a73848e-3c30-4e3a-a8ef-3092afe91d25">
Dec 01 19:15:41 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 01 19:15:41 user nova-compute[75066]:         </nova:port>
Dec 01 19:15:41 user nova-compute[75066]:       </nova:ports>
Dec 01 19:15:41 user nova-compute[75066]:     </nova:instance>
Dec 01 19:15:41 user nova-compute[75066]:   </metadata>
Dec 01 19:15:41 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:15:41 user nova-compute[75066]:     <system>
Dec 01 19:15:41 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:15:41 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:15:41 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:15:41 user nova-compute[75066]:       <entry name="serial">dd67db6c-8bd1-402e-93ce-9b2d7a405a6e</entry>
Dec 01 19:15:41 user nova-compute[75066]:       <entry name="uuid">dd67db6c-8bd1-402e-93ce-9b2d7a405a6e</entry>
Dec 01 19:15:41 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:15:41 user nova-compute[75066]:     </system>
Dec 01 19:15:41 user nova-compute[75066]:   </sysinfo>
Dec 01 19:15:41 user nova-compute[75066]:   <os>
Dec 01 19:15:41 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:15:41 user nova-compute[75066]:     <boot dev="hd"/>
Dec 01 19:15:41 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:15:41 user nova-compute[75066]:   </os>
Dec 01 19:15:41 user nova-compute[75066]:   <features>
Dec 01 19:15:41 user nova-compute[75066]:     <acpi/>
Dec 01 19:15:41 user nova-compute[75066]:     <apic/>
Dec 01 19:15:41 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:15:41 user nova-compute[75066]:   </features>
Dec 01 19:15:41 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:15:41 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:15:41 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:15:41 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:15:41 user nova-compute[75066]:   </clock>
Dec 01 19:15:41 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:15:41 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:15:41 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:15:41 user nova-compute[75066]:   </cpu>
Dec 01 19:15:41 user nova-compute[75066]:   <devices>
Dec 01 19:15:41 user nova-compute[75066]:     <disk type="file" device="disk">
Dec 01 19:15:41 user nova-compute[75066]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 19:15:41 user nova-compute[75066]:       <source file="/opt/stack/data/nova/instances/dd67db6c-8bd1-402e-93ce-9b2d7a405a6e/disk"/>
Dec 01 19:15:41 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:15:41 user nova-compute[75066]:     </disk>
Dec 01 19:15:41 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:15:41 user nova-compute[75066]:       <mac address="fa:16:3e:14:de:da"/>
Dec 01 19:15:41 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:15:41 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:15:41 user nova-compute[75066]:       <target dev="tap0a73848e-3c"/>
Dec 01 19:15:41 user nova-compute[75066]:     </interface>
Dec 01 19:15:41 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:15:41 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/dd67db6c-8bd1-402e-93ce-9b2d7a405a6e/console.log" append="off"/>
Dec 01 19:15:41 user nova-compute[75066]:     </serial>
Dec 01 19:15:41 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:15:41 user nova-compute[75066]:     <video>
Dec 01 19:15:41 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:15:41 user nova-compute[75066]:     </video>
Dec 01 19:15:41 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:15:41 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:15:41 user nova-compute[75066]:     </rng>
Dec 01 19:15:41 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:15:41 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:15:41 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:15:41 user nova-compute[75066]:     </memballoon>
Dec 01 19:15:41 user nova-compute[75066]:   </devices>
Dec 01 19:15:41 user nova-compute[75066]: </domain>
Dec 01 19:15:41 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:15:41 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:15:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-900353537',display_name='tempest-TestVolumeSwap-server-900353537',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-900353537',id=7,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFiW2QbPGRYvL2NqqQbQ6Y9GMFMiDePQw5kKWCdg0HsDib5pR/cZzbwkv86TmgVdgocEJzjGsYBabIUT5Ho+tIh8QbuHUA8NfI3kz6OsX0wXzopjfW6SdnRuMw4HF0ZB6A==',key_name='tempest-keypair-65114224',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='163a9f68fa59476290f11dd2de613d79',ramdisk_id='',reservation_id='r-91mlod53',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1546773416',owner_user_name='tempest-TestVolumeSwap-1546773416-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:15:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='87b72f05df6847889abed27a497addf8',uuid=dd67db6c-8bd1-402e-93ce-9b2d7a405a6e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a73848e-3c30-4e3a-a8ef-3092afe91d25", "address": "fa:16:3e:14:de:da", "network": {"id": "8ab1e58c-73ec-479c-9da7-3fbb9b968fd7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-579378626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "163a9f68fa59476290f11dd2de613d79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a73848e-3c", "ovs_interfaceid": "0a73848e-3c30-4e3a-a8ef-3092afe91d25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:15:41 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Converting VIF {"id": "0a73848e-3c30-4e3a-a8ef-3092afe91d25", "address": "fa:16:3e:14:de:da", "network": {"id": "8ab1e58c-73ec-479c-9da7-3fbb9b968fd7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-579378626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "163a9f68fa59476290f11dd2de613d79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a73848e-3c", "ovs_interfaceid": "0a73848e-3c30-4e3a-a8ef-3092afe91d25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:15:41 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:de:da,bridge_name='br-int',has_traffic_filtering=True,id=0a73848e-3c30-4e3a-a8ef-3092afe91d25,network=Network(8ab1e58c-73ec-479c-9da7-3fbb9b968fd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a73848e-3c') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:15:41 user nova-compute[75066]: DEBUG os_vif [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:de:da,bridge_name='br-int',has_traffic_filtering=True,id=0a73848e-3c30-4e3a-a8ef-3092afe91d25,network=Network(8ab1e58c-73ec-479c-9da7-3fbb9b968fd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a73848e-3c') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:15:41 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:41 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:15:41 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:15:41 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:41 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '348f4fef-a2d9-5961-8f86-0ba0d5efc1cb', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:15:41 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:41 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:15:41 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:41 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0a73848e-3c, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:15:41 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0a73848e-3c, col_values=(('qos', UUID('ef371682-13db-46a7-9d60-950258a02b62')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:15:41 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0a73848e-3c, col_values=(('external_ids', {'iface-id': '0a73848e-3c30-4e3a-a8ef-3092afe91d25', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:de:da', 'vm-uuid': 'dd67db6c-8bd1-402e-93ce-9b2d7a405a6e'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:15:41 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:41 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:15:41 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:41 user nova-compute[75066]: INFO os_vif [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:de:da,bridge_name='br-int',has_traffic_filtering=True,id=0a73848e-3c30-4e3a-a8ef-3092afe91d25,network=Network(8ab1e58c-73ec-479c-9da7-3fbb9b968fd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a73848e-3c')
Dec 01 19:15:41 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:15:41 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] No VIF found with MAC fa:16:3e:14:de:da, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:15:41 user nova-compute[75066]: DEBUG nova.compute.manager [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] Instance event wait completed in 0 seconds for  {{(pid=75066) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 19:15:41 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] Guest created on hypervisor {{(pid=75066) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 19:15:41 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] Instance spawned successfully.
Dec 01 19:15:41 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 19:15:41 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] Found default for hw_input_bus of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:15:41 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] Found default for hw_pointer_model of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:15:41 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] Found default for hw_video_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:15:41 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] Found default for hw_vif_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:15:41 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:41 user nova-compute[75066]: INFO nova.compute.manager [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] Took 10.91 seconds to spawn the instance on the hypervisor.
Dec 01 19:15:41 user nova-compute[75066]: DEBUG nova.compute.manager [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:15:42 user nova-compute[75066]: DEBUG nova.network.neutron [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Successfully updated port: a6d11620-ab4c-4475-a3c6-3e2354955f95 {{(pid=75066) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 19:15:42 user nova-compute[75066]: DEBUG nova.compute.manager [req-5305d606-ab98-4f4a-aed6-f1e2939c1395 req-711e2ced-ba85-4d67-b003-b261ab6112cf service nova] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Received event network-changed-0a73848e-3c30-4e3a-a8ef-3092afe91d25 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:15:42 user nova-compute[75066]: DEBUG nova.compute.manager [req-5305d606-ab98-4f4a-aed6-f1e2939c1395 req-711e2ced-ba85-4d67-b003-b261ab6112cf service nova] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Refreshing instance network info cache due to event network-changed-0a73848e-3c30-4e3a-a8ef-3092afe91d25. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:15:42 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-5305d606-ab98-4f4a-aed6-f1e2939c1395 req-711e2ced-ba85-4d67-b003-b261ab6112cf service nova] Acquiring lock "refresh_cache-dd67db6c-8bd1-402e-93ce-9b2d7a405a6e" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:15:42 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-5305d606-ab98-4f4a-aed6-f1e2939c1395 req-711e2ced-ba85-4d67-b003-b261ab6112cf service nova] Acquired lock "refresh_cache-dd67db6c-8bd1-402e-93ce-9b2d7a405a6e" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:15:42 user nova-compute[75066]: DEBUG nova.network.neutron [req-5305d606-ab98-4f4a-aed6-f1e2939c1395 req-711e2ced-ba85-4d67-b003-b261ab6112cf service nova] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Refreshing network info cache for port 0a73848e-3c30-4e3a-a8ef-3092afe91d25 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:15:42 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Acquiring lock "refresh_cache-00ff7dfa-1da6-4e32-a227-0c194a5aa28f" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:15:42 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Acquired lock "refresh_cache-00ff7dfa-1da6-4e32-a227-0c194a5aa28f" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:15:42 user nova-compute[75066]: DEBUG nova.network.neutron [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:15:42 user nova-compute[75066]: INFO nova.compute.manager [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] Took 12.63 seconds to build instance.
Dec 01 19:15:42 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-bad9132d-17c0-445c-8619-1b192d2a0b9f tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Lock "f253bb0a-6cd0-4e62-8bcb-898537ce8c0b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.914s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:15:42 user nova-compute[75066]: DEBUG nova.compute.manager [req-8e0d0daa-2cc4-45e4-925e-5fe3ee2359f8 req-8f6938f6-fc34-4dc7-9149-f9a81a4258b1 service nova] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Received event network-changed-a6d11620-ab4c-4475-a3c6-3e2354955f95 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:15:42 user nova-compute[75066]: DEBUG nova.compute.manager [req-8e0d0daa-2cc4-45e4-925e-5fe3ee2359f8 req-8f6938f6-fc34-4dc7-9149-f9a81a4258b1 service nova] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Refreshing instance network info cache due to event network-changed-a6d11620-ab4c-4475-a3c6-3e2354955f95. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:15:42 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-8e0d0daa-2cc4-45e4-925e-5fe3ee2359f8 req-8f6938f6-fc34-4dc7-9149-f9a81a4258b1 service nova] Acquiring lock "refresh_cache-00ff7dfa-1da6-4e32-a227-0c194a5aa28f" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:15:42 user nova-compute[75066]: DEBUG nova.network.neutron [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:15:42 user nova-compute[75066]: DEBUG nova.network.neutron [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Updating instance_info_cache with network_info: [{"id": "a6d11620-ab4c-4475-a3c6-3e2354955f95", "address": "fa:16:3e:93:04:1d", "network": {"id": "9a1a0a90-7233-4d75-93a7-3cb72a60e8dc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1583104105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "212e84a5aed6451fb2aa40a87de287d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d11620-ab", "ovs_interfaceid": "a6d11620-ab4c-4475-a3c6-3e2354955f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:15:42 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Releasing lock "refresh_cache-00ff7dfa-1da6-4e32-a227-0c194a5aa28f" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:15:42 user nova-compute[75066]: DEBUG nova.compute.manager [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Instance network_info: |[{"id": "a6d11620-ab4c-4475-a3c6-3e2354955f95", "address": "fa:16:3e:93:04:1d", "network": {"id": "9a1a0a90-7233-4d75-93a7-3cb72a60e8dc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1583104105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "212e84a5aed6451fb2aa40a87de287d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d11620-ab", "ovs_interfaceid": "a6d11620-ab4c-4475-a3c6-3e2354955f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 19:15:42 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-8e0d0daa-2cc4-45e4-925e-5fe3ee2359f8 req-8f6938f6-fc34-4dc7-9149-f9a81a4258b1 service nova] Acquired lock "refresh_cache-00ff7dfa-1da6-4e32-a227-0c194a5aa28f" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:15:42 user nova-compute[75066]: DEBUG nova.network.neutron [req-8e0d0daa-2cc4-45e4-925e-5fe3ee2359f8 req-8f6938f6-fc34-4dc7-9149-f9a81a4258b1 service nova] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Refreshing network info cache for port a6d11620-ab4c-4475-a3c6-3e2354955f95 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:15:42 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Start _get_guest_xml network_info=[{"id": "a6d11620-ab4c-4475-a3c6-3e2354955f95", "address": "fa:16:3e:93:04:1d", "network": {"id": "9a1a0a90-7233-4d75-93a7-3cb72a60e8dc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1583104105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "212e84a5aed6451fb2aa40a87de287d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d11620-ab", "ovs_interfaceid": "a6d11620-ab4c-4475-a3c6-3e2354955f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'image_id': '900b237b-e99c-4fdd-a44f-dcb7a08baa86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:15:42 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:15:42 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:15:42 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:15:42 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:15:42 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:15:42 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:15:42 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:15:42 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:15:42 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:15:42 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:15:42 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:15:42 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:15:42 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:15:42 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:15:42 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:15:42 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:15:42 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:15:42 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:15:42 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:15:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-754956822',display_name='tempest-VolumesAssistedSnapshotsTest-server-754956822',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-754956822',id=8,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJcfIcSljhGnHBDfEY4LYrFEGDFITQ5UoUxDih5goPenKoR6cUULRG6a7mVBN0TWe+/Kir7BdkC5ipIJgbA0Lxz2jt/gnuCjIJSLvehy8XOBaWGsKNS/oxOH3OChHCLNQ==',key_name='tempest-keypair-1580116847',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='212e84a5aed6451fb2aa40a87de287d5',ramdisk_id='',reservation_id='r-gug9ywdu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-773941717',owner_user_name='tempest-VolumesAssistedSnapshotsTest-773941717-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:15:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7aa029cbe5094890bcc390ad6b8dc477',uuid=00ff7dfa-1da6-4e32-a227-0c194a5aa28f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6d11620-ab4c-4475-a3c6-3e2354955f95", "address": "fa:16:3e:93:04:1d", "network": {"id": "9a1a0a90-7233-4d75-93a7-3cb72a60e8dc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1583104105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "212e84a5aed6451fb2aa40a87de287d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d11620-ab", "ovs_interfaceid": "a6d11620-ab4c-4475-a3c6-3e2354955f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:15:42 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Converting VIF {"id": "a6d11620-ab4c-4475-a3c6-3e2354955f95", "address": "fa:16:3e:93:04:1d", "network": {"id": "9a1a0a90-7233-4d75-93a7-3cb72a60e8dc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1583104105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "212e84a5aed6451fb2aa40a87de287d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d11620-ab", "ovs_interfaceid": "a6d11620-ab4c-4475-a3c6-3e2354955f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:15:42 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:04:1d,bridge_name='br-int',has_traffic_filtering=True,id=a6d11620-ab4c-4475-a3c6-3e2354955f95,network=Network(9a1a0a90-7233-4d75-93a7-3cb72a60e8dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6d11620-ab') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:15:42 user nova-compute[75066]: DEBUG nova.objects.instance [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Lazy-loading 'pci_devices' on Instance uuid 00ff7dfa-1da6-4e32-a227-0c194a5aa28f {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:15:42 user nova-compute[75066]: DEBUG nova.network.neutron [req-5305d606-ab98-4f4a-aed6-f1e2939c1395 req-711e2ced-ba85-4d67-b003-b261ab6112cf service nova] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Updated VIF entry in instance network info cache for port 0a73848e-3c30-4e3a-a8ef-3092afe91d25. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:15:42 user nova-compute[75066]: DEBUG nova.network.neutron [req-5305d606-ab98-4f4a-aed6-f1e2939c1395 req-711e2ced-ba85-4d67-b003-b261ab6112cf service nova] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Updating instance_info_cache with network_info: [{"id": "0a73848e-3c30-4e3a-a8ef-3092afe91d25", "address": "fa:16:3e:14:de:da", "network": {"id": "8ab1e58c-73ec-479c-9da7-3fbb9b968fd7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-579378626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "163a9f68fa59476290f11dd2de613d79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a73848e-3c", "ovs_interfaceid": "0a73848e-3c30-4e3a-a8ef-3092afe91d25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:15:42 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:15:42 user nova-compute[75066]:   <uuid>00ff7dfa-1da6-4e32-a227-0c194a5aa28f</uuid>
Dec 01 19:15:42 user nova-compute[75066]:   <name>instance-00000008</name>
Dec 01 19:15:42 user nova-compute[75066]:   <memory>524288</memory>
Dec 01 19:15:42 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:15:42 user nova-compute[75066]:   <metadata>
Dec 01 19:15:42 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:15:42 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:15:42 user nova-compute[75066]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-754956822</nova:name>
Dec 01 19:15:42 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:15:42</nova:creationTime>
Dec 01 19:15:42 user nova-compute[75066]:       <nova:flavor name="m1.tiny">
Dec 01 19:15:42 user nova-compute[75066]:         <nova:memory>512</nova:memory>
Dec 01 19:15:42 user nova-compute[75066]:         <nova:disk>1</nova:disk>
Dec 01 19:15:42 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:15:42 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:15:42 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:15:42 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:15:42 user nova-compute[75066]:       <nova:owner>
Dec 01 19:15:42 user nova-compute[75066]:         <nova:user uuid="7aa029cbe5094890bcc390ad6b8dc477">tempest-VolumesAssistedSnapshotsTest-773941717-project-member</nova:user>
Dec 01 19:15:42 user nova-compute[75066]:         <nova:project uuid="212e84a5aed6451fb2aa40a87de287d5">tempest-VolumesAssistedSnapshotsTest-773941717</nova:project>
Dec 01 19:15:42 user nova-compute[75066]:       </nova:owner>
Dec 01 19:15:42 user nova-compute[75066]:       <nova:root type="image" uuid="900b237b-e99c-4fdd-a44f-dcb7a08baa86"/>
Dec 01 19:15:42 user nova-compute[75066]:       <nova:ports>
Dec 01 19:15:42 user nova-compute[75066]:         <nova:port uuid="a6d11620-ab4c-4475-a3c6-3e2354955f95">
Dec 01 19:15:42 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Dec 01 19:15:42 user nova-compute[75066]:         </nova:port>
Dec 01 19:15:42 user nova-compute[75066]:       </nova:ports>
Dec 01 19:15:42 user nova-compute[75066]:     </nova:instance>
Dec 01 19:15:42 user nova-compute[75066]:   </metadata>
Dec 01 19:15:42 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:15:42 user nova-compute[75066]:     <system>
Dec 01 19:15:42 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:15:42 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:15:42 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:15:42 user nova-compute[75066]:       <entry name="serial">00ff7dfa-1da6-4e32-a227-0c194a5aa28f</entry>
Dec 01 19:15:42 user nova-compute[75066]:       <entry name="uuid">00ff7dfa-1da6-4e32-a227-0c194a5aa28f</entry>
Dec 01 19:15:42 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:15:42 user nova-compute[75066]:     </system>
Dec 01 19:15:42 user nova-compute[75066]:   </sysinfo>
Dec 01 19:15:42 user nova-compute[75066]:   <os>
Dec 01 19:15:42 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:15:42 user nova-compute[75066]:     <boot dev="hd"/>
Dec 01 19:15:42 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:15:42 user nova-compute[75066]:   </os>
Dec 01 19:15:42 user nova-compute[75066]:   <features>
Dec 01 19:15:42 user nova-compute[75066]:     <acpi/>
Dec 01 19:15:42 user nova-compute[75066]:     <apic/>
Dec 01 19:15:42 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:15:42 user nova-compute[75066]:   </features>
Dec 01 19:15:42 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:15:42 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:15:42 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:15:42 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:15:42 user nova-compute[75066]:   </clock>
Dec 01 19:15:42 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:15:42 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:15:42 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:15:42 user nova-compute[75066]:   </cpu>
Dec 01 19:15:42 user nova-compute[75066]:   <devices>
Dec 01 19:15:42 user nova-compute[75066]:     <disk type="file" device="disk">
Dec 01 19:15:42 user nova-compute[75066]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 19:15:42 user nova-compute[75066]:       <source file="/opt/stack/data/nova/instances/00ff7dfa-1da6-4e32-a227-0c194a5aa28f/disk"/>
Dec 01 19:15:42 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:15:42 user nova-compute[75066]:     </disk>
Dec 01 19:15:42 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:15:42 user nova-compute[75066]:       <mac address="fa:16:3e:93:04:1d"/>
Dec 01 19:15:42 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:15:42 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:15:42 user nova-compute[75066]:       <target dev="tapa6d11620-ab"/>
Dec 01 19:15:42 user nova-compute[75066]:     </interface>
Dec 01 19:15:42 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:15:42 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/00ff7dfa-1da6-4e32-a227-0c194a5aa28f/console.log" append="off"/>
Dec 01 19:15:42 user nova-compute[75066]:     </serial>
Dec 01 19:15:42 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:15:42 user nova-compute[75066]:     <video>
Dec 01 19:15:42 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:15:42 user nova-compute[75066]:     </video>
Dec 01 19:15:42 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:15:42 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:15:42 user nova-compute[75066]:     </rng>
Dec 01 19:15:42 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:15:42 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:15:42 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:15:42 user nova-compute[75066]:     </memballoon>
Dec 01 19:15:42 user nova-compute[75066]:   </devices>
Dec 01 19:15:42 user nova-compute[75066]: </domain>
Dec 01 19:15:42 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:15:42 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:15:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-754956822',display_name='tempest-VolumesAssistedSnapshotsTest-server-754956822',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-754956822',id=8,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJcfIcSljhGnHBDfEY4LYrFEGDFITQ5UoUxDih5goPenKoR6cUULRG6a7mVBN0TWe+/Kir7BdkC5ipIJgbA0Lxz2jt/gnuCjIJSLvehy8XOBaWGsKNS/oxOH3OChHCLNQ==',key_name='tempest-keypair-1580116847',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='212e84a5aed6451fb2aa40a87de287d5',ramdisk_id='',reservation_id='r-gug9ywdu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-773941717',owner_user_name='tempest-VolumesAssistedSnapshotsTest-773941717-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:15:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7aa029cbe5094890bcc390ad6b8dc477',uuid=00ff7dfa-1da6-4e32-a227-0c194a5aa28f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6d11620-ab4c-4475-a3c6-3e2354955f95", "address": "fa:16:3e:93:04:1d", "network": {"id": "9a1a0a90-7233-4d75-93a7-3cb72a60e8dc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1583104105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "212e84a5aed6451fb2aa40a87de287d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d11620-ab", "ovs_interfaceid": "a6d11620-ab4c-4475-a3c6-3e2354955f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:15:42 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Converting VIF {"id": "a6d11620-ab4c-4475-a3c6-3e2354955f95", "address": "fa:16:3e:93:04:1d", "network": {"id": "9a1a0a90-7233-4d75-93a7-3cb72a60e8dc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1583104105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "212e84a5aed6451fb2aa40a87de287d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d11620-ab", "ovs_interfaceid": "a6d11620-ab4c-4475-a3c6-3e2354955f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:15:42 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:93:04:1d,bridge_name='br-int',has_traffic_filtering=True,id=a6d11620-ab4c-4475-a3c6-3e2354955f95,network=Network(9a1a0a90-7233-4d75-93a7-3cb72a60e8dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6d11620-ab') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:15:42 user nova-compute[75066]: DEBUG os_vif [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:04:1d,bridge_name='br-int',has_traffic_filtering=True,id=a6d11620-ab4c-4475-a3c6-3e2354955f95,network=Network(9a1a0a90-7233-4d75-93a7-3cb72a60e8dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6d11620-ab') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:15:42 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:42 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:15:42 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:15:42 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-5305d606-ab98-4f4a-aed6-f1e2939c1395 req-711e2ced-ba85-4d67-b003-b261ab6112cf service nova] Releasing lock "refresh_cache-dd67db6c-8bd1-402e-93ce-9b2d7a405a6e" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:15:42 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:42 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '24af1f34-77cb-58fc-b571-e4317cfa322c', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:15:42 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:42 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:15:42 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:42 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa6d11620-ab, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:15:42 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa6d11620-ab, col_values=(('qos', UUID('039ef674-d680-4ba1-87a9-9a66a8ed597a')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:15:42 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa6d11620-ab, col_values=(('external_ids', {'iface-id': 'a6d11620-ab4c-4475-a3c6-3e2354955f95', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:93:04:1d', 'vm-uuid': '00ff7dfa-1da6-4e32-a227-0c194a5aa28f'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:15:42 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:15:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:43 user nova-compute[75066]: INFO os_vif [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:93:04:1d,bridge_name='br-int',has_traffic_filtering=True,id=a6d11620-ab4c-4475-a3c6-3e2354955f95,network=Network(9a1a0a90-7233-4d75-93a7-3cb72a60e8dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6d11620-ab')
Dec 01 19:15:43 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:15:43 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] No VIF found with MAC fa:16:3e:93:04:1d, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:15:43 user nova-compute[75066]: DEBUG nova.network.neutron [req-8e0d0daa-2cc4-45e4-925e-5fe3ee2359f8 req-8f6938f6-fc34-4dc7-9149-f9a81a4258b1 service nova] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Updated VIF entry in instance network info cache for port a6d11620-ab4c-4475-a3c6-3e2354955f95. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:15:43 user nova-compute[75066]: DEBUG nova.network.neutron [req-8e0d0daa-2cc4-45e4-925e-5fe3ee2359f8 req-8f6938f6-fc34-4dc7-9149-f9a81a4258b1 service nova] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Updating instance_info_cache with network_info: [{"id": "a6d11620-ab4c-4475-a3c6-3e2354955f95", "address": "fa:16:3e:93:04:1d", "network": {"id": "9a1a0a90-7233-4d75-93a7-3cb72a60e8dc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1583104105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "212e84a5aed6451fb2aa40a87de287d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d11620-ab", "ovs_interfaceid": "a6d11620-ab4c-4475-a3c6-3e2354955f95", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:15:43 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-8e0d0daa-2cc4-45e4-925e-5fe3ee2359f8 req-8f6938f6-fc34-4dc7-9149-f9a81a4258b1 service nova] Releasing lock "refresh_cache-00ff7dfa-1da6-4e32-a227-0c194a5aa28f" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:15:44 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:44 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:44 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:44 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:44 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:45 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:45 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:45 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:45 user nova-compute[75066]: DEBUG nova.compute.manager [req-f0050fee-5f52-4981-b7df-5b33b9a2272a req-6dcaa7bc-e8c7-4624-bc95-c40e16588dd4 service nova] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] Received event network-vif-plugged-ba7d09a3-d2cc-43ca-a1e8-278f841ae513 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:15:45 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-f0050fee-5f52-4981-b7df-5b33b9a2272a req-6dcaa7bc-e8c7-4624-bc95-c40e16588dd4 service nova] Acquiring lock "f253bb0a-6cd0-4e62-8bcb-898537ce8c0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:15:45 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-f0050fee-5f52-4981-b7df-5b33b9a2272a req-6dcaa7bc-e8c7-4624-bc95-c40e16588dd4 service nova] Lock "f253bb0a-6cd0-4e62-8bcb-898537ce8c0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:15:45 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-f0050fee-5f52-4981-b7df-5b33b9a2272a req-6dcaa7bc-e8c7-4624-bc95-c40e16588dd4 service nova] Lock "f253bb0a-6cd0-4e62-8bcb-898537ce8c0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:15:45 user nova-compute[75066]: DEBUG nova.compute.manager [req-f0050fee-5f52-4981-b7df-5b33b9a2272a req-6dcaa7bc-e8c7-4624-bc95-c40e16588dd4 service nova] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] No waiting events found dispatching network-vif-plugged-ba7d09a3-d2cc-43ca-a1e8-278f841ae513 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:15:45 user nova-compute[75066]: WARNING nova.compute.manager [req-f0050fee-5f52-4981-b7df-5b33b9a2272a req-6dcaa7bc-e8c7-4624-bc95-c40e16588dd4 service nova] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] Received unexpected event network-vif-plugged-ba7d09a3-d2cc-43ca-a1e8-278f841ae513 for instance with vm_state active and task_state None.
Dec 01 19:15:46 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:46 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:46 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:46 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:46 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:47 user nova-compute[75066]: DEBUG nova.compute.manager [req-d819f501-0d1b-4a21-acc0-7e2a77ae68ec req-fa6202e0-0949-499b-8397-2aec1c66ea5e service nova] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Received event network-vif-plugged-478e7aea-9546-4659-bdac-09213bd9cb82 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:15:47 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d819f501-0d1b-4a21-acc0-7e2a77ae68ec req-fa6202e0-0949-499b-8397-2aec1c66ea5e service nova] Acquiring lock "dd546862-fcd5-4b69-8ea3-a8fa4859a489-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:15:47 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d819f501-0d1b-4a21-acc0-7e2a77ae68ec req-fa6202e0-0949-499b-8397-2aec1c66ea5e service nova] Lock "dd546862-fcd5-4b69-8ea3-a8fa4859a489-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:15:47 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d819f501-0d1b-4a21-acc0-7e2a77ae68ec req-fa6202e0-0949-499b-8397-2aec1c66ea5e service nova] Lock "dd546862-fcd5-4b69-8ea3-a8fa4859a489-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:15:47 user nova-compute[75066]: DEBUG nova.compute.manager [req-d819f501-0d1b-4a21-acc0-7e2a77ae68ec req-fa6202e0-0949-499b-8397-2aec1c66ea5e service nova] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] No waiting events found dispatching network-vif-plugged-478e7aea-9546-4659-bdac-09213bd9cb82 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:15:47 user nova-compute[75066]: WARNING nova.compute.manager [req-d819f501-0d1b-4a21-acc0-7e2a77ae68ec req-fa6202e0-0949-499b-8397-2aec1c66ea5e service nova] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Received unexpected event network-vif-plugged-478e7aea-9546-4659-bdac-09213bd9cb82 for instance with vm_state active and task_state None.
Dec 01 19:15:47 user nova-compute[75066]: DEBUG nova.compute.manager [req-c25c4423-73d9-48d6-b07f-5066ee82a412 req-ae72e365-245b-4f9b-880a-cc815d55208a service nova] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] Received event network-vif-plugged-ba7d09a3-d2cc-43ca-a1e8-278f841ae513 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:15:47 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-c25c4423-73d9-48d6-b07f-5066ee82a412 req-ae72e365-245b-4f9b-880a-cc815d55208a service nova] Acquiring lock "f253bb0a-6cd0-4e62-8bcb-898537ce8c0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:15:47 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-c25c4423-73d9-48d6-b07f-5066ee82a412 req-ae72e365-245b-4f9b-880a-cc815d55208a service nova] Lock "f253bb0a-6cd0-4e62-8bcb-898537ce8c0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:15:47 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-c25c4423-73d9-48d6-b07f-5066ee82a412 req-ae72e365-245b-4f9b-880a-cc815d55208a service nova] Lock "f253bb0a-6cd0-4e62-8bcb-898537ce8c0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:15:47 user nova-compute[75066]: DEBUG nova.compute.manager [req-c25c4423-73d9-48d6-b07f-5066ee82a412 req-ae72e365-245b-4f9b-880a-cc815d55208a service nova] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] No waiting events found dispatching network-vif-plugged-ba7d09a3-d2cc-43ca-a1e8-278f841ae513 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:15:47 user nova-compute[75066]: WARNING nova.compute.manager [req-c25c4423-73d9-48d6-b07f-5066ee82a412 req-ae72e365-245b-4f9b-880a-cc815d55208a service nova] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] Received unexpected event network-vif-plugged-ba7d09a3-d2cc-43ca-a1e8-278f841ae513 for instance with vm_state active and task_state None.
Dec 01 19:15:47 user nova-compute[75066]: DEBUG nova.compute.manager [req-c25c4423-73d9-48d6-b07f-5066ee82a412 req-ae72e365-245b-4f9b-880a-cc815d55208a service nova] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Received event network-vif-plugged-0a73848e-3c30-4e3a-a8ef-3092afe91d25 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:15:47 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-c25c4423-73d9-48d6-b07f-5066ee82a412 req-ae72e365-245b-4f9b-880a-cc815d55208a service nova] Acquiring lock "dd67db6c-8bd1-402e-93ce-9b2d7a405a6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:15:47 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-c25c4423-73d9-48d6-b07f-5066ee82a412 req-ae72e365-245b-4f9b-880a-cc815d55208a service nova] Lock "dd67db6c-8bd1-402e-93ce-9b2d7a405a6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:15:47 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-c25c4423-73d9-48d6-b07f-5066ee82a412 req-ae72e365-245b-4f9b-880a-cc815d55208a service nova] Lock "dd67db6c-8bd1-402e-93ce-9b2d7a405a6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:15:47 user nova-compute[75066]: DEBUG nova.compute.manager [req-c25c4423-73d9-48d6-b07f-5066ee82a412 req-ae72e365-245b-4f9b-880a-cc815d55208a service nova] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] No waiting events found dispatching network-vif-plugged-0a73848e-3c30-4e3a-a8ef-3092afe91d25 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:15:47 user nova-compute[75066]: WARNING nova.compute.manager [req-c25c4423-73d9-48d6-b07f-5066ee82a412 req-ae72e365-245b-4f9b-880a-cc815d55208a service nova] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Received unexpected event network-vif-plugged-0a73848e-3c30-4e3a-a8ef-3092afe91d25 for instance with vm_state building and task_state spawning.
Dec 01 19:15:47 user nova-compute[75066]: DEBUG nova.compute.manager [req-c25c4423-73d9-48d6-b07f-5066ee82a412 req-ae72e365-245b-4f9b-880a-cc815d55208a service nova] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Received event network-vif-plugged-0a73848e-3c30-4e3a-a8ef-3092afe91d25 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:15:47 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-c25c4423-73d9-48d6-b07f-5066ee82a412 req-ae72e365-245b-4f9b-880a-cc815d55208a service nova] Acquiring lock "dd67db6c-8bd1-402e-93ce-9b2d7a405a6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:15:47 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-c25c4423-73d9-48d6-b07f-5066ee82a412 req-ae72e365-245b-4f9b-880a-cc815d55208a service nova] Lock "dd67db6c-8bd1-402e-93ce-9b2d7a405a6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:15:47 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-c25c4423-73d9-48d6-b07f-5066ee82a412 req-ae72e365-245b-4f9b-880a-cc815d55208a service nova] Lock "dd67db6c-8bd1-402e-93ce-9b2d7a405a6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:15:47 user nova-compute[75066]: DEBUG nova.compute.manager [req-c25c4423-73d9-48d6-b07f-5066ee82a412 req-ae72e365-245b-4f9b-880a-cc815d55208a service nova] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] No waiting events found dispatching network-vif-plugged-0a73848e-3c30-4e3a-a8ef-3092afe91d25 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:15:47 user nova-compute[75066]: WARNING nova.compute.manager [req-c25c4423-73d9-48d6-b07f-5066ee82a412 req-ae72e365-245b-4f9b-880a-cc815d55208a service nova] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Received unexpected event network-vif-plugged-0a73848e-3c30-4e3a-a8ef-3092afe91d25 for instance with vm_state building and task_state spawning.
Dec 01 19:15:47 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:48 user nova-compute[75066]: DEBUG nova.compute.manager [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Instance event wait completed in 0 seconds for  {{(pid=75066) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 19:15:48 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Guest created on hypervisor {{(pid=75066) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 19:15:48 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Instance spawned successfully.
Dec 01 19:15:48 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 19:15:48 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Found default for hw_cdrom_bus of ide {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:15:48 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Found default for hw_disk_bus of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:15:48 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Found default for hw_input_bus of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:15:48 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Found default for hw_pointer_model of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:15:48 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Found default for hw_video_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:15:48 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Found default for hw_vif_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:15:48 user nova-compute[75066]: DEBUG nova.compute.manager [req-6b06f8b1-5a27-4962-aff7-57f587eb9030 req-a710eef5-c772-4c24-b89e-a6bb090104bd service nova] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Received event network-vif-plugged-a6d11620-ab4c-4475-a3c6-3e2354955f95 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:15:48 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-6b06f8b1-5a27-4962-aff7-57f587eb9030 req-a710eef5-c772-4c24-b89e-a6bb090104bd service nova] Acquiring lock "00ff7dfa-1da6-4e32-a227-0c194a5aa28f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:15:48 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-6b06f8b1-5a27-4962-aff7-57f587eb9030 req-a710eef5-c772-4c24-b89e-a6bb090104bd service nova] Lock "00ff7dfa-1da6-4e32-a227-0c194a5aa28f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:15:48 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-6b06f8b1-5a27-4962-aff7-57f587eb9030 req-a710eef5-c772-4c24-b89e-a6bb090104bd service nova] Lock "00ff7dfa-1da6-4e32-a227-0c194a5aa28f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:15:48 user nova-compute[75066]: DEBUG nova.compute.manager [req-6b06f8b1-5a27-4962-aff7-57f587eb9030 req-a710eef5-c772-4c24-b89e-a6bb090104bd service nova] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] No waiting events found dispatching network-vif-plugged-a6d11620-ab4c-4475-a3c6-3e2354955f95 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:15:48 user nova-compute[75066]: WARNING nova.compute.manager [req-6b06f8b1-5a27-4962-aff7-57f587eb9030 req-a710eef5-c772-4c24-b89e-a6bb090104bd service nova] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Received unexpected event network-vif-plugged-a6d11620-ab4c-4475-a3c6-3e2354955f95 for instance with vm_state building and task_state spawning.
Dec 01 19:15:48 user nova-compute[75066]: INFO nova.compute.manager [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Took 12.19 seconds to spawn the instance on the hypervisor.
Dec 01 19:15:48 user nova-compute[75066]: DEBUG nova.compute.manager [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:15:49 user nova-compute[75066]: INFO nova.compute.manager [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Took 13.91 seconds to build instance.
Dec 01 19:15:49 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e3b3d63d-6866-46c4-9427-ffd7f7868731 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Lock "dd67db6c-8bd1-402e-93ce-9b2d7a405a6e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.129s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:15:49 user nova-compute[75066]: DEBUG nova.compute.manager [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Instance event wait completed in 0 seconds for  {{(pid=75066) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 19:15:49 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Guest created on hypervisor {{(pid=75066) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 19:15:49 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Instance spawned successfully.
Dec 01 19:15:49 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 19:15:49 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Found default for hw_cdrom_bus of ide {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:15:49 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Found default for hw_disk_bus of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:15:49 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Found default for hw_input_bus of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:15:49 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Found default for hw_pointer_model of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:15:49 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Found default for hw_video_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:15:49 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Found default for hw_vif_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:15:49 user nova-compute[75066]: INFO nova.compute.manager [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Took 10.09 seconds to spawn the instance on the hypervisor.
Dec 01 19:15:49 user nova-compute[75066]: DEBUG nova.compute.manager [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:15:49 user nova-compute[75066]: DEBUG nova.compute.manager [req-e55c980a-06ef-4061-b4dd-52897b32c0e2 req-ad6a6350-ca48-4d74-b418-2a81871a684c service nova] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Received event network-vif-plugged-478e7aea-9546-4659-bdac-09213bd9cb82 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:15:49 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-e55c980a-06ef-4061-b4dd-52897b32c0e2 req-ad6a6350-ca48-4d74-b418-2a81871a684c service nova] Acquiring lock "dd546862-fcd5-4b69-8ea3-a8fa4859a489-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:15:49 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-e55c980a-06ef-4061-b4dd-52897b32c0e2 req-ad6a6350-ca48-4d74-b418-2a81871a684c service nova] Lock "dd546862-fcd5-4b69-8ea3-a8fa4859a489-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:15:49 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-e55c980a-06ef-4061-b4dd-52897b32c0e2 req-ad6a6350-ca48-4d74-b418-2a81871a684c service nova] Lock "dd546862-fcd5-4b69-8ea3-a8fa4859a489-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:15:49 user nova-compute[75066]: DEBUG nova.compute.manager [req-e55c980a-06ef-4061-b4dd-52897b32c0e2 req-ad6a6350-ca48-4d74-b418-2a81871a684c service nova] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] No waiting events found dispatching network-vif-plugged-478e7aea-9546-4659-bdac-09213bd9cb82 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:15:49 user nova-compute[75066]: WARNING nova.compute.manager [req-e55c980a-06ef-4061-b4dd-52897b32c0e2 req-ad6a6350-ca48-4d74-b418-2a81871a684c service nova] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Received unexpected event network-vif-plugged-478e7aea-9546-4659-bdac-09213bd9cb82 for instance with vm_state active and task_state None.
Dec 01 19:15:50 user nova-compute[75066]: INFO nova.compute.manager [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Took 11.79 seconds to build instance.
Dec 01 19:15:50 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-81efb149-9c69-49c2-a123-99464e8f789c tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Lock "00ff7dfa-1da6-4e32-a227-0c194a5aa28f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.976s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:15:50 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:50 user nova-compute[75066]: DEBUG nova.compute.manager [req-18c69365-ff6f-4edf-a67e-6eb81b1ec15b req-3a3d8f45-f093-49a9-854e-706708f326ea service nova] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Received event network-vif-plugged-a6d11620-ab4c-4475-a3c6-3e2354955f95 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:15:50 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-18c69365-ff6f-4edf-a67e-6eb81b1ec15b req-3a3d8f45-f093-49a9-854e-706708f326ea service nova] Acquiring lock "00ff7dfa-1da6-4e32-a227-0c194a5aa28f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:15:50 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-18c69365-ff6f-4edf-a67e-6eb81b1ec15b req-3a3d8f45-f093-49a9-854e-706708f326ea service nova] Lock "00ff7dfa-1da6-4e32-a227-0c194a5aa28f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:15:50 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-18c69365-ff6f-4edf-a67e-6eb81b1ec15b req-3a3d8f45-f093-49a9-854e-706708f326ea service nova] Lock "00ff7dfa-1da6-4e32-a227-0c194a5aa28f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:15:50 user nova-compute[75066]: DEBUG nova.compute.manager [req-18c69365-ff6f-4edf-a67e-6eb81b1ec15b req-3a3d8f45-f093-49a9-854e-706708f326ea service nova] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] No waiting events found dispatching network-vif-plugged-a6d11620-ab4c-4475-a3c6-3e2354955f95 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:15:50 user nova-compute[75066]: WARNING nova.compute.manager [req-18c69365-ff6f-4edf-a67e-6eb81b1ec15b req-3a3d8f45-f093-49a9-854e-706708f326ea service nova] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Received unexpected event network-vif-plugged-a6d11620-ab4c-4475-a3c6-3e2354955f95 for instance with vm_state active and task_state None.
Dec 01 19:15:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:52 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Acquiring lock "47bd5998-8ded-4a9c-8b98-f0658a526f47" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:15:52 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Lock "47bd5998-8ded-4a9c-8b98-f0658a526f47" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:15:52 user nova-compute[75066]: DEBUG nova.compute.manager [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] [instance: 47bd5998-8ded-4a9c-8b98-f0658a526f47] Starting instance... {{(pid=75066) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 19:15:52 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:15:52 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Cleaning up deleted instances {{(pid=75066) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 01 19:15:52 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] There are 0 instances to clean {{(pid=75066) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 01 19:15:52 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:15:52 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75066) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 01 19:15:52 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:15:52 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:15:52 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:15:52 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75066) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 19:15:52 user nova-compute[75066]: INFO nova.compute.claims [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] [instance: 47bd5998-8ded-4a9c-8b98-f0658a526f47] Claim successful on node user
Dec 01 19:15:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:53 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:15:53 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:15:53 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.903s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:15:53 user nova-compute[75066]: DEBUG nova.compute.manager [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] [instance: 47bd5998-8ded-4a9c-8b98-f0658a526f47] Start building networks asynchronously for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 19:15:53 user nova-compute[75066]: DEBUG nova.compute.manager [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] [instance: 47bd5998-8ded-4a9c-8b98-f0658a526f47] Allocating IP information in the background. {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 19:15:53 user nova-compute[75066]: DEBUG nova.network.neutron [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] [instance: 47bd5998-8ded-4a9c-8b98-f0658a526f47] allocate_for_instance() {{(pid=75066) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 19:15:53 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] [instance: 47bd5998-8ded-4a9c-8b98-f0658a526f47] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 19:15:53 user nova-compute[75066]: DEBUG nova.compute.manager [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] [instance: 47bd5998-8ded-4a9c-8b98-f0658a526f47] Start building block device mappings for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 19:15:53 user nova-compute[75066]: DEBUG nova.policy [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '810ed8c7290946fc87c1b95c8b574150', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '588c6f5a3e3c4427887e9dab6fb17cb2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75066) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 19:15:53 user nova-compute[75066]: DEBUG nova.compute.manager [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] [instance: 47bd5998-8ded-4a9c-8b98-f0658a526f47] Start spawning the instance on the hypervisor. {{(pid=75066) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 19:15:53 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] [instance: 47bd5998-8ded-4a9c-8b98-f0658a526f47] Creating instance directory {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 19:15:53 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] [instance: 47bd5998-8ded-4a9c-8b98-f0658a526f47] Creating image(s)
Dec 01 19:15:53 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Acquiring lock "/opt/stack/data/nova/instances/47bd5998-8ded-4a9c-8b98-f0658a526f47/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:15:53 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Lock "/opt/stack/data/nova/instances/47bd5998-8ded-4a9c-8b98-f0658a526f47/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:15:53 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Lock "/opt/stack/data/nova/instances/47bd5998-8ded-4a9c-8b98-f0658a526f47/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:15:53 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:15:54 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.318s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:15:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Acquiring lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:15:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:15:54 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:15:54 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.279s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:15:54 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/47bd5998-8ded-4a9c-8b98-f0658a526f47/disk 1073741824 {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:15:54 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:15:54 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/47bd5998-8ded-4a9c-8b98-f0658a526f47/disk 1073741824" returned: 0 in 0.088s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:15:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.384s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:15:54 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:15:54 user nova-compute[75066]: DEBUG nova.network.neutron [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] [instance: 47bd5998-8ded-4a9c-8b98-f0658a526f47] Successfully created port: fd31d06c-eab4-4e76-a35b-ca65d171d3c5 {{(pid=75066) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 19:15:54 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.243s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:15:54 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Checking if we can resize image /opt/stack/data/nova/instances/47bd5998-8ded-4a9c-8b98-f0658a526f47/disk. size=1073741824 {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 19:15:54 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47bd5998-8ded-4a9c-8b98-f0658a526f47/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:15:55 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47bd5998-8ded-4a9c-8b98-f0658a526f47/disk --force-share --output=json" returned: 0 in 0.343s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:15:55 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Cannot resize image /opt/stack/data/nova/instances/47bd5998-8ded-4a9c-8b98-f0658a526f47/disk to a smaller size. {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 19:15:55 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] [instance: 47bd5998-8ded-4a9c-8b98-f0658a526f47] Created local disks {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 19:15:55 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] [instance: 47bd5998-8ded-4a9c-8b98-f0658a526f47] Ensure instance console log exists: /opt/stack/data/nova/instances/47bd5998-8ded-4a9c-8b98-f0658a526f47/console.log {{(pid=75066) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 19:15:55 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:15:55 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:15:55 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:15:55 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:15:55 user nova-compute[75066]: DEBUG nova.network.neutron [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] [instance: 47bd5998-8ded-4a9c-8b98-f0658a526f47] Successfully updated port: fd31d06c-eab4-4e76-a35b-ca65d171d3c5 {{(pid=75066) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 19:15:55 user nova-compute[75066]: DEBUG nova.compute.manager [req-5e4ab705-163b-4b42-9003-0dfd5fd8a1b4 req-26414d87-0a78-4a6b-b332-9dccd998b6f9 service nova] [instance: 47bd5998-8ded-4a9c-8b98-f0658a526f47] Received event network-changed-fd31d06c-eab4-4e76-a35b-ca65d171d3c5 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:15:55 user nova-compute[75066]: DEBUG nova.compute.manager [req-5e4ab705-163b-4b42-9003-0dfd5fd8a1b4 req-26414d87-0a78-4a6b-b332-9dccd998b6f9 service nova] [instance: 47bd5998-8ded-4a9c-8b98-f0658a526f47] Refreshing instance network info cache due to event network-changed-fd31d06c-eab4-4e76-a35b-ca65d171d3c5. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:15:55 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-5e4ab705-163b-4b42-9003-0dfd5fd8a1b4 req-26414d87-0a78-4a6b-b332-9dccd998b6f9 service nova] Acquiring lock "refresh_cache-47bd5998-8ded-4a9c-8b98-f0658a526f47" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:15:55 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-5e4ab705-163b-4b42-9003-0dfd5fd8a1b4 req-26414d87-0a78-4a6b-b332-9dccd998b6f9 service nova] Acquired lock "refresh_cache-47bd5998-8ded-4a9c-8b98-f0658a526f47" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:15:55 user nova-compute[75066]: DEBUG nova.network.neutron [req-5e4ab705-163b-4b42-9003-0dfd5fd8a1b4 req-26414d87-0a78-4a6b-b332-9dccd998b6f9 service nova] [instance: 47bd5998-8ded-4a9c-8b98-f0658a526f47] Refreshing network info cache for port fd31d06c-eab4-4e76-a35b-ca65d171d3c5 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:15:55 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Acquiring lock "refresh_cache-47bd5998-8ded-4a9c-8b98-f0658a526f47" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:15:55 user nova-compute[75066]: DEBUG nova.network.neutron [req-5e4ab705-163b-4b42-9003-0dfd5fd8a1b4 req-26414d87-0a78-4a6b-b332-9dccd998b6f9 service nova] [instance: 47bd5998-8ded-4a9c-8b98-f0658a526f47] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:15:56 user nova-compute[75066]: DEBUG nova.network.neutron [req-5e4ab705-163b-4b42-9003-0dfd5fd8a1b4 req-26414d87-0a78-4a6b-b332-9dccd998b6f9 service nova] [instance: 47bd5998-8ded-4a9c-8b98-f0658a526f47] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:15:56 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:15:56 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Starting heal instance info cache {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 19:15:56 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Rebuilding the list of instances to heal {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 19:15:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-5e4ab705-163b-4b42-9003-0dfd5fd8a1b4 req-26414d87-0a78-4a6b-b332-9dccd998b6f9 service nova] Releasing lock "refresh_cache-47bd5998-8ded-4a9c-8b98-f0658a526f47" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:15:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Acquired lock "refresh_cache-47bd5998-8ded-4a9c-8b98-f0658a526f47" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:15:56 user nova-compute[75066]: DEBUG nova.network.neutron [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] [instance: 47bd5998-8ded-4a9c-8b98-f0658a526f47] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:15:56 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: 47bd5998-8ded-4a9c-8b98-f0658a526f47] Skipping network cache update for instance because it is Building. {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Dec 01 19:15:56 user nova-compute[75066]: DEBUG nova.network.neutron [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] [instance: 47bd5998-8ded-4a9c-8b98-f0658a526f47] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:15:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "refresh_cache-67c5dd7c-88aa-4f2f-8f62-a9af0480c38e" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:15:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquired lock "refresh_cache-67c5dd7c-88aa-4f2f-8f62-a9af0480c38e" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:15:56 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Forcefully refreshing network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 19:15:56 user nova-compute[75066]: DEBUG nova.objects.instance [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lazy-loading 'info_cache' on Instance uuid 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:15:56 user nova-compute[75066]: DEBUG nova.network.neutron [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] [instance: 47bd5998-8ded-4a9c-8b98-f0658a526f47] Updating instance_info_cache with network_info: [{"id": "fd31d06c-eab4-4e76-a35b-ca65d171d3c5", "address": "fa:16:3e:ce:12:83", "network": {"id": "c348a6f7-f0af-42c3-9464-a81ae42a7890", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1057676448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "588c6f5a3e3c4427887e9dab6fb17cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd31d06c-ea", "ovs_interfaceid": "fd31d06c-eab4-4e76-a35b-ca65d171d3c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:15:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Releasing lock "refresh_cache-47bd5998-8ded-4a9c-8b98-f0658a526f47" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:15:56 user nova-compute[75066]: DEBUG nova.compute.manager [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] [instance: 47bd5998-8ded-4a9c-8b98-f0658a526f47] Instance network_info: |[{"id": "fd31d06c-eab4-4e76-a35b-ca65d171d3c5", "address": "fa:16:3e:ce:12:83", "network": {"id": "c348a6f7-f0af-42c3-9464-a81ae42a7890", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1057676448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "588c6f5a3e3c4427887e9dab6fb17cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd31d06c-ea", "ovs_interfaceid": "fd31d06c-eab4-4e76-a35b-ca65d171d3c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 19:15:56 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] [instance: 47bd5998-8ded-4a9c-8b98-f0658a526f47] Start _get_guest_xml network_info=[{"id": "fd31d06c-eab4-4e76-a35b-ca65d171d3c5", "address": "fa:16:3e:ce:12:83", "network": {"id": "c348a6f7-f0af-42c3-9464-a81ae42a7890", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1057676448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "588c6f5a3e3c4427887e9dab6fb17cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd31d06c-ea", "ovs_interfaceid": "fd31d06c-eab4-4e76-a35b-ca65d171d3c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'image_id': '900b237b-e99c-4fdd-a44f-dcb7a08baa86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:15:56 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:56 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:15:56 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:15:56 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:15:56 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:15:56 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:15:56 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:15:56 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:15:56 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:15:56 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:15:56 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:15:56 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:15:56 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:15:56 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:15:56 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:15:56 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:15:56 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:15:56 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:15:56 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:15:56 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:15:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1736469981',display_name='tempest-VolumesActionsTest-instance-1736469981',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1736469981',id=9,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='588c6f5a3e3c4427887e9dab6fb17cb2',ramdisk_id='',reservation_id='r-8ewqcnqi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-580795590',owner_user_name='tempest-VolumesActionsTest-580795590-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:15:54Z,user_data=None,user_id='810ed8c7290946fc87c1b95c8b574150',uuid=47bd5998-8ded-4a9c-8b98-f0658a526f47,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd31d06c-eab4-4e76-a35b-ca65d171d3c5", "address": "fa:16:3e:ce:12:83", "network": {"id": "c348a6f7-f0af-42c3-9464-a81ae42a7890", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1057676448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "588c6f5a3e3c4427887e9dab6fb17cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd31d06c-ea", "ovs_interfaceid": "fd31d06c-eab4-4e76-a35b-ca65d171d3c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:15:56 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Converting VIF {"id": "fd31d06c-eab4-4e76-a35b-ca65d171d3c5", "address": "fa:16:3e:ce:12:83", "network": {"id": "c348a6f7-f0af-42c3-9464-a81ae42a7890", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1057676448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "588c6f5a3e3c4427887e9dab6fb17cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd31d06c-ea", "ovs_interfaceid": "fd31d06c-eab4-4e76-a35b-ca65d171d3c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:15:56 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:12:83,bridge_name='br-int',has_traffic_filtering=True,id=fd31d06c-eab4-4e76-a35b-ca65d171d3c5,network=Network(c348a6f7-f0af-42c3-9464-a81ae42a7890),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd31d06c-ea') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:15:56 user nova-compute[75066]: DEBUG nova.objects.instance [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Lazy-loading 'pci_devices' on Instance uuid 47bd5998-8ded-4a9c-8b98-f0658a526f47 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:15:56 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] [instance: 47bd5998-8ded-4a9c-8b98-f0658a526f47] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:15:56 user nova-compute[75066]:   <uuid>47bd5998-8ded-4a9c-8b98-f0658a526f47</uuid>
Dec 01 19:15:56 user nova-compute[75066]:   <name>instance-00000009</name>
Dec 01 19:15:56 user nova-compute[75066]:   <memory>524288</memory>
Dec 01 19:15:56 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:15:56 user nova-compute[75066]:   <metadata>
Dec 01 19:15:56 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:15:56 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:15:56 user nova-compute[75066]:       <nova:name>tempest-VolumesActionsTest-instance-1736469981</nova:name>
Dec 01 19:15:56 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:15:56</nova:creationTime>
Dec 01 19:15:56 user nova-compute[75066]:       <nova:flavor name="m1.tiny">
Dec 01 19:15:56 user nova-compute[75066]:         <nova:memory>512</nova:memory>
Dec 01 19:15:56 user nova-compute[75066]:         <nova:disk>1</nova:disk>
Dec 01 19:15:56 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:15:56 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:15:56 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:15:56 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:15:56 user nova-compute[75066]:       <nova:owner>
Dec 01 19:15:56 user nova-compute[75066]:         <nova:user uuid="810ed8c7290946fc87c1b95c8b574150">tempest-VolumesActionsTest-580795590-project-member</nova:user>
Dec 01 19:15:56 user nova-compute[75066]:         <nova:project uuid="588c6f5a3e3c4427887e9dab6fb17cb2">tempest-VolumesActionsTest-580795590</nova:project>
Dec 01 19:15:56 user nova-compute[75066]:       </nova:owner>
Dec 01 19:15:56 user nova-compute[75066]:       <nova:root type="image" uuid="900b237b-e99c-4fdd-a44f-dcb7a08baa86"/>
Dec 01 19:15:56 user nova-compute[75066]:       <nova:ports>
Dec 01 19:15:56 user nova-compute[75066]:         <nova:port uuid="fd31d06c-eab4-4e76-a35b-ca65d171d3c5">
Dec 01 19:15:56 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 01 19:15:56 user nova-compute[75066]:         </nova:port>
Dec 01 19:15:56 user nova-compute[75066]:       </nova:ports>
Dec 01 19:15:56 user nova-compute[75066]:     </nova:instance>
Dec 01 19:15:56 user nova-compute[75066]:   </metadata>
Dec 01 19:15:56 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:15:56 user nova-compute[75066]:     <system>
Dec 01 19:15:56 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:15:56 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:15:56 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:15:56 user nova-compute[75066]:       <entry name="serial">47bd5998-8ded-4a9c-8b98-f0658a526f47</entry>
Dec 01 19:15:56 user nova-compute[75066]:       <entry name="uuid">47bd5998-8ded-4a9c-8b98-f0658a526f47</entry>
Dec 01 19:15:56 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:15:56 user nova-compute[75066]:     </system>
Dec 01 19:15:56 user nova-compute[75066]:   </sysinfo>
Dec 01 19:15:56 user nova-compute[75066]:   <os>
Dec 01 19:15:56 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:15:56 user nova-compute[75066]:     <boot dev="hd"/>
Dec 01 19:15:56 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:15:56 user nova-compute[75066]:   </os>
Dec 01 19:15:56 user nova-compute[75066]:   <features>
Dec 01 19:15:56 user nova-compute[75066]:     <acpi/>
Dec 01 19:15:56 user nova-compute[75066]:     <apic/>
Dec 01 19:15:56 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:15:56 user nova-compute[75066]:   </features>
Dec 01 19:15:56 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:15:56 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:15:56 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:15:56 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:15:56 user nova-compute[75066]:   </clock>
Dec 01 19:15:56 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:15:56 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:15:56 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:15:56 user nova-compute[75066]:   </cpu>
Dec 01 19:15:56 user nova-compute[75066]:   <devices>
Dec 01 19:15:56 user nova-compute[75066]:     <disk type="file" device="disk">
Dec 01 19:15:56 user nova-compute[75066]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 19:15:56 user nova-compute[75066]:       <source file="/opt/stack/data/nova/instances/47bd5998-8ded-4a9c-8b98-f0658a526f47/disk"/>
Dec 01 19:15:56 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:15:56 user nova-compute[75066]:     </disk>
Dec 01 19:15:56 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:15:56 user nova-compute[75066]:       <mac address="fa:16:3e:ce:12:83"/>
Dec 01 19:15:56 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:15:56 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:15:56 user nova-compute[75066]:       <target dev="tapfd31d06c-ea"/>
Dec 01 19:15:56 user nova-compute[75066]:     </interface>
Dec 01 19:15:56 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:15:56 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/47bd5998-8ded-4a9c-8b98-f0658a526f47/console.log" append="off"/>
Dec 01 19:15:56 user nova-compute[75066]:     </serial>
Dec 01 19:15:56 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:15:56 user nova-compute[75066]:     <video>
Dec 01 19:15:56 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:15:56 user nova-compute[75066]:     </video>
Dec 01 19:15:56 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:15:56 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:15:56 user nova-compute[75066]:     </rng>
Dec 01 19:15:56 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:15:56 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:15:56 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:15:56 user nova-compute[75066]:     </memballoon>
Dec 01 19:15:56 user nova-compute[75066]:   </devices>
Dec 01 19:15:56 user nova-compute[75066]: </domain>
Dec 01 19:15:56 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:15:56 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:15:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1736469981',display_name='tempest-VolumesActionsTest-instance-1736469981',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1736469981',id=9,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='588c6f5a3e3c4427887e9dab6fb17cb2',ramdisk_id='',reservation_id='r-8ewqcnqi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-580795590',owner_user_name='tempest-VolumesActionsTest-580795590-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:15:54Z,user_data=None,user_id='810ed8c7290946fc87c1b95c8b574150',uuid=47bd5998-8ded-4a9c-8b98-f0658a526f47,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd31d06c-eab4-4e76-a35b-ca65d171d3c5", "address": "fa:16:3e:ce:12:83", "network": {"id": "c348a6f7-f0af-42c3-9464-a81ae42a7890", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1057676448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "588c6f5a3e3c4427887e9dab6fb17cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd31d06c-ea", "ovs_interfaceid": "fd31d06c-eab4-4e76-a35b-ca65d171d3c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:15:56 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Converting VIF {"id": "fd31d06c-eab4-4e76-a35b-ca65d171d3c5", "address": "fa:16:3e:ce:12:83", "network": {"id": "c348a6f7-f0af-42c3-9464-a81ae42a7890", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1057676448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "588c6f5a3e3c4427887e9dab6fb17cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd31d06c-ea", "ovs_interfaceid": "fd31d06c-eab4-4e76-a35b-ca65d171d3c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:15:56 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:12:83,bridge_name='br-int',has_traffic_filtering=True,id=fd31d06c-eab4-4e76-a35b-ca65d171d3c5,network=Network(c348a6f7-f0af-42c3-9464-a81ae42a7890),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd31d06c-ea') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:15:56 user nova-compute[75066]: DEBUG os_vif [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:12:83,bridge_name='br-int',has_traffic_filtering=True,id=fd31d06c-eab4-4e76-a35b-ca65d171d3c5,network=Network(c348a6f7-f0af-42c3-9464-a81ae42a7890),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd31d06c-ea') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:15:56 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:56 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:15:56 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:15:56 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:56 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '49cb739f-ac1d-51c1-b963-eabc89fa9fc8', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:15:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:15:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd31d06c-ea, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:15:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfd31d06c-ea, col_values=(('qos', UUID('ed06a933-c2ae-420d-bbcf-4947799da450')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:15:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfd31d06c-ea, col_values=(('external_ids', {'iface-id': 'fd31d06c-eab4-4e76-a35b-ca65d171d3c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:12:83', 'vm-uuid': '47bd5998-8ded-4a9c-8b98-f0658a526f47'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:15:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:15:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:57 user nova-compute[75066]: INFO os_vif [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:12:83,bridge_name='br-int',has_traffic_filtering=True,id=fd31d06c-eab4-4e76-a35b-ca65d171d3c5,network=Network(c348a6f7-f0af-42c3-9464-a81ae42a7890),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd31d06c-ea')
Dec 01 19:15:57 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:15:57 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] No VIF found with MAC fa:16:3e:ce:12:83, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:15:57 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Updating instance_info_cache with network_info: [{"id": "73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2", "address": "fa:16:3e:5a:73:a4", "network": {"id": "fdb3c017-aafb-4c3e-a08c-a73a68be9f70", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1696445417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "306d3049e90647fa9f1c90a104eac0e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bdff9a-3a", "ovs_interfaceid": "73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:15:57 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Releasing lock "refresh_cache-67c5dd7c-88aa-4f2f-8f62-a9af0480c38e" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:15:57 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Updated the network info_cache for instance {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 19:15:57 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:15:57 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:15:57 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:15:57 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:15:57 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:15:57 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:15:57 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75066) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 19:15:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:58 user nova-compute[75066]: DEBUG nova.compute.manager [req-d4d76da8-4f02-421b-80ee-8c2308041a3b req-cb781bde-0abe-47e9-aff1-9d1124a5d0ad service nova] [instance: 47bd5998-8ded-4a9c-8b98-f0658a526f47] Received event network-vif-plugged-fd31d06c-eab4-4e76-a35b-ca65d171d3c5 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:15:58 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d4d76da8-4f02-421b-80ee-8c2308041a3b req-cb781bde-0abe-47e9-aff1-9d1124a5d0ad service nova] Acquiring lock "47bd5998-8ded-4a9c-8b98-f0658a526f47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:15:58 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d4d76da8-4f02-421b-80ee-8c2308041a3b req-cb781bde-0abe-47e9-aff1-9d1124a5d0ad service nova] Lock "47bd5998-8ded-4a9c-8b98-f0658a526f47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:15:58 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d4d76da8-4f02-421b-80ee-8c2308041a3b req-cb781bde-0abe-47e9-aff1-9d1124a5d0ad service nova] Lock "47bd5998-8ded-4a9c-8b98-f0658a526f47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:15:58 user nova-compute[75066]: DEBUG nova.compute.manager [req-d4d76da8-4f02-421b-80ee-8c2308041a3b req-cb781bde-0abe-47e9-aff1-9d1124a5d0ad service nova] [instance: 47bd5998-8ded-4a9c-8b98-f0658a526f47] No waiting events found dispatching network-vif-plugged-fd31d06c-eab4-4e76-a35b-ca65d171d3c5 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:15:58 user nova-compute[75066]: WARNING nova.compute.manager [req-d4d76da8-4f02-421b-80ee-8c2308041a3b req-cb781bde-0abe-47e9-aff1-9d1124a5d0ad service nova] [instance: 47bd5998-8ded-4a9c-8b98-f0658a526f47] Received unexpected event network-vif-plugged-fd31d06c-eab4-4e76-a35b-ca65d171d3c5 for instance with vm_state building and task_state spawning.
Dec 01 19:15:59 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6c46e8d-982f-4169-af80-96274a165b02/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:15:59 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:59 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:15:59 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6c46e8d-982f-4169-af80-96274a165b02/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:15:59 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6c46e8d-982f-4169-af80-96274a165b02/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:15:59 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6c46e8d-982f-4169-af80-96274a165b02/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:15:59 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json" returned: 0 in 0.288s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f253bb0a-6cd0-4e62-8bcb-898537ce8c0b/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f253bb0a-6cd0-4e62-8bcb-898537ce8c0b/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f253bb0a-6cd0-4e62-8bcb-898537ce8c0b/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f253bb0a-6cd0-4e62-8bcb-898537ce8c0b/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67c5dd7c-88aa-4f2f-8f62-a9af0480c38e/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:00 user nova-compute[75066]: DEBUG nova.compute.manager [req-83ac2cee-8178-4c95-b9c0-29616cc590f3 req-a32b0fe4-a500-43f0-a827-dd50fc609b0f service nova] [instance: 47bd5998-8ded-4a9c-8b98-f0658a526f47] Received event network-vif-plugged-fd31d06c-eab4-4e76-a35b-ca65d171d3c5 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:16:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-83ac2cee-8178-4c95-b9c0-29616cc590f3 req-a32b0fe4-a500-43f0-a827-dd50fc609b0f service nova] Acquiring lock "47bd5998-8ded-4a9c-8b98-f0658a526f47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:16:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-83ac2cee-8178-4c95-b9c0-29616cc590f3 req-a32b0fe4-a500-43f0-a827-dd50fc609b0f service nova] Lock "47bd5998-8ded-4a9c-8b98-f0658a526f47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:16:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-83ac2cee-8178-4c95-b9c0-29616cc590f3 req-a32b0fe4-a500-43f0-a827-dd50fc609b0f service nova] Lock "47bd5998-8ded-4a9c-8b98-f0658a526f47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:16:00 user nova-compute[75066]: DEBUG nova.compute.manager [req-83ac2cee-8178-4c95-b9c0-29616cc590f3 req-a32b0fe4-a500-43f0-a827-dd50fc609b0f service nova] [instance: 47bd5998-8ded-4a9c-8b98-f0658a526f47] No waiting events found dispatching network-vif-plugged-fd31d06c-eab4-4e76-a35b-ca65d171d3c5 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:16:00 user nova-compute[75066]: WARNING nova.compute.manager [req-83ac2cee-8178-4c95-b9c0-29616cc590f3 req-a32b0fe4-a500-43f0-a827-dd50fc609b0f service nova] [instance: 47bd5998-8ded-4a9c-8b98-f0658a526f47] Received unexpected event network-vif-plugged-fd31d06c-eab4-4e76-a35b-ca65d171d3c5 for instance with vm_state building and task_state spawning.
Dec 01 19:16:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67c5dd7c-88aa-4f2f-8f62-a9af0480c38e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67c5dd7c-88aa-4f2f-8f62-a9af0480c38e/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67c5dd7c-88aa-4f2f-8f62-a9af0480c38e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:01 user nova-compute[75066]: DEBUG nova.compute.manager [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] [instance: 47bd5998-8ded-4a9c-8b98-f0658a526f47] Instance event wait completed in 0 seconds for  {{(pid=75066) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 19:16:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] [instance: 47bd5998-8ded-4a9c-8b98-f0658a526f47] Guest created on hypervisor {{(pid=75066) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 19:16:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:01 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 47bd5998-8ded-4a9c-8b98-f0658a526f47] Instance spawned successfully.
Dec 01 19:16:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] [instance: 47bd5998-8ded-4a9c-8b98-f0658a526f47] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 19:16:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] [instance: 47bd5998-8ded-4a9c-8b98-f0658a526f47] Found default for hw_cdrom_bus of ide {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:16:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] [instance: 47bd5998-8ded-4a9c-8b98-f0658a526f47] Found default for hw_disk_bus of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:16:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] [instance: 47bd5998-8ded-4a9c-8b98-f0658a526f47] Found default for hw_input_bus of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:16:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] [instance: 47bd5998-8ded-4a9c-8b98-f0658a526f47] Found default for hw_pointer_model of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:16:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] [instance: 47bd5998-8ded-4a9c-8b98-f0658a526f47] Found default for hw_video_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:16:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] [instance: 47bd5998-8ded-4a9c-8b98-f0658a526f47] Found default for hw_vif_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:16:01 user nova-compute[75066]: INFO nova.compute.manager [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] [instance: 47bd5998-8ded-4a9c-8b98-f0658a526f47] Took 7.55 seconds to spawn the instance on the hypervisor.
Dec 01 19:16:01 user nova-compute[75066]: DEBUG nova.compute.manager [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] [instance: 47bd5998-8ded-4a9c-8b98-f0658a526f47] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:16:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:01 user nova-compute[75066]: INFO nova.compute.manager [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] [instance: 47bd5998-8ded-4a9c-8b98-f0658a526f47] Took 9.10 seconds to build instance.
Dec 01 19:16:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-9a40fe5b-30b1-401c-bf67-7fae13bc45ab tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Lock "47bd5998-8ded-4a9c-8b98-f0658a526f47" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.312s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:16:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00ff7dfa-1da6-4e32-a227-0c194a5aa28f/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:01 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00ff7dfa-1da6-4e32-a227-0c194a5aa28f/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00ff7dfa-1da6-4e32-a227-0c194a5aa28f/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00ff7dfa-1da6-4e32-a227-0c194a5aa28f/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd67db6c-8bd1-402e-93ce-9b2d7a405a6e/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd67db6c-8bd1-402e-93ce-9b2d7a405a6e/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd67db6c-8bd1-402e-93ce-9b2d7a405a6e/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd67db6c-8bd1-402e-93ce-9b2d7a405a6e/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47bd5998-8ded-4a9c-8b98-f0658a526f47/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:03 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47bd5998-8ded-4a9c-8b98-f0658a526f47/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:03 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47bd5998-8ded-4a9c-8b98-f0658a526f47/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:03 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47bd5998-8ded-4a9c-8b98-f0658a526f47/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:03 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:16:03 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:16:03 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Hypervisor/Node resource view: name=user free_ram=7521MB free_disk=25.45077133178711GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75066) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 19:16:03 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:16:03 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:16:04 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:16:04 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance b6c46e8d-982f-4169-af80-96274a165b02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:16:04 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance c223be70-8b9c-46d4-9b5a-3b83dfc05a17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:16:04 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance c3ceeca4-c16c-4cf5-adfd-7d5a2925f435 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:16:04 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance dd546862-fcd5-4b69-8ea3-a8fa4859a489 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:16:04 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance f253bb0a-6cd0-4e62-8bcb-898537ce8c0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:16:04 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance dd67db6c-8bd1-402e-93ce-9b2d7a405a6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:16:04 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 00ff7dfa-1da6-4e32-a227-0c194a5aa28f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:16:04 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 47bd5998-8ded-4a9c-8b98-f0658a526f47 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:16:04 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 19:16:04 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 19:16:04 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Refreshing inventories for resource provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 01 19:16:04 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Updating ProviderTree inventory for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 01 19:16:04 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Updating inventory in ProviderTree for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 01 19:16:04 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Refreshing aggregate associations for resource provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62, aggregates: None {{(pid=75066) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 01 19:16:04 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Refreshing trait associations for resource provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62, traits: COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SECURITY_UEFI_SECURE_BOOT {{(pid=75066) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 01 19:16:04 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:16:04 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:16:04 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Compute_service record updated for user:user {{(pid=75066) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 19:16:04 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.937s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:16:05 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:16:05 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:16:05 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:16:05 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75066) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 19:16:06 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:07 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Acquiring lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:16:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:16:15 user nova-compute[75066]: DEBUG nova.compute.manager [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Starting instance... {{(pid=75066) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 19:16:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:16:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:16:15 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75066) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 19:16:15 user nova-compute[75066]: INFO nova.compute.claims [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Claim successful on node user
Dec 01 19:16:15 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:16:15 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:16:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.472s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:16:15 user nova-compute[75066]: DEBUG nova.compute.manager [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Start building networks asynchronously for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 19:16:15 user nova-compute[75066]: DEBUG nova.compute.manager [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Allocating IP information in the background. {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 19:16:15 user nova-compute[75066]: DEBUG nova.network.neutron [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] allocate_for_instance() {{(pid=75066) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 19:16:15 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 19:16:15 user nova-compute[75066]: DEBUG nova.compute.manager [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Start building block device mappings for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 19:16:16 user nova-compute[75066]: INFO nova.virt.block_device [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Booting with volume 7e19af37-2e86-449b-83a6-4a58b63d0d3a at /dev/vda
Dec 01 19:16:16 user nova-compute[75066]: DEBUG nova.policy [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2f03c5da7e0e4205baafc13cbcbb7c5e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea3c2552714a477396da7ad322703173', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75066) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 19:16:16 user nova-compute[75066]: DEBUG os_brick.utils [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:16:16 user nova-compute[75066]: INFO oslo.privsep.daemon [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpzztsxoci/privsep.sock']
Dec 01 19:16:16 user sudo[86132]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpzztsxoci/privsep.sock
Dec 01 19:16:16 user sudo[86132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Dec 01 19:16:16 user nova-compute[75066]: DEBUG nova.network.neutron [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Successfully created port: b39c07b1-b2c2-45bf-bf1c-1865dfc9ceff {{(pid=75066) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 19:16:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:17 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:17 user nova-compute[75066]: DEBUG nova.network.neutron [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Successfully created port: 294424e7-040a-4720-9012-7353ff25f249 {{(pid=75066) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 19:16:17 user sudo[86132]: pam_unix(sudo:session): session closed for user root
Dec 01 19:16:17 user nova-compute[75066]: INFO oslo.privsep.daemon [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Spawned new privsep daemon via rootwrap
Dec 01 19:16:17 user nova-compute[75066]: INFO oslo.privsep.daemon [-] privsep daemon starting
Dec 01 19:16:17 user nova-compute[75066]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Dec 01 19:16:17 user nova-compute[75066]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Dec 01 19:16:17 user nova-compute[75066]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86136
Dec 01 19:16:17 user nova-compute[75066]: DEBUG nova.network.neutron [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Successfully created port: 26418177-564a-4d5b-a37e-91c6334334e9 {{(pid=75066) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 19:16:17 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8fd5d37-dcb0-4e53-b6a3-80f105de3975]: (2,) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:16:17 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:18 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aee99e2-4720-4ed1-820e-a572b1910d16]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1959854982f\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:16:18 user nova-compute[75066]: WARNING os_brick.initiator.connectors.nvmeof [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Dec 01 19:16:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:18 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb35b28f-987d-45dd-a24b-4713b7c7de33]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:16:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:18 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[f11b9c87-edff-401a-b647-b8be4ce2fb34]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:16:18 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[77154c48-5a19-49f8-8a20-87e302934a44]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:16:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Running cmd (subprocess): nvme version {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] 'nvme version' failed. Not Retrying. {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:16:18 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] nvme not present on system {{(pid=75066) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 19:16:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:16:18 user nova-compute[75066]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 19:16:18 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea6f2d0-8353-44ff-909b-442c35c7a799]: (4, '') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:16:18 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75066) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 19:16:18 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 19:16:18 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] LIGHTOS: no hostnqn found. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 19:16:18 user nova-compute[75066]: DEBUG os_brick.utils [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] <== get_connector_properties: return (1917ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1959854982f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:16:18 user nova-compute[75066]: DEBUG nova.virt.block_device [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Updating existing volume attachment record: e540e406-c097-41f5-a656-847d63f55fe6 {{(pid=75066) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 19:16:18 user nova-compute[75066]: DEBUG nova.network.neutron [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Successfully created port: 21b7577f-898b-4d3b-9ecd-911568f3923f {{(pid=75066) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 19:16:19 user nova-compute[75066]: DEBUG nova.network.neutron [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Successfully created port: 10d4a23a-1f6c-4c81-b937-bfa19dcc3606 {{(pid=75066) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 19:16:19 user nova-compute[75066]: DEBUG nova.network.neutron [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Successfully updated port: b39c07b1-b2c2-45bf-bf1c-1865dfc9ceff {{(pid=75066) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 19:16:20 user nova-compute[75066]: DEBUG nova.compute.manager [req-72274860-4f9b-4d39-bb94-1af9e933d112 req-5b6d06b1-63a8-4360-b2e1-dbe5aaf6d66f service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received event network-changed-b39c07b1-b2c2-45bf-bf1c-1865dfc9ceff {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:16:20 user nova-compute[75066]: DEBUG nova.compute.manager [req-72274860-4f9b-4d39-bb94-1af9e933d112 req-5b6d06b1-63a8-4360-b2e1-dbe5aaf6d66f service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Refreshing instance network info cache due to event network-changed-b39c07b1-b2c2-45bf-bf1c-1865dfc9ceff. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:16:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-72274860-4f9b-4d39-bb94-1af9e933d112 req-5b6d06b1-63a8-4360-b2e1-dbe5aaf6d66f service nova] Acquiring lock "refresh_cache-6d2de2c4-0c0d-4238-933c-d0ef6538964e" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:16:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-72274860-4f9b-4d39-bb94-1af9e933d112 req-5b6d06b1-63a8-4360-b2e1-dbe5aaf6d66f service nova] Acquired lock "refresh_cache-6d2de2c4-0c0d-4238-933c-d0ef6538964e" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:16:20 user nova-compute[75066]: DEBUG nova.network.neutron [req-72274860-4f9b-4d39-bb94-1af9e933d112 req-5b6d06b1-63a8-4360-b2e1-dbe5aaf6d66f service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Refreshing network info cache for port b39c07b1-b2c2-45bf-bf1c-1865dfc9ceff {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:16:20 user nova-compute[75066]: DEBUG nova.network.neutron [req-72274860-4f9b-4d39-bb94-1af9e933d112 req-5b6d06b1-63a8-4360-b2e1-dbe5aaf6d66f service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:16:20 user nova-compute[75066]: DEBUG nova.network.neutron [req-72274860-4f9b-4d39-bb94-1af9e933d112 req-5b6d06b1-63a8-4360-b2e1-dbe5aaf6d66f service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:16:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-72274860-4f9b-4d39-bb94-1af9e933d112 req-5b6d06b1-63a8-4360-b2e1-dbe5aaf6d66f service nova] Releasing lock "refresh_cache-6d2de2c4-0c0d-4238-933c-d0ef6538964e" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:16:20 user nova-compute[75066]: DEBUG nova.network.neutron [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Successfully updated port: 6eea2787-921d-4d51-aa70-d843d187a47f {{(pid=75066) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 19:16:21 user nova-compute[75066]: DEBUG nova.network.neutron [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Successfully updated port: fbddb1ea-5cff-4ae8-ac1c-1ee726012aea {{(pid=75066) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 19:16:21 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:22 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:22 user nova-compute[75066]: DEBUG nova.compute.manager [req-05ca4bee-65ff-4513-bd77-f09a6dfcb1a6 req-e0108bde-a9b0-4dd3-92f7-f5fcc30c1917 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received event network-changed-6eea2787-921d-4d51-aa70-d843d187a47f {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:16:22 user nova-compute[75066]: DEBUG nova.compute.manager [req-05ca4bee-65ff-4513-bd77-f09a6dfcb1a6 req-e0108bde-a9b0-4dd3-92f7-f5fcc30c1917 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Refreshing instance network info cache due to event network-changed-6eea2787-921d-4d51-aa70-d843d187a47f. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:16:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-05ca4bee-65ff-4513-bd77-f09a6dfcb1a6 req-e0108bde-a9b0-4dd3-92f7-f5fcc30c1917 service nova] Acquiring lock "refresh_cache-6d2de2c4-0c0d-4238-933c-d0ef6538964e" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:16:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-05ca4bee-65ff-4513-bd77-f09a6dfcb1a6 req-e0108bde-a9b0-4dd3-92f7-f5fcc30c1917 service nova] Acquired lock "refresh_cache-6d2de2c4-0c0d-4238-933c-d0ef6538964e" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:16:22 user nova-compute[75066]: DEBUG nova.network.neutron [req-05ca4bee-65ff-4513-bd77-f09a6dfcb1a6 req-e0108bde-a9b0-4dd3-92f7-f5fcc30c1917 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Refreshing network info cache for port 6eea2787-921d-4d51-aa70-d843d187a47f {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:16:22 user nova-compute[75066]: DEBUG nova.network.neutron [req-05ca4bee-65ff-4513-bd77-f09a6dfcb1a6 req-e0108bde-a9b0-4dd3-92f7-f5fcc30c1917 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:16:22 user nova-compute[75066]: DEBUG nova.network.neutron [req-05ca4bee-65ff-4513-bd77-f09a6dfcb1a6 req-e0108bde-a9b0-4dd3-92f7-f5fcc30c1917 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:16:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-05ca4bee-65ff-4513-bd77-f09a6dfcb1a6 req-e0108bde-a9b0-4dd3-92f7-f5fcc30c1917 service nova] Releasing lock "refresh_cache-6d2de2c4-0c0d-4238-933c-d0ef6538964e" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:16:22 user nova-compute[75066]: DEBUG nova.compute.manager [req-05ca4bee-65ff-4513-bd77-f09a6dfcb1a6 req-e0108bde-a9b0-4dd3-92f7-f5fcc30c1917 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received event network-changed-fbddb1ea-5cff-4ae8-ac1c-1ee726012aea {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:16:22 user nova-compute[75066]: DEBUG nova.compute.manager [req-05ca4bee-65ff-4513-bd77-f09a6dfcb1a6 req-e0108bde-a9b0-4dd3-92f7-f5fcc30c1917 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Refreshing instance network info cache due to event network-changed-fbddb1ea-5cff-4ae8-ac1c-1ee726012aea. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:16:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-05ca4bee-65ff-4513-bd77-f09a6dfcb1a6 req-e0108bde-a9b0-4dd3-92f7-f5fcc30c1917 service nova] Acquiring lock "refresh_cache-6d2de2c4-0c0d-4238-933c-d0ef6538964e" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:16:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-05ca4bee-65ff-4513-bd77-f09a6dfcb1a6 req-e0108bde-a9b0-4dd3-92f7-f5fcc30c1917 service nova] Acquired lock "refresh_cache-6d2de2c4-0c0d-4238-933c-d0ef6538964e" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:16:22 user nova-compute[75066]: DEBUG nova.network.neutron [req-05ca4bee-65ff-4513-bd77-f09a6dfcb1a6 req-e0108bde-a9b0-4dd3-92f7-f5fcc30c1917 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Refreshing network info cache for port fbddb1ea-5cff-4ae8-ac1c-1ee726012aea {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:16:22 user nova-compute[75066]: DEBUG nova.network.neutron [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Successfully updated port: 294424e7-040a-4720-9012-7353ff25f249 {{(pid=75066) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 19:16:22 user nova-compute[75066]: DEBUG nova.network.neutron [req-05ca4bee-65ff-4513-bd77-f09a6dfcb1a6 req-e0108bde-a9b0-4dd3-92f7-f5fcc30c1917 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:16:22 user nova-compute[75066]: DEBUG nova.network.neutron [req-05ca4bee-65ff-4513-bd77-f09a6dfcb1a6 req-e0108bde-a9b0-4dd3-92f7-f5fcc30c1917 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:16:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-05ca4bee-65ff-4513-bd77-f09a6dfcb1a6 req-e0108bde-a9b0-4dd3-92f7-f5fcc30c1917 service nova] Releasing lock "refresh_cache-6d2de2c4-0c0d-4238-933c-d0ef6538964e" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:16:22 user nova-compute[75066]: DEBUG nova.network.neutron [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Successfully updated port: 26418177-564a-4d5b-a37e-91c6334334e9 {{(pid=75066) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 19:16:23 user nova-compute[75066]: DEBUG nova.network.neutron [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Successfully updated port: 21b7577f-898b-4d3b-9ecd-911568f3923f {{(pid=75066) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 19:16:24 user nova-compute[75066]: DEBUG nova.compute.manager [req-ab4a118f-50e3-44b6-a6b3-b3049450ba0c req-b82f737b-d20c-4338-8a1f-439a31059603 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received event network-changed-294424e7-040a-4720-9012-7353ff25f249 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:16:24 user nova-compute[75066]: DEBUG nova.compute.manager [req-ab4a118f-50e3-44b6-a6b3-b3049450ba0c req-b82f737b-d20c-4338-8a1f-439a31059603 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Refreshing instance network info cache due to event network-changed-294424e7-040a-4720-9012-7353ff25f249. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:16:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-ab4a118f-50e3-44b6-a6b3-b3049450ba0c req-b82f737b-d20c-4338-8a1f-439a31059603 service nova] Acquiring lock "refresh_cache-6d2de2c4-0c0d-4238-933c-d0ef6538964e" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:16:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-ab4a118f-50e3-44b6-a6b3-b3049450ba0c req-b82f737b-d20c-4338-8a1f-439a31059603 service nova] Acquired lock "refresh_cache-6d2de2c4-0c0d-4238-933c-d0ef6538964e" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:16:24 user nova-compute[75066]: DEBUG nova.network.neutron [req-ab4a118f-50e3-44b6-a6b3-b3049450ba0c req-b82f737b-d20c-4338-8a1f-439a31059603 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Refreshing network info cache for port 294424e7-040a-4720-9012-7353ff25f249 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:16:24 user nova-compute[75066]: DEBUG nova.network.neutron [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Successfully updated port: 10d4a23a-1f6c-4c81-b937-bfa19dcc3606 {{(pid=75066) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 19:16:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Acquiring lock "refresh_cache-6d2de2c4-0c0d-4238-933c-d0ef6538964e" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:16:24 user nova-compute[75066]: DEBUG nova.network.neutron [req-ab4a118f-50e3-44b6-a6b3-b3049450ba0c req-b82f737b-d20c-4338-8a1f-439a31059603 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:16:24 user nova-compute[75066]: DEBUG nova.network.neutron [req-ab4a118f-50e3-44b6-a6b3-b3049450ba0c req-b82f737b-d20c-4338-8a1f-439a31059603 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:16:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-ab4a118f-50e3-44b6-a6b3-b3049450ba0c req-b82f737b-d20c-4338-8a1f-439a31059603 service nova] Releasing lock "refresh_cache-6d2de2c4-0c0d-4238-933c-d0ef6538964e" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:16:24 user nova-compute[75066]: DEBUG nova.compute.manager [req-ab4a118f-50e3-44b6-a6b3-b3049450ba0c req-b82f737b-d20c-4338-8a1f-439a31059603 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received event network-changed-26418177-564a-4d5b-a37e-91c6334334e9 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:16:24 user nova-compute[75066]: DEBUG nova.compute.manager [req-ab4a118f-50e3-44b6-a6b3-b3049450ba0c req-b82f737b-d20c-4338-8a1f-439a31059603 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Refreshing instance network info cache due to event network-changed-26418177-564a-4d5b-a37e-91c6334334e9. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:16:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-ab4a118f-50e3-44b6-a6b3-b3049450ba0c req-b82f737b-d20c-4338-8a1f-439a31059603 service nova] Acquiring lock "refresh_cache-6d2de2c4-0c0d-4238-933c-d0ef6538964e" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:16:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-ab4a118f-50e3-44b6-a6b3-b3049450ba0c req-b82f737b-d20c-4338-8a1f-439a31059603 service nova] Acquired lock "refresh_cache-6d2de2c4-0c0d-4238-933c-d0ef6538964e" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:16:24 user nova-compute[75066]: DEBUG nova.network.neutron [req-ab4a118f-50e3-44b6-a6b3-b3049450ba0c req-b82f737b-d20c-4338-8a1f-439a31059603 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Refreshing network info cache for port 26418177-564a-4d5b-a37e-91c6334334e9 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:16:24 user nova-compute[75066]: DEBUG nova.network.neutron [req-ab4a118f-50e3-44b6-a6b3-b3049450ba0c req-b82f737b-d20c-4338-8a1f-439a31059603 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:16:24 user nova-compute[75066]: DEBUG nova.network.neutron [req-ab4a118f-50e3-44b6-a6b3-b3049450ba0c req-b82f737b-d20c-4338-8a1f-439a31059603 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:16:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-ab4a118f-50e3-44b6-a6b3-b3049450ba0c req-b82f737b-d20c-4338-8a1f-439a31059603 service nova] Releasing lock "refresh_cache-6d2de2c4-0c0d-4238-933c-d0ef6538964e" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:16:24 user nova-compute[75066]: DEBUG nova.compute.manager [req-ab4a118f-50e3-44b6-a6b3-b3049450ba0c req-b82f737b-d20c-4338-8a1f-439a31059603 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received event network-changed-21b7577f-898b-4d3b-9ecd-911568f3923f {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:16:24 user nova-compute[75066]: DEBUG nova.compute.manager [req-ab4a118f-50e3-44b6-a6b3-b3049450ba0c req-b82f737b-d20c-4338-8a1f-439a31059603 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Refreshing instance network info cache due to event network-changed-21b7577f-898b-4d3b-9ecd-911568f3923f. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:16:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-ab4a118f-50e3-44b6-a6b3-b3049450ba0c req-b82f737b-d20c-4338-8a1f-439a31059603 service nova] Acquiring lock "refresh_cache-6d2de2c4-0c0d-4238-933c-d0ef6538964e" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:16:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-ab4a118f-50e3-44b6-a6b3-b3049450ba0c req-b82f737b-d20c-4338-8a1f-439a31059603 service nova] Acquired lock "refresh_cache-6d2de2c4-0c0d-4238-933c-d0ef6538964e" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:16:24 user nova-compute[75066]: DEBUG nova.network.neutron [req-ab4a118f-50e3-44b6-a6b3-b3049450ba0c req-b82f737b-d20c-4338-8a1f-439a31059603 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Refreshing network info cache for port 21b7577f-898b-4d3b-9ecd-911568f3923f {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:16:25 user nova-compute[75066]: DEBUG nova.network.neutron [req-ab4a118f-50e3-44b6-a6b3-b3049450ba0c req-b82f737b-d20c-4338-8a1f-439a31059603 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:16:25 user nova-compute[75066]: DEBUG nova.network.neutron [req-ab4a118f-50e3-44b6-a6b3-b3049450ba0c req-b82f737b-d20c-4338-8a1f-439a31059603 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:16:25 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-ab4a118f-50e3-44b6-a6b3-b3049450ba0c req-b82f737b-d20c-4338-8a1f-439a31059603 service nova] Releasing lock "refresh_cache-6d2de2c4-0c0d-4238-933c-d0ef6538964e" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:16:25 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Acquired lock "refresh_cache-6d2de2c4-0c0d-4238-933c-d0ef6538964e" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:16:25 user nova-compute[75066]: DEBUG nova.network.neutron [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:16:25 user nova-compute[75066]: DEBUG nova.network.neutron [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:16:26 user nova-compute[75066]: DEBUG nova.compute.manager [req-ce7c181a-fb3a-43c4-803e-ee163dc7fb54 req-4d9ded5a-82cd-4b1d-82e6-fd3be75fefa0 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received event network-changed-10d4a23a-1f6c-4c81-b937-bfa19dcc3606 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:16:26 user nova-compute[75066]: DEBUG nova.compute.manager [req-ce7c181a-fb3a-43c4-803e-ee163dc7fb54 req-4d9ded5a-82cd-4b1d-82e6-fd3be75fefa0 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Refreshing instance network info cache due to event network-changed-10d4a23a-1f6c-4c81-b937-bfa19dcc3606. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:16:26 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-ce7c181a-fb3a-43c4-803e-ee163dc7fb54 req-4d9ded5a-82cd-4b1d-82e6-fd3be75fefa0 service nova] Acquiring lock "refresh_cache-6d2de2c4-0c0d-4238-933c-d0ef6538964e" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:16:26 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:27 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:27 user nova-compute[75066]: DEBUG nova.network.neutron [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Updating instance_info_cache with network_info: [{"id": "b39c07b1-b2c2-45bf-bf1c-1865dfc9ceff", "address": "fa:16:3e:f7:4a:d3", "network": {"id": "c77595ef-65b2-45cd-be6a-8bf0380a449b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-402289383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb39c07b1-b2", "ovs_interfaceid": "b39c07b1-b2c2-45bf-bf1c-1865dfc9ceff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6eea2787-921d-4d51-aa70-d843d187a47f", "address": "fa:16:3e:7b:03:0e", "network": {"id": "8f2b8b19-449f-4d10-8d47-356d5d5e5338", "bridge": "br-int", "label": "tempest-device-tagging-net1-967030387", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eea2787-92", "ovs_interfaceid": "6eea2787-921d-4d51-aa70-d843d187a47f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fbddb1ea-5cff-4ae8-ac1c-1ee726012aea", "address": "fa:16:3e:63:9b:41", "network": {"id": "8f2b8b19-449f-4d10-8d47-356d5d5e5338", "bridge": "br-int", "label": "tempest-device-tagging-net1-967030387", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbddb1ea-5c", "ovs_interfaceid": "fbddb1ea-5cff-4ae8-ac1c-1ee726012aea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "294424e7-040a-4720-9012-7353ff25f249", "address": "fa:16:3e:94:c6:01", "network": {"id": "8f2b8b19-449f-4d10-8d47-356d5d5e5338", "bridge": "br-int", "label": "tempest-device-tagging-net1-967030387", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294424e7-04", "ovs_interfaceid": "294424e7-040a-4720-9012-7353ff25f249", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "26418177-564a-4d5b-a37e-91c6334334e9", "address": "fa:16:3e:cc:74:51", "network": {"id": "8f2b8b19-449f-4d10-8d47-356d5d5e5338", "bridge": "br-int", "label": "tempest-device-tagging-net1-967030387", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26418177-56", "ovs_interfaceid": "26418177-564a-4d5b-a37e-91c6334334e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "21b7577f-898b-4d3b-9ecd-911568f3923f", "address": "fa:16:3e:52:1c:5b", "network": {"id": "88fd1225-bf6b-4d28-bc10-deb410395ac9", "bridge": "br-int", "label": "tempest-device-tagging-net2-224351536", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21b7577f-89", "ovs_interfaceid": "21b7577f-898b-4d3b-9ecd-911568f3923f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "10d4a23a-1f6c-4c81-b937-bfa19dcc3606", "address": "fa:16:3e:c3:1c:9d", "network": {"id": "88fd1225-bf6b-4d28-bc10-deb410395ac9", "bridge": "br-int", "label": "tempest-device-tagging-net2-224351536", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10d4a23a-1f", "ovs_interfaceid": "10d4a23a-1f6c-4c81-b937-bfa19dcc3606", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:16:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Releasing lock "refresh_cache-6d2de2c4-0c0d-4238-933c-d0ef6538964e" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:16:27 user nova-compute[75066]: DEBUG nova.compute.manager [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Instance network_info: |[{"id": "b39c07b1-b2c2-45bf-bf1c-1865dfc9ceff", "address": "fa:16:3e:f7:4a:d3", "network": {"id": "c77595ef-65b2-45cd-be6a-8bf0380a449b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-402289383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb39c07b1-b2", "ovs_interfaceid": "b39c07b1-b2c2-45bf-bf1c-1865dfc9ceff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6eea2787-921d-4d51-aa70-d843d187a47f", "address": "fa:16:3e:7b:03:0e", "network": {"id": "8f2b8b19-449f-4d10-8d47-356d5d5e5338", "bridge": "br-int", "label": "tempest-device-tagging-net1-967030387", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eea2787-92", "ovs_interfaceid": "6eea2787-921d-4d51-aa70-d843d187a47f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fbddb1ea-5cff-4ae8-ac1c-1ee726012aea", "address": "fa:16:3e:63:9b:41", "network": {"id": "8f2b8b19-449f-4d10-8d47-356d5d5e5338", "bridge": "br-int", "label": "tempest-device-tagging-net1-967030387", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbddb1ea-5c", "ovs_interfaceid": "fbddb1ea-5cff-4ae8-ac1c-1ee726012aea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "294424e7-040a-4720-9012-7353ff25f249", "address": "fa:16:3e:94:c6:01", "network": {"id": "8f2b8b19-449f-4d10-8d47-356d5d5e5338", "bridge": "br-int", "label": "tempest-device-tagging-net1-967030387", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294424e7-04", "ovs_interfaceid": "294424e7-040a-4720-9012-7353ff25f249", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "26418177-564a-4d5b-a37e-91c6334334e9", "address": "fa:16:3e:cc:74:51", "network": {"id": "8f2b8b19-449f-4d10-8d47-356d5d5e5338", "bridge": "br-int", "label": "tempest-device-tagging-net1-967030387", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26418177-56", "ovs_interfaceid": "26418177-564a-4d5b-a37e-91c6334334e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "21b7577f-898b-4d3b-9ecd-911568f3923f", "address": "fa:16:3e:52:1c:5b", "network": {"id": "88fd1225-bf6b-4d28-bc10-deb410395ac9", "bridge": "br-int", "label": "tempest-device-tagging-net2-224351536", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21b7577f-89", "ovs_interfaceid": "21b7577f-898b-4d3b-9ecd-911568f3923f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "10d4a23a-1f6c-4c81-b937-bfa19dcc3606", "address": "fa:16:3e:c3:1c:9d", "network": {"id": "88fd1225-bf6b-4d28-bc10-deb410395ac9", "bridge": "br-int", "label": "tempest-device-tagging-net2-224351536", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10d4a23a-1f", "ovs_interfaceid": "10d4a23a-1f6c-4c81-b937-bfa19dcc3606", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 19:16:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-ce7c181a-fb3a-43c4-803e-ee163dc7fb54 req-4d9ded5a-82cd-4b1d-82e6-fd3be75fefa0 service nova] Acquired lock "refresh_cache-6d2de2c4-0c0d-4238-933c-d0ef6538964e" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:16:27 user nova-compute[75066]: DEBUG nova.network.neutron [req-ce7c181a-fb3a-43c4-803e-ee163dc7fb54 req-4d9ded5a-82cd-4b1d-82e6-fd3be75fefa0 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Refreshing network info cache for port 10d4a23a-1f6c-4c81-b937-bfa19dcc3606 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:16:27 user nova-compute[75066]: DEBUG nova.network.neutron [req-ce7c181a-fb3a-43c4-803e-ee163dc7fb54 req-4d9ded5a-82cd-4b1d-82e6-fd3be75fefa0 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Updated VIF entry in instance network info cache for port 10d4a23a-1f6c-4c81-b937-bfa19dcc3606. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:16:27 user nova-compute[75066]: DEBUG nova.network.neutron [req-ce7c181a-fb3a-43c4-803e-ee163dc7fb54 req-4d9ded5a-82cd-4b1d-82e6-fd3be75fefa0 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Updating instance_info_cache with network_info: [{"id": "b39c07b1-b2c2-45bf-bf1c-1865dfc9ceff", "address": "fa:16:3e:f7:4a:d3", "network": {"id": "c77595ef-65b2-45cd-be6a-8bf0380a449b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-402289383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb39c07b1-b2", "ovs_interfaceid": "b39c07b1-b2c2-45bf-bf1c-1865dfc9ceff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6eea2787-921d-4d51-aa70-d843d187a47f", "address": "fa:16:3e:7b:03:0e", "network": {"id": "8f2b8b19-449f-4d10-8d47-356d5d5e5338", "bridge": "br-int", "label": "tempest-device-tagging-net1-967030387", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eea2787-92", "ovs_interfaceid": "6eea2787-921d-4d51-aa70-d843d187a47f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fbddb1ea-5cff-4ae8-ac1c-1ee726012aea", "address": "fa:16:3e:63:9b:41", "network": {"id": "8f2b8b19-449f-4d10-8d47-356d5d5e5338", "bridge": "br-int", "label": "tempest-device-tagging-net1-967030387", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbddb1ea-5c", "ovs_interfaceid": "fbddb1ea-5cff-4ae8-ac1c-1ee726012aea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "294424e7-040a-4720-9012-7353ff25f249", "address": "fa:16:3e:94:c6:01", "network": {"id": "8f2b8b19-449f-4d10-8d47-356d5d5e5338", "bridge": "br-int", "label": "tempest-device-tagging-net1-967030387", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294424e7-04", "ovs_interfaceid": "294424e7-040a-4720-9012-7353ff25f249", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "26418177-564a-4d5b-a37e-91c6334334e9", "address": "fa:16:3e:cc:74:51", "network": {"id": "8f2b8b19-449f-4d10-8d47-356d5d5e5338", "bridge": "br-int", "label": "tempest-device-tagging-net1-967030387", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26418177-56", "ovs_interfaceid": "26418177-564a-4d5b-a37e-91c6334334e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "21b7577f-898b-4d3b-9ecd-911568f3923f", "address": "fa:16:3e:52:1c:5b", "network": {"id": "88fd1225-bf6b-4d28-bc10-deb410395ac9", "bridge": "br-int", "label": "tempest-device-tagging-net2-224351536", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21b7577f-89", "ovs_interfaceid": "21b7577f-898b-4d3b-9ecd-911568f3923f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "10d4a23a-1f6c-4c81-b937-bfa19dcc3606", "address": "fa:16:3e:c3:1c:9d", "network": {"id": "88fd1225-bf6b-4d28-bc10-deb410395ac9", "bridge": "br-int", "label": "tempest-device-tagging-net2-224351536", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10d4a23a-1f", "ovs_interfaceid": "10d4a23a-1f6c-4c81-b937-bfa19dcc3606", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:16:27 user nova-compute[75066]: INFO nova.virt.block_device [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Booting with volume 2eb196a1-1efb-4bd5-9113-5745861c7315 at /dev/vdb
Dec 01 19:16:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-ce7c181a-fb3a-43c4-803e-ee163dc7fb54 req-4d9ded5a-82cd-4b1d-82e6-fd3be75fefa0 service nova] Releasing lock "refresh_cache-6d2de2c4-0c0d-4238-933c-d0ef6538964e" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:16:27 user nova-compute[75066]: DEBUG os_brick.utils [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:16:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:28 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:28 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[83dc651f-d4ea-43de-ac09-c7538e945c35]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1959854982f\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:16:28 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:28 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:28 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d64ace-6640-4d58-b407-a80a595c4eb7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:16:28 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:28 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:28 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[176183fc-0042-4c6d-be40-35174e65a6c5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:16:28 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ef42b4-8617-4c8b-8322-330ef752b314]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:16:28 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Running cmd (subprocess): nvme version {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:28 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] 'nvme version' failed. Not Retrying. {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:16:28 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] nvme not present on system {{(pid=75066) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 19:16:28 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:28 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:16:28 user nova-compute[75066]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 19:16:28 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[b681fe66-56b7-440c-875c-3db404e2609e]: (4, '') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:16:28 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75066) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 19:16:28 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 19:16:28 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] LIGHTOS: no hostnqn found. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 19:16:28 user nova-compute[75066]: DEBUG os_brick.utils [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1959854982f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:16:28 user nova-compute[75066]: DEBUG nova.virt.block_device [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Updating existing volume attachment record: 0da766cc-cb60-46ea-a134-b9994f9a6e18 {{(pid=75066) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 19:16:31 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:32 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:36 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:37 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:37 user nova-compute[75066]: INFO nova.virt.block_device [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Booting with volume f81dcbf2-df0b-42ef-a856-a14ea3341d5a at /dev/vdc
Dec 01 19:16:37 user nova-compute[75066]: DEBUG os_brick.utils [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:16:37 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:37 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:37 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[5135b788-dba1-4fd4-8f5c-c2342d0fb469]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1959854982f\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:16:37 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:37 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:37 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[885fedfb-eab0-4dfe-ab04-109a8cc50926]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:16:37 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:37 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:37 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[d88597d1-65dc-4556-a757-9ea8527114fe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:16:37 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ed88c2-d280-4876-8d1d-8594ff83292c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:16:37 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Running cmd (subprocess): nvme version {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:37 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] 'nvme version' failed. Not Retrying. {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:16:37 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] nvme not present on system {{(pid=75066) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 19:16:37 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:37 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:16:37 user nova-compute[75066]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 19:16:37 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21437d8-6f56-480e-8acd-e2122738dafe]: (4, '') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:16:37 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75066) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 19:16:37 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 19:16:37 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] LIGHTOS: no hostnqn found. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 19:16:37 user nova-compute[75066]: DEBUG os_brick.utils [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1959854982f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:16:37 user nova-compute[75066]: DEBUG nova.virt.block_device [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Updating existing volume attachment record: 7903593e-4ab1-46c9-aead-941c9ef0daca {{(pid=75066) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 19:16:42 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75066) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG nova.compute.manager [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Start spawning the instance on the hypervisor. {{(pid=75066) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Creating instance directory {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 19:16:47 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Creating image(s)
Dec 01 19:16:47 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Did not create local disks {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Ensure instance console log exists: /opt/stack/data/nova/instances/6d2de2c4-0c0d-4238-933c-d0ef6538964e/console.log {{(pid=75066) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Start _get_guest_xml network_info=[{"id": "b39c07b1-b2c2-45bf-bf1c-1865dfc9ceff", "address": "fa:16:3e:f7:4a:d3", "network": {"id": "c77595ef-65b2-45cd-be6a-8bf0380a449b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-402289383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb39c07b1-b2", "ovs_interfaceid": "b39c07b1-b2c2-45bf-bf1c-1865dfc9ceff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6eea2787-921d-4d51-aa70-d843d187a47f", "address": "fa:16:3e:7b:03:0e", "network": {"id": "8f2b8b19-449f-4d10-8d47-356d5d5e5338", "bridge": "br-int", "label": "tempest-device-tagging-net1-967030387", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eea2787-92", "ovs_interfaceid": "6eea2787-921d-4d51-aa70-d843d187a47f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fbddb1ea-5cff-4ae8-ac1c-1ee726012aea", "address": "fa:16:3e:63:9b:41", "network": {"id": "8f2b8b19-449f-4d10-8d47-356d5d5e5338", "bridge": "br-int", "label": "tempest-device-tagging-net1-967030387", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbddb1ea-5c", "ovs_interfaceid": "fbddb1ea-5cff-4ae8-ac1c-1ee726012aea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "294424e7-040a-4720-9012-7353ff25f249", "address": "fa:16:3e:94:c6:01", "network": {"id": "8f2b8b19-449f-4d10-8d47-356d5d5e5338", "bridge": "br-int", "label": "tempest-device-tagging-net1-967030387", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294424e7-04", "ovs_interfaceid": "294424e7-040a-4720-9012-7353ff25f249", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "26418177-564a-4d5b-a37e-91c6334334e9", "address": "fa:16:3e:cc:74:51", "network": {"id": "8f2b8b19-449f-4d10-8d47-356d5d5e5338", "bridge": "br-int", "label": "tempest-device-tagging-net1-967030387", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26418177-56", "ovs_interfaceid": "26418177-564a-4d5b-a37e-91c6334334e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "21b7577f-898b-4d3b-9ecd-911568f3923f", "address": "fa:16:3e:52:1c:5b", "network": {"id": "88fd1225-bf6b-4d28-bc10-deb410395ac9", "bridge": "br-int", "label": "tempest-device-tagging-net2-224351536", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21b7577f-89", "ovs_interfaceid": "21b7577f-898b-4d3b-9ecd-911568f3923f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "10d4a23a-1f6c-4c81-b937-bfa19dcc3606", "address": "fa:16:3e:c3:1c:9d", "network": {"id": "88fd1225-bf6b-4d28-bc10-deb410395ac9", "bridge": "br-int", "label": "tempest-device-tagging-net2-224351536", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10d4a23a-1f", "ovs_interfaceid": "10d4a23a-1f6c-4c81-b937-bfa19dcc3606", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': False, 'attachment_id': 'e540e406-c097-41f5-a656-847d63f55fe6', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZvMkyNKW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6d2de2c4-0c0d-4238-933c-d0ef6538964e', 'attached_at': '', 'detached_at': '', 'volume_id': '7e19af37-2e86-449b-83a6-4a58b63d0d3a', 'serial': '7e19af37-2e86-449b-83a6-4a58b63d0d3a'}, 'device_type': 'disk', 'volume_type': None}, {'boot_index': 1, 'mount_device': '/dev/vdb', 'guest_format': None, 'delete_on_termination': False, 'attachment_id': '0da766cc-cb60-46ea-a134-b9994f9a6e18', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tTiXvpqN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6d2de2c4-0c0d-4238-933c-d0ef6538964e', 'attached_at': '', 'detached_at': '', 'volume_id': '2eb196a1-1efb-4bd5-9113-5745861c7315', 'serial': '2eb196a1-1efb-4bd5-9113-5745861c7315'}, 'device_type': 'disk', 'volume_type': None}, {'boot_index': 2, 'mount_device': '/dev/vdc', 'guest_format': None, 'delete_on_termination': False, 'attachment_id': '7903593e-4ab1-46c9-aead-941c9ef0daca', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YXNclRnG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6d2de2c4-0c0d-4238-933c-d0ef6538964e', 'attached_at': '', 'detached_at': '', 'volume_id': 'f81dcbf2-df0b-42ef-a856-a14ea3341d5a', 'serial': 'f81dcbf2-df0b-42ef-a856-a14ea3341d5a'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:16:47 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:16:47 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:16:47 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG os_brick.initiator.connector [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Factory for ISCSI on None {{(pid=75066) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Calling os-brick to attach iSCSI Volume {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZvMkyNKW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:16:47 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:16:47 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:16:47 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:16:47 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:16:47 user nova-compute[75066]: INFO os_brick.initiator.connectors.iscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 19:16:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a -p 172.16.0.220:3260 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa44e86-5011-4f42-aa4f-22150041cb36]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 19:16:47 user nova-compute[75066]:  {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a -p 172.16.0.220:3260 --interface default --op new {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e636ad8-0cc7-4cdf-bb2b-6b7c22d850bc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a] added\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a] added
Dec 01 19:16:47 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d0aba35-69cc-43e6-9745-01609f75a477]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b4e7e7-3e15-423e-b933-31100c858cad]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZvMkyNKW {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZvMkyNKW" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[8931eb05-d9b8-4d8b-b707-7635dcb581a2]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZvMkyNKW'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[4432d4a0-dbc0-4c5e-93b1-88c8d1f4a743]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2be668-32bf-415d-aef9-46d3f3089c88]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 01 19:16:47 user nova-compute[75066]:  {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 01 19:16:47 user nova-compute[75066]:  {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:16:47 user nova-compute[75066]: WARNING os_brick.initiator.connectors.iscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 01 19:16:47 user nova-compute[75066]: 
Dec 01 19:16:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a -p 172.16.0.220:3260 --login {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[4141150d-35f2-495b-8e38-6685c5a1af5b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a, portal: 172.16.0.220,3260]
Dec 01 19:16:47 user nova-compute[75066]: Login to [iface: default, target: iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a, portal: 172.16.0.220,3260] successful.
Dec 01 19:16:47 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.016s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8b4c46-4d97-4932-bc08-51a033954573]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[83676bc8-64a2-4396-b899-6314576bb7ba]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)
Dec 01 19:16:47 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)
Dec 01 19:16:47 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Connected to 172.16.0.220:3260 {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75066) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75066) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3efe30-883c-42c0-b6fb-2c1b9e3c2a32]: (4, ('- - 0', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:16:47 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZvMkyNKW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 19:16:48 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:16:48 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '23539363535616339', 'path': '/dev/sdb'} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:16:48 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539363535616339', 'path': '/dev/sdb'} {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 19:16:48 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Calling os-brick to attach iSCSI Volume {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 19:16:48 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tTiXvpqN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:16:48 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:16:48 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:16:48 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:16:48 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:16:48 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:16:48 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:16:48 user nova-compute[75066]: INFO os_brick.initiator.connectors.iscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 19:16:48 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 -p 172.16.0.220:3260 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:48 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:48 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a50e29-3ba4-4aa8-bec3-2bcc1a9931dd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:16:48 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 19:16:48 user nova-compute[75066]:  {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:16:48 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 -p 172.16.0.220:3260 --interface default --op new {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:48 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:48 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[66fa0ab4-78fd-481d-bf8b-dfc45fbe5c34]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315] added\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:16:48 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315] added
Dec 01 19:16:48 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:16:48 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:48 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:48 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9c9af4-9164-4a75-9630-93c90c30c63a]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:16:48 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:16:48 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:49 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31abe6c-c4f4-426a-a6bb-80571128924f]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:16:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:16:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tTiXvpqN {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tTiXvpqN" returned: 0 in 0.016s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:49 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb4d814-cec5-4cd7-b5b0-6ce8a9b5927d]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:16:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tTiXvpqN'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:16:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:49 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[205e233e-e54d-4865-ba6a-33cc8ffd3f34]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:16:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:16:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:49 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6ae596-afec-49c3-8ca1-e4018be80225]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:16:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)
Dec 01 19:16:49 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:16:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)
Dec 01 19:16:49 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:16:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 -p 172.16.0.220:3260 --login {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:49 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4aae84f-a1dc-4cf4-9cd9-90bfd98dc1fa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:16:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315, portal: 172.16.0.220,3260]
Dec 01 19:16:49 user nova-compute[75066]: Login to [iface: default, target: iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315, portal: 172.16.0.220,3260] successful.
Dec 01 19:16:49 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:16:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:49 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a091b2-95df-4403-a9cd-03e6720a543d]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:16:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:16:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:49 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[913076f7-8dee-4658-9093-23fc1b173b59]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:16:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)
Dec 01 19:16:49 user nova-compute[75066]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)
Dec 01 19:16:49 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:16:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)
Dec 01 19:16:49 user nova-compute[75066]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)
Dec 01 19:16:49 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:16:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.267s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:16:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Connected to 172.16.0.220:3260 {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 19:16:49 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75066) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 19:16:49 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75066) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 19:16:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:49 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b2cee2e-800b-4ec3-96cf-19366f4b4a5c]: (4, ('- - 0', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:16:49 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:16:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tTiXvpqN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 19:16:50 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:16:50 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '26131396134666361', 'path': '/dev/sdc'} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:16:50 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26131396134666361', 'path': '/dev/sdc'} {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 19:16:50 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Calling os-brick to attach iSCSI Volume {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 19:16:50 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YXNclRnG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:16:50 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:16:50 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:16:50 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:16:50 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:16:50 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:16:50 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:16:50 user nova-compute[75066]: INFO os_brick.initiator.connectors.iscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 19:16:50 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a -p 172.16.0.220:3260 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:50 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:50 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[20537cc4-8438-40bb-a24a-6ff430c5db8f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:16:50 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 19:16:50 user nova-compute[75066]:  {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:16:50 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a -p 172.16.0.220:3260 --interface default --op new {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:50 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:50 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[7218ce50-e218-49ba-a90b-568e250f4ceb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a] added\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:16:50 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a] added
Dec 01 19:16:50 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:16:50 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:50 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:50 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e0277f-863c-4da8-9e6e-b04b04c395ed]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:16:50 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:16:50 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:50 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:50 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b73846f-e6a6-4aa2-990c-aaaa9dd43f35]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:16:50 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:16:50 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YXNclRnG {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:50 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YXNclRnG" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:50 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ecf9c7-9e3f-482f-bd85-8b25abd1755c]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:16:50 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YXNclRnG'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:16:50 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:50 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:50 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c91b66-f9d9-4a31-bd85-9660c4eb7484]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:16:50 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:16:50 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:50 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:50 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c68439-ce78-4f86-9ca0-067cd54ec82f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:16:50 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)
Dec 01 19:16:50 user nova-compute[75066]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)
Dec 01 19:16:50 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:16:50 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)
Dec 01 19:16:50 user nova-compute[75066]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)
Dec 01 19:16:50 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:16:50 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a -p 172.16.0.220:3260 --login {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:50 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:50 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[b937feb5-219c-4954-9b8a-ea193c660436]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:16:50 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a, portal: 172.16.0.220,3260]
Dec 01 19:16:50 user nova-compute[75066]: Login to [iface: default, target: iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a, portal: 172.16.0.220,3260] successful.
Dec 01 19:16:50 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:16:50 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:50 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:50 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[097c00a1-cc4b-44f6-b3df-71e0fba7f513]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:16:50 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:16:50 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:50 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:50 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0baf482-0370-4c1a-aa69-f5da6ed92791]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:16:50 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)
Dec 01 19:16:50 user nova-compute[75066]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)
Dec 01 19:16:50 user nova-compute[75066]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a (non-flash)
Dec 01 19:16:50 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:16:50 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)
Dec 01 19:16:50 user nova-compute[75066]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)
Dec 01 19:16:50 user nova-compute[75066]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a (non-flash)
Dec 01 19:16:50 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:16:50 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.247s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:16:50 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Connected to 172.16.0.220:3260 {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 19:16:50 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=75066) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 19:16:50 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75066) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 19:16:50 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:50 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:50 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[8007dfc4-11fb-4954-ae48-7a8d4af3640a]: (4, ('- - 0', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:16:50 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:16:50 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YXNclRnG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.278s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] <== connect_volume: return (1280ms) {'type': 'block', 'scsi_wwn': '26462633436353636', 'path': '/dev/sdd'} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26462633436353636', 'path': '/dev/sdd'} {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T19:16:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-247223983',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-247223983',id=10,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFtqCwylgyb0WG7sDs1o5pvYmHxawQEA+xG3Vj+g2ckKpssw5PEMOPCxErPCNd9MCv+qpEsvhzBeg1YY0i3jiFaY6IEPyg71FeHYLEjeyEgekY9hItoVOi960ErfPbPyA==',key_name='tempest-keypair-1359189134',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea3c2552714a477396da7ad322703173',ramdisk_id='',reservation_id='r-nyf9qoti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-752167218',owner_user_name='tempest-TaggedBootDevicesTest-752167218-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:16:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f03c5da7e0e4205baafc13cbcbb7c5e',uuid=6d2de2c4-0c0d-4238-933c-d0ef6538964e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b39c07b1-b2c2-45bf-bf1c-1865dfc9ceff", "address": "fa:16:3e:f7:4a:d3", "network": {"id": "c77595ef-65b2-45cd-be6a-8bf0380a449b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-402289383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb39c07b1-b2", "ovs_interfaceid": "b39c07b1-b2c2-45bf-bf1c-1865dfc9ceff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Converting VIF {"id": "b39c07b1-b2c2-45bf-bf1c-1865dfc9ceff", "address": "fa:16:3e:f7:4a:d3", "network": {"id": "c77595ef-65b2-45cd-be6a-8bf0380a449b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-402289383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb39c07b1-b2", "ovs_interfaceid": "b39c07b1-b2c2-45bf-bf1c-1865dfc9ceff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:4a:d3,bridge_name='br-int',has_traffic_filtering=True,id=b39c07b1-b2c2-45bf-bf1c-1865dfc9ceff,network=Network(c77595ef-65b2-45cd-be6a-8bf0380a449b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb39c07b1-b2') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T19:16:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-247223983',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-247223983',id=10,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFtqCwylgyb0WG7sDs1o5pvYmHxawQEA+xG3Vj+g2ckKpssw5PEMOPCxErPCNd9MCv+qpEsvhzBeg1YY0i3jiFaY6IEPyg71FeHYLEjeyEgekY9hItoVOi960ErfPbPyA==',key_name='tempest-keypair-1359189134',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea3c2552714a477396da7ad322703173',ramdisk_id='',reservation_id='r-nyf9qoti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-752167218',owner_user_name='tempest-TaggedBootDevicesTest-752167218-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:16:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f03c5da7e0e4205baafc13cbcbb7c5e',uuid=6d2de2c4-0c0d-4238-933c-d0ef6538964e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6eea2787-921d-4d51-aa70-d843d187a47f", "address": "fa:16:3e:7b:03:0e", "network": {"id": "8f2b8b19-449f-4d10-8d47-356d5d5e5338", "bridge": "br-int", "label": "tempest-device-tagging-net1-967030387", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eea2787-92", "ovs_interfaceid": "6eea2787-921d-4d51-aa70-d843d187a47f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Converting VIF {"id": "6eea2787-921d-4d51-aa70-d843d187a47f", "address": "fa:16:3e:7b:03:0e", "network": {"id": "8f2b8b19-449f-4d10-8d47-356d5d5e5338", "bridge": "br-int", "label": "tempest-device-tagging-net1-967030387", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eea2787-92", "ovs_interfaceid": "6eea2787-921d-4d51-aa70-d843d187a47f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:03:0e,bridge_name='br-int',has_traffic_filtering=True,id=6eea2787-921d-4d51-aa70-d843d187a47f,network=Network(8f2b8b19-449f-4d10-8d47-356d5d5e5338),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6eea2787-92') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T19:16:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-247223983',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-247223983',id=10,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFtqCwylgyb0WG7sDs1o5pvYmHxawQEA+xG3Vj+g2ckKpssw5PEMOPCxErPCNd9MCv+qpEsvhzBeg1YY0i3jiFaY6IEPyg71FeHYLEjeyEgekY9hItoVOi960ErfPbPyA==',key_name='tempest-keypair-1359189134',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea3c2552714a477396da7ad322703173',ramdisk_id='',reservation_id='r-nyf9qoti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-752167218',owner_user_name='tempest-TaggedBootDevicesTest-752167218-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:16:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f03c5da7e0e4205baafc13cbcbb7c5e',uuid=6d2de2c4-0c0d-4238-933c-d0ef6538964e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fbddb1ea-5cff-4ae8-ac1c-1ee726012aea", "address": "fa:16:3e:63:9b:41", "network": {"id": "8f2b8b19-449f-4d10-8d47-356d5d5e5338", "bridge": "br-int", "label": "tempest-device-tagging-net1-967030387", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbddb1ea-5c", "ovs_interfaceid": "fbddb1ea-5cff-4ae8-ac1c-1ee726012aea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Converting VIF {"id": "fbddb1ea-5cff-4ae8-ac1c-1ee726012aea", "address": "fa:16:3e:63:9b:41", "network": {"id": "8f2b8b19-449f-4d10-8d47-356d5d5e5338", "bridge": "br-int", "label": "tempest-device-tagging-net1-967030387", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbddb1ea-5c", "ovs_interfaceid": "fbddb1ea-5cff-4ae8-ac1c-1ee726012aea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:9b:41,bridge_name='br-int',has_traffic_filtering=True,id=fbddb1ea-5cff-4ae8-ac1c-1ee726012aea,network=Network(8f2b8b19-449f-4d10-8d47-356d5d5e5338),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfbddb1ea-5c') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T19:16:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-247223983',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-247223983',id=10,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFtqCwylgyb0WG7sDs1o5pvYmHxawQEA+xG3Vj+g2ckKpssw5PEMOPCxErPCNd9MCv+qpEsvhzBeg1YY0i3jiFaY6IEPyg71FeHYLEjeyEgekY9hItoVOi960ErfPbPyA==',key_name='tempest-keypair-1359189134',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea3c2552714a477396da7ad322703173',ramdisk_id='',reservation_id='r-nyf9qoti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-752167218',owner_user_name='tempest-TaggedBootDevicesTest-752167218-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:16:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f03c5da7e0e4205baafc13cbcbb7c5e',uuid=6d2de2c4-0c0d-4238-933c-d0ef6538964e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "294424e7-040a-4720-9012-7353ff25f249", "address": "fa:16:3e:94:c6:01", "network": {"id": "8f2b8b19-449f-4d10-8d47-356d5d5e5338", "bridge": "br-int", "label": "tempest-device-tagging-net1-967030387", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294424e7-04", "ovs_interfaceid": "294424e7-040a-4720-9012-7353ff25f249", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Converting VIF {"id": "294424e7-040a-4720-9012-7353ff25f249", "address": "fa:16:3e:94:c6:01", "network": {"id": "8f2b8b19-449f-4d10-8d47-356d5d5e5338", "bridge": "br-int", "label": "tempest-device-tagging-net1-967030387", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294424e7-04", "ovs_interfaceid": "294424e7-040a-4720-9012-7353ff25f249", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:c6:01,bridge_name='br-int',has_traffic_filtering=True,id=294424e7-040a-4720-9012-7353ff25f249,network=Network(8f2b8b19-449f-4d10-8d47-356d5d5e5338),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap294424e7-04') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T19:16:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-247223983',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-247223983',id=10,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFtqCwylgyb0WG7sDs1o5pvYmHxawQEA+xG3Vj+g2ckKpssw5PEMOPCxErPCNd9MCv+qpEsvhzBeg1YY0i3jiFaY6IEPyg71FeHYLEjeyEgekY9hItoVOi960ErfPbPyA==',key_name='tempest-keypair-1359189134',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea3c2552714a477396da7ad322703173',ramdisk_id='',reservation_id='r-nyf9qoti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-752167218',owner_user_name='tempest-TaggedBootDevicesTest-752167218-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:16:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f03c5da7e0e4205baafc13cbcbb7c5e',uuid=6d2de2c4-0c0d-4238-933c-d0ef6538964e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26418177-564a-4d5b-a37e-91c6334334e9", "address": "fa:16:3e:cc:74:51", "network": {"id": "8f2b8b19-449f-4d10-8d47-356d5d5e5338", "bridge": "br-int", "label": "tempest-device-tagging-net1-967030387", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26418177-56", "ovs_interfaceid": "26418177-564a-4d5b-a37e-91c6334334e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Converting VIF {"id": "26418177-564a-4d5b-a37e-91c6334334e9", "address": "fa:16:3e:cc:74:51", "network": {"id": "8f2b8b19-449f-4d10-8d47-356d5d5e5338", "bridge": "br-int", "label": "tempest-device-tagging-net1-967030387", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26418177-56", "ovs_interfaceid": "26418177-564a-4d5b-a37e-91c6334334e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:74:51,bridge_name='br-int',has_traffic_filtering=True,id=26418177-564a-4d5b-a37e-91c6334334e9,network=Network(8f2b8b19-449f-4d10-8d47-356d5d5e5338),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26418177-56') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T19:16:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-247223983',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-247223983',id=10,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFtqCwylgyb0WG7sDs1o5pvYmHxawQEA+xG3Vj+g2ckKpssw5PEMOPCxErPCNd9MCv+qpEsvhzBeg1YY0i3jiFaY6IEPyg71FeHYLEjeyEgekY9hItoVOi960ErfPbPyA==',key_name='tempest-keypair-1359189134',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea3c2552714a477396da7ad322703173',ramdisk_id='',reservation_id='r-nyf9qoti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-752167218',owner_user_name='tempest-TaggedBootDevicesTest-752167218-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:16:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f03c5da7e0e4205baafc13cbcbb7c5e',uuid=6d2de2c4-0c0d-4238-933c-d0ef6538964e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21b7577f-898b-4d3b-9ecd-911568f3923f", "address": "fa:16:3e:52:1c:5b", "network": {"id": "88fd1225-bf6b-4d28-bc10-deb410395ac9", "bridge": "br-int", "label": "tempest-device-tagging-net2-224351536", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21b7577f-89", "ovs_interfaceid": "21b7577f-898b-4d3b-9ecd-911568f3923f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Converting VIF {"id": "21b7577f-898b-4d3b-9ecd-911568f3923f", "address": "fa:16:3e:52:1c:5b", "network": {"id": "88fd1225-bf6b-4d28-bc10-deb410395ac9", "bridge": "br-int", "label": "tempest-device-tagging-net2-224351536", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21b7577f-89", "ovs_interfaceid": "21b7577f-898b-4d3b-9ecd-911568f3923f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:1c:5b,bridge_name='br-int',has_traffic_filtering=True,id=21b7577f-898b-4d3b-9ecd-911568f3923f,network=Network(88fd1225-bf6b-4d28-bc10-deb410395ac9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21b7577f-89') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T19:16:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-247223983',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-247223983',id=10,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFtqCwylgyb0WG7sDs1o5pvYmHxawQEA+xG3Vj+g2ckKpssw5PEMOPCxErPCNd9MCv+qpEsvhzBeg1YY0i3jiFaY6IEPyg71FeHYLEjeyEgekY9hItoVOi960ErfPbPyA==',key_name='tempest-keypair-1359189134',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea3c2552714a477396da7ad322703173',ramdisk_id='',reservation_id='r-nyf9qoti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-752167218',owner_user_name='tempest-TaggedBootDevicesTest-752167218-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:16:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f03c5da7e0e4205baafc13cbcbb7c5e',uuid=6d2de2c4-0c0d-4238-933c-d0ef6538964e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10d4a23a-1f6c-4c81-b937-bfa19dcc3606", "address": "fa:16:3e:c3:1c:9d", "network": {"id": "88fd1225-bf6b-4d28-bc10-deb410395ac9", "bridge": "br-int", "label": "tempest-device-tagging-net2-224351536", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10d4a23a-1f", "ovs_interfaceid": "10d4a23a-1f6c-4c81-b937-bfa19dcc3606", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Converting VIF {"id": "10d4a23a-1f6c-4c81-b937-bfa19dcc3606", "address": "fa:16:3e:c3:1c:9d", "network": {"id": "88fd1225-bf6b-4d28-bc10-deb410395ac9", "bridge": "br-int", "label": "tempest-device-tagging-net2-224351536", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10d4a23a-1f", "ovs_interfaceid": "10d4a23a-1f6c-4c81-b937-bfa19dcc3606", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:1c:9d,bridge_name='br-int',has_traffic_filtering=True,id=10d4a23a-1f6c-4c81-b937-bfa19dcc3606,network=Network(88fd1225-bf6b-4d28-bc10-deb410395ac9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10d4a23a-1f') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG nova.objects.instance [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Lazy-loading 'pci_devices' on Instance uuid 6d2de2c4-0c0d-4238-933c-d0ef6538964e {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:16:51 user nova-compute[75066]:   <uuid>6d2de2c4-0c0d-4238-933c-d0ef6538964e</uuid>
Dec 01 19:16:51 user nova-compute[75066]:   <name>instance-0000000a</name>
Dec 01 19:16:51 user nova-compute[75066]:   <memory>524288</memory>
Dec 01 19:16:51 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:16:51 user nova-compute[75066]:   <metadata>
Dec 01 19:16:51 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:16:51 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:16:51 user nova-compute[75066]:       <nova:name>tempest-device-tagging-server-247223983</nova:name>
Dec 01 19:16:51 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:16:47</nova:creationTime>
Dec 01 19:16:51 user nova-compute[75066]:       <nova:flavor name="m1.tiny">
Dec 01 19:16:51 user nova-compute[75066]:         <nova:memory>512</nova:memory>
Dec 01 19:16:51 user nova-compute[75066]:         <nova:disk>1</nova:disk>
Dec 01 19:16:51 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:16:51 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:16:51 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:16:51 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:16:51 user nova-compute[75066]:       <nova:owner>
Dec 01 19:16:51 user nova-compute[75066]:         <nova:user uuid="2f03c5da7e0e4205baafc13cbcbb7c5e">tempest-TaggedBootDevicesTest-752167218-project-member</nova:user>
Dec 01 19:16:51 user nova-compute[75066]:         <nova:project uuid="ea3c2552714a477396da7ad322703173">tempest-TaggedBootDevicesTest-752167218</nova:project>
Dec 01 19:16:51 user nova-compute[75066]:       </nova:owner>
Dec 01 19:16:51 user nova-compute[75066]:       <nova:root type="image" uuid="900b237b-e99c-4fdd-a44f-dcb7a08baa86"/>
Dec 01 19:16:51 user nova-compute[75066]:       <nova:ports>
Dec 01 19:16:51 user nova-compute[75066]:         <nova:port uuid="b39c07b1-b2c2-45bf-bf1c-1865dfc9ceff">
Dec 01 19:16:51 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Dec 01 19:16:51 user nova-compute[75066]:         </nova:port>
Dec 01 19:16:51 user nova-compute[75066]:         <nova:port uuid="6eea2787-921d-4d51-aa70-d843d187a47f">
Dec 01 19:16:51 user nova-compute[75066]:           <nova:ip type="fixed" address="10.1.1.89" ipVersion="4"/>
Dec 01 19:16:51 user nova-compute[75066]:         </nova:port>
Dec 01 19:16:51 user nova-compute[75066]:         <nova:port uuid="fbddb1ea-5cff-4ae8-ac1c-1ee726012aea">
Dec 01 19:16:51 user nova-compute[75066]:           <nova:ip type="fixed" address="10.1.1.198" ipVersion="4"/>
Dec 01 19:16:51 user nova-compute[75066]:         </nova:port>
Dec 01 19:16:51 user nova-compute[75066]:         <nova:port uuid="294424e7-040a-4720-9012-7353ff25f249">
Dec 01 19:16:51 user nova-compute[75066]:           <nova:ip type="fixed" address="10.1.1.59" ipVersion="4"/>
Dec 01 19:16:51 user nova-compute[75066]:         </nova:port>
Dec 01 19:16:51 user nova-compute[75066]:         <nova:port uuid="26418177-564a-4d5b-a37e-91c6334334e9">
Dec 01 19:16:51 user nova-compute[75066]:           <nova:ip type="fixed" address="10.1.1.166" ipVersion="4"/>
Dec 01 19:16:51 user nova-compute[75066]:         </nova:port>
Dec 01 19:16:51 user nova-compute[75066]:         <nova:port uuid="21b7577f-898b-4d3b-9ecd-911568f3923f">
Dec 01 19:16:51 user nova-compute[75066]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Dec 01 19:16:51 user nova-compute[75066]:         </nova:port>
Dec 01 19:16:51 user nova-compute[75066]:         <nova:port uuid="10d4a23a-1f6c-4c81-b937-bfa19dcc3606">
Dec 01 19:16:51 user nova-compute[75066]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Dec 01 19:16:51 user nova-compute[75066]:         </nova:port>
Dec 01 19:16:51 user nova-compute[75066]:       </nova:ports>
Dec 01 19:16:51 user nova-compute[75066]:     </nova:instance>
Dec 01 19:16:51 user nova-compute[75066]:   </metadata>
Dec 01 19:16:51 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:16:51 user nova-compute[75066]:     <system>
Dec 01 19:16:51 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:16:51 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:16:51 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:16:51 user nova-compute[75066]:       <entry name="serial">6d2de2c4-0c0d-4238-933c-d0ef6538964e</entry>
Dec 01 19:16:51 user nova-compute[75066]:       <entry name="uuid">6d2de2c4-0c0d-4238-933c-d0ef6538964e</entry>
Dec 01 19:16:51 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:16:51 user nova-compute[75066]:     </system>
Dec 01 19:16:51 user nova-compute[75066]:   </sysinfo>
Dec 01 19:16:51 user nova-compute[75066]:   <os>
Dec 01 19:16:51 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:16:51 user nova-compute[75066]:     <boot dev="hd"/>
Dec 01 19:16:51 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:16:51 user nova-compute[75066]:   </os>
Dec 01 19:16:51 user nova-compute[75066]:   <features>
Dec 01 19:16:51 user nova-compute[75066]:     <acpi/>
Dec 01 19:16:51 user nova-compute[75066]:     <apic/>
Dec 01 19:16:51 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:16:51 user nova-compute[75066]:   </features>
Dec 01 19:16:51 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:16:51 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:16:51 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:16:51 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:16:51 user nova-compute[75066]:   </clock>
Dec 01 19:16:51 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:16:51 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:16:51 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:16:51 user nova-compute[75066]:   </cpu>
Dec 01 19:16:51 user nova-compute[75066]:   <devices>
Dec 01 19:16:51 user nova-compute[75066]:     <disk type="file" device="cdrom">
Dec 01 19:16:51 user nova-compute[75066]:       <driver name="qemu" type="raw" cache="none"/>
Dec 01 19:16:51 user nova-compute[75066]:       <source file="/opt/stack/data/nova/instances/6d2de2c4-0c0d-4238-933c-d0ef6538964e/disk.config"/>
Dec 01 19:16:51 user nova-compute[75066]:       <target dev="hda" bus="ide"/>
Dec 01 19:16:51 user nova-compute[75066]:     </disk>
Dec 01 19:16:51 user nova-compute[75066]:     <disk type="block" device="disk">
Dec 01 19:16:51 user nova-compute[75066]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:16:51 user nova-compute[75066]:       <source dev="/dev/sdb"/>
Dec 01 19:16:51 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:16:51 user nova-compute[75066]:       <serial>7e19af37-2e86-449b-83a6-4a58b63d0d3a</serial>
Dec 01 19:16:51 user nova-compute[75066]:     </disk>
Dec 01 19:16:51 user nova-compute[75066]:     <disk type="block" device="disk">
Dec 01 19:16:51 user nova-compute[75066]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:16:51 user nova-compute[75066]:       <source dev="/dev/sdc"/>
Dec 01 19:16:51 user nova-compute[75066]:       <target dev="vdb" bus="virtio"/>
Dec 01 19:16:51 user nova-compute[75066]:       <serial>2eb196a1-1efb-4bd5-9113-5745861c7315</serial>
Dec 01 19:16:51 user nova-compute[75066]:     </disk>
Dec 01 19:16:51 user nova-compute[75066]:     <disk type="block" device="disk">
Dec 01 19:16:51 user nova-compute[75066]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:16:51 user nova-compute[75066]:       <source dev="/dev/sdd"/>
Dec 01 19:16:51 user nova-compute[75066]:       <target dev="vdc" bus="virtio"/>
Dec 01 19:16:51 user nova-compute[75066]:       <serial>f81dcbf2-df0b-42ef-a856-a14ea3341d5a</serial>
Dec 01 19:16:51 user nova-compute[75066]:     </disk>
Dec 01 19:16:51 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:16:51 user nova-compute[75066]:       <mac address="fa:16:3e:f7:4a:d3"/>
Dec 01 19:16:51 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:16:51 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:16:51 user nova-compute[75066]:       <target dev="tapb39c07b1-b2"/>
Dec 01 19:16:51 user nova-compute[75066]:     </interface>
Dec 01 19:16:51 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:16:51 user nova-compute[75066]:       <mac address="fa:16:3e:7b:03:0e"/>
Dec 01 19:16:51 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:16:51 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:16:51 user nova-compute[75066]:       <target dev="tap6eea2787-92"/>
Dec 01 19:16:51 user nova-compute[75066]:     </interface>
Dec 01 19:16:51 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:16:51 user nova-compute[75066]:       <mac address="fa:16:3e:63:9b:41"/>
Dec 01 19:16:51 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:16:51 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:16:51 user nova-compute[75066]:       <target dev="tapfbddb1ea-5c"/>
Dec 01 19:16:51 user nova-compute[75066]:     </interface>
Dec 01 19:16:51 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:16:51 user nova-compute[75066]:       <mac address="fa:16:3e:94:c6:01"/>
Dec 01 19:16:51 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:16:51 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:16:51 user nova-compute[75066]:       <target dev="tap294424e7-04"/>
Dec 01 19:16:51 user nova-compute[75066]:     </interface>
Dec 01 19:16:51 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:16:51 user nova-compute[75066]:       <mac address="fa:16:3e:cc:74:51"/>
Dec 01 19:16:51 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:16:51 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:16:51 user nova-compute[75066]:       <target dev="tap26418177-56"/>
Dec 01 19:16:51 user nova-compute[75066]:     </interface>
Dec 01 19:16:51 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:16:51 user nova-compute[75066]:       <mac address="fa:16:3e:52:1c:5b"/>
Dec 01 19:16:51 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:16:51 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:16:51 user nova-compute[75066]:       <target dev="tap21b7577f-89"/>
Dec 01 19:16:51 user nova-compute[75066]:     </interface>
Dec 01 19:16:51 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:16:51 user nova-compute[75066]:       <mac address="fa:16:3e:c3:1c:9d"/>
Dec 01 19:16:51 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:16:51 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:16:51 user nova-compute[75066]:       <target dev="tap10d4a23a-1f"/>
Dec 01 19:16:51 user nova-compute[75066]:     </interface>
Dec 01 19:16:51 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:16:51 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/6d2de2c4-0c0d-4238-933c-d0ef6538964e/console.log" append="off"/>
Dec 01 19:16:51 user nova-compute[75066]:     </serial>
Dec 01 19:16:51 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:16:51 user nova-compute[75066]:     <video>
Dec 01 19:16:51 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:16:51 user nova-compute[75066]:     </video>
Dec 01 19:16:51 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:16:51 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:16:51 user nova-compute[75066]:     </rng>
Dec 01 19:16:51 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:16:51 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:16:51 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:16:51 user nova-compute[75066]:     </memballoon>
Dec 01 19:16:51 user nova-compute[75066]:   </devices>
Dec 01 19:16:51 user nova-compute[75066]: </domain>
Dec 01 19:16:51 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T19:16:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-247223983',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-247223983',id=10,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFtqCwylgyb0WG7sDs1o5pvYmHxawQEA+xG3Vj+g2ckKpssw5PEMOPCxErPCNd9MCv+qpEsvhzBeg1YY0i3jiFaY6IEPyg71FeHYLEjeyEgekY9hItoVOi960ErfPbPyA==',key_name='tempest-keypair-1359189134',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea3c2552714a477396da7ad322703173',ramdisk_id='',reservation_id='r-nyf9qoti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-752167218',owner_user_name='tempest-TaggedBootDevicesTest-752167218-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:16:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f03c5da7e0e4205baafc13cbcbb7c5e',uuid=6d2de2c4-0c0d-4238-933c-d0ef6538964e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b39c07b1-b2c2-45bf-bf1c-1865dfc9ceff", "address": "fa:16:3e:f7:4a:d3", "network": {"id": "c77595ef-65b2-45cd-be6a-8bf0380a449b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-402289383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb39c07b1-b2", "ovs_interfaceid": "b39c07b1-b2c2-45bf-bf1c-1865dfc9ceff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Converting VIF {"id": "b39c07b1-b2c2-45bf-bf1c-1865dfc9ceff", "address": "fa:16:3e:f7:4a:d3", "network": {"id": "c77595ef-65b2-45cd-be6a-8bf0380a449b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-402289383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb39c07b1-b2", "ovs_interfaceid": "b39c07b1-b2c2-45bf-bf1c-1865dfc9ceff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:4a:d3,bridge_name='br-int',has_traffic_filtering=True,id=b39c07b1-b2c2-45bf-bf1c-1865dfc9ceff,network=Network(c77595ef-65b2-45cd-be6a-8bf0380a449b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb39c07b1-b2') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG os_vif [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:4a:d3,bridge_name='br-int',has_traffic_filtering=True,id=b39c07b1-b2c2-45bf-bf1c-1865dfc9ceff,network=Network(c77595ef-65b2-45cd-be6a-8bf0380a449b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb39c07b1-b2') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5e62a5b8-dd0e-5a6e-ad25-e309d3c67fba', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb39c07b1-b2, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb39c07b1-b2, col_values=(('qos', UUID('b58e274c-213c-4bc9-ada5-1e9969bb8878')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb39c07b1-b2, col_values=(('external_ids', {'iface-id': 'b39c07b1-b2c2-45bf-bf1c-1865dfc9ceff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:4a:d3', 'vm-uuid': '6d2de2c4-0c0d-4238-933c-d0ef6538964e'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:51 user nova-compute[75066]: INFO os_vif [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:4a:d3,bridge_name='br-int',has_traffic_filtering=True,id=b39c07b1-b2c2-45bf-bf1c-1865dfc9ceff,network=Network(c77595ef-65b2-45cd-be6a-8bf0380a449b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb39c07b1-b2')
Dec 01 19:16:51 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T19:16:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-247223983',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-247223983',id=10,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFtqCwylgyb0WG7sDs1o5pvYmHxawQEA+xG3Vj+g2ckKpssw5PEMOPCxErPCNd9MCv+qpEsvhzBeg1YY0i3jiFaY6IEPyg71FeHYLEjeyEgekY9hItoVOi960ErfPbPyA==',key_name='tempest-keypair-1359189134',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea3c2552714a477396da7ad322703173',ramdisk_id='',reservation_id='r-nyf9qoti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-752167218',owner_user_name='tempest-TaggedBootDevicesTest-752167218-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:16:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f03c5da7e0e4205baafc13cbcbb7c5e',uuid=6d2de2c4-0c0d-4238-933c-d0ef6538964e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6eea2787-921d-4d51-aa70-d843d187a47f", "address": "fa:16:3e:7b:03:0e", "network": {"id": "8f2b8b19-449f-4d10-8d47-356d5d5e5338", "bridge": "br-int", "label": "tempest-device-tagging-net1-967030387", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eea2787-92", "ovs_interfaceid": "6eea2787-921d-4d51-aa70-d843d187a47f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Converting VIF {"id": "6eea2787-921d-4d51-aa70-d843d187a47f", "address": "fa:16:3e:7b:03:0e", "network": {"id": "8f2b8b19-449f-4d10-8d47-356d5d5e5338", "bridge": "br-int", "label": "tempest-device-tagging-net1-967030387", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eea2787-92", "ovs_interfaceid": "6eea2787-921d-4d51-aa70-d843d187a47f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:03:0e,bridge_name='br-int',has_traffic_filtering=True,id=6eea2787-921d-4d51-aa70-d843d187a47f,network=Network(8f2b8b19-449f-4d10-8d47-356d5d5e5338),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6eea2787-92') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG os_vif [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:03:0e,bridge_name='br-int',has_traffic_filtering=True,id=6eea2787-921d-4d51-aa70-d843d187a47f,network=Network(8f2b8b19-449f-4d10-8d47-356d5d5e5338),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6eea2787-92') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e1af94ab-3252-5b8e-8d7f-3e73b30c11bb', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6eea2787-92, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6eea2787-92, col_values=(('qos', UUID('08b2bc11-c63c-43ba-a530-01572c155e01')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6eea2787-92, col_values=(('external_ids', {'iface-id': '6eea2787-921d-4d51-aa70-d843d187a47f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:03:0e', 'vm-uuid': '6d2de2c4-0c0d-4238-933c-d0ef6538964e'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:51 user nova-compute[75066]: INFO os_vif [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:03:0e,bridge_name='br-int',has_traffic_filtering=True,id=6eea2787-921d-4d51-aa70-d843d187a47f,network=Network(8f2b8b19-449f-4d10-8d47-356d5d5e5338),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6eea2787-92')
Dec 01 19:16:51 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T19:16:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-247223983',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-247223983',id=10,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFtqCwylgyb0WG7sDs1o5pvYmHxawQEA+xG3Vj+g2ckKpssw5PEMOPCxErPCNd9MCv+qpEsvhzBeg1YY0i3jiFaY6IEPyg71FeHYLEjeyEgekY9hItoVOi960ErfPbPyA==',key_name='tempest-keypair-1359189134',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea3c2552714a477396da7ad322703173',ramdisk_id='',reservation_id='r-nyf9qoti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-752167218',owner_user_name='tempest-TaggedBootDevicesTest-752167218-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:16:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f03c5da7e0e4205baafc13cbcbb7c5e',uuid=6d2de2c4-0c0d-4238-933c-d0ef6538964e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fbddb1ea-5cff-4ae8-ac1c-1ee726012aea", "address": "fa:16:3e:63:9b:41", "network": {"id": "8f2b8b19-449f-4d10-8d47-356d5d5e5338", "bridge": "br-int", "label": "tempest-device-tagging-net1-967030387", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbddb1ea-5c", "ovs_interfaceid": "fbddb1ea-5cff-4ae8-ac1c-1ee726012aea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Converting VIF {"id": "fbddb1ea-5cff-4ae8-ac1c-1ee726012aea", "address": "fa:16:3e:63:9b:41", "network": {"id": "8f2b8b19-449f-4d10-8d47-356d5d5e5338", "bridge": "br-int", "label": "tempest-device-tagging-net1-967030387", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbddb1ea-5c", "ovs_interfaceid": "fbddb1ea-5cff-4ae8-ac1c-1ee726012aea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:9b:41,bridge_name='br-int',has_traffic_filtering=True,id=fbddb1ea-5cff-4ae8-ac1c-1ee726012aea,network=Network(8f2b8b19-449f-4d10-8d47-356d5d5e5338),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfbddb1ea-5c') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG os_vif [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:9b:41,bridge_name='br-int',has_traffic_filtering=True,id=fbddb1ea-5cff-4ae8-ac1c-1ee726012aea,network=Network(8f2b8b19-449f-4d10-8d47-356d5d5e5338),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfbddb1ea-5c') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f590e0a0-4285-5403-a9aa-afdd4e6668f7', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfbddb1ea-5c, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfbddb1ea-5c, col_values=(('qos', UUID('4fd2f996-ad37-4c30-acdc-7865902eded5')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfbddb1ea-5c, col_values=(('external_ids', {'iface-id': 'fbddb1ea-5cff-4ae8-ac1c-1ee726012aea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:9b:41', 'vm-uuid': '6d2de2c4-0c0d-4238-933c-d0ef6538964e'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:51 user nova-compute[75066]: INFO os_vif [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:9b:41,bridge_name='br-int',has_traffic_filtering=True,id=fbddb1ea-5cff-4ae8-ac1c-1ee726012aea,network=Network(8f2b8b19-449f-4d10-8d47-356d5d5e5338),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfbddb1ea-5c')
Dec 01 19:16:51 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T19:16:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-247223983',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-247223983',id=10,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFtqCwylgyb0WG7sDs1o5pvYmHxawQEA+xG3Vj+g2ckKpssw5PEMOPCxErPCNd9MCv+qpEsvhzBeg1YY0i3jiFaY6IEPyg71FeHYLEjeyEgekY9hItoVOi960ErfPbPyA==',key_name='tempest-keypair-1359189134',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea3c2552714a477396da7ad322703173',ramdisk_id='',reservation_id='r-nyf9qoti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-752167218',owner_user_name='tempest-TaggedBootDevicesTest-752167218-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:16:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f03c5da7e0e4205baafc13cbcbb7c5e',uuid=6d2de2c4-0c0d-4238-933c-d0ef6538964e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "294424e7-040a-4720-9012-7353ff25f249", "address": "fa:16:3e:94:c6:01", "network": {"id": "8f2b8b19-449f-4d10-8d47-356d5d5e5338", "bridge": "br-int", "label": "tempest-device-tagging-net1-967030387", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294424e7-04", "ovs_interfaceid": "294424e7-040a-4720-9012-7353ff25f249", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Converting VIF {"id": "294424e7-040a-4720-9012-7353ff25f249", "address": "fa:16:3e:94:c6:01", "network": {"id": "8f2b8b19-449f-4d10-8d47-356d5d5e5338", "bridge": "br-int", "label": "tempest-device-tagging-net1-967030387", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294424e7-04", "ovs_interfaceid": "294424e7-040a-4720-9012-7353ff25f249", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:c6:01,bridge_name='br-int',has_traffic_filtering=True,id=294424e7-040a-4720-9012-7353ff25f249,network=Network(8f2b8b19-449f-4d10-8d47-356d5d5e5338),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap294424e7-04') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG os_vif [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:c6:01,bridge_name='br-int',has_traffic_filtering=True,id=294424e7-040a-4720-9012-7353ff25f249,network=Network(8f2b8b19-449f-4d10-8d47-356d5d5e5338),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap294424e7-04') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bea7eda8-d8fe-5a40-9ef6-d92428052b02', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap294424e7-04, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap294424e7-04, col_values=(('qos', UUID('3127453c-c114-4adf-a157-7588afd6c1fc')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap294424e7-04, col_values=(('external_ids', {'iface-id': '294424e7-040a-4720-9012-7353ff25f249', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:94:c6:01', 'vm-uuid': '6d2de2c4-0c0d-4238-933c-d0ef6538964e'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:51 user nova-compute[75066]: INFO os_vif [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:c6:01,bridge_name='br-int',has_traffic_filtering=True,id=294424e7-040a-4720-9012-7353ff25f249,network=Network(8f2b8b19-449f-4d10-8d47-356d5d5e5338),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap294424e7-04')
Dec 01 19:16:51 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T19:16:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-247223983',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-247223983',id=10,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFtqCwylgyb0WG7sDs1o5pvYmHxawQEA+xG3Vj+g2ckKpssw5PEMOPCxErPCNd9MCv+qpEsvhzBeg1YY0i3jiFaY6IEPyg71FeHYLEjeyEgekY9hItoVOi960ErfPbPyA==',key_name='tempest-keypair-1359189134',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea3c2552714a477396da7ad322703173',ramdisk_id='',reservation_id='r-nyf9qoti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-752167218',owner_user_name='tempest-TaggedBootDevicesTest-752167218-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:16:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f03c5da7e0e4205baafc13cbcbb7c5e',uuid=6d2de2c4-0c0d-4238-933c-d0ef6538964e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26418177-564a-4d5b-a37e-91c6334334e9", "address": "fa:16:3e:cc:74:51", "network": {"id": "8f2b8b19-449f-4d10-8d47-356d5d5e5338", "bridge": "br-int", "label": "tempest-device-tagging-net1-967030387", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26418177-56", "ovs_interfaceid": "26418177-564a-4d5b-a37e-91c6334334e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Converting VIF {"id": "26418177-564a-4d5b-a37e-91c6334334e9", "address": "fa:16:3e:cc:74:51", "network": {"id": "8f2b8b19-449f-4d10-8d47-356d5d5e5338", "bridge": "br-int", "label": "tempest-device-tagging-net1-967030387", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26418177-56", "ovs_interfaceid": "26418177-564a-4d5b-a37e-91c6334334e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:74:51,bridge_name='br-int',has_traffic_filtering=True,id=26418177-564a-4d5b-a37e-91c6334334e9,network=Network(8f2b8b19-449f-4d10-8d47-356d5d5e5338),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26418177-56') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG os_vif [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:74:51,bridge_name='br-int',has_traffic_filtering=True,id=26418177-564a-4d5b-a37e-91c6334334e9,network=Network(8f2b8b19-449f-4d10-8d47-356d5d5e5338),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26418177-56') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd5958e2b-6d00-5bf4-9fc1-fa4ab461fa75', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap26418177-56, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap26418177-56, col_values=(('qos', UUID('b0bc0e13-e07c-4bd0-acbd-0ebe9105e13f')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap26418177-56, col_values=(('external_ids', {'iface-id': '26418177-564a-4d5b-a37e-91c6334334e9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:74:51', 'vm-uuid': '6d2de2c4-0c0d-4238-933c-d0ef6538964e'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:51 user nova-compute[75066]: INFO os_vif [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:74:51,bridge_name='br-int',has_traffic_filtering=True,id=26418177-564a-4d5b-a37e-91c6334334e9,network=Network(8f2b8b19-449f-4d10-8d47-356d5d5e5338),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26418177-56')
Dec 01 19:16:51 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T19:16:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-247223983',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-247223983',id=10,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFtqCwylgyb0WG7sDs1o5pvYmHxawQEA+xG3Vj+g2ckKpssw5PEMOPCxErPCNd9MCv+qpEsvhzBeg1YY0i3jiFaY6IEPyg71FeHYLEjeyEgekY9hItoVOi960ErfPbPyA==',key_name='tempest-keypair-1359189134',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea3c2552714a477396da7ad322703173',ramdisk_id='',reservation_id='r-nyf9qoti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-752167218',owner_user_name='tempest-TaggedBootDevicesTest-752167218-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:16:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f03c5da7e0e4205baafc13cbcbb7c5e',uuid=6d2de2c4-0c0d-4238-933c-d0ef6538964e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21b7577f-898b-4d3b-9ecd-911568f3923f", "address": "fa:16:3e:52:1c:5b", "network": {"id": "88fd1225-bf6b-4d28-bc10-deb410395ac9", "bridge": "br-int", "label": "tempest-device-tagging-net2-224351536", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21b7577f-89", "ovs_interfaceid": "21b7577f-898b-4d3b-9ecd-911568f3923f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Converting VIF {"id": "21b7577f-898b-4d3b-9ecd-911568f3923f", "address": "fa:16:3e:52:1c:5b", "network": {"id": "88fd1225-bf6b-4d28-bc10-deb410395ac9", "bridge": "br-int", "label": "tempest-device-tagging-net2-224351536", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21b7577f-89", "ovs_interfaceid": "21b7577f-898b-4d3b-9ecd-911568f3923f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:1c:5b,bridge_name='br-int',has_traffic_filtering=True,id=21b7577f-898b-4d3b-9ecd-911568f3923f,network=Network(88fd1225-bf6b-4d28-bc10-deb410395ac9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21b7577f-89') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG os_vif [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:1c:5b,bridge_name='br-int',has_traffic_filtering=True,id=21b7577f-898b-4d3b-9ecd-911568f3923f,network=Network(88fd1225-bf6b-4d28-bc10-deb410395ac9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21b7577f-89') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6c2872b0-6ecf-5f8a-9e2d-5def9bef8da8', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:16:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap21b7577f-89, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:16:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap21b7577f-89, col_values=(('qos', UUID('669b4987-32e2-4590-9b77-a71e04408f0e')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:16:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap21b7577f-89, col_values=(('external_ids', {'iface-id': '21b7577f-898b-4d3b-9ecd-911568f3923f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:1c:5b', 'vm-uuid': '6d2de2c4-0c0d-4238-933c-d0ef6538964e'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:16:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:16:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:52 user nova-compute[75066]: INFO os_vif [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:1c:5b,bridge_name='br-int',has_traffic_filtering=True,id=21b7577f-898b-4d3b-9ecd-911568f3923f,network=Network(88fd1225-bf6b-4d28-bc10-deb410395ac9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21b7577f-89')
Dec 01 19:16:52 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T19:16:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-247223983',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-247223983',id=10,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFtqCwylgyb0WG7sDs1o5pvYmHxawQEA+xG3Vj+g2ckKpssw5PEMOPCxErPCNd9MCv+qpEsvhzBeg1YY0i3jiFaY6IEPyg71FeHYLEjeyEgekY9hItoVOi960ErfPbPyA==',key_name='tempest-keypair-1359189134',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea3c2552714a477396da7ad322703173',ramdisk_id='',reservation_id='r-nyf9qoti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-752167218',owner_user_name='tempest-TaggedBootDevicesTest-752167218-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:16:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f03c5da7e0e4205baafc13cbcbb7c5e',uuid=6d2de2c4-0c0d-4238-933c-d0ef6538964e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "10d4a23a-1f6c-4c81-b937-bfa19dcc3606", "address": "fa:16:3e:c3:1c:9d", "network": {"id": "88fd1225-bf6b-4d28-bc10-deb410395ac9", "bridge": "br-int", "label": "tempest-device-tagging-net2-224351536", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10d4a23a-1f", "ovs_interfaceid": "10d4a23a-1f6c-4c81-b937-bfa19dcc3606", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:16:52 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Converting VIF {"id": "10d4a23a-1f6c-4c81-b937-bfa19dcc3606", "address": "fa:16:3e:c3:1c:9d", "network": {"id": "88fd1225-bf6b-4d28-bc10-deb410395ac9", "bridge": "br-int", "label": "tempest-device-tagging-net2-224351536", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10d4a23a-1f", "ovs_interfaceid": "10d4a23a-1f6c-4c81-b937-bfa19dcc3606", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:16:52 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:1c:9d,bridge_name='br-int',has_traffic_filtering=True,id=10d4a23a-1f6c-4c81-b937-bfa19dcc3606,network=Network(88fd1225-bf6b-4d28-bc10-deb410395ac9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10d4a23a-1f') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:16:52 user nova-compute[75066]: DEBUG os_vif [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:1c:9d,bridge_name='br-int',has_traffic_filtering=True,id=10d4a23a-1f6c-4c81-b937-bfa19dcc3606,network=Network(88fd1225-bf6b-4d28-bc10-deb410395ac9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10d4a23a-1f') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:16:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:16:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:16:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3d01bbb4-d4fd-5a69-97f8-40267e76c7c8', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:16:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:16:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap10d4a23a-1f, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:16:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap10d4a23a-1f, col_values=(('qos', UUID('56825f90-1cef-450c-abeb-5d9534da8909')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:16:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap10d4a23a-1f, col_values=(('external_ids', {'iface-id': '10d4a23a-1f6c-4c81-b937-bfa19dcc3606', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c3:1c:9d', 'vm-uuid': '6d2de2c4-0c0d-4238-933c-d0ef6538964e'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:16:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:16:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:52 user nova-compute[75066]: INFO os_vif [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:1c:9d,bridge_name='br-int',has_traffic_filtering=True,id=10d4a23a-1f6c-4c81-b937-bfa19dcc3606,network=Network(88fd1225-bf6b-4d28-bc10-deb410395ac9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10d4a23a-1f')
Dec 01 19:16:52 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] No BDM found with device name hda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:16:52 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:16:52 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] No VIF found with MAC fa:16:3e:f7:4a:d3, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:16:52 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] No VIF found with MAC fa:16:3e:cc:74:51, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:16:52 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Using config drive
Dec 01 19:16:52 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Creating config drive at /opt/stack/data/nova/instances/6d2de2c4-0c0d-4238-933c-d0ef6538964e/disk.config
Dec 01 19:16:52 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6d2de2c4-0c0d-4238-933c-d0ef6538964e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpxob9ccuj {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:52 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6d2de2c4-0c0d-4238-933c-d0ef6538964e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpxob9ccuj" returned: 0 in 0.055s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:53 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:53 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:53 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:53 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:54 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:54 user nova-compute[75066]: DEBUG nova.compute.manager [req-18699d1f-ffdf-4a10-bbdf-523736f38ebf req-e1387ab9-357a-427d-bacd-48d1cdea1d3d service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received event network-vif-plugged-b39c07b1-b2c2-45bf-bf1c-1865dfc9ceff {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:16:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-18699d1f-ffdf-4a10-bbdf-523736f38ebf req-e1387ab9-357a-427d-bacd-48d1cdea1d3d service nova] Acquiring lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:16:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-18699d1f-ffdf-4a10-bbdf-523736f38ebf req-e1387ab9-357a-427d-bacd-48d1cdea1d3d service nova] Lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:16:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-18699d1f-ffdf-4a10-bbdf-523736f38ebf req-e1387ab9-357a-427d-bacd-48d1cdea1d3d service nova] Lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:16:54 user nova-compute[75066]: DEBUG nova.compute.manager [req-18699d1f-ffdf-4a10-bbdf-523736f38ebf req-e1387ab9-357a-427d-bacd-48d1cdea1d3d service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] No waiting events found dispatching network-vif-plugged-b39c07b1-b2c2-45bf-bf1c-1865dfc9ceff {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:16:54 user nova-compute[75066]: WARNING nova.compute.manager [req-18699d1f-ffdf-4a10-bbdf-523736f38ebf req-e1387ab9-357a-427d-bacd-48d1cdea1d3d service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received unexpected event network-vif-plugged-b39c07b1-b2c2-45bf-bf1c-1865dfc9ceff for instance with vm_state building and task_state spawning.
Dec 01 19:16:54 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:54 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:54 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:54 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:54 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:54 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:54 user nova-compute[75066]: DEBUG nova.compute.manager [req-a55adaeb-a940-4125-8d5d-a6dac512bd39 req-cb80e75f-bbfa-4290-a987-b1a3fa03479f service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received event network-vif-plugged-6eea2787-921d-4d51-aa70-d843d187a47f {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:16:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a55adaeb-a940-4125-8d5d-a6dac512bd39 req-cb80e75f-bbfa-4290-a987-b1a3fa03479f service nova] Acquiring lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:16:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a55adaeb-a940-4125-8d5d-a6dac512bd39 req-cb80e75f-bbfa-4290-a987-b1a3fa03479f service nova] Lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:16:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a55adaeb-a940-4125-8d5d-a6dac512bd39 req-cb80e75f-bbfa-4290-a987-b1a3fa03479f service nova] Lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:16:54 user nova-compute[75066]: DEBUG nova.compute.manager [req-a55adaeb-a940-4125-8d5d-a6dac512bd39 req-cb80e75f-bbfa-4290-a987-b1a3fa03479f service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] No waiting events found dispatching network-vif-plugged-6eea2787-921d-4d51-aa70-d843d187a47f {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:16:54 user nova-compute[75066]: WARNING nova.compute.manager [req-a55adaeb-a940-4125-8d5d-a6dac512bd39 req-cb80e75f-bbfa-4290-a987-b1a3fa03479f service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received unexpected event network-vif-plugged-6eea2787-921d-4d51-aa70-d843d187a47f for instance with vm_state building and task_state spawning.
Dec 01 19:16:54 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:54 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:54 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:55 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:55 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:55 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:55 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:55 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:16:55 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:55 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:55 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:55 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:55 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:55 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:55 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:55 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:55 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:55 user nova-compute[75066]: DEBUG nova.compute.manager [req-d1280719-bf79-4f9a-95c9-823b85c020e9 req-38998055-a11d-4a47-ac79-1b05c9f1e0d7 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received event network-vif-plugged-26418177-564a-4d5b-a37e-91c6334334e9 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:16:55 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d1280719-bf79-4f9a-95c9-823b85c020e9 req-38998055-a11d-4a47-ac79-1b05c9f1e0d7 service nova] Acquiring lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:16:55 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d1280719-bf79-4f9a-95c9-823b85c020e9 req-38998055-a11d-4a47-ac79-1b05c9f1e0d7 service nova] Lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:16:55 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d1280719-bf79-4f9a-95c9-823b85c020e9 req-38998055-a11d-4a47-ac79-1b05c9f1e0d7 service nova] Lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:16:55 user nova-compute[75066]: DEBUG nova.compute.manager [req-d1280719-bf79-4f9a-95c9-823b85c020e9 req-38998055-a11d-4a47-ac79-1b05c9f1e0d7 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] No waiting events found dispatching network-vif-plugged-26418177-564a-4d5b-a37e-91c6334334e9 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:16:55 user nova-compute[75066]: WARNING nova.compute.manager [req-d1280719-bf79-4f9a-95c9-823b85c020e9 req-38998055-a11d-4a47-ac79-1b05c9f1e0d7 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received unexpected event network-vif-plugged-26418177-564a-4d5b-a37e-91c6334334e9 for instance with vm_state building and task_state spawning.
Dec 01 19:16:55 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:56 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:56 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:56 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:56 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:56 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:56 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:56 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:56 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:56 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:16:56 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:56 user nova-compute[75066]: DEBUG nova.compute.manager [req-fe249c2e-42e0-4142-ae22-0946c74d4061 req-a02eca8e-226c-4c84-b44f-d5231b451b95 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received event network-vif-plugged-b39c07b1-b2c2-45bf-bf1c-1865dfc9ceff {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:16:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-fe249c2e-42e0-4142-ae22-0946c74d4061 req-a02eca8e-226c-4c84-b44f-d5231b451b95 service nova] Acquiring lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:16:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-fe249c2e-42e0-4142-ae22-0946c74d4061 req-a02eca8e-226c-4c84-b44f-d5231b451b95 service nova] Lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:16:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-fe249c2e-42e0-4142-ae22-0946c74d4061 req-a02eca8e-226c-4c84-b44f-d5231b451b95 service nova] Lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:16:56 user nova-compute[75066]: DEBUG nova.compute.manager [req-fe249c2e-42e0-4142-ae22-0946c74d4061 req-a02eca8e-226c-4c84-b44f-d5231b451b95 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] No waiting events found dispatching network-vif-plugged-b39c07b1-b2c2-45bf-bf1c-1865dfc9ceff {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:16:56 user nova-compute[75066]: WARNING nova.compute.manager [req-fe249c2e-42e0-4142-ae22-0946c74d4061 req-a02eca8e-226c-4c84-b44f-d5231b451b95 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received unexpected event network-vif-plugged-b39c07b1-b2c2-45bf-bf1c-1865dfc9ceff for instance with vm_state building and task_state spawning.
Dec 01 19:16:56 user nova-compute[75066]: DEBUG nova.compute.manager [req-fe249c2e-42e0-4142-ae22-0946c74d4061 req-a02eca8e-226c-4c84-b44f-d5231b451b95 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received event network-vif-plugged-294424e7-040a-4720-9012-7353ff25f249 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:16:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-fe249c2e-42e0-4142-ae22-0946c74d4061 req-a02eca8e-226c-4c84-b44f-d5231b451b95 service nova] Acquiring lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:16:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-fe249c2e-42e0-4142-ae22-0946c74d4061 req-a02eca8e-226c-4c84-b44f-d5231b451b95 service nova] Lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:16:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-fe249c2e-42e0-4142-ae22-0946c74d4061 req-a02eca8e-226c-4c84-b44f-d5231b451b95 service nova] Lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:16:56 user nova-compute[75066]: DEBUG nova.compute.manager [req-fe249c2e-42e0-4142-ae22-0946c74d4061 req-a02eca8e-226c-4c84-b44f-d5231b451b95 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] No waiting events found dispatching network-vif-plugged-294424e7-040a-4720-9012-7353ff25f249 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:16:56 user nova-compute[75066]: WARNING nova.compute.manager [req-fe249c2e-42e0-4142-ae22-0946c74d4061 req-a02eca8e-226c-4c84-b44f-d5231b451b95 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received unexpected event network-vif-plugged-294424e7-040a-4720-9012-7353ff25f249 for instance with vm_state building and task_state spawning.
Dec 01 19:16:56 user nova-compute[75066]: DEBUG nova.compute.manager [req-fe249c2e-42e0-4142-ae22-0946c74d4061 req-a02eca8e-226c-4c84-b44f-d5231b451b95 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received event network-vif-plugged-294424e7-040a-4720-9012-7353ff25f249 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:16:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-fe249c2e-42e0-4142-ae22-0946c74d4061 req-a02eca8e-226c-4c84-b44f-d5231b451b95 service nova] Acquiring lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:16:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-fe249c2e-42e0-4142-ae22-0946c74d4061 req-a02eca8e-226c-4c84-b44f-d5231b451b95 service nova] Lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:16:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-fe249c2e-42e0-4142-ae22-0946c74d4061 req-a02eca8e-226c-4c84-b44f-d5231b451b95 service nova] Lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:16:56 user nova-compute[75066]: DEBUG nova.compute.manager [req-fe249c2e-42e0-4142-ae22-0946c74d4061 req-a02eca8e-226c-4c84-b44f-d5231b451b95 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] No waiting events found dispatching network-vif-plugged-294424e7-040a-4720-9012-7353ff25f249 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:16:56 user nova-compute[75066]: WARNING nova.compute.manager [req-fe249c2e-42e0-4142-ae22-0946c74d4061 req-a02eca8e-226c-4c84-b44f-d5231b451b95 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received unexpected event network-vif-plugged-294424e7-040a-4720-9012-7353ff25f249 for instance with vm_state building and task_state spawning.
Dec 01 19:16:56 user nova-compute[75066]: DEBUG nova.compute.manager [req-fe249c2e-42e0-4142-ae22-0946c74d4061 req-a02eca8e-226c-4c84-b44f-d5231b451b95 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received event network-vif-plugged-21b7577f-898b-4d3b-9ecd-911568f3923f {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:16:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-fe249c2e-42e0-4142-ae22-0946c74d4061 req-a02eca8e-226c-4c84-b44f-d5231b451b95 service nova] Acquiring lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:16:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-fe249c2e-42e0-4142-ae22-0946c74d4061 req-a02eca8e-226c-4c84-b44f-d5231b451b95 service nova] Lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:16:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-fe249c2e-42e0-4142-ae22-0946c74d4061 req-a02eca8e-226c-4c84-b44f-d5231b451b95 service nova] Lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:16:56 user nova-compute[75066]: DEBUG nova.compute.manager [req-fe249c2e-42e0-4142-ae22-0946c74d4061 req-a02eca8e-226c-4c84-b44f-d5231b451b95 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] No waiting events found dispatching network-vif-plugged-21b7577f-898b-4d3b-9ecd-911568f3923f {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:16:56 user nova-compute[75066]: WARNING nova.compute.manager [req-fe249c2e-42e0-4142-ae22-0946c74d4061 req-a02eca8e-226c-4c84-b44f-d5231b451b95 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received unexpected event network-vif-plugged-21b7577f-898b-4d3b-9ecd-911568f3923f for instance with vm_state building and task_state spawning.
Dec 01 19:16:56 user nova-compute[75066]: DEBUG nova.compute.manager [None req-a90cea2f-a1ac-41f3-a934-1a8b4a4eb11f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:16:56 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:56 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:56 user nova-compute[75066]: INFO nova.compute.manager [None req-a90cea2f-a1ac-41f3-a934-1a8b4a4eb11f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] instance snapshotting
Dec 01 19:16:56 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-a90cea2f-a1ac-41f3-a934-1a8b4a4eb11f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Beginning live snapshot process
Dec 01 19:16:56 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:56 user nova-compute[75066]: DEBUG nova.compute.manager [req-5e1b651b-2ed0-4e9b-a88e-a1259097eff3 req-acfdcd6a-f09c-4f21-91da-afc59fb9689f service nova] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Received event network-changed-73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:16:56 user nova-compute[75066]: DEBUG nova.compute.manager [req-5e1b651b-2ed0-4e9b-a88e-a1259097eff3 req-acfdcd6a-f09c-4f21-91da-afc59fb9689f service nova] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Refreshing instance network info cache due to event network-changed-73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:16:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-5e1b651b-2ed0-4e9b-a88e-a1259097eff3 req-acfdcd6a-f09c-4f21-91da-afc59fb9689f service nova] Acquiring lock "refresh_cache-67c5dd7c-88aa-4f2f-8f62-a9af0480c38e" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:16:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-5e1b651b-2ed0-4e9b-a88e-a1259097eff3 req-acfdcd6a-f09c-4f21-91da-afc59fb9689f service nova] Acquired lock "refresh_cache-67c5dd7c-88aa-4f2f-8f62-a9af0480c38e" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:16:56 user nova-compute[75066]: DEBUG nova.network.neutron [req-5e1b651b-2ed0-4e9b-a88e-a1259097eff3 req-acfdcd6a-f09c-4f21-91da-afc59fb9689f service nova] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Refreshing network info cache for port 73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:16:56 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:56 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-a90cea2f-a1ac-41f3-a934-1a8b4a4eb11f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67c5dd7c-88aa-4f2f-8f62-a9af0480c38e/disk --force-share --output=json -f qcow2 {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:57 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:16:57 user nova-compute[75066]: DEBUG nova.network.neutron [req-5e1b651b-2ed0-4e9b-a88e-a1259097eff3 req-acfdcd6a-f09c-4f21-91da-afc59fb9689f service nova] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Updated VIF entry in instance network info cache for port 73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:16:57 user nova-compute[75066]: DEBUG nova.network.neutron [req-5e1b651b-2ed0-4e9b-a88e-a1259097eff3 req-acfdcd6a-f09c-4f21-91da-afc59fb9689f service nova] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Updating instance_info_cache with network_info: [{"id": "73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2", "address": "fa:16:3e:5a:73:a4", "network": {"id": "fdb3c017-aafb-4c3e-a08c-a73a68be9f70", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1696445417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "306d3049e90647fa9f1c90a104eac0e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bdff9a-3a", "ovs_interfaceid": "73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:16:57 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-5e1b651b-2ed0-4e9b-a88e-a1259097eff3 req-acfdcd6a-f09c-4f21-91da-afc59fb9689f service nova] Releasing lock "refresh_cache-67c5dd7c-88aa-4f2f-8f62-a9af0480c38e" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:16:57 user nova-compute[75066]: DEBUG nova.compute.manager [req-5e1b651b-2ed0-4e9b-a88e-a1259097eff3 req-acfdcd6a-f09c-4f21-91da-afc59fb9689f service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received event network-vif-plugged-6eea2787-921d-4d51-aa70-d843d187a47f {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:16:57 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-5e1b651b-2ed0-4e9b-a88e-a1259097eff3 req-acfdcd6a-f09c-4f21-91da-afc59fb9689f service nova] Acquiring lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:16:57 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-5e1b651b-2ed0-4e9b-a88e-a1259097eff3 req-acfdcd6a-f09c-4f21-91da-afc59fb9689f service nova] Lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:16:57 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-5e1b651b-2ed0-4e9b-a88e-a1259097eff3 req-acfdcd6a-f09c-4f21-91da-afc59fb9689f service nova] Lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:16:57 user nova-compute[75066]: DEBUG nova.compute.manager [req-5e1b651b-2ed0-4e9b-a88e-a1259097eff3 req-acfdcd6a-f09c-4f21-91da-afc59fb9689f service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] No waiting events found dispatching network-vif-plugged-6eea2787-921d-4d51-aa70-d843d187a47f {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:16:57 user nova-compute[75066]: WARNING nova.compute.manager [req-5e1b651b-2ed0-4e9b-a88e-a1259097eff3 req-acfdcd6a-f09c-4f21-91da-afc59fb9689f service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received unexpected event network-vif-plugged-6eea2787-921d-4d51-aa70-d843d187a47f for instance with vm_state building and task_state spawning.
Dec 01 19:16:57 user nova-compute[75066]: DEBUG nova.compute.manager [req-5e1b651b-2ed0-4e9b-a88e-a1259097eff3 req-acfdcd6a-f09c-4f21-91da-afc59fb9689f service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received event network-vif-plugged-fbddb1ea-5cff-4ae8-ac1c-1ee726012aea {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:16:57 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-5e1b651b-2ed0-4e9b-a88e-a1259097eff3 req-acfdcd6a-f09c-4f21-91da-afc59fb9689f service nova] Acquiring lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:16:57 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-5e1b651b-2ed0-4e9b-a88e-a1259097eff3 req-acfdcd6a-f09c-4f21-91da-afc59fb9689f service nova] Lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:16:57 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-5e1b651b-2ed0-4e9b-a88e-a1259097eff3 req-acfdcd6a-f09c-4f21-91da-afc59fb9689f service nova] Lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:16:57 user nova-compute[75066]: DEBUG nova.compute.manager [req-5e1b651b-2ed0-4e9b-a88e-a1259097eff3 req-acfdcd6a-f09c-4f21-91da-afc59fb9689f service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] No waiting events found dispatching network-vif-plugged-fbddb1ea-5cff-4ae8-ac1c-1ee726012aea {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:16:57 user nova-compute[75066]: WARNING nova.compute.manager [req-5e1b651b-2ed0-4e9b-a88e-a1259097eff3 req-acfdcd6a-f09c-4f21-91da-afc59fb9689f service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received unexpected event network-vif-plugged-fbddb1ea-5cff-4ae8-ac1c-1ee726012aea for instance with vm_state building and task_state spawning.
Dec 01 19:16:57 user nova-compute[75066]: DEBUG nova.compute.manager [req-5e1b651b-2ed0-4e9b-a88e-a1259097eff3 req-acfdcd6a-f09c-4f21-91da-afc59fb9689f service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received event network-vif-plugged-fbddb1ea-5cff-4ae8-ac1c-1ee726012aea {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:16:57 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-5e1b651b-2ed0-4e9b-a88e-a1259097eff3 req-acfdcd6a-f09c-4f21-91da-afc59fb9689f service nova] Acquiring lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:16:57 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-5e1b651b-2ed0-4e9b-a88e-a1259097eff3 req-acfdcd6a-f09c-4f21-91da-afc59fb9689f service nova] Lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:16:57 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-5e1b651b-2ed0-4e9b-a88e-a1259097eff3 req-acfdcd6a-f09c-4f21-91da-afc59fb9689f service nova] Lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:16:57 user nova-compute[75066]: DEBUG nova.compute.manager [req-5e1b651b-2ed0-4e9b-a88e-a1259097eff3 req-acfdcd6a-f09c-4f21-91da-afc59fb9689f service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] No waiting events found dispatching network-vif-plugged-fbddb1ea-5cff-4ae8-ac1c-1ee726012aea {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:16:57 user nova-compute[75066]: WARNING nova.compute.manager [req-5e1b651b-2ed0-4e9b-a88e-a1259097eff3 req-acfdcd6a-f09c-4f21-91da-afc59fb9689f service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received unexpected event network-vif-plugged-fbddb1ea-5cff-4ae8-ac1c-1ee726012aea for instance with vm_state building and task_state spawning.
Dec 01 19:16:57 user nova-compute[75066]: DEBUG nova.compute.manager [req-5e1b651b-2ed0-4e9b-a88e-a1259097eff3 req-acfdcd6a-f09c-4f21-91da-afc59fb9689f service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received event network-vif-plugged-10d4a23a-1f6c-4c81-b937-bfa19dcc3606 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:16:57 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-5e1b651b-2ed0-4e9b-a88e-a1259097eff3 req-acfdcd6a-f09c-4f21-91da-afc59fb9689f service nova] Acquiring lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:16:57 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-5e1b651b-2ed0-4e9b-a88e-a1259097eff3 req-acfdcd6a-f09c-4f21-91da-afc59fb9689f service nova] Lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:16:57 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-5e1b651b-2ed0-4e9b-a88e-a1259097eff3 req-acfdcd6a-f09c-4f21-91da-afc59fb9689f service nova] Lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:16:57 user nova-compute[75066]: DEBUG nova.compute.manager [req-5e1b651b-2ed0-4e9b-a88e-a1259097eff3 req-acfdcd6a-f09c-4f21-91da-afc59fb9689f service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] No waiting events found dispatching network-vif-plugged-10d4a23a-1f6c-4c81-b937-bfa19dcc3606 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:16:57 user nova-compute[75066]: WARNING nova.compute.manager [req-5e1b651b-2ed0-4e9b-a88e-a1259097eff3 req-acfdcd6a-f09c-4f21-91da-afc59fb9689f service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received unexpected event network-vif-plugged-10d4a23a-1f6c-4c81-b937-bfa19dcc3606 for instance with vm_state building and task_state spawning.
Dec 01 19:16:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-a90cea2f-a1ac-41f3-a934-1a8b4a4eb11f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67c5dd7c-88aa-4f2f-8f62-a9af0480c38e/disk --force-share --output=json -f qcow2" returned: 0 in 0.689s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-a90cea2f-a1ac-41f3-a934-1a8b4a4eb11f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67c5dd7c-88aa-4f2f-8f62-a9af0480c38e/disk --force-share --output=json -f qcow2 {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-a90cea2f-a1ac-41f3-a934-1a8b4a4eb11f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67c5dd7c-88aa-4f2f-8f62-a9af0480c38e/disk --force-share --output=json -f qcow2" returned: 0 in 0.197s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-a90cea2f-a1ac-41f3-a934-1a8b4a4eb11f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:57 user nova-compute[75066]: DEBUG nova.compute.manager [req-12ad2666-95a6-4afb-b610-be7385ecbc0c req-6405351c-e28b-431a-80ea-dd968b5dce61 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received event network-vif-plugged-26418177-564a-4d5b-a37e-91c6334334e9 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:16:57 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-12ad2666-95a6-4afb-b610-be7385ecbc0c req-6405351c-e28b-431a-80ea-dd968b5dce61 service nova] Acquiring lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:16:57 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-12ad2666-95a6-4afb-b610-be7385ecbc0c req-6405351c-e28b-431a-80ea-dd968b5dce61 service nova] Lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:16:57 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-12ad2666-95a6-4afb-b610-be7385ecbc0c req-6405351c-e28b-431a-80ea-dd968b5dce61 service nova] Lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:16:57 user nova-compute[75066]: DEBUG nova.compute.manager [req-12ad2666-95a6-4afb-b610-be7385ecbc0c req-6405351c-e28b-431a-80ea-dd968b5dce61 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] No waiting events found dispatching network-vif-plugged-26418177-564a-4d5b-a37e-91c6334334e9 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:16:57 user nova-compute[75066]: WARNING nova.compute.manager [req-12ad2666-95a6-4afb-b610-be7385ecbc0c req-6405351c-e28b-431a-80ea-dd968b5dce61 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received unexpected event network-vif-plugged-26418177-564a-4d5b-a37e-91c6334334e9 for instance with vm_state building and task_state spawning.
Dec 01 19:16:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:16:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-a90cea2f-a1ac-41f3-a934-1a8b4a4eb11f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.214s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-a90cea2f-a1ac-41f3-a934-1a8b4a4eb11f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp4oi3p1c7/90dcabc1ebfc4f99a9f6646109bc5225.delta 1073741824 {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-a90cea2f-a1ac-41f3-a934-1a8b4a4eb11f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp4oi3p1c7/90dcabc1ebfc4f99a9f6646109bc5225.delta 1073741824" returned: 0 in 0.047s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:58 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-a90cea2f-a1ac-41f3-a934-1a8b4a4eb11f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Quiescing instance not available: QEMU guest agent is not enabled.
Dec 01 19:16:58 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-a90cea2f-a1ac-41f3-a934-1a8b4a4eb11f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75066) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1753}}
Dec 01 19:16:58 user nova-compute[75066]: INFO nova.virt.libvirt.host [None req-a90cea2f-a1ac-41f3-a934-1a8b4a4eb11f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] UEFI support detected
Dec 01 19:16:58 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:16:58 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Starting heal instance info cache {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 19:16:58 user nova-compute[75066]: DEBUG nova.compute.manager [req-7b3dfbe4-2739-4b85-9138-0d951f80807d req-9228aa7b-ea2c-4fe1-aefc-8291f0f5277f service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received event network-vif-plugged-21b7577f-898b-4d3b-9ecd-911568f3923f {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:16:58 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-7b3dfbe4-2739-4b85-9138-0d951f80807d req-9228aa7b-ea2c-4fe1-aefc-8291f0f5277f service nova] Acquiring lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:16:58 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-7b3dfbe4-2739-4b85-9138-0d951f80807d req-9228aa7b-ea2c-4fe1-aefc-8291f0f5277f service nova] Lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:16:58 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-7b3dfbe4-2739-4b85-9138-0d951f80807d req-9228aa7b-ea2c-4fe1-aefc-8291f0f5277f service nova] Lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:16:58 user nova-compute[75066]: DEBUG nova.compute.manager [req-7b3dfbe4-2739-4b85-9138-0d951f80807d req-9228aa7b-ea2c-4fe1-aefc-8291f0f5277f service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] No waiting events found dispatching network-vif-plugged-21b7577f-898b-4d3b-9ecd-911568f3923f {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:16:58 user nova-compute[75066]: WARNING nova.compute.manager [req-7b3dfbe4-2739-4b85-9138-0d951f80807d req-9228aa7b-ea2c-4fe1-aefc-8291f0f5277f service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received unexpected event network-vif-plugged-21b7577f-898b-4d3b-9ecd-911568f3923f for instance with vm_state building and task_state spawning.
Dec 01 19:16:58 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "refresh_cache-b6c46e8d-982f-4169-af80-96274a165b02" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:16:58 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquired lock "refresh_cache-b6c46e8d-982f-4169-af80-96274a165b02" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:16:58 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: b6c46e8d-982f-4169-af80-96274a165b02] Forcefully refreshing network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 19:16:58 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: b6c46e8d-982f-4169-af80-96274a165b02] Updating instance_info_cache with network_info: [{"id": "6853aa2a-6a9e-471a-ade8-f29f1064c006", "address": "fa:16:3e:0e:a0:20", "network": {"id": "30057e96-0f86-466d-bf3f-e3cf15d9e5af", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-383866239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0c442a2ec3a41bfa602949a1aeb1e1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6853aa2a-6a", "ovs_interfaceid": "6853aa2a-6a9e-471a-ade8-f29f1064c006", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:16:58 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Releasing lock "refresh_cache-b6c46e8d-982f-4169-af80-96274a165b02" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:16:58 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: b6c46e8d-982f-4169-af80-96274a165b02] Updated the network info_cache for instance {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 19:16:58 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:16:58 user nova-compute[75066]: DEBUG nova.compute.manager [req-e30f870d-abdc-494d-8156-7f7645150190 req-b88d507d-e059-443d-b3e6-0559b96c4d72 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received event network-vif-plugged-10d4a23a-1f6c-4c81-b937-bfa19dcc3606 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:16:58 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-e30f870d-abdc-494d-8156-7f7645150190 req-b88d507d-e059-443d-b3e6-0559b96c4d72 service nova] Acquiring lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:16:58 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-e30f870d-abdc-494d-8156-7f7645150190 req-b88d507d-e059-443d-b3e6-0559b96c4d72 service nova] Lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:16:58 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-e30f870d-abdc-494d-8156-7f7645150190 req-b88d507d-e059-443d-b3e6-0559b96c4d72 service nova] Lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:16:58 user nova-compute[75066]: DEBUG nova.compute.manager [req-e30f870d-abdc-494d-8156-7f7645150190 req-b88d507d-e059-443d-b3e6-0559b96c4d72 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] No waiting events found dispatching network-vif-plugged-10d4a23a-1f6c-4c81-b937-bfa19dcc3606 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:16:58 user nova-compute[75066]: WARNING nova.compute.manager [req-e30f870d-abdc-494d-8156-7f7645150190 req-b88d507d-e059-443d-b3e6-0559b96c4d72 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received unexpected event network-vif-plugged-10d4a23a-1f6c-4c81-b937-bfa19dcc3606 for instance with vm_state building and task_state spawning.
Dec 01 19:16:58 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-a90cea2f-a1ac-41f3-a934-1a8b4a4eb11f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75066) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 19:16:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-3ec47b3c-ebd4-42af-ad18-483f9faf2658 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Acquiring lock "b6c46e8d-982f-4169-af80-96274a165b02" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:16:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-3ec47b3c-ebd4-42af-ad18-483f9faf2658 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Lock "b6c46e8d-982f-4169-af80-96274a165b02" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:16:59 user nova-compute[75066]: DEBUG nova.compute.manager [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Instance event wait completed in 0 seconds for  {{(pid=75066) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 19:16:59 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Guest created on hypervisor {{(pid=75066) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 19:16:59 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Instance spawned successfully.
Dec 01 19:16:59 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 19:16:59 user nova-compute[75066]: DEBUG nova.objects.instance [None req-3ec47b3c-ebd4-42af-ad18-483f9faf2658 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Lazy-loading 'flavor' on Instance uuid b6c46e8d-982f-4169-af80-96274a165b02 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:16:59 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Found default for hw_cdrom_bus of ide {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:16:59 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Found default for hw_disk_bus of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:16:59 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Found default for hw_input_bus of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:16:59 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Found default for hw_pointer_model of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:16:59 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Found default for hw_video_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:16:59 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Found default for hw_vif_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:16:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-3ec47b3c-ebd4-42af-ad18-483f9faf2658 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Lock "b6c46e8d-982f-4169-af80-96274a165b02" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.154s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:16:59 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:16:59 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:16:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:16:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:16:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:16:59 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75066) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 19:16:59 user nova-compute[75066]: INFO nova.compute.manager [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Took 11.87 seconds to spawn the instance on the hypervisor.
Dec 01 19:16:59 user nova-compute[75066]: DEBUG nova.compute.manager [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:16:59 user nova-compute[75066]: INFO nova.compute.manager [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Took 44.24 seconds to build instance.
Dec 01 19:16:59 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-a90cea2f-a1ac-41f3-a934-1a8b4a4eb11f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75066) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 19:16:59 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-a90cea2f-a1ac-41f3-a934-1a8b4a4eb11f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Skipping quiescing instance: QEMU guest agent is not enabled.
Dec 01 19:16:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c0c10f42-70da-4ea0-977a-56d9524e88bd tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 44.398s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:16:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-3ec47b3c-ebd4-42af-ad18-483f9faf2658 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Acquiring lock "b6c46e8d-982f-4169-af80-96274a165b02" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:16:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-3ec47b3c-ebd4-42af-ad18-483f9faf2658 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Lock "b6c46e8d-982f-4169-af80-96274a165b02" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:16:59 user nova-compute[75066]: INFO nova.compute.manager [None req-3ec47b3c-ebd4-42af-ad18-483f9faf2658 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] [instance: b6c46e8d-982f-4169-af80-96274a165b02] Attaching volume 01ebc88f-657c-4c7e-8eac-da22345db3ac to /dev/vdb
Dec 01 19:16:59 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6c46e8d-982f-4169-af80-96274a165b02/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:59 user nova-compute[75066]: DEBUG os_brick.utils [None req-3ec47b3c-ebd4-42af-ad18-483f9faf2658 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:16:59 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:59 user nova-compute[75066]: DEBUG nova.privsep.utils [None req-a90cea2f-a1ac-41f3-a934-1a8b4a4eb11f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75066) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 01 19:16:59 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-a90cea2f-a1ac-41f3-a934-1a8b4a4eb11f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp4oi3p1c7/90dcabc1ebfc4f99a9f6646109bc5225.delta /opt/stack/data/nova/instances/snapshots/tmp4oi3p1c7/90dcabc1ebfc4f99a9f6646109bc5225 {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:59 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:59 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[463eeab5-12bd-4fdd-8a4b-5b7292283e1e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1959854982f\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:16:59 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:59 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:59 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa912183-390a-42e4-b50d-2f602c568dd9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:16:59 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:59 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.032s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:59 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[987494ec-3769-4545-a785-64853db1247c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:16:59 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4df17e-a977-40ae-baad-3acc068ab3a0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:16:59 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-3ec47b3c-ebd4-42af-ad18-483f9faf2658 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Running cmd (subprocess): nvme version {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:59 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-3ec47b3c-ebd4-42af-ad18-483f9faf2658 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] 'nvme version' failed. Not Retrying. {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:16:59 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3ec47b3c-ebd4-42af-ad18-483f9faf2658 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] nvme not present on system {{(pid=75066) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 19:16:59 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:59 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6c46e8d-982f-4169-af80-96274a165b02/disk --force-share --output=json" returned: 0 in 0.301s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:16:59 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6c46e8d-982f-4169-af80-96274a165b02/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:16:59 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:16:59 user nova-compute[75066]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 19:16:59 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fffd3ae-1582-4c97-bd12-d322929225df]: (4, '') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:16:59 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-3ec47b3c-ebd4-42af-ad18-483f9faf2658 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75066) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 19:16:59 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-3ec47b3c-ebd4-42af-ad18-483f9faf2658 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 19:16:59 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-3ec47b3c-ebd4-42af-ad18-483f9faf2658 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] LIGHTOS: no hostnqn found. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 19:16:59 user nova-compute[75066]: DEBUG os_brick.utils [None req-3ec47b3c-ebd4-42af-ad18-483f9faf2658 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] <== get_connector_properties: return (268ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1959854982f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:16:59 user nova-compute[75066]: DEBUG nova.virt.block_device [None req-3ec47b3c-ebd4-42af-ad18-483f9faf2658 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] [instance: b6c46e8d-982f-4169-af80-96274a165b02] Updating existing volume attachment record: eb76113a-4a3e-47d6-825f-fdd21dfdc892 {{(pid=75066) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 19:17:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6c46e8d-982f-4169-af80-96274a165b02/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-a90cea2f-a1ac-41f3-a934-1a8b4a4eb11f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp4oi3p1c7/90dcabc1ebfc4f99a9f6646109bc5225.delta /opt/stack/data/nova/instances/snapshots/tmp4oi3p1c7/90dcabc1ebfc4f99a9f6646109bc5225" returned: 0 in 0.722s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:00 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-a90cea2f-a1ac-41f3-a934-1a8b4a4eb11f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Snapshot extracted, beginning image upload
Dec 01 19:17:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f253bb0a-6cd0-4e62-8bcb-898537ce8c0b/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f253bb0a-6cd0-4e62-8bcb-898537ce8c0b/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f253bb0a-6cd0-4e62-8bcb-898537ce8c0b/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f253bb0a-6cd0-4e62-8bcb-898537ce8c0b/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:00 user nova-compute[75066]: DEBUG nova.compute.manager [req-f53828eb-b5f7-4174-9019-ca1fe92e9bd3 req-4b281376-1c4a-41f3-b77c-04447ff2d404 service nova] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Received event network-changed-2698607a-e8b6-4da8-bfc7-90dc528ade6b {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:17:00 user nova-compute[75066]: DEBUG nova.compute.manager [req-f53828eb-b5f7-4174-9019-ca1fe92e9bd3 req-4b281376-1c4a-41f3-b77c-04447ff2d404 service nova] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Refreshing instance network info cache due to event network-changed-2698607a-e8b6-4da8-bfc7-90dc528ade6b. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:17:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-f53828eb-b5f7-4174-9019-ca1fe92e9bd3 req-4b281376-1c4a-41f3-b77c-04447ff2d404 service nova] Acquiring lock "refresh_cache-c223be70-8b9c-46d4-9b5a-3b83dfc05a17" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:17:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-f53828eb-b5f7-4174-9019-ca1fe92e9bd3 req-4b281376-1c4a-41f3-b77c-04447ff2d404 service nova] Acquired lock "refresh_cache-c223be70-8b9c-46d4-9b5a-3b83dfc05a17" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:17:00 user nova-compute[75066]: DEBUG nova.network.neutron [req-f53828eb-b5f7-4174-9019-ca1fe92e9bd3 req-4b281376-1c4a-41f3-b77c-04447ff2d404 service nova] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Refreshing network info cache for port 2698607a-e8b6-4da8-bfc7-90dc528ade6b {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:17:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67c5dd7c-88aa-4f2f-8f62-a9af0480c38e/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67c5dd7c-88aa-4f2f-8f62-a9af0480c38e/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67c5dd7c-88aa-4f2f-8f62-a9af0480c38e/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67c5dd7c-88aa-4f2f-8f62-a9af0480c38e/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:01 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:17:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00ff7dfa-1da6-4e32-a227-0c194a5aa28f/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:01 user nova-compute[75066]: DEBUG nova.network.neutron [req-f53828eb-b5f7-4174-9019-ca1fe92e9bd3 req-4b281376-1c4a-41f3-b77c-04447ff2d404 service nova] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Updated VIF entry in instance network info cache for port 2698607a-e8b6-4da8-bfc7-90dc528ade6b. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:17:01 user nova-compute[75066]: DEBUG nova.network.neutron [req-f53828eb-b5f7-4174-9019-ca1fe92e9bd3 req-4b281376-1c4a-41f3-b77c-04447ff2d404 service nova] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Updating instance_info_cache with network_info: [{"id": "2698607a-e8b6-4da8-bfc7-90dc528ade6b", "address": "fa:16:3e:52:d6:e9", "network": {"id": "9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-696310557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0f7516d1db4dd5bc7d77a0bd1d44d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2698607a-e8", "ovs_interfaceid": "2698607a-e8b6-4da8-bfc7-90dc528ade6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:17:02 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-f53828eb-b5f7-4174-9019-ca1fe92e9bd3 req-4b281376-1c4a-41f3-b77c-04447ff2d404 service nova] Releasing lock "refresh_cache-c223be70-8b9c-46d4-9b5a-3b83dfc05a17" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:17:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00ff7dfa-1da6-4e32-a227-0c194a5aa28f/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00ff7dfa-1da6-4e32-a227-0c194a5aa28f/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:17:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00ff7dfa-1da6-4e32-a227-0c194a5aa28f/disk --force-share --output=json" returned: 0 in 0.319s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd67db6c-8bd1-402e-93ce-9b2d7a405a6e/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd67db6c-8bd1-402e-93ce-9b2d7a405a6e/disk --force-share --output=json" returned: 0 in 0.289s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd67db6c-8bd1-402e-93ce-9b2d7a405a6e/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:03 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd67db6c-8bd1-402e-93ce-9b2d7a405a6e/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:03 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:03 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk --force-share --output=json" returned: 0 in 0.408s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:03 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:03 user nova-compute[75066]: DEBUG nova.compute.manager [req-65a45dd4-e6d7-4f5e-809f-b05e687b8b42 req-291853b2-3b80-41db-b7ff-eb4743f9eb5f service nova] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Received event network-changed-478e7aea-9546-4659-bdac-09213bd9cb82 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:17:03 user nova-compute[75066]: DEBUG nova.compute.manager [req-65a45dd4-e6d7-4f5e-809f-b05e687b8b42 req-291853b2-3b80-41db-b7ff-eb4743f9eb5f service nova] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Refreshing instance network info cache due to event network-changed-478e7aea-9546-4659-bdac-09213bd9cb82. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:17:03 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-65a45dd4-e6d7-4f5e-809f-b05e687b8b42 req-291853b2-3b80-41db-b7ff-eb4743f9eb5f service nova] Acquiring lock "refresh_cache-dd546862-fcd5-4b69-8ea3-a8fa4859a489" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:17:03 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-65a45dd4-e6d7-4f5e-809f-b05e687b8b42 req-291853b2-3b80-41db-b7ff-eb4743f9eb5f service nova] Acquired lock "refresh_cache-dd546862-fcd5-4b69-8ea3-a8fa4859a489" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:17:03 user nova-compute[75066]: DEBUG nova.network.neutron [req-65a45dd4-e6d7-4f5e-809f-b05e687b8b42 req-291853b2-3b80-41db-b7ff-eb4743f9eb5f service nova] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Refreshing network info cache for port 478e7aea-9546-4659-bdac-09213bd9cb82 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:17:03 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:03 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:17:03 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:17:03 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:17:03 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47bd5998-8ded-4a9c-8b98-f0658a526f47/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:04 user nova-compute[75066]: DEBUG nova.compute.manager [req-edc902b5-d42e-4588-babd-4fc89b220c09 req-ba3ece68-5d13-4667-b6c1-d99da0c43378 service nova] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Received event network-changed-c9353199-d4a3-488f-857d-b0ebdb31a68f {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:17:04 user nova-compute[75066]: DEBUG nova.compute.manager [req-edc902b5-d42e-4588-babd-4fc89b220c09 req-ba3ece68-5d13-4667-b6c1-d99da0c43378 service nova] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Refreshing instance network info cache due to event network-changed-c9353199-d4a3-488f-857d-b0ebdb31a68f. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:17:04 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-edc902b5-d42e-4588-babd-4fc89b220c09 req-ba3ece68-5d13-4667-b6c1-d99da0c43378 service nova] Acquiring lock "refresh_cache-c3ceeca4-c16c-4cf5-adfd-7d5a2925f435" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:17:04 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-edc902b5-d42e-4588-babd-4fc89b220c09 req-ba3ece68-5d13-4667-b6c1-d99da0c43378 service nova] Acquired lock "refresh_cache-c3ceeca4-c16c-4cf5-adfd-7d5a2925f435" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:17:04 user nova-compute[75066]: DEBUG nova.network.neutron [req-edc902b5-d42e-4588-babd-4fc89b220c09 req-ba3ece68-5d13-4667-b6c1-d99da0c43378 service nova] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Refreshing network info cache for port c9353199-d4a3-488f-857d-b0ebdb31a68f {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:17:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47bd5998-8ded-4a9c-8b98-f0658a526f47/disk --force-share --output=json" returned: 0 in 0.412s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47bd5998-8ded-4a9c-8b98-f0658a526f47/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:04 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-a90cea2f-a1ac-41f3-a934-1a8b4a4eb11f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Snapshot image upload complete
Dec 01 19:17:04 user nova-compute[75066]: INFO nova.compute.manager [None req-a90cea2f-a1ac-41f3-a934-1a8b4a4eb11f tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Took 7.73 seconds to snapshot the instance on the hypervisor.
Dec 01 19:17:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/47bd5998-8ded-4a9c-8b98-f0658a526f47/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:04 user nova-compute[75066]: DEBUG nova.network.neutron [req-65a45dd4-e6d7-4f5e-809f-b05e687b8b42 req-291853b2-3b80-41db-b7ff-eb4743f9eb5f service nova] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Updated VIF entry in instance network info cache for port 478e7aea-9546-4659-bdac-09213bd9cb82. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:17:04 user nova-compute[75066]: DEBUG nova.network.neutron [req-65a45dd4-e6d7-4f5e-809f-b05e687b8b42 req-291853b2-3b80-41db-b7ff-eb4743f9eb5f service nova] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Updating instance_info_cache with network_info: [{"id": "478e7aea-9546-4659-bdac-09213bd9cb82", "address": "fa:16:3e:9a:26:f6", "network": {"id": "d182d3d1-113a-4bf5-b325-f073247f0547", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-325272674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2830de7697db4d5e8b9c358dab7f4368", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap478e7aea-95", "ovs_interfaceid": "478e7aea-9546-4659-bdac-09213bd9cb82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:17:04 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-65a45dd4-e6d7-4f5e-809f-b05e687b8b42 req-291853b2-3b80-41db-b7ff-eb4743f9eb5f service nova] Releasing lock "refresh_cache-dd546862-fcd5-4b69-8ea3-a8fa4859a489" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:17:05 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:17:05 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:17:05 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Hypervisor/Node resource view: name=user free_ram=7093MB free_disk=25.302326202392578GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75066) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 19:17:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:17:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:17:05 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:17:05 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance b6c46e8d-982f-4169-af80-96274a165b02 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:17:05 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance c223be70-8b9c-46d4-9b5a-3b83dfc05a17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:17:05 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance c3ceeca4-c16c-4cf5-adfd-7d5a2925f435 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:17:05 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance dd546862-fcd5-4b69-8ea3-a8fa4859a489 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:17:05 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance f253bb0a-6cd0-4e62-8bcb-898537ce8c0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:17:05 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance dd67db6c-8bd1-402e-93ce-9b2d7a405a6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:17:05 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 00ff7dfa-1da6-4e32-a227-0c194a5aa28f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:17:05 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 47bd5998-8ded-4a9c-8b98-f0658a526f47 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:17:05 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 6d2de2c4-0c0d-4238-933c-d0ef6538964e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:17:05 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 19:17:05 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 19:17:05 user nova-compute[75066]: DEBUG nova.network.neutron [req-edc902b5-d42e-4588-babd-4fc89b220c09 req-ba3ece68-5d13-4667-b6c1-d99da0c43378 service nova] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Updated VIF entry in instance network info cache for port c9353199-d4a3-488f-857d-b0ebdb31a68f. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:17:05 user nova-compute[75066]: DEBUG nova.network.neutron [req-edc902b5-d42e-4588-babd-4fc89b220c09 req-ba3ece68-5d13-4667-b6c1-d99da0c43378 service nova] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Updating instance_info_cache with network_info: [{"id": "c9353199-d4a3-488f-857d-b0ebdb31a68f", "address": "fa:16:3e:d4:7c:91", "network": {"id": "4a6c6c26-4d29-486c-b11e-fc53769083ea", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1139388453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "492e0b2da61e4e4f9ea991df15531e24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9353199-d4", "ovs_interfaceid": "c9353199-d4a3-488f-857d-b0ebdb31a68f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:17:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-edc902b5-d42e-4588-babd-4fc89b220c09 req-ba3ece68-5d13-4667-b6c1-d99da0c43378 service nova] Releasing lock "refresh_cache-c3ceeca4-c16c-4cf5-adfd-7d5a2925f435" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:17:05 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:17:05 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:17:05 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Compute_service record updated for user:user {{(pid=75066) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 19:17:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.614s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:17:06 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:17:06 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:17:06 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:17:06 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75066) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 19:17:06 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:17:07 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:17:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-cae164ca-48b0-47d2-a798-7de3752586bd tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Acquiring lock "c3ceeca4-c16c-4cf5-adfd-7d5a2925f435" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:17:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-cae164ca-48b0-47d2-a798-7de3752586bd tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "c3ceeca4-c16c-4cf5-adfd-7d5a2925f435" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:17:07 user nova-compute[75066]: DEBUG nova.objects.instance [None req-cae164ca-48b0-47d2-a798-7de3752586bd tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lazy-loading 'flavor' on Instance uuid c3ceeca4-c16c-4cf5-adfd-7d5a2925f435 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:17:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-cae164ca-48b0-47d2-a798-7de3752586bd tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "c3ceeca4-c16c-4cf5-adfd-7d5a2925f435" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:17:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-cae164ca-48b0-47d2-a798-7de3752586bd tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Acquiring lock "c3ceeca4-c16c-4cf5-adfd-7d5a2925f435" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:17:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-cae164ca-48b0-47d2-a798-7de3752586bd tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "c3ceeca4-c16c-4cf5-adfd-7d5a2925f435" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:17:07 user nova-compute[75066]: INFO nova.compute.manager [None req-cae164ca-48b0-47d2-a798-7de3752586bd tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Attaching volume f32073d6-c4aa-49cc-a329-e000fd930829 to /dev/vdb
Dec 01 19:17:07 user nova-compute[75066]: DEBUG os_brick.utils [None req-cae164ca-48b0-47d2-a798-7de3752586bd tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:17:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:07 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[27815e24-8990-48c3-8b7e-b8b36c56d3d2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1959854982f\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:07 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[031ab098-5fdb-4394-9bd5-b1371dceba10]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:07 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f148a51-6986-40d6-8b83-3d9ebb4e8a75]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:07 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[09390ff7-a6b5-45bb-a621-60f874ccecc2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-cae164ca-48b0-47d2-a798-7de3752586bd tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Running cmd (subprocess): nvme version {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-cae164ca-48b0-47d2-a798-7de3752586bd tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] 'nvme version' failed. Not Retrying. {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:17:07 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cae164ca-48b0-47d2-a798-7de3752586bd tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] nvme not present on system {{(pid=75066) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 19:17:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:17:07 user nova-compute[75066]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 19:17:07 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d7fbe5-55d4-4f78-af42-c82734bbf547]: (4, '') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:07 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-cae164ca-48b0-47d2-a798-7de3752586bd tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75066) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 19:17:07 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-cae164ca-48b0-47d2-a798-7de3752586bd tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 19:17:07 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-cae164ca-48b0-47d2-a798-7de3752586bd tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] LIGHTOS: no hostnqn found. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 19:17:07 user nova-compute[75066]: DEBUG os_brick.utils [None req-cae164ca-48b0-47d2-a798-7de3752586bd tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1959854982f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:17:07 user nova-compute[75066]: DEBUG nova.virt.block_device [None req-cae164ca-48b0-47d2-a798-7de3752586bd tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Updating existing volume attachment record: 3197229d-bf5a-4fb4-90d0-1a4d0efb7291 {{(pid=75066) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 19:17:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:17:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:17:15 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ec47b3c-ebd4-42af-ad18-483f9faf2658 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] [instance: b6c46e8d-982f-4169-af80-96274a165b02] Calling os-brick to attach iSCSI Volume {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 19:17:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec47b3c-ebd4-42af-ad18-483f9faf2658 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:01ebc88f-657c-4c7e-8eac-da22345db3ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uvZwADdj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:17:15 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-3ec47b3c-ebd4-42af-ad18-483f9faf2658 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:17:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-3ec47b3c-ebd4-42af-ad18-483f9faf2658 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:17:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-3ec47b3c-ebd4-42af-ad18-483f9faf2658 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:17:15 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-3ec47b3c-ebd4-42af-ad18-483f9faf2658 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:17:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-3ec47b3c-ebd4-42af-ad18-483f9faf2658 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01ebc88f-657c-4c7e-8eac-da22345db3ac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:17:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-3ec47b3c-ebd4-42af-ad18-483f9faf2658 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01ebc88f-657c-4c7e-8eac-da22345db3ac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:17:15 user nova-compute[75066]: INFO os_brick.initiator.connectors.iscsi [None req-3ec47b3c-ebd4-42af-ad18-483f9faf2658 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 19:17:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01ebc88f-657c-4c7e-8eac-da22345db3ac -p 172.16.0.220:3260 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01ebc88f-657c-4c7e-8eac-da22345db3ac -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:15 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2fac41-07fb-44b1-aff8-a7678537b0c7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec47b3c-ebd4-42af-ad18-483f9faf2658 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 19:17:15 user nova-compute[75066]:  {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:17:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01ebc88f-657c-4c7e-8eac-da22345db3ac -p 172.16.0.220:3260 --interface default --op new {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01ebc88f-657c-4c7e-8eac-da22345db3ac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:15 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99e44ee-56e8-4cd8-bc0d-23c8f3162182]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:01ebc88f-657c-4c7e-8eac-da22345db3ac] added\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec47b3c-ebd4-42af-ad18-483f9faf2658 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:01ebc88f-657c-4c7e-8eac-da22345db3ac] added
Dec 01 19:17:15 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:17:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01ebc88f-657c-4c7e-8eac-da22345db3ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01ebc88f-657c-4c7e-8eac-da22345db3ac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:15 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[771e8940-1006-4d69-99df-faaf38b7422a]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec47b3c-ebd4-42af-ad18-483f9faf2658 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:17:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01ebc88f-657c-4c7e-8eac-da22345db3ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01ebc88f-657c-4c7e-8eac-da22345db3ac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:15 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[5abc22a8-e633-424b-9ff1-5c836c85485f]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec47b3c-ebd4-42af-ad18-483f9faf2658 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:17:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01ebc88f-657c-4c7e-8eac-da22345db3ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uvZwADdj {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01ebc88f-657c-4c7e-8eac-da22345db3ac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uvZwADdj" returned: 0 in 0.023s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:15 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b4cbb1-63c2-47a4-a5f7-266858ca5e87]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec47b3c-ebd4-42af-ad18-483f9faf2658 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uvZwADdj'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:17:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01ebc88f-657c-4c7e-8eac-da22345db3ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01ebc88f-657c-4c7e-8eac-da22345db3ac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:15 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5c0e63-2775-4ce8-adab-f5188efa8d73]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec47b3c-ebd4-42af-ad18-483f9faf2658 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:17:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:15 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c2e512-43bc-4fdb-bcb2-ef636a567c31]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec47b3c-ebd4-42af-ad18-483f9faf2658 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)
Dec 01 19:17:15 user nova-compute[75066]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)
Dec 01 19:17:15 user nova-compute[75066]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a (non-flash)
Dec 01 19:17:15 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:17:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec47b3c-ebd4-42af-ad18-483f9faf2658 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)
Dec 01 19:17:15 user nova-compute[75066]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)
Dec 01 19:17:15 user nova-compute[75066]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a (non-flash)
Dec 01 19:17:15 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:17:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01ebc88f-657c-4c7e-8eac-da22345db3ac -p 172.16.0.220:3260 --login {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01ebc88f-657c-4c7e-8eac-da22345db3ac -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:16 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbbaeea1-f8f5-43fb-bf4c-9abfd14ec464]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:01ebc88f-657c-4c7e-8eac-da22345db3ac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:01ebc88f-657c-4c7e-8eac-da22345db3ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:16 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec47b3c-ebd4-42af-ad18-483f9faf2658 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:01ebc88f-657c-4c7e-8eac-da22345db3ac, portal: 172.16.0.220,3260]
Dec 01 19:17:16 user nova-compute[75066]: Login to [iface: default, target: iqn.2010-10.org.openstack:01ebc88f-657c-4c7e-8eac-da22345db3ac, portal: 172.16.0.220,3260] successful.
Dec 01 19:17:16 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:17:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01ebc88f-657c-4c7e-8eac-da22345db3ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01ebc88f-657c-4c7e-8eac-da22345db3ac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:16 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c1815d-e28a-4863-8bd6-ccbb3767344c]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:16 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec47b3c-ebd4-42af-ad18-483f9faf2658 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:17:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:16 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7f706a-b16a-432a-b88b-621c0a90a8af]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ebc88f-657c-4c7e-8eac-da22345db3ac (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:16 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec47b3c-ebd4-42af-ad18-483f9faf2658 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)
Dec 01 19:17:16 user nova-compute[75066]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)
Dec 01 19:17:16 user nova-compute[75066]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a (non-flash)
Dec 01 19:17:16 user nova-compute[75066]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ebc88f-657c-4c7e-8eac-da22345db3ac (non-flash)
Dec 01 19:17:16 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:17:16 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec47b3c-ebd4-42af-ad18-483f9faf2658 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)
Dec 01 19:17:16 user nova-compute[75066]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)
Dec 01 19:17:16 user nova-compute[75066]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a (non-flash)
Dec 01 19:17:16 user nova-compute[75066]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ebc88f-657c-4c7e-8eac-da22345db3ac (non-flash)
Dec 01 19:17:16 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:17:16 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-3ec47b3c-ebd4-42af-ad18-483f9faf2658 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:01ebc88f-657c-4c7e-8eac-da22345db3ac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:17:16 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec47b3c-ebd4-42af-ad18-483f9faf2658 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Connected to 172.16.0.220:3260 {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 19:17:16 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-3ec47b3c-ebd4-42af-ad18-483f9faf2658 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=75066) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 19:17:16 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-3ec47b3c-ebd4-42af-ad18-483f9faf2658 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75066) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 19:17:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.023s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:16 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde38a29-5b37-46ad-92c5-dabc27a2d0dc]: (4, ('- - 0', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:16 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-3ec47b3c-ebd4-42af-ad18-483f9faf2658 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:17:16 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec47b3c-ebd4-42af-ad18-483f9faf2658 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:01ebc88f-657c-4c7e-8eac-da22345db3ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uvZwADdj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 19:17:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:17:17 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-3ec47b3c-ebd4-42af-ad18-483f9faf2658 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:17:17 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ec47b3c-ebd4-42af-ad18-483f9faf2658 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23938623061363930', 'path': '/dev/sde'} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:17:17 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ec47b3c-ebd4-42af-ad18-483f9faf2658 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] [instance: b6c46e8d-982f-4169-af80-96274a165b02] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23938623061363930', 'path': '/dev/sde'} {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 19:17:17 user nova-compute[75066]: DEBUG nova.objects.instance [None req-3ec47b3c-ebd4-42af-ad18-483f9faf2658 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Lazy-loading 'flavor' on Instance uuid b6c46e8d-982f-4169-af80-96274a165b02 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:17:17 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-3ec47b3c-ebd4-42af-ad18-483f9faf2658 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 19:17:17 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:17:17 user nova-compute[75066]:   <source dev="/dev/sde"/>
Dec 01 19:17:17 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:17:17 user nova-compute[75066]:   <serial>01ebc88f-657c-4c7e-8eac-da22345db3ac</serial>
Dec 01 19:17:17 user nova-compute[75066]: </disk>
Dec 01 19:17:17 user nova-compute[75066]:  {{(pid=75066) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 19:17:17 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:17:18 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-3ec47b3c-ebd4-42af-ad18-483f9faf2658 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:17:18 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-3ec47b3c-ebd4-42af-ad18-483f9faf2658 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:17:18 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-3ec47b3c-ebd4-42af-ad18-483f9faf2658 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] No VIF found with MAC fa:16:3e:0e:a0:20, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:17:18 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-3ec47b3c-ebd4-42af-ad18-483f9faf2658 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Lock "b6c46e8d-982f-4169-af80-96274a165b02" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.915s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:17:18 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cae164ca-48b0-47d2-a798-7de3752586bd tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Calling os-brick to attach iSCSI Volume {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 19:17:18 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-cae164ca-48b0-47d2-a798-7de3752586bd tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qYPJGAzg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:17:18 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-cae164ca-48b0-47d2-a798-7de3752586bd tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:17:18 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-cae164ca-48b0-47d2-a798-7de3752586bd tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:17:18 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-cae164ca-48b0-47d2-a798-7de3752586bd tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:17:18 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-cae164ca-48b0-47d2-a798-7de3752586bd tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:17:18 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-cae164ca-48b0-47d2-a798-7de3752586bd tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:17:18 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-cae164ca-48b0-47d2-a798-7de3752586bd tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:17:18 user nova-compute[75066]: INFO os_brick.initiator.connectors.iscsi [None req-cae164ca-48b0-47d2-a798-7de3752586bd tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 19:17:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 -p 172.16.0.220:3260 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:18 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb37b56d-8551-432c-92c9-7a591c0a6cd9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:18 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-cae164ca-48b0-47d2-a798-7de3752586bd tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 19:17:18 user nova-compute[75066]:  {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:17:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 -p 172.16.0.220:3260 --interface default --op new {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:18 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebed728e-fbaf-4df2-b975-6bbc8ec1755d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829] added\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:18 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-cae164ca-48b0-47d2-a798-7de3752586bd tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829] added
Dec 01 19:17:18 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:17:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:18 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ae2815-6349-4419-9c5f-7ea595af9287]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:18 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-cae164ca-48b0-47d2-a798-7de3752586bd tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:17:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:19 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5f12b8-3739-4c44-8463-2843111b65f2]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:19 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-cae164ca-48b0-47d2-a798-7de3752586bd tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:17:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qYPJGAzg {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qYPJGAzg" returned: 0 in 0.025s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:19 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[51577078-c2b7-45c8-8a40-6440efeb89a5]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:19 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-cae164ca-48b0-47d2-a798-7de3752586bd tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qYPJGAzg'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:17:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:19 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a7b388-834c-44d6-96cb-c714ad6bf91e]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:19 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-cae164ca-48b0-47d2-a798-7de3752586bd tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:17:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:19 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8657571-cc6f-4325-b55f-273b813abb0c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ebc88f-657c-4c7e-8eac-da22345db3ac (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:19 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-cae164ca-48b0-47d2-a798-7de3752586bd tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)
Dec 01 19:17:19 user nova-compute[75066]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)
Dec 01 19:17:19 user nova-compute[75066]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a (non-flash)
Dec 01 19:17:19 user nova-compute[75066]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ebc88f-657c-4c7e-8eac-da22345db3ac (non-flash)
Dec 01 19:17:19 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:17:19 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-cae164ca-48b0-47d2-a798-7de3752586bd tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)
Dec 01 19:17:19 user nova-compute[75066]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)
Dec 01 19:17:19 user nova-compute[75066]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a (non-flash)
Dec 01 19:17:19 user nova-compute[75066]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ebc88f-657c-4c7e-8eac-da22345db3ac (non-flash)
Dec 01 19:17:19 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:17:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 -p 172.16.0.220:3260 --login {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:19 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb28e58-f9ff-4560-91c6-0860286d0cc9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:19 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-cae164ca-48b0-47d2-a798-7de3752586bd tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829, portal: 172.16.0.220,3260]
Dec 01 19:17:19 user nova-compute[75066]: Login to [iface: default, target: iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829, portal: 172.16.0.220,3260] successful.
Dec 01 19:17:19 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:17:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:19 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1a213f-ec4b-42a0-861e-21179af19633]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:19 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-cae164ca-48b0-47d2-a798-7de3752586bd tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:17:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:19 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[da63cd64-1fd4-4e08-9cb5-1dbd04215e07]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ebc88f-657c-4c7e-8eac-da22345db3ac (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:19 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-cae164ca-48b0-47d2-a798-7de3752586bd tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)
Dec 01 19:17:19 user nova-compute[75066]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)
Dec 01 19:17:19 user nova-compute[75066]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a (non-flash)
Dec 01 19:17:19 user nova-compute[75066]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ebc88f-657c-4c7e-8eac-da22345db3ac (non-flash)
Dec 01 19:17:19 user nova-compute[75066]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:17:19 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:17:19 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-cae164ca-48b0-47d2-a798-7de3752586bd tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)
Dec 01 19:17:19 user nova-compute[75066]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)
Dec 01 19:17:19 user nova-compute[75066]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a (non-flash)
Dec 01 19:17:19 user nova-compute[75066]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ebc88f-657c-4c7e-8eac-da22345db3ac (non-flash)
Dec 01 19:17:19 user nova-compute[75066]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:17:19 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:17:19 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-cae164ca-48b0-47d2-a798-7de3752586bd tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:17:19 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-cae164ca-48b0-47d2-a798-7de3752586bd tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Connected to 172.16.0.220:3260 {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 19:17:19 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-cae164ca-48b0-47d2-a798-7de3752586bd tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=75066) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 19:17:19 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-cae164ca-48b0-47d2-a798-7de3752586bd tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75066) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 19:17:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:19 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc8978c-3735-4ff9-9002-f385fec768e4]: (4, ('- - 0', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:19 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-cae164ca-48b0-47d2-a798-7de3752586bd tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: None {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:17:19 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-bc4cf526-5220-434e-a95c-2fdd52a288c3 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Acquiring lock "b6c46e8d-982f-4169-af80-96274a165b02" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:17:19 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-bc4cf526-5220-434e-a95c-2fdd52a288c3 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Lock "b6c46e8d-982f-4169-af80-96274a165b02" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:17:19 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-bc4cf526-5220-434e-a95c-2fdd52a288c3 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Acquiring lock "b6c46e8d-982f-4169-af80-96274a165b02-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:17:19 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-bc4cf526-5220-434e-a95c-2fdd52a288c3 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Lock "b6c46e8d-982f-4169-af80-96274a165b02-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:17:19 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-bc4cf526-5220-434e-a95c-2fdd52a288c3 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Lock "b6c46e8d-982f-4169-af80-96274a165b02-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:17:19 user nova-compute[75066]: INFO nova.compute.manager [None req-bc4cf526-5220-434e-a95c-2fdd52a288c3 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] [instance: b6c46e8d-982f-4169-af80-96274a165b02] Terminating instance
Dec 01 19:17:19 user nova-compute[75066]: DEBUG nova.compute.manager [None req-bc4cf526-5220-434e-a95c-2fdd52a288c3 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] [instance: b6c46e8d-982f-4169-af80-96274a165b02] Start destroying the instance on the hypervisor. {{(pid=75066) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 19:17:19 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:17:19 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:17:19 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:17:19 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG nova.compute.manager [req-7ad76755-2680-4e40-b8cc-20caa9b45486 req-150f7b86-c423-4826-b274-bb5c48745513 service nova] [instance: b6c46e8d-982f-4169-af80-96274a165b02] Received event network-vif-unplugged-6853aa2a-6a9e-471a-ade8-f29f1064c006 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-7ad76755-2680-4e40-b8cc-20caa9b45486 req-150f7b86-c423-4826-b274-bb5c48745513 service nova] Acquiring lock "b6c46e8d-982f-4169-af80-96274a165b02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-7ad76755-2680-4e40-b8cc-20caa9b45486 req-150f7b86-c423-4826-b274-bb5c48745513 service nova] Lock "b6c46e8d-982f-4169-af80-96274a165b02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-7ad76755-2680-4e40-b8cc-20caa9b45486 req-150f7b86-c423-4826-b274-bb5c48745513 service nova] Lock "b6c46e8d-982f-4169-af80-96274a165b02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG nova.compute.manager [req-7ad76755-2680-4e40-b8cc-20caa9b45486 req-150f7b86-c423-4826-b274-bb5c48745513 service nova] [instance: b6c46e8d-982f-4169-af80-96274a165b02] No waiting events found dispatching network-vif-unplugged-6853aa2a-6a9e-471a-ade8-f29f1064c006 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG nova.compute.manager [req-7ad76755-2680-4e40-b8cc-20caa9b45486 req-150f7b86-c423-4826-b274-bb5c48745513 service nova] [instance: b6c46e8d-982f-4169-af80-96274a165b02] Received event network-vif-unplugged-6853aa2a-6a9e-471a-ade8-f29f1064c006 for instance with task_state deleting. {{(pid=75066) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:17:20 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: b6c46e8d-982f-4169-af80-96274a165b02] Instance destroyed successfully.
Dec 01 19:17:20 user nova-compute[75066]: DEBUG nova.objects.instance [None req-bc4cf526-5220-434e-a95c-2fdd52a288c3 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Lazy-loading 'resources' on Instance uuid b6c46e8d-982f-4169-af80-96274a165b02 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-bc4cf526-5220-434e-a95c-2fdd52a288c3 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:15:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1490091229',display_name='tempest-DeleteServersTestJSON-server-1490091229',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1490091229',id=2,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:15:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a0c442a2ec3a41bfa602949a1aeb1e1b',ramdisk_id='',reservation_id='r-0wwuhxqb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-88724826',owner_user_name='tempest-DeleteServersTestJSON-88724826-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:15:25Z,user_data=None,user_id='009206429ab7462c8ff29cb4c2bf7d09',uuid=b6c46e8d-982f-4169-af80-96274a165b02,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6853aa2a-6a9e-471a-ade8-f29f1064c006", "address": "fa:16:3e:0e:a0:20", "network": {"id": "30057e96-0f86-466d-bf3f-e3cf15d9e5af", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-383866239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0c442a2ec3a41bfa602949a1aeb1e1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6853aa2a-6a", "ovs_interfaceid": "6853aa2a-6a9e-471a-ade8-f29f1064c006", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-bc4cf526-5220-434e-a95c-2fdd52a288c3 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Converting VIF {"id": "6853aa2a-6a9e-471a-ade8-f29f1064c006", "address": "fa:16:3e:0e:a0:20", "network": {"id": "30057e96-0f86-466d-bf3f-e3cf15d9e5af", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-383866239-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a0c442a2ec3a41bfa602949a1aeb1e1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6853aa2a-6a", "ovs_interfaceid": "6853aa2a-6a9e-471a-ade8-f29f1064c006", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-bc4cf526-5220-434e-a95c-2fdd52a288c3 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:a0:20,bridge_name='br-int',has_traffic_filtering=True,id=6853aa2a-6a9e-471a-ade8-f29f1064c006,network=Network(30057e96-0f86-466d-bf3f-e3cf15d9e5af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6853aa2a-6a') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG os_vif [None req-bc4cf526-5220-434e-a95c-2fdd52a288c3 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:a0:20,bridge_name='br-int',has_traffic_filtering=True,id=6853aa2a-6a9e-471a-ade8-f29f1064c006,network=Network(30057e96-0f86-466d-bf3f-e3cf15d9e5af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6853aa2a-6a') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6853aa2a-6a, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2b96b96a-e0f5-46ae-b29d-b88098b70c15) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-cae164ca-48b0-47d2-a798-7de3752586bd tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-cae164ca-48b0-47d2-a798-7de3752586bd tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qYPJGAzg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-cae164ca-48b0-47d2-a798-7de3752586bd tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-cae164ca-48b0-47d2-a798-7de3752586bd tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '23464303338666462', 'path': '/dev/sdf'} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cae164ca-48b0-47d2-a798-7de3752586bd tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464303338666462', 'path': '/dev/sdf'} {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:17:20 user nova-compute[75066]: INFO os_vif [None req-bc4cf526-5220-434e-a95c-2fdd52a288c3 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:a0:20,bridge_name='br-int',has_traffic_filtering=True,id=6853aa2a-6a9e-471a-ade8-f29f1064c006,network=Network(30057e96-0f86-466d-bf3f-e3cf15d9e5af),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6853aa2a-6a')
Dec 01 19:17:20 user nova-compute[75066]: DEBUG nova.objects.instance [None req-cae164ca-48b0-47d2-a798-7de3752586bd tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lazy-loading 'flavor' on Instance uuid c3ceeca4-c16c-4cf5-adfd-7d5a2925f435 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc4cf526-5220-434e-a95c-2fdd52a288c3 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] [instance: b6c46e8d-982f-4169-af80-96274a165b02] calling os-brick to detach iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc4cf526-5220-434e-a95c-2fdd52a288c3 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, {'target_iqn': 'iqn.2010-10.org.openstack:01ebc88f-657c-4c7e-8eac-da22345db3ac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uvZwADdj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:17:20 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-bc4cf526-5220-434e-a95c-2fdd52a288c3 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:17:20 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-bc4cf526-5220-434e-a95c-2fdd52a288c3 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-bc4cf526-5220-434e-a95c-2fdd52a288c3 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-cae164ca-48b0-47d2-a798-7de3752586bd tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 19:17:20 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:17:20 user nova-compute[75066]:   <source dev="/dev/sdf"/>
Dec 01 19:17:20 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:17:20 user nova-compute[75066]:   <serial>f32073d6-c4aa-49cc-a329-e000fd930829</serial>
Dec 01 19:17:20 user nova-compute[75066]: </disk>
Dec 01 19:17:20 user nova-compute[75066]:  {{(pid=75066) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e3c064a-f058-4374-ba53-6b080c1ac5cb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:01ebc88f-657c-4c7e-8eac-da22345db3ac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc4cf526-5220-434e-a95c-2fdd52a288c3 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 19:17:20 user nova-compute[75066]: No targets found.
Dec 01 19:17:20 user nova-compute[75066]: iSNS:
Dec 01 19:17:20 user nova-compute[75066]: No targets found.
Dec 01 19:17:20 user nova-compute[75066]: STATIC:
Dec 01 19:17:20 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a
Dec 01 19:17:20 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:17:20 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:17:20 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829
Dec 01 19:17:20 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:17:20 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:17:20 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315
Dec 01 19:17:20 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:17:20 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:17:20 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a
Dec 01 19:17:20 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:17:20 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:17:20 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:01ebc88f-657c-4c7e-8eac-da22345db3ac
Dec 01 19:17:20 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:17:20 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:17:20 user nova-compute[75066]: FIRMWARE:
Dec 01 19:17:20 user nova-compute[75066]: No targets found.
Dec 01 19:17:20 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc4cf526-5220-434e-a95c-2fdd52a288c3 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 19:17:20 user nova-compute[75066]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 19:17:20 user nova-compute[75066]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75066) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc4cf526-5220-434e-a95c-2fdd52a288c3 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01ebc88f-657c-4c7e-8eac-da22345db3ac', 0)] {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a8a00d-c225-43f7-95b4-6e441226dac8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:01ebc88f-657c-4c7e-8eac-da22345db3ac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8b322c-6b19-4630-af93-bd94d56cdd7a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ebc88f-657c-4c7e-8eac-da22345db3ac (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc4cf526-5220-434e-a95c-2fdd52a288c3 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)
Dec 01 19:17:20 user nova-compute[75066]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)
Dec 01 19:17:20 user nova-compute[75066]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a (non-flash)
Dec 01 19:17:20 user nova-compute[75066]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ebc88f-657c-4c7e-8eac-da22345db3ac (non-flash)
Dec 01 19:17:20 user nova-compute[75066]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:17:20 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc4cf526-5220-434e-a95c-2fdd52a288c3 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)
Dec 01 19:17:20 user nova-compute[75066]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)
Dec 01 19:17:20 user nova-compute[75066]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a (non-flash)
Dec 01 19:17:20 user nova-compute[75066]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:01ebc88f-657c-4c7e-8eac-da22345db3ac (non-flash)
Dec 01 19:17:20 user nova-compute[75066]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:17:20 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc4cf526-5220-434e-a95c-2fdd52a288c3 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9190553760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01ebc88f-657c-4c7e-8eac-da22345db3ac'): ({'sde'}, set())}) {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-bc4cf526-5220-434e-a95c-2fdd52a288c3 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Removing single pathed devices sde {{(pid=75066) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb87308-b032-43c5-ad94-cf81d53dd8d4]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[f839da2f-69da-47d3-8330-a20f52f757b2]: (4, ('ok\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-bc4cf526-5220-434e-a95c-2fdd52a288c3 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Flushing IO for device /dev/sde {{(pid=75066) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98223df-b719-4ead-aed6-92bca8ad85f7]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-bc4cf526-5220-434e-a95c-2fdd52a288c3 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75066) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.059s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1af883-796e-4c8a-bbdc-2cd1b0c1472e]: (4, ('1', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-bc4cf526-5220-434e-a95c-2fdd52a288c3 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-bc4cf526-5220-434e-a95c-2fdd52a288c3 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] SCSI volumes sde have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc4cf526-5220-434e-a95c-2fdd52a288c3 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:01ebc88f-657c-4c7e-8eac-da22345db3ac')] {{(pid=75066) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01ebc88f-657c-4c7e-8eac-da22345db3ac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01ebc88f-657c-4c7e-8eac-da22345db3ac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[78345ceb-3426-4ac1-ac93-998fa432b21e]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc4cf526-5220-434e-a95c-2fdd52a288c3 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01ebc88f-657c-4c7e-8eac-da22345db3ac -p 172.16.0.220:3260 --logout {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01ebc88f-657c-4c7e-8eac-da22345db3ac -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1696d7-a8f0-43ba-a86d-1abb1edf3da2]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:01ebc88f-657c-4c7e-8eac-da22345db3ac, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:01ebc88f-657c-4c7e-8eac-da22345db3ac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc4cf526-5220-434e-a95c-2fdd52a288c3 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:01ebc88f-657c-4c7e-8eac-da22345db3ac, portal: 172.16.0.220,3260]
Dec 01 19:17:20 user nova-compute[75066]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:01ebc88f-657c-4c7e-8eac-da22345db3ac, portal: 172.16.0.220,3260] successful.
Dec 01 19:17:20 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:01ebc88f-657c-4c7e-8eac-da22345db3ac -p 172.16.0.220:3260 --op delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:01ebc88f-657c-4c7e-8eac-da22345db3ac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b534025-887a-4a05-8402-f7f124ddac9f]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc4cf526-5220-434e-a95c-2fdd52a288c3 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-bc4cf526-5220-434e-a95c-2fdd52a288c3 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bc4cf526-5220-434e-a95c-2fdd52a288c3 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] <== disconnect_volume: return (369ms) None {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bc4cf526-5220-434e-a95c-2fdd52a288c3 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] [instance: b6c46e8d-982f-4169-af80-96274a165b02] Disconnected iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 19:17:20 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-bc4cf526-5220-434e-a95c-2fdd52a288c3 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] [instance: b6c46e8d-982f-4169-af80-96274a165b02] Deleting instance files /opt/stack/data/nova/instances/b6c46e8d-982f-4169-af80-96274a165b02_del
Dec 01 19:17:20 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-bc4cf526-5220-434e-a95c-2fdd52a288c3 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] [instance: b6c46e8d-982f-4169-af80-96274a165b02] Deletion of /opt/stack/data/nova/instances/b6c46e8d-982f-4169-af80-96274a165b02_del complete
Dec 01 19:17:20 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-cae164ca-48b0-47d2-a798-7de3752586bd tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-cae164ca-48b0-47d2-a798-7de3752586bd tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-cae164ca-48b0-47d2-a798-7de3752586bd tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] No VIF found with MAC fa:16:3e:d4:7c:91, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:17:20 user nova-compute[75066]: INFO nova.compute.manager [None req-bc4cf526-5220-434e-a95c-2fdd52a288c3 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] [instance: b6c46e8d-982f-4169-af80-96274a165b02] Took 1.35 seconds to destroy the instance on the hypervisor.
Dec 01 19:17:20 user nova-compute[75066]: DEBUG oslo.service.loopingcall [None req-bc4cf526-5220-434e-a95c-2fdd52a288c3 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75066) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG nova.compute.manager [-] [instance: b6c46e8d-982f-4169-af80-96274a165b02] Deallocating network for instance {{(pid=75066) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: b6c46e8d-982f-4169-af80-96274a165b02] deallocate_for_instance() {{(pid=75066) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 19:17:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-cae164ca-48b0-47d2-a798-7de3752586bd tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "c3ceeca4-c16c-4cf5-adfd-7d5a2925f435" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.267s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:17:21 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: b6c46e8d-982f-4169-af80-96274a165b02] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:17:21 user nova-compute[75066]: INFO nova.compute.manager [-] [instance: b6c46e8d-982f-4169-af80-96274a165b02] Took 0.66 seconds to deallocate network for instance.
Dec 01 19:17:21 user nova-compute[75066]: DEBUG nova.compute.manager [req-e265a580-7062-4ce3-83da-c396d5ef2146 req-7d7cb051-68ac-44a8-b0f2-0772ac91c5c7 service nova] [instance: b6c46e8d-982f-4169-af80-96274a165b02] Received event network-vif-deleted-6853aa2a-6a9e-471a-ade8-f29f1064c006 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:17:21 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b55a5e9b-b6d0-4aa0-b8ca-a4f0452c8c80 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Acquiring lock "c3ceeca4-c16c-4cf5-adfd-7d5a2925f435" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:17:21 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b55a5e9b-b6d0-4aa0-b8ca-a4f0452c8c80 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "c3ceeca4-c16c-4cf5-adfd-7d5a2925f435" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:17:21 user nova-compute[75066]: DEBUG nova.compute.manager [None req-b55a5e9b-b6d0-4aa0-b8ca-a4f0452c8c80 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:17:21 user nova-compute[75066]: DEBUG nova.compute.manager [None req-b55a5e9b-b6d0-4aa0-b8ca-a4f0452c8c80 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75066) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Dec 01 19:17:21 user nova-compute[75066]: DEBUG nova.objects.instance [None req-b55a5e9b-b6d0-4aa0-b8ca-a4f0452c8c80 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lazy-loading 'flavor' on Instance uuid c3ceeca4-c16c-4cf5-adfd-7d5a2925f435 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:17:21 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:17:22 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:17:22 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:17:22 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:17:22 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:17:22 user nova-compute[75066]: DEBUG nova.compute.manager [req-aa1f7916-9ec2-498e-af84-04555c1b52cd req-c9a157d0-8993-46d0-8cda-f4561580fc48 service nova] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] Received event network-changed-ba7d09a3-d2cc-43ca-a1e8-278f841ae513 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:17:22 user nova-compute[75066]: DEBUG nova.compute.manager [req-aa1f7916-9ec2-498e-af84-04555c1b52cd req-c9a157d0-8993-46d0-8cda-f4561580fc48 service nova] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] Refreshing instance network info cache due to event network-changed-ba7d09a3-d2cc-43ca-a1e8-278f841ae513. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:17:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-aa1f7916-9ec2-498e-af84-04555c1b52cd req-c9a157d0-8993-46d0-8cda-f4561580fc48 service nova] Acquiring lock "refresh_cache-f253bb0a-6cd0-4e62-8bcb-898537ce8c0b" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:17:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-aa1f7916-9ec2-498e-af84-04555c1b52cd req-c9a157d0-8993-46d0-8cda-f4561580fc48 service nova] Acquired lock "refresh_cache-f253bb0a-6cd0-4e62-8bcb-898537ce8c0b" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:17:22 user nova-compute[75066]: DEBUG nova.network.neutron [req-aa1f7916-9ec2-498e-af84-04555c1b52cd req-c9a157d0-8993-46d0-8cda-f4561580fc48 service nova] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] Refreshing network info cache for port ba7d09a3-d2cc-43ca-a1e8-278f841ae513 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:17:22 user nova-compute[75066]: INFO nova.compute.manager [None req-bc4cf526-5220-434e-a95c-2fdd52a288c3 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] [instance: b6c46e8d-982f-4169-af80-96274a165b02] Took 1.08 seconds to detach 1 volumes for instance.
Dec 01 19:17:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-bc4cf526-5220-434e-a95c-2fdd52a288c3 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:17:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-bc4cf526-5220-434e-a95c-2fdd52a288c3 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:17:22 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Instance destroyed successfully.
Dec 01 19:17:22 user nova-compute[75066]: DEBUG nova.compute.manager [None req-b55a5e9b-b6d0-4aa0-b8ca-a4f0452c8c80 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:17:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b55a5e9b-b6d0-4aa0-b8ca-a4f0452c8c80 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "c3ceeca4-c16c-4cf5-adfd-7d5a2925f435" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.010s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:17:22 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-bc4cf526-5220-434e-a95c-2fdd52a288c3 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:17:22 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-bc4cf526-5220-434e-a95c-2fdd52a288c3 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:17:22 user nova-compute[75066]: DEBUG nova.network.neutron [req-aa1f7916-9ec2-498e-af84-04555c1b52cd req-c9a157d0-8993-46d0-8cda-f4561580fc48 service nova] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] Updated VIF entry in instance network info cache for port ba7d09a3-d2cc-43ca-a1e8-278f841ae513. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:17:22 user nova-compute[75066]: DEBUG nova.network.neutron [req-aa1f7916-9ec2-498e-af84-04555c1b52cd req-c9a157d0-8993-46d0-8cda-f4561580fc48 service nova] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] Updating instance_info_cache with network_info: [{"id": "ba7d09a3-d2cc-43ca-a1e8-278f841ae513", "address": "fa:16:3e:88:28:51", "network": {"id": "69bb86af-79ca-4a0b-a0f7-8580fb07e2ce", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1708610135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da44764312b448268176827b746f5c21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba7d09a3-d2", "ovs_interfaceid": "ba7d09a3-d2cc-43ca-a1e8-278f841ae513", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:17:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-bc4cf526-5220-434e-a95c-2fdd52a288c3 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.385s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:17:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-aa1f7916-9ec2-498e-af84-04555c1b52cd req-c9a157d0-8993-46d0-8cda-f4561580fc48 service nova] Releasing lock "refresh_cache-f253bb0a-6cd0-4e62-8bcb-898537ce8c0b" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:17:22 user nova-compute[75066]: DEBUG nova.compute.manager [req-aa1f7916-9ec2-498e-af84-04555c1b52cd req-c9a157d0-8993-46d0-8cda-f4561580fc48 service nova] [instance: b6c46e8d-982f-4169-af80-96274a165b02] Received event network-vif-plugged-6853aa2a-6a9e-471a-ade8-f29f1064c006 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:17:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-aa1f7916-9ec2-498e-af84-04555c1b52cd req-c9a157d0-8993-46d0-8cda-f4561580fc48 service nova] Acquiring lock "b6c46e8d-982f-4169-af80-96274a165b02-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:17:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-aa1f7916-9ec2-498e-af84-04555c1b52cd req-c9a157d0-8993-46d0-8cda-f4561580fc48 service nova] Lock "b6c46e8d-982f-4169-af80-96274a165b02-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:17:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-aa1f7916-9ec2-498e-af84-04555c1b52cd req-c9a157d0-8993-46d0-8cda-f4561580fc48 service nova] Lock "b6c46e8d-982f-4169-af80-96274a165b02-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:17:22 user nova-compute[75066]: DEBUG nova.compute.manager [req-aa1f7916-9ec2-498e-af84-04555c1b52cd req-c9a157d0-8993-46d0-8cda-f4561580fc48 service nova] [instance: b6c46e8d-982f-4169-af80-96274a165b02] No waiting events found dispatching network-vif-plugged-6853aa2a-6a9e-471a-ade8-f29f1064c006 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:17:22 user nova-compute[75066]: WARNING nova.compute.manager [req-aa1f7916-9ec2-498e-af84-04555c1b52cd req-c9a157d0-8993-46d0-8cda-f4561580fc48 service nova] [instance: b6c46e8d-982f-4169-af80-96274a165b02] Received unexpected event network-vif-plugged-6853aa2a-6a9e-471a-ade8-f29f1064c006 for instance with vm_state active and task_state deleting.
Dec 01 19:17:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-1e2f3d63-ef56-4009-9409-cb4b92e9a785 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Acquiring lock "f253bb0a-6cd0-4e62-8bcb-898537ce8c0b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:17:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-1e2f3d63-ef56-4009-9409-cb4b92e9a785 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Lock "f253bb0a-6cd0-4e62-8bcb-898537ce8c0b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:17:22 user nova-compute[75066]: INFO nova.scheduler.client.report [None req-bc4cf526-5220-434e-a95c-2fdd52a288c3 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Deleted allocations for instance b6c46e8d-982f-4169-af80-96274a165b02
Dec 01 19:17:23 user nova-compute[75066]: DEBUG nova.objects.instance [None req-1e2f3d63-ef56-4009-9409-cb4b92e9a785 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Lazy-loading 'flavor' on Instance uuid f253bb0a-6cd0-4e62-8bcb-898537ce8c0b {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:17:23 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-1e2f3d63-ef56-4009-9409-cb4b92e9a785 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Lock "f253bb0a-6cd0-4e62-8bcb-898537ce8c0b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:17:23 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-bc4cf526-5220-434e-a95c-2fdd52a288c3 tempest-DeleteServersTestJSON-88724826 tempest-DeleteServersTestJSON-88724826-project-member] Lock "b6c46e8d-982f-4169-af80-96274a165b02" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.706s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:17:23 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-1e2f3d63-ef56-4009-9409-cb4b92e9a785 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Acquiring lock "f253bb0a-6cd0-4e62-8bcb-898537ce8c0b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:17:23 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-1e2f3d63-ef56-4009-9409-cb4b92e9a785 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Lock "f253bb0a-6cd0-4e62-8bcb-898537ce8c0b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:17:23 user nova-compute[75066]: INFO nova.compute.manager [None req-1e2f3d63-ef56-4009-9409-cb4b92e9a785 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] Attaching volume 6d9883cd-57eb-4dc1-aba6-442bb84b899b to /dev/sdc
Dec 01 19:17:23 user nova-compute[75066]: DEBUG os_brick.utils [None req-1e2f3d63-ef56-4009-9409-cb4b92e9a785 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:17:23 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:23 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:23 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5d39286-2860-47ba-a3a7-01ba2f979898]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1959854982f\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:23 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:23 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:23 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[df6d2161-e2b2-4cee-ac70-7913034b4c44]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:23 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:23 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:23 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[14da3039-f6e4-43f7-81fe-596ae88395c1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:23 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d2e8c9-ee06-473f-95fa-eefb8cafecb9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:23 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-1e2f3d63-ef56-4009-9409-cb4b92e9a785 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Running cmd (subprocess): nvme version {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:23 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-1e2f3d63-ef56-4009-9409-cb4b92e9a785 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] 'nvme version' failed. Not Retrying. {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:17:23 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1e2f3d63-ef56-4009-9409-cb4b92e9a785 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] nvme not present on system {{(pid=75066) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 19:17:23 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:23 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:17:23 user nova-compute[75066]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 19:17:23 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[321c9fa1-c9eb-4d51-8be8-bfde2c3b969a]: (4, '') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:23 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-1e2f3d63-ef56-4009-9409-cb4b92e9a785 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75066) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 19:17:23 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-1e2f3d63-ef56-4009-9409-cb4b92e9a785 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 19:17:23 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-1e2f3d63-ef56-4009-9409-cb4b92e9a785 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] LIGHTOS: no hostnqn found. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 19:17:23 user nova-compute[75066]: DEBUG os_brick.utils [None req-1e2f3d63-ef56-4009-9409-cb4b92e9a785 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1959854982f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:17:23 user nova-compute[75066]: DEBUG nova.virt.block_device [None req-1e2f3d63-ef56-4009-9409-cb4b92e9a785 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] Updating existing volume attachment record: fc4899e8-40a6-4ed1-bb0b-3400e05f71d1 {{(pid=75066) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 19:17:24 user nova-compute[75066]: DEBUG nova.compute.manager [req-0ae688ac-c291-426c-a4e0-7a1872ee13fc req-432b55a8-9422-461a-8a43-418316acf772 service nova] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Received event network-vif-unplugged-c9353199-d4a3-488f-857d-b0ebdb31a68f {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:17:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-0ae688ac-c291-426c-a4e0-7a1872ee13fc req-432b55a8-9422-461a-8a43-418316acf772 service nova] Acquiring lock "c3ceeca4-c16c-4cf5-adfd-7d5a2925f435-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:17:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-0ae688ac-c291-426c-a4e0-7a1872ee13fc req-432b55a8-9422-461a-8a43-418316acf772 service nova] Lock "c3ceeca4-c16c-4cf5-adfd-7d5a2925f435-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:17:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-0ae688ac-c291-426c-a4e0-7a1872ee13fc req-432b55a8-9422-461a-8a43-418316acf772 service nova] Lock "c3ceeca4-c16c-4cf5-adfd-7d5a2925f435-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:17:24 user nova-compute[75066]: DEBUG nova.compute.manager [req-0ae688ac-c291-426c-a4e0-7a1872ee13fc req-432b55a8-9422-461a-8a43-418316acf772 service nova] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] No waiting events found dispatching network-vif-unplugged-c9353199-d4a3-488f-857d-b0ebdb31a68f {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:17:24 user nova-compute[75066]: WARNING nova.compute.manager [req-0ae688ac-c291-426c-a4e0-7a1872ee13fc req-432b55a8-9422-461a-8a43-418316acf772 service nova] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Received unexpected event network-vif-unplugged-c9353199-d4a3-488f-857d-b0ebdb31a68f for instance with vm_state stopped and task_state None.
Dec 01 19:17:24 user nova-compute[75066]: DEBUG nova.compute.manager [req-0ae688ac-c291-426c-a4e0-7a1872ee13fc req-432b55a8-9422-461a-8a43-418316acf772 service nova] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Received event network-vif-plugged-c9353199-d4a3-488f-857d-b0ebdb31a68f {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:17:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-0ae688ac-c291-426c-a4e0-7a1872ee13fc req-432b55a8-9422-461a-8a43-418316acf772 service nova] Acquiring lock "c3ceeca4-c16c-4cf5-adfd-7d5a2925f435-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:17:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-0ae688ac-c291-426c-a4e0-7a1872ee13fc req-432b55a8-9422-461a-8a43-418316acf772 service nova] Lock "c3ceeca4-c16c-4cf5-adfd-7d5a2925f435-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:17:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-0ae688ac-c291-426c-a4e0-7a1872ee13fc req-432b55a8-9422-461a-8a43-418316acf772 service nova] Lock "c3ceeca4-c16c-4cf5-adfd-7d5a2925f435-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:17:24 user nova-compute[75066]: DEBUG nova.compute.manager [req-0ae688ac-c291-426c-a4e0-7a1872ee13fc req-432b55a8-9422-461a-8a43-418316acf772 service nova] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] No waiting events found dispatching network-vif-plugged-c9353199-d4a3-488f-857d-b0ebdb31a68f {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:17:24 user nova-compute[75066]: WARNING nova.compute.manager [req-0ae688ac-c291-426c-a4e0-7a1872ee13fc req-432b55a8-9422-461a-8a43-418316acf772 service nova] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Received unexpected event network-vif-plugged-c9353199-d4a3-488f-857d-b0ebdb31a68f for instance with vm_state stopped and task_state None.
Dec 01 19:17:25 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:17:25 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b4bad134-bc54-408f-a44b-3f30bef4b671 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Acquiring lock "dd67db6c-8bd1-402e-93ce-9b2d7a405a6e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:17:25 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b4bad134-bc54-408f-a44b-3f30bef4b671 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Lock "dd67db6c-8bd1-402e-93ce-9b2d7a405a6e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:17:25 user nova-compute[75066]: DEBUG nova.objects.instance [None req-b4bad134-bc54-408f-a44b-3f30bef4b671 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Lazy-loading 'flavor' on Instance uuid dd67db6c-8bd1-402e-93ce-9b2d7a405a6e {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:17:25 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b4bad134-bc54-408f-a44b-3f30bef4b671 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Lock "dd67db6c-8bd1-402e-93ce-9b2d7a405a6e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:17:25 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b4bad134-bc54-408f-a44b-3f30bef4b671 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Acquiring lock "dd67db6c-8bd1-402e-93ce-9b2d7a405a6e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:17:25 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b4bad134-bc54-408f-a44b-3f30bef4b671 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Lock "dd67db6c-8bd1-402e-93ce-9b2d7a405a6e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:17:25 user nova-compute[75066]: INFO nova.compute.manager [None req-b4bad134-bc54-408f-a44b-3f30bef4b671 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Attaching volume ae6d6a5d-9de3-4500-80b2-7c4860102e9a to /dev/vdb
Dec 01 19:17:26 user nova-compute[75066]: DEBUG os_brick.utils [None req-b4bad134-bc54-408f-a44b-3f30bef4b671 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:17:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:26 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[07fe6139-9057-4ae0-a6ab-050bb22a898e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1959854982f\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:26 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[42fc88d0-107e-43d5-b2d1-7e3019a3d951]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:26 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74046ea-a994-4988-b09d-7cdf7a00bdd6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:26 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[003513bb-fa30-4cc5-8d64-679e788619b8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-b4bad134-bc54-408f-a44b-3f30bef4b671 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Running cmd (subprocess): nvme version {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-b4bad134-bc54-408f-a44b-3f30bef4b671 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] 'nvme version' failed. Not Retrying. {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:17:26 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b4bad134-bc54-408f-a44b-3f30bef4b671 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] nvme not present on system {{(pid=75066) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 19:17:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:17:26 user nova-compute[75066]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 19:17:26 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[a24bc5e0-6049-4229-8cce-dd5aedfd431b]: (4, '') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:26 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-b4bad134-bc54-408f-a44b-3f30bef4b671 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75066) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 19:17:26 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-b4bad134-bc54-408f-a44b-3f30bef4b671 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 19:17:26 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-b4bad134-bc54-408f-a44b-3f30bef4b671 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] LIGHTOS: no hostnqn found. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 19:17:26 user nova-compute[75066]: DEBUG os_brick.utils [None req-b4bad134-bc54-408f-a44b-3f30bef4b671 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1959854982f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:17:26 user nova-compute[75066]: DEBUG nova.virt.block_device [None req-b4bad134-bc54-408f-a44b-3f30bef4b671 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Updating existing volume attachment record: 2cd2148f-06c3-49e1-9e51-9307b8c8ba61 {{(pid=75066) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 19:17:26 user nova-compute[75066]: DEBUG nova.compute.manager [req-420940d6-e8f4-4ca9-918c-87f39114a6de req-fc792871-7d08-4e8c-bf3d-aecb09349db4 service nova] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Received event network-changed-0a73848e-3c30-4e3a-a8ef-3092afe91d25 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:17:26 user nova-compute[75066]: DEBUG nova.compute.manager [req-420940d6-e8f4-4ca9-918c-87f39114a6de req-fc792871-7d08-4e8c-bf3d-aecb09349db4 service nova] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Refreshing instance network info cache due to event network-changed-0a73848e-3c30-4e3a-a8ef-3092afe91d25. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:17:26 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-420940d6-e8f4-4ca9-918c-87f39114a6de req-fc792871-7d08-4e8c-bf3d-aecb09349db4 service nova] Acquiring lock "refresh_cache-dd67db6c-8bd1-402e-93ce-9b2d7a405a6e" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:17:26 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-420940d6-e8f4-4ca9-918c-87f39114a6de req-fc792871-7d08-4e8c-bf3d-aecb09349db4 service nova] Acquired lock "refresh_cache-dd67db6c-8bd1-402e-93ce-9b2d7a405a6e" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:17:26 user nova-compute[75066]: DEBUG nova.network.neutron [req-420940d6-e8f4-4ca9-918c-87f39114a6de req-fc792871-7d08-4e8c-bf3d-aecb09349db4 service nova] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Refreshing network info cache for port 0a73848e-3c30-4e3a-a8ef-3092afe91d25 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:17:26 user nova-compute[75066]: DEBUG nova.network.neutron [req-420940d6-e8f4-4ca9-918c-87f39114a6de req-fc792871-7d08-4e8c-bf3d-aecb09349db4 service nova] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Updated VIF entry in instance network info cache for port 0a73848e-3c30-4e3a-a8ef-3092afe91d25. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:17:26 user nova-compute[75066]: DEBUG nova.network.neutron [req-420940d6-e8f4-4ca9-918c-87f39114a6de req-fc792871-7d08-4e8c-bf3d-aecb09349db4 service nova] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Updating instance_info_cache with network_info: [{"id": "0a73848e-3c30-4e3a-a8ef-3092afe91d25", "address": "fa:16:3e:14:de:da", "network": {"id": "8ab1e58c-73ec-479c-9da7-3fbb9b968fd7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-579378626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "163a9f68fa59476290f11dd2de613d79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a73848e-3c", "ovs_interfaceid": "0a73848e-3c30-4e3a-a8ef-3092afe91d25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:17:26 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-420940d6-e8f4-4ca9-918c-87f39114a6de req-fc792871-7d08-4e8c-bf3d-aecb09349db4 service nova] Releasing lock "refresh_cache-dd67db6c-8bd1-402e-93ce-9b2d7a405a6e" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:17:26 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:17:28 user nova-compute[75066]: DEBUG nova.compute.manager [req-874efb54-fb65-47b1-b4d2-fa8ac7ddcedd req-51901d6c-670f-4107-a93b-55074e31f093 service nova] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Received event network-changed-a6d11620-ab4c-4475-a3c6-3e2354955f95 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:17:28 user nova-compute[75066]: DEBUG nova.compute.manager [req-874efb54-fb65-47b1-b4d2-fa8ac7ddcedd req-51901d6c-670f-4107-a93b-55074e31f093 service nova] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Refreshing instance network info cache due to event network-changed-a6d11620-ab4c-4475-a3c6-3e2354955f95. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:17:28 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-874efb54-fb65-47b1-b4d2-fa8ac7ddcedd req-51901d6c-670f-4107-a93b-55074e31f093 service nova] Acquiring lock "refresh_cache-00ff7dfa-1da6-4e32-a227-0c194a5aa28f" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:17:28 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-874efb54-fb65-47b1-b4d2-fa8ac7ddcedd req-51901d6c-670f-4107-a93b-55074e31f093 service nova] Acquired lock "refresh_cache-00ff7dfa-1da6-4e32-a227-0c194a5aa28f" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:17:28 user nova-compute[75066]: DEBUG nova.network.neutron [req-874efb54-fb65-47b1-b4d2-fa8ac7ddcedd req-51901d6c-670f-4107-a93b-55074e31f093 service nova] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Refreshing network info cache for port a6d11620-ab4c-4475-a3c6-3e2354955f95 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:17:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d5087dbb-42b4-48dc-bbf6-8c24bfd27963 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] Acquiring lock "00ff7dfa-1da6-4e32-a227-0c194a5aa28f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:17:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d5087dbb-42b4-48dc-bbf6-8c24bfd27963 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] Lock "00ff7dfa-1da6-4e32-a227-0c194a5aa28f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:17:29 user nova-compute[75066]: DEBUG nova.objects.instance [None req-d5087dbb-42b4-48dc-bbf6-8c24bfd27963 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] Lazy-loading 'flavor' on Instance uuid 00ff7dfa-1da6-4e32-a227-0c194a5aa28f {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:17:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d5087dbb-42b4-48dc-bbf6-8c24bfd27963 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] Lock "00ff7dfa-1da6-4e32-a227-0c194a5aa28f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.104s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:17:29 user nova-compute[75066]: DEBUG nova.network.neutron [req-874efb54-fb65-47b1-b4d2-fa8ac7ddcedd req-51901d6c-670f-4107-a93b-55074e31f093 service nova] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Updated VIF entry in instance network info cache for port a6d11620-ab4c-4475-a3c6-3e2354955f95. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:17:29 user nova-compute[75066]: DEBUG nova.network.neutron [req-874efb54-fb65-47b1-b4d2-fa8ac7ddcedd req-51901d6c-670f-4107-a93b-55074e31f093 service nova] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Updating instance_info_cache with network_info: [{"id": "a6d11620-ab4c-4475-a3c6-3e2354955f95", "address": "fa:16:3e:93:04:1d", "network": {"id": "9a1a0a90-7233-4d75-93a7-3cb72a60e8dc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1583104105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "212e84a5aed6451fb2aa40a87de287d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d11620-ab", "ovs_interfaceid": "a6d11620-ab4c-4475-a3c6-3e2354955f95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:17:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-874efb54-fb65-47b1-b4d2-fa8ac7ddcedd req-51901d6c-670f-4107-a93b-55074e31f093 service nova] Releasing lock "refresh_cache-00ff7dfa-1da6-4e32-a227-0c194a5aa28f" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:17:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d5087dbb-42b4-48dc-bbf6-8c24bfd27963 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] Acquiring lock "00ff7dfa-1da6-4e32-a227-0c194a5aa28f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:17:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d5087dbb-42b4-48dc-bbf6-8c24bfd27963 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] Lock "00ff7dfa-1da6-4e32-a227-0c194a5aa28f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:17:29 user nova-compute[75066]: INFO nova.compute.manager [None req-d5087dbb-42b4-48dc-bbf6-8c24bfd27963 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Attaching volume c4bda540-193b-4278-a204-3c523dddb82d to /dev/vdb
Dec 01 19:17:29 user nova-compute[75066]: DEBUG os_brick.utils [None req-d5087dbb-42b4-48dc-bbf6-8c24bfd27963 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:17:29 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:29 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:29 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[956f5757-ff14-4e5d-b73c-8ab0e6351526]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1959854982f\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:29 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:29 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:29 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dee8e48-fd51-4997-bce1-5846737f1a44]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:29 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:29 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:29 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddd09f0b-3328-412d-9ec4-33192d06c875]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:29 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3bf6025-845a-498c-98c9-8371651f936a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:29 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-d5087dbb-42b4-48dc-bbf6-8c24bfd27963 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] Running cmd (subprocess): nvme version {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:29 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-d5087dbb-42b4-48dc-bbf6-8c24bfd27963 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:17:29 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d5087dbb-42b4-48dc-bbf6-8c24bfd27963 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] nvme not present on system {{(pid=75066) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 19:17:29 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:29 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:17:29 user nova-compute[75066]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 19:17:29 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d211c82-d215-4168-8a11-0868c8240000]: (4, '') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:29 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-d5087dbb-42b4-48dc-bbf6-8c24bfd27963 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75066) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 19:17:29 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-d5087dbb-42b4-48dc-bbf6-8c24bfd27963 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 19:17:29 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-d5087dbb-42b4-48dc-bbf6-8c24bfd27963 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] LIGHTOS: no hostnqn found. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 19:17:29 user nova-compute[75066]: DEBUG os_brick.utils [None req-d5087dbb-42b4-48dc-bbf6-8c24bfd27963 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1959854982f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:17:29 user nova-compute[75066]: DEBUG nova.virt.block_device [None req-d5087dbb-42b4-48dc-bbf6-8c24bfd27963 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Updating existing volume attachment record: a07b64ad-8273-4d69-8a1f-9f276b95299e {{(pid=75066) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 19:17:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:17:31 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:17:35 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:17:36 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4bad134-bc54-408f-a44b-3f30bef4b671 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Calling os-brick to attach iSCSI Volume {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 19:17:36 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4bad134-bc54-408f-a44b-3f30bef4b671 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FZWvItMl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:17:36 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-b4bad134-bc54-408f-a44b-3f30bef4b671 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:17:36 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-b4bad134-bc54-408f-a44b-3f30bef4b671 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:17:36 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-b4bad134-bc54-408f-a44b-3f30bef4b671 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:17:36 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-b4bad134-bc54-408f-a44b-3f30bef4b671 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:17:36 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-b4bad134-bc54-408f-a44b-3f30bef4b671 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:17:36 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-b4bad134-bc54-408f-a44b-3f30bef4b671 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:17:36 user nova-compute[75066]: INFO os_brick.initiator.connectors.iscsi [None req-b4bad134-bc54-408f-a44b-3f30bef4b671 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 19:17:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a -p 172.16.0.220:3260 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:36 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f27476-781e-46a0-8c3c-e415ce18a89e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:36 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4bad134-bc54-408f-a44b-3f30bef4b671 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 19:17:36 user nova-compute[75066]:  {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:17:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a -p 172.16.0.220:3260 --interface default --op new {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:36 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[512e9f4f-c416-4daa-99d3-c01c1fc4e2ee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a] added\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:36 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4bad134-bc54-408f-a44b-3f30bef4b671 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a] added
Dec 01 19:17:36 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:17:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:36 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7947039-018b-4536-b8eb-7d76a7d04ecb]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:36 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4bad134-bc54-408f-a44b-3f30bef4b671 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:17:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:36 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[032a6b80-88b7-4d4c-8c2f-aeed44f4f868]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:36 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4bad134-bc54-408f-a44b-3f30bef4b671 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:17:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FZWvItMl {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FZWvItMl" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:36 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ca6389-5b4a-4c4d-b1cf-be79989004c4]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:36 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4bad134-bc54-408f-a44b-3f30bef4b671 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FZWvItMl'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:17:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:36 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7186382-04f4-4c23-b42c-1fbb1133a28a]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:36 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4bad134-bc54-408f-a44b-3f30bef4b671 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:17:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:36 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80f761f-7722-4aa3-b17d-55284bbdaecb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:36 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4bad134-bc54-408f-a44b-3f30bef4b671 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)
Dec 01 19:17:36 user nova-compute[75066]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)
Dec 01 19:17:36 user nova-compute[75066]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a (non-flash)
Dec 01 19:17:36 user nova-compute[75066]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:17:36 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:17:36 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4bad134-bc54-408f-a44b-3f30bef4b671 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)
Dec 01 19:17:36 user nova-compute[75066]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)
Dec 01 19:17:36 user nova-compute[75066]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a (non-flash)
Dec 01 19:17:36 user nova-compute[75066]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:17:36 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:17:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a -p 172.16.0.220:3260 --login {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:36 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ccd61c-6015-4be8-a1eb-3dfca1cb15b1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:36 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4bad134-bc54-408f-a44b-3f30bef4b671 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a, portal: 172.16.0.220,3260]
Dec 01 19:17:36 user nova-compute[75066]: Login to [iface: default, target: iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a, portal: 172.16.0.220,3260] successful.
Dec 01 19:17:36 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:17:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:36 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb0e70b-bc49-4154-b814-354ddebf8a7e]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:36 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4bad134-bc54-408f-a44b-3f30bef4b671 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:17:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:36 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[33384357-5325-43dd-9df6-3fe274cd9de1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:36 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4bad134-bc54-408f-a44b-3f30bef4b671 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)
Dec 01 19:17:36 user nova-compute[75066]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)
Dec 01 19:17:36 user nova-compute[75066]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a (non-flash)
Dec 01 19:17:36 user nova-compute[75066]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:17:36 user nova-compute[75066]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a (non-flash)
Dec 01 19:17:36 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:17:36 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4bad134-bc54-408f-a44b-3f30bef4b671 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)
Dec 01 19:17:36 user nova-compute[75066]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)
Dec 01 19:17:36 user nova-compute[75066]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a (non-flash)
Dec 01 19:17:36 user nova-compute[75066]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:17:36 user nova-compute[75066]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a (non-flash)
Dec 01 19:17:36 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:17:36 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-b4bad134-bc54-408f-a44b-3f30bef4b671 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:17:36 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4bad134-bc54-408f-a44b-3f30bef4b671 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Connected to 172.16.0.220:3260 {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 19:17:36 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-b4bad134-bc54-408f-a44b-3f30bef4b671 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] HCTL ('36', '-', '-', 0) found on session 7 with lun 0 {{(pid=75066) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 19:17:36 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-b4bad134-bc54-408f-a44b-3f30bef4b671 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75066) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 19:17:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:36 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[c259d889-2703-4b17-9409-a5fc83164159]: (4, ('- - 0', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:36 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-b4bad134-bc54-408f-a44b-3f30bef4b671 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Searching for a device in session 7 and hctl ['36', '*', '*', 0] yield: None {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:17:36 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:17:37 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-b4bad134-bc54-408f-a44b-3f30bef4b671 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Searching for a device in session 7 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:17:37 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4bad134-bc54-408f-a44b-3f30bef4b671 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FZWvItMl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 19:17:37 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-b4bad134-bc54-408f-a44b-3f30bef4b671 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:17:37 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4bad134-bc54-408f-a44b-3f30bef4b671 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '26632313830303533', 'path': '/dev/sde'} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:17:37 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4bad134-bc54-408f-a44b-3f30bef4b671 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632313830303533', 'path': '/dev/sde'} {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 19:17:37 user nova-compute[75066]: DEBUG nova.objects.instance [None req-b4bad134-bc54-408f-a44b-3f30bef4b671 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Lazy-loading 'flavor' on Instance uuid dd67db6c-8bd1-402e-93ce-9b2d7a405a6e {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:17:37 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-b4bad134-bc54-408f-a44b-3f30bef4b671 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 19:17:37 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:17:37 user nova-compute[75066]:   <source dev="/dev/sde"/>
Dec 01 19:17:37 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:17:37 user nova-compute[75066]:   <serial>ae6d6a5d-9de3-4500-80b2-7c4860102e9a</serial>
Dec 01 19:17:37 user nova-compute[75066]: </disk>
Dec 01 19:17:37 user nova-compute[75066]:  {{(pid=75066) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 19:17:38 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b4bad134-bc54-408f-a44b-3f30bef4b671 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:17:38 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b4bad134-bc54-408f-a44b-3f30bef4b671 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:17:38 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b4bad134-bc54-408f-a44b-3f30bef4b671 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] No VIF found with MAC fa:16:3e:14:de:da, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:17:38 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b4bad134-bc54-408f-a44b-3f30bef4b671 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Lock "dd67db6c-8bd1-402e-93ce-9b2d7a405a6e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.216s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:17:39 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] Acquiring lock "dd67db6c-8bd1-402e-93ce-9b2d7a405a6e" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:17:39 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] Lock "dd67db6c-8bd1-402e-93ce-9b2d7a405a6e" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:17:39 user nova-compute[75066]: DEBUG os_brick.utils [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:17:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:39 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d28f9b-dfd6-4ac1-a6e8-40050d4faa7e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1959854982f\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:39 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[572e277c-d7dc-4358-aca3-16c082e16ede]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:39 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2fc33a-b5c5-4fe1-974c-5dd4288270b3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:39 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[c493ecac-ec0f-4083-811d-c9e52574ab2b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] Running cmd (subprocess): nvme version {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:17:39 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] nvme not present on system {{(pid=75066) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 19:17:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:17:39 user nova-compute[75066]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 19:17:39 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e45ad93-64ea-4f8e-8bbb-c533baa36317]: (4, '') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:39 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75066) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 19:17:39 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 19:17:39 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] LIGHTOS: no hostnqn found. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 19:17:39 user nova-compute[75066]: DEBUG os_brick.utils [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] <== get_connector_properties: return (473ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1959854982f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:17:40 user nova-compute[75066]: INFO nova.compute.manager [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Swapping volume ae6d6a5d-9de3-4500-80b2-7c4860102e9a for c10d14d8-bbda-434e-9572-40dfc759bd95
Dec 01 19:17:40 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:17:41 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:17:43 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e2f3d63-ef56-4009-9409-cb4b92e9a785 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] Calling os-brick to attach iSCSI Volume {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 19:17:43 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2f3d63-ef56-4009-9409-cb4b92e9a785 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fROQykSD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:17:43 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-1e2f3d63-ef56-4009-9409-cb4b92e9a785 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:17:43 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-1e2f3d63-ef56-4009-9409-cb4b92e9a785 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:17:43 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-1e2f3d63-ef56-4009-9409-cb4b92e9a785 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:17:43 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-1e2f3d63-ef56-4009-9409-cb4b92e9a785 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:17:43 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-1e2f3d63-ef56-4009-9409-cb4b92e9a785 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:17:43 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-1e2f3d63-ef56-4009-9409-cb4b92e9a785 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:17:43 user nova-compute[75066]: INFO os_brick.initiator.connectors.iscsi [None req-1e2f3d63-ef56-4009-9409-cb4b92e9a785 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 19:17:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b -p 172.16.0.220:3260 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:43 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcfb571b-f4e0-4ac5-acb8-256e9a28af20]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:43 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2f3d63-ef56-4009-9409-cb4b92e9a785 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 19:17:43 user nova-compute[75066]:  {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:17:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b -p 172.16.0.220:3260 --interface default --op new {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:43 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd06512-7241-4b14-9eea-d52c36822145]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b] added\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:43 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2f3d63-ef56-4009-9409-cb4b92e9a785 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b] added
Dec 01 19:17:43 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:17:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:43 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c28a8bc-ce19-4117-a25e-c761a390381e]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:43 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2f3d63-ef56-4009-9409-cb4b92e9a785 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:17:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:43 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5087dbb-42b4-48dc-bbf6-8c24bfd27963 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Calling os-brick to attach iSCSI Volume {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 19:17:43 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5087dbb-42b4-48dc-bbf6-8c24bfd27963 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UYOwfreh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:17:43 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-d5087dbb-42b4-48dc-bbf6-8c24bfd27963 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:17:43 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-d5087dbb-42b4-48dc-bbf6-8c24bfd27963 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:17:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:43 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e94c0d-d2b9-4a8e-9961-0d453cb546f8]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:43 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2f3d63-ef56-4009-9409-cb4b92e9a785 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:17:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fROQykSD {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fROQykSD" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:43 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df0e98d-739c-4a8f-b420-a7e1ac7675bc]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:43 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2f3d63-ef56-4009-9409-cb4b92e9a785 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fROQykSD'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:17:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:43 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[40517087-733e-47bf-a3d4-3243555cede3]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:43 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2f3d63-ef56-4009-9409-cb4b92e9a785 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:17:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:43 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[867be215-bd7e-4379-9abb-a9bef6e69b13]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:43 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2f3d63-ef56-4009-9409-cb4b92e9a785 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)
Dec 01 19:17:43 user nova-compute[75066]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)
Dec 01 19:17:43 user nova-compute[75066]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a (non-flash)
Dec 01 19:17:43 user nova-compute[75066]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:17:43 user nova-compute[75066]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a (non-flash)
Dec 01 19:17:43 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:17:43 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2f3d63-ef56-4009-9409-cb4b92e9a785 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)
Dec 01 19:17:43 user nova-compute[75066]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)
Dec 01 19:17:43 user nova-compute[75066]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a (non-flash)
Dec 01 19:17:43 user nova-compute[75066]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:17:43 user nova-compute[75066]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a (non-flash)
Dec 01 19:17:43 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:17:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b -p 172.16.0.220:3260 --login {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:43 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d92719-cfc1-44ac-876a-8344bb3cc3a3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:43 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2f3d63-ef56-4009-9409-cb4b92e9a785 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b, portal: 172.16.0.220,3260]
Dec 01 19:17:43 user nova-compute[75066]: Login to [iface: default, target: iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b, portal: 172.16.0.220,3260] successful.
Dec 01 19:17:43 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:17:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:43 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[758acdec-93ef-4918-96dc-2a0bcec7aa09]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:43 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2f3d63-ef56-4009-9409-cb4b92e9a785 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:17:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:43 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[68fbeba5-3758-462e-a0a7-87a61ca4d670]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:43 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2f3d63-ef56-4009-9409-cb4b92e9a785 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)
Dec 01 19:17:43 user nova-compute[75066]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)
Dec 01 19:17:43 user nova-compute[75066]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a (non-flash)
Dec 01 19:17:43 user nova-compute[75066]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:17:43 user nova-compute[75066]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a (non-flash)
Dec 01 19:17:43 user nova-compute[75066]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b (non-flash)
Dec 01 19:17:43 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:17:43 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2f3d63-ef56-4009-9409-cb4b92e9a785 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)
Dec 01 19:17:43 user nova-compute[75066]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)
Dec 01 19:17:43 user nova-compute[75066]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a (non-flash)
Dec 01 19:17:43 user nova-compute[75066]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:17:43 user nova-compute[75066]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a (non-flash)
Dec 01 19:17:43 user nova-compute[75066]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b (non-flash)
Dec 01 19:17:43 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:17:43 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-1e2f3d63-ef56-4009-9409-cb4b92e9a785 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:17:43 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2f3d63-ef56-4009-9409-cb4b92e9a785 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Connected to 172.16.0.220:3260 {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 19:17:43 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-1e2f3d63-ef56-4009-9409-cb4b92e9a785 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=75066) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 19:17:43 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-1e2f3d63-ef56-4009-9409-cb4b92e9a785 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75066) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 19:17:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:43 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[823402c5-2f1c-4752-824b-0d449c596712]: (4, ('- - 0', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:43 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-1e2f3d63-ef56-4009-9409-cb4b92e9a785 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:17:43 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2f3d63-ef56-4009-9409-cb4b92e9a785 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fROQykSD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 19:17:44 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-1e2f3d63-ef56-4009-9409-cb4b92e9a785 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:17:44 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1e2f3d63-ef56-4009-9409-cb4b92e9a785 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '26635383433313662', 'path': '/dev/sdg'} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:17:44 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1e2f3d63-ef56-4009-9409-cb4b92e9a785 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26635383433313662', 'path': '/dev/sdg'} {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 19:17:44 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-d5087dbb-42b4-48dc-bbf6-8c24bfd27963 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.278s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:17:44 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-d5087dbb-42b4-48dc-bbf6-8c24bfd27963 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:17:44 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-d5087dbb-42b4-48dc-bbf6-8c24bfd27963 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:17:44 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-d5087dbb-42b4-48dc-bbf6-8c24bfd27963 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:17:44 user nova-compute[75066]: INFO os_brick.initiator.connectors.iscsi [None req-d5087dbb-42b4-48dc-bbf6-8c24bfd27963 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 19:17:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d -p 172.16.0.220:3260 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:44 user nova-compute[75066]: DEBUG nova.objects.instance [None req-1e2f3d63-ef56-4009-9409-cb4b92e9a785 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Lazy-loading 'flavor' on Instance uuid f253bb0a-6cd0-4e62-8bcb-898537ce8c0b {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:17:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:44 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a7ec19-9ed2-4405-ae77-93460ac92c6b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:44 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5087dbb-42b4-48dc-bbf6-8c24bfd27963 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 19:17:44 user nova-compute[75066]:  {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:17:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d -p 172.16.0.220:3260 --interface default --op new {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:44 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-1e2f3d63-ef56-4009-9409-cb4b92e9a785 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 19:17:44 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:17:44 user nova-compute[75066]:   <source dev="/dev/sdg"/>
Dec 01 19:17:44 user nova-compute[75066]:   <target dev="sdc" bus="scsi"/>
Dec 01 19:17:44 user nova-compute[75066]:   <serial>6d9883cd-57eb-4dc1-aba6-442bb84b899b</serial>
Dec 01 19:17:44 user nova-compute[75066]:   <address type="drive" controller="0" unit="2"/>
Dec 01 19:17:44 user nova-compute[75066]: </disk>
Dec 01 19:17:44 user nova-compute[75066]:  {{(pid=75066) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 19:17:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:44 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e02a72-47e2-4a0c-b411-f0d3a426de52]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d] added\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:44 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5087dbb-42b4-48dc-bbf6-8c24bfd27963 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d] added
Dec 01 19:17:44 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:17:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:44 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8fa1f3e-1f90-4432-9211-ee13509c493e]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:44 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5087dbb-42b4-48dc-bbf6-8c24bfd27963 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:17:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:44 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1eb7e58-1df3-409c-aa01-8b9081a07de4]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:44 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5087dbb-42b4-48dc-bbf6-8c24bfd27963 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:17:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UYOwfreh {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UYOwfreh" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:44 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ee2551-c29f-4e11-96ce-84ffa3e14c24]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:44 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5087dbb-42b4-48dc-bbf6-8c24bfd27963 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UYOwfreh'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:17:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:44 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[1518401f-f496-428c-8ad0-92a1a3a7536c]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:44 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5087dbb-42b4-48dc-bbf6-8c24bfd27963 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:17:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:44 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c882b44-88b4-44a6-96b6-25596cdf79ec]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:44 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5087dbb-42b4-48dc-bbf6-8c24bfd27963 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)
Dec 01 19:17:44 user nova-compute[75066]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)
Dec 01 19:17:44 user nova-compute[75066]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a (non-flash)
Dec 01 19:17:44 user nova-compute[75066]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:17:44 user nova-compute[75066]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a (non-flash)
Dec 01 19:17:44 user nova-compute[75066]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b (non-flash)
Dec 01 19:17:44 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:17:44 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5087dbb-42b4-48dc-bbf6-8c24bfd27963 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)
Dec 01 19:17:44 user nova-compute[75066]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)
Dec 01 19:17:44 user nova-compute[75066]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a (non-flash)
Dec 01 19:17:44 user nova-compute[75066]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:17:44 user nova-compute[75066]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a (non-flash)
Dec 01 19:17:44 user nova-compute[75066]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b (non-flash)
Dec 01 19:17:44 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:17:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d -p 172.16.0.220:3260 --login {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:44 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b52045-3237-455d-a109-3582e8354a29]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:44 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5087dbb-42b4-48dc-bbf6-8c24bfd27963 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d, portal: 172.16.0.220,3260]
Dec 01 19:17:44 user nova-compute[75066]: Login to [iface: default, target: iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d, portal: 172.16.0.220,3260] successful.
Dec 01 19:17:44 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:17:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:44 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[49d8c440-4678-41d6-92d7-021088ced6de]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:44 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5087dbb-42b4-48dc-bbf6-8c24bfd27963 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:17:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:44 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c24eb45-8a62-43a8-a980-8d7f6b985f46]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:44 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5087dbb-42b4-48dc-bbf6-8c24bfd27963 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)
Dec 01 19:17:44 user nova-compute[75066]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)
Dec 01 19:17:44 user nova-compute[75066]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a (non-flash)
Dec 01 19:17:44 user nova-compute[75066]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:17:44 user nova-compute[75066]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a (non-flash)
Dec 01 19:17:44 user nova-compute[75066]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b (non-flash)
Dec 01 19:17:44 user nova-compute[75066]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d (non-flash)
Dec 01 19:17:44 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:17:44 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5087dbb-42b4-48dc-bbf6-8c24bfd27963 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)
Dec 01 19:17:44 user nova-compute[75066]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)
Dec 01 19:17:44 user nova-compute[75066]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a (non-flash)
Dec 01 19:17:44 user nova-compute[75066]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:17:44 user nova-compute[75066]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a (non-flash)
Dec 01 19:17:44 user nova-compute[75066]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b (non-flash)
Dec 01 19:17:44 user nova-compute[75066]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d (non-flash)
Dec 01 19:17:44 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:17:44 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-d5087dbb-42b4-48dc-bbf6-8c24bfd27963 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:17:44 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5087dbb-42b4-48dc-bbf6-8c24bfd27963 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] Connected to 172.16.0.220:3260 {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 19:17:44 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-d5087dbb-42b4-48dc-bbf6-8c24bfd27963 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=75066) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 19:17:44 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-d5087dbb-42b4-48dc-bbf6-8c24bfd27963 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=75066) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 19:17:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:44 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b10bb1-b929-4d6d-ae55-c49ae3091ebd]: (4, ('- - 0', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:44 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-d5087dbb-42b4-48dc-bbf6-8c24bfd27963 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:17:44 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5087dbb-42b4-48dc-bbf6-8c24bfd27963 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UYOwfreh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 19:17:45 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-1e2f3d63-ef56-4009-9409-cb4b92e9a785 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] No BDM found with device name sda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:17:45 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-1e2f3d63-ef56-4009-9409-cb4b92e9a785 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:17:45 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-1e2f3d63-ef56-4009-9409-cb4b92e9a785 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:17:45 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-1e2f3d63-ef56-4009-9409-cb4b92e9a785 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] No VIF found with MAC fa:16:3e:88:28:51, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:17:45 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-1e2f3d63-ef56-4009-9409-cb4b92e9a785 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Lock "f253bb0a-6cd0-4e62-8bcb-898537ce8c0b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.953s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:17:45 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:17:45 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-d5087dbb-42b4-48dc-bbf6-8c24bfd27963 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.358s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:17:45 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5087dbb-42b4-48dc-bbf6-8c24bfd27963 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] <== connect_volume: return (2636ms) {'type': 'block', 'scsi_wwn': '23638613738346162', 'path': '/dev/sdh'} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:17:45 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5087dbb-42b4-48dc-bbf6-8c24bfd27963 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638613738346162', 'path': '/dev/sdh'} {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 19:17:45 user nova-compute[75066]: DEBUG nova.objects.instance [None req-d5087dbb-42b4-48dc-bbf6-8c24bfd27963 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] Lazy-loading 'flavor' on Instance uuid 00ff7dfa-1da6-4e32-a227-0c194a5aa28f {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:17:45 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-d5087dbb-42b4-48dc-bbf6-8c24bfd27963 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] attach device xml: <disk type="block" device="disk">
Dec 01 19:17:45 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:17:45 user nova-compute[75066]:   <source dev="/dev/sdh"/>
Dec 01 19:17:45 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:17:45 user nova-compute[75066]:   <serial>c4bda540-193b-4278-a204-3c523dddb82d</serial>
Dec 01 19:17:45 user nova-compute[75066]: </disk>
Dec 01 19:17:45 user nova-compute[75066]:  {{(pid=75066) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 19:17:45 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-1646ec75-e7c3-4e10-867d-c6888be74e93 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Acquiring lock "f253bb0a-6cd0-4e62-8bcb-898537ce8c0b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:17:45 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-1646ec75-e7c3-4e10-867d-c6888be74e93 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Lock "f253bb0a-6cd0-4e62-8bcb-898537ce8c0b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:17:46 user nova-compute[75066]: INFO nova.compute.manager [None req-1646ec75-e7c3-4e10-867d-c6888be74e93 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] Detaching volume 6d9883cd-57eb-4dc1-aba6-442bb84b899b
Dec 01 19:17:46 user nova-compute[75066]: INFO nova.virt.block_device [None req-1646ec75-e7c3-4e10-867d-c6888be74e93 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] Attempting to driver detach volume 6d9883cd-57eb-4dc1-aba6-442bb84b899b from mountpoint /dev/sdc
Dec 01 19:17:46 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-1646ec75-e7c3-4e10-867d-c6888be74e93 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Attempting to detach device sdc from instance f253bb0a-6cd0-4e62-8bcb-898537ce8c0b from the persistent domain config. {{(pid=75066) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 19:17:46 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-1646ec75-e7c3-4e10-867d-c6888be74e93 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 19:17:46 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:17:46 user nova-compute[75066]:   <source dev="/dev/sdg"/>
Dec 01 19:17:46 user nova-compute[75066]:   <target dev="sdc" bus="scsi"/>
Dec 01 19:17:46 user nova-compute[75066]:   <serial>6d9883cd-57eb-4dc1-aba6-442bb84b899b</serial>
Dec 01 19:17:46 user nova-compute[75066]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Dec 01 19:17:46 user nova-compute[75066]: </disk>
Dec 01 19:17:46 user nova-compute[75066]:  {{(pid=75066) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 19:17:46 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-1646ec75-e7c3-4e10-867d-c6888be74e93 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Successfully detached device sdc from instance f253bb0a-6cd0-4e62-8bcb-898537ce8c0b from the persistent domain config.
Dec 01 19:17:46 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-1646ec75-e7c3-4e10-867d-c6888be74e93 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance f253bb0a-6cd0-4e62-8bcb-898537ce8c0b from the live domain config. {{(pid=75066) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 19:17:46 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-1646ec75-e7c3-4e10-867d-c6888be74e93 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 19:17:46 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:17:46 user nova-compute[75066]:   <source dev="/dev/sdg"/>
Dec 01 19:17:46 user nova-compute[75066]:   <target dev="sdc" bus="scsi"/>
Dec 01 19:17:46 user nova-compute[75066]:   <serial>6d9883cd-57eb-4dc1-aba6-442bb84b899b</serial>
Dec 01 19:17:46 user nova-compute[75066]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Dec 01 19:17:46 user nova-compute[75066]: </disk>
Dec 01 19:17:46 user nova-compute[75066]:  {{(pid=75066) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 19:17:46 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-1646ec75-e7c3-4e10-867d-c6888be74e93 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance f253bb0a-6cd0-4e62-8bcb-898537ce8c0b {{(pid=75066) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 19:17:46 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-d5087dbb-42b4-48dc-bbf6-8c24bfd27963 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:17:46 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-d5087dbb-42b4-48dc-bbf6-8c24bfd27963 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:17:46 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-d5087dbb-42b4-48dc-bbf6-8c24bfd27963 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] No VIF found with MAC fa:16:3e:93:04:1d, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:17:46 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d5087dbb-42b4-48dc-bbf6-8c24bfd27963 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] Lock "00ff7dfa-1da6-4e32-a227-0c194a5aa28f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.339s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:17:46 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:17:47 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-35b7b424-8bac-48bf-975a-aaa3fc63ccec tempest-VolumesAssistedSnapshotsTest-1760824435 tempest-VolumesAssistedSnapshotsTest-1760824435-project] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] volume_snapshot_create: create_info: {'snapshot_id': '76df5081-d5e4-4e21-9537-f458458fc639', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75066) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3572}}
Dec 01 19:17:47 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-35b7b424-8bac-48bf-975a-aaa3fc63ccec tempest-VolumesAssistedSnapshotsTest-1760824435 tempest-VolumesAssistedSnapshotsTest-1760824435-project] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] snap xml: <domainsnapshot>
Dec 01 19:17:47 user nova-compute[75066]:   <disks>
Dec 01 19:17:47 user nova-compute[75066]:     <disk name="/dev/sdh" snapshot="external" type="file">
Dec 01 19:17:47 user nova-compute[75066]:       <source file="/dev/new_file"/>
Dec 01 19:17:47 user nova-compute[75066]:     </disk>
Dec 01 19:17:47 user nova-compute[75066]:     <disk name="vda" snapshot="no"/>
Dec 01 19:17:47 user nova-compute[75066]:   </disks>
Dec 01 19:17:47 user nova-compute[75066]: </domainsnapshot>
Dec 01 19:17:47 user nova-compute[75066]:  {{(pid=75066) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3513}}
Dec 01 19:17:47 user nova-compute[75066]: DEBUG nova.objects.instance [None req-35b7b424-8bac-48bf-975a-aaa3fc63ccec tempest-VolumesAssistedSnapshotsTest-1760824435 tempest-VolumesAssistedSnapshotsTest-1760824435-project] Lazy-loading 'system_metadata' on Instance uuid 00ff7dfa-1da6-4e32-a227-0c194a5aa28f {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:17:47 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-35b7b424-8bac-48bf-975a-aaa3fc63ccec tempest-VolumesAssistedSnapshotsTest-1760824435 tempest-VolumesAssistedSnapshotsTest-1760824435-project] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Skipping quiescing instance: QEMU guest agent is not enabled.
Dec 01 19:17:47 user nova-compute[75066]: ERROR nova.virt.libvirt.driver [None req-35b7b424-8bac-48bf-975a-aaa3fc63ccec tempest-VolumesAssistedSnapshotsTest-1760824435 tempest-VolumesAssistedSnapshotsTest-1760824435-project] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Dec 01 19:17:47 user nova-compute[75066]: ERROR nova.virt.libvirt.driver [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Traceback (most recent call last):
Dec 01 19:17:47 user nova-compute[75066]: ERROR nova.virt.libvirt.driver [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3540, in _volume_snapshot_create
Dec 01 19:17:47 user nova-compute[75066]: ERROR nova.virt.libvirt.driver [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Dec 01 19:17:47 user nova-compute[75066]: ERROR nova.virt.libvirt.driver [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Dec 01 19:17:47 user nova-compute[75066]: ERROR nova.virt.libvirt.driver [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Dec 01 19:17:47 user nova-compute[75066]: ERROR nova.virt.libvirt.driver [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Dec 01 19:17:47 user nova-compute[75066]: ERROR nova.virt.libvirt.driver [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Dec 01 19:17:47 user nova-compute[75066]: ERROR nova.virt.libvirt.driver [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Dec 01 19:17:47 user nova-compute[75066]: ERROR nova.virt.libvirt.driver [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f]     rv = execute(f, *args, **kwargs)
Dec 01 19:17:47 user nova-compute[75066]: ERROR nova.virt.libvirt.driver [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Dec 01 19:17:47 user nova-compute[75066]: ERROR nova.virt.libvirt.driver [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f]     six.reraise(c, e, tb)
Dec 01 19:17:47 user nova-compute[75066]: ERROR nova.virt.libvirt.driver [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Dec 01 19:17:47 user nova-compute[75066]: ERROR nova.virt.libvirt.driver [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f]     raise value
Dec 01 19:17:47 user nova-compute[75066]: ERROR nova.virt.libvirt.driver [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Dec 01 19:17:47 user nova-compute[75066]: ERROR nova.virt.libvirt.driver [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f]     rv = meth(*args, **kwargs)
Dec 01 19:17:47 user nova-compute[75066]: ERROR nova.virt.libvirt.driver [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Dec 01 19:17:47 user nova-compute[75066]: ERROR nova.virt.libvirt.driver [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Dec 01 19:17:47 user nova-compute[75066]: ERROR nova.virt.libvirt.driver [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Dec 01 19:17:47 user nova-compute[75066]: ERROR nova.virt.libvirt.driver [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] 
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver [None req-35b7b424-8bac-48bf-975a-aaa3fc63ccec tempest-VolumesAssistedSnapshotsTest-1760824435 tempest-VolumesAssistedSnapshotsTest-1760824435-project] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Traceback (most recent call last):
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3590, in volume_snapshot_create
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f]     self._volume_snapshot_create(context, instance, guest,
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3540, in _volume_snapshot_create
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f]     rv = execute(f, *args, **kwargs)
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f]     six.reraise(c, e, tb)
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f]     raise value
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f]     rv = meth(*args, **kwargs)
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] 
Dec 01 19:17:48 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c1d8c166-8c3d-4b0c-b0b5-82bc4c98f024 tempest-VolumesAssistedSnapshotsTest-1760824435 tempest-VolumesAssistedSnapshotsTest-1760824435-project] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] volume_snapshot_delete: delete_info: {'volume_id': 'c4bda540-193b-4278-a204-3c523dddb82d'} {{(pid=75066) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3673}}
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver [None req-c1d8c166-8c3d-4b0c-b0b5-82bc4c98f024 tempest-VolumesAssistedSnapshotsTest-1760824435 tempest-VolumesAssistedSnapshotsTest-1760824435-project] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Traceback (most recent call last):
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3846, in volume_snapshot_delete
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f]     self._volume_snapshot_delete(context, instance, volume_id,
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3676, in _volume_snapshot_delete
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f]     if delete_info['type'] != 'qcow2':
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] KeyError: 'type'
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] 
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver [None req-35b7b424-8bac-48bf-975a-aaa3fc63ccec tempest-VolumesAssistedSnapshotsTest-1760824435 tempest-VolumesAssistedSnapshotsTest-1760824435-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 76df5081-d5e4-4e21-9537-f458458fc639 could not be found.
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3590, in volume_snapshot_create
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3540, in _volume_snapshot_create
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver     raise value
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver 
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver 
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 76df5081-d5e4-4e21-9537-f458458fc639 could not be found. (HTTP 404) (Request-ID: req-7c4bfbb7-eb8c-44eb-a583-cf4ae4517102)
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver 
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver 
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3412, in _volume_snapshot_update_status
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 76df5081-d5e4-4e21-9537-f458458fc639 could not be found.
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver 
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server [None req-35b7b424-8bac-48bf-975a-aaa3fc63ccec tempest-VolumesAssistedSnapshotsTest-1760824435 tempest-VolumesAssistedSnapshotsTest-1760824435-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server     raise self.value
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3593, in volume_snapshot_create
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server     raise self.value
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3590, in volume_snapshot_create
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3540, in _volume_snapshot_create
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server     raise value
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server 
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver [None req-c1d8c166-8c3d-4b0c-b0b5-82bc4c98f024 tempest-VolumesAssistedSnapshotsTest-1760824435 tempest-VolumesAssistedSnapshotsTest-1760824435-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3846, in volume_snapshot_delete
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3676, in _volume_snapshot_delete
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver 
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver 
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-d7a5d89d-8baa-4786-ab8c-2d35d39ff719)
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver 
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver 
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3412, in _volume_snapshot_update_status
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Dec 01 19:17:48 user nova-compute[75066]: ERROR nova.virt.libvirt.driver 
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server [None req-c1d8c166-8c3d-4b0c-b0b5-82bc4c98f024 tempest-VolumesAssistedSnapshotsTest-1760824435 tempest-VolumesAssistedSnapshotsTest-1760824435-project] Exception during message handling: KeyError: 'type'
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server     raise self.value
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3849, in volume_snapshot_delete
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server     raise self.value
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3846, in volume_snapshot_delete
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3676, in _volume_snapshot_delete
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Dec 01 19:17:48 user nova-compute[75066]: ERROR oslo_messaging.rpc.server 
Dec 01 19:17:48 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-2f9b1fbb-d219-4548-92cd-a6f528048b07 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] Acquiring lock "00ff7dfa-1da6-4e32-a227-0c194a5aa28f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:17:48 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-2f9b1fbb-d219-4548-92cd-a6f528048b07 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] Lock "00ff7dfa-1da6-4e32-a227-0c194a5aa28f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:17:48 user nova-compute[75066]: INFO nova.compute.manager [None req-2f9b1fbb-d219-4548-92cd-a6f528048b07 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Detaching volume c4bda540-193b-4278-a204-3c523dddb82d
Dec 01 19:17:48 user nova-compute[75066]: INFO nova.virt.block_device [None req-2f9b1fbb-d219-4548-92cd-a6f528048b07 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Attempting to driver detach volume c4bda540-193b-4278-a204-3c523dddb82d from mountpoint /dev/vdb
Dec 01 19:17:48 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-2f9b1fbb-d219-4548-92cd-a6f528048b07 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] Attempting to detach device vdb from instance 00ff7dfa-1da6-4e32-a227-0c194a5aa28f from the persistent domain config. {{(pid=75066) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 19:17:48 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-2f9b1fbb-d219-4548-92cd-a6f528048b07 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] detach device xml: <disk type="block" device="disk">
Dec 01 19:17:48 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:17:48 user nova-compute[75066]:   <source dev="/dev/sdh"/>
Dec 01 19:17:48 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:17:48 user nova-compute[75066]:   <serial>c4bda540-193b-4278-a204-3c523dddb82d</serial>
Dec 01 19:17:48 user nova-compute[75066]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 19:17:48 user nova-compute[75066]: </disk>
Dec 01 19:17:48 user nova-compute[75066]:  {{(pid=75066) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 19:17:48 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-2f9b1fbb-d219-4548-92cd-a6f528048b07 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] Successfully detached device vdb from instance 00ff7dfa-1da6-4e32-a227-0c194a5aa28f from the persistent domain config.
Dec 01 19:17:48 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-2f9b1fbb-d219-4548-92cd-a6f528048b07 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 00ff7dfa-1da6-4e32-a227-0c194a5aa28f from the live domain config. {{(pid=75066) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 19:17:48 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-2f9b1fbb-d219-4548-92cd-a6f528048b07 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] detach device xml: <disk type="block" device="disk">
Dec 01 19:17:48 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:17:48 user nova-compute[75066]:   <source dev="/dev/sdh"/>
Dec 01 19:17:48 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:17:48 user nova-compute[75066]:   <serial>c4bda540-193b-4278-a204-3c523dddb82d</serial>
Dec 01 19:17:48 user nova-compute[75066]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 19:17:48 user nova-compute[75066]: </disk>
Dec 01 19:17:48 user nova-compute[75066]:  {{(pid=75066) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 19:17:48 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-2f9b1fbb-d219-4548-92cd-a6f528048b07 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 00ff7dfa-1da6-4e32-a227-0c194a5aa28f {{(pid=75066) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 19:17:50 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:17:50 user nova-compute[75066]: DEBUG nova.compute.manager [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JBmryjgn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dd67db6c-8bd1-402e-93ce-9b2d7a405a6e', 'attached_at': '', 'detached_at': '', 'volume_id': 'c10d14d8-bbda-434e-9572-40dfc759bd95', 'serial': 'c10d14d8-bbda-434e-9572-40dfc759bd95'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FZWvItMl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'dd67db6c-8bd1-402e-93ce-9b2d7a405a6e', 'attached_at': '', 'detached_at': '', 'volume_id': 'ae6d6a5d-9de3-4500-80b2-7c4860102e9a', 'serial'} {{(pid=75066) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Dec 01 19:17:50 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Calling os-brick to attach iSCSI Volume {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 19:17:50 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JBmryjgn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:17:50 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:17:50 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:17:50 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:17:50 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:17:50 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:17:50 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:17:50 user nova-compute[75066]: INFO os_brick.initiator.connectors.iscsi [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 19:17:50 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95 -p 172.16.0.220:3260 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:50 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:50 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e27398-9b84-474a-ac2e-6c83416de666]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:50 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 19:17:50 user nova-compute[75066]:  {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:17:50 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95 -p 172.16.0.220:3260 --interface default --op new {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:50 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:50 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7fa078c-abac-4e32-b3f6-8171f48c3172]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95] added\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:50 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95] added
Dec 01 19:17:50 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:17:50 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:50 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:50 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[47029533-2da3-438a-84f2-2d317d8ce541]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:50 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:17:50 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:50 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.068s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:50 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eb26656-f078-4b7d-8c1b-8f57e8d1985b]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:50 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:17:50 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JBmryjgn {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:50 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JBmryjgn" returned: 0 in 0.046s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:50 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[70875966-e95d-4188-af1a-b24e8cadfe63]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:50 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JBmryjgn'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:17:50 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:50 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.036s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:50 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ebebcc-8593-4179-9091-57cbdbcf4a33]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:50 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:17:50 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:50 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:50 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f5e72f-5682-4209-b1f3-039d13dedb8e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:50 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)
Dec 01 19:17:50 user nova-compute[75066]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)
Dec 01 19:17:50 user nova-compute[75066]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a (non-flash)
Dec 01 19:17:50 user nova-compute[75066]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:17:50 user nova-compute[75066]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a (non-flash)
Dec 01 19:17:50 user nova-compute[75066]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b (non-flash)
Dec 01 19:17:50 user nova-compute[75066]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d (non-flash)
Dec 01 19:17:50 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:17:50 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)
Dec 01 19:17:50 user nova-compute[75066]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)
Dec 01 19:17:50 user nova-compute[75066]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a (non-flash)
Dec 01 19:17:50 user nova-compute[75066]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:17:50 user nova-compute[75066]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a (non-flash)
Dec 01 19:17:50 user nova-compute[75066]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b (non-flash)
Dec 01 19:17:50 user nova-compute[75066]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d (non-flash)
Dec 01 19:17:50 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:17:50 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95 -p 172.16.0.220:3260 --login {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:50 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:50 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe920c8-1654-49ba-b26e-ccc973b07f31]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:50 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95, portal: 172.16.0.220,3260]
Dec 01 19:17:50 user nova-compute[75066]: Login to [iface: default, target: iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95, portal: 172.16.0.220,3260] successful.
Dec 01 19:17:50 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:17:50 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:50 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:50 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[654498e8-fc07-44fc-aa0c-e700595b2296]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:50 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:17:50 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:50 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:50 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[35bbc5a4-a932-4c21-98a5-d5bc8b1a6b8d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:50 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95 (non-flash)
Dec 01 19:17:50 user nova-compute[75066]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)
Dec 01 19:17:50 user nova-compute[75066]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)
Dec 01 19:17:50 user nova-compute[75066]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a (non-flash)
Dec 01 19:17:50 user nova-compute[75066]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:17:50 user nova-compute[75066]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a (non-flash)
Dec 01 19:17:50 user nova-compute[75066]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b (non-flash)
Dec 01 19:17:50 user nova-compute[75066]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d (non-flash)
Dec 01 19:17:50 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:17:50 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95 (non-flash)
Dec 01 19:17:50 user nova-compute[75066]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)
Dec 01 19:17:50 user nova-compute[75066]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)
Dec 01 19:17:50 user nova-compute[75066]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a (non-flash)
Dec 01 19:17:50 user nova-compute[75066]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:17:50 user nova-compute[75066]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a (non-flash)
Dec 01 19:17:50 user nova-compute[75066]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b (non-flash)
Dec 01 19:17:50 user nova-compute[75066]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d (non-flash)
Dec 01 19:17:50 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:17:50 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.507s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:17:50 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] Connected to 172.16.0.220:3260 {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 19:17:50 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=75066) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 19:17:50 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=75066) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 19:17:50 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:51 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.022s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:51 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[6171701a-7c8e-4756-a380-07ad88be3138]: (4, ('- - 0', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:51 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:17:51 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JBmryjgn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 19:17:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5131542f-0967-42f8-a8b3-6db8e45945bb tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Acquiring lock "47bd5998-8ded-4a9c-8b98-f0658a526f47" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:17:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5131542f-0967-42f8-a8b3-6db8e45945bb tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Lock "47bd5998-8ded-4a9c-8b98-f0658a526f47" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:17:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5131542f-0967-42f8-a8b3-6db8e45945bb tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Acquiring lock "47bd5998-8ded-4a9c-8b98-f0658a526f47-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:17:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5131542f-0967-42f8-a8b3-6db8e45945bb tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Lock "47bd5998-8ded-4a9c-8b98-f0658a526f47-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:17:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5131542f-0967-42f8-a8b3-6db8e45945bb tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Lock "47bd5998-8ded-4a9c-8b98-f0658a526f47-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:17:51 user nova-compute[75066]: INFO nova.compute.manager [None req-5131542f-0967-42f8-a8b3-6db8e45945bb tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] [instance: 47bd5998-8ded-4a9c-8b98-f0658a526f47] Terminating instance
Dec 01 19:17:51 user nova-compute[75066]: DEBUG nova.compute.manager [None req-5131542f-0967-42f8-a8b3-6db8e45945bb tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] [instance: 47bd5998-8ded-4a9c-8b98-f0658a526f47] Start destroying the instance on the hypervisor. {{(pid=75066) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 19:17:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:17:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:17:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:17:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:17:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:17:51 user nova-compute[75066]: DEBUG nova.compute.manager [req-193fc02f-edb9-41ad-a924-0d08da49708f req-e0ae43d2-2506-449b-bbc1-c775981579c1 service nova] [instance: 47bd5998-8ded-4a9c-8b98-f0658a526f47] Received event network-vif-unplugged-fd31d06c-eab4-4e76-a35b-ca65d171d3c5 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:17:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-193fc02f-edb9-41ad-a924-0d08da49708f req-e0ae43d2-2506-449b-bbc1-c775981579c1 service nova] Acquiring lock "47bd5998-8ded-4a9c-8b98-f0658a526f47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:17:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-193fc02f-edb9-41ad-a924-0d08da49708f req-e0ae43d2-2506-449b-bbc1-c775981579c1 service nova] Lock "47bd5998-8ded-4a9c-8b98-f0658a526f47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:17:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-193fc02f-edb9-41ad-a924-0d08da49708f req-e0ae43d2-2506-449b-bbc1-c775981579c1 service nova] Lock "47bd5998-8ded-4a9c-8b98-f0658a526f47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:17:51 user nova-compute[75066]: DEBUG nova.compute.manager [req-193fc02f-edb9-41ad-a924-0d08da49708f req-e0ae43d2-2506-449b-bbc1-c775981579c1 service nova] [instance: 47bd5998-8ded-4a9c-8b98-f0658a526f47] No waiting events found dispatching network-vif-unplugged-fd31d06c-eab4-4e76-a35b-ca65d171d3c5 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:17:51 user nova-compute[75066]: DEBUG nova.compute.manager [req-193fc02f-edb9-41ad-a924-0d08da49708f req-e0ae43d2-2506-449b-bbc1-c775981579c1 service nova] [instance: 47bd5998-8ded-4a9c-8b98-f0658a526f47] Received event network-vif-unplugged-fd31d06c-eab4-4e76-a35b-ca65d171d3c5 for instance with task_state deleting. {{(pid=75066) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 19:17:52 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.549s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:17:52 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] <== connect_volume: return (1551ms) {'type': 'block', 'scsi_wwn': '23666316431313836', 'path': '/dev/sdi'} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:17:52 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23666316431313836', 'path': '/dev/sdi'} {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 19:17:52 user nova-compute[75066]: DEBUG nova.objects.instance [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] Lazy-loading 'flavor' on Instance uuid dd67db6c-8bd1-402e-93ce-9b2d7a405a6e {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:17:52 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 47bd5998-8ded-4a9c-8b98-f0658a526f47] Instance destroyed successfully.
Dec 01 19:17:52 user nova-compute[75066]: DEBUG nova.objects.instance [None req-5131542f-0967-42f8-a8b3-6db8e45945bb tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Lazy-loading 'resources' on Instance uuid 47bd5998-8ded-4a9c-8b98-f0658a526f47 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:17:52 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-5131542f-0967-42f8-a8b3-6db8e45945bb tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:15:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1736469981',display_name='tempest-VolumesActionsTest-instance-1736469981',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1736469981',id=9,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:16:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='588c6f5a3e3c4427887e9dab6fb17cb2',ramdisk_id='',reservation_id='r-8ewqcnqi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-580795590',owner_user_name='tempest-VolumesActionsTest-580795590-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:16:01Z,user_data=None,user_id='810ed8c7290946fc87c1b95c8b574150',uuid=47bd5998-8ded-4a9c-8b98-f0658a526f47,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd31d06c-eab4-4e76-a35b-ca65d171d3c5", "address": "fa:16:3e:ce:12:83", "network": {"id": "c348a6f7-f0af-42c3-9464-a81ae42a7890", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1057676448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "588c6f5a3e3c4427887e9dab6fb17cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd31d06c-ea", "ovs_interfaceid": "fd31d06c-eab4-4e76-a35b-ca65d171d3c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:17:52 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-5131542f-0967-42f8-a8b3-6db8e45945bb tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Converting VIF {"id": "fd31d06c-eab4-4e76-a35b-ca65d171d3c5", "address": "fa:16:3e:ce:12:83", "network": {"id": "c348a6f7-f0af-42c3-9464-a81ae42a7890", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1057676448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "588c6f5a3e3c4427887e9dab6fb17cb2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd31d06c-ea", "ovs_interfaceid": "fd31d06c-eab4-4e76-a35b-ca65d171d3c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:17:52 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-5131542f-0967-42f8-a8b3-6db8e45945bb tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:12:83,bridge_name='br-int',has_traffic_filtering=True,id=fd31d06c-eab4-4e76-a35b-ca65d171d3c5,network=Network(c348a6f7-f0af-42c3-9464-a81ae42a7890),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd31d06c-ea') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:17:52 user nova-compute[75066]: DEBUG os_vif [None req-5131542f-0967-42f8-a8b3-6db8e45945bb tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:12:83,bridge_name='br-int',has_traffic_filtering=True,id=fd31d06c-eab4-4e76-a35b-ca65d171d3c5,network=Network(c348a6f7-f0af-42c3-9464-a81ae42a7890),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd31d06c-ea') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:17:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:17:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd31d06c-ea, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:17:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:17:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:17:52 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75066) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 19:17:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:17:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:17:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ed06a933-c2ae-420d-bbcf-4947799da450) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:17:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:17:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:17:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:17:52 user nova-compute[75066]: INFO os_vif [None req-5131542f-0967-42f8-a8b3-6db8e45945bb tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:12:83,bridge_name='br-int',has_traffic_filtering=True,id=fd31d06c-eab4-4e76-a35b-ca65d171d3c5,network=Network(c348a6f7-f0af-42c3-9464-a81ae42a7890),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd31d06c-ea')
Dec 01 19:17:52 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-5131542f-0967-42f8-a8b3-6db8e45945bb tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] [instance: 47bd5998-8ded-4a9c-8b98-f0658a526f47] Deleting instance files /opt/stack/data/nova/instances/47bd5998-8ded-4a9c-8b98-f0658a526f47_del
Dec 01 19:17:52 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-5131542f-0967-42f8-a8b3-6db8e45945bb tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] [instance: 47bd5998-8ded-4a9c-8b98-f0658a526f47] Deletion of /opt/stack/data/nova/instances/47bd5998-8ded-4a9c-8b98-f0658a526f47_del complete
Dec 01 19:17:52 user nova-compute[75066]: INFO nova.compute.manager [None req-5131542f-0967-42f8-a8b3-6db8e45945bb tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] [instance: 47bd5998-8ded-4a9c-8b98-f0658a526f47] Took 1.19 seconds to destroy the instance on the hypervisor.
Dec 01 19:17:52 user nova-compute[75066]: DEBUG oslo.service.loopingcall [None req-5131542f-0967-42f8-a8b3-6db8e45945bb tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75066) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 19:17:52 user nova-compute[75066]: DEBUG nova.compute.manager [-] [instance: 47bd5998-8ded-4a9c-8b98-f0658a526f47] Deallocating network for instance {{(pid=75066) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 19:17:52 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: 47bd5998-8ded-4a9c-8b98-f0658a526f47] deallocate_for_instance() {{(pid=75066) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 19:17:53 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] COPY block job progress, current cursor: 154140672 final cursor: 1073741824 {{(pid=75066) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 19:17:53 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: 47bd5998-8ded-4a9c-8b98-f0658a526f47] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:17:53 user nova-compute[75066]: DEBUG nova.compute.manager [req-73a614cf-55f7-49a2-a84a-e0aaa2b4a735 req-8556e779-fdbb-4819-bddc-ac7f6c76a04e service nova] [instance: 47bd5998-8ded-4a9c-8b98-f0658a526f47] Received event network-vif-deleted-fd31d06c-eab4-4e76-a35b-ca65d171d3c5 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:17:53 user nova-compute[75066]: INFO nova.compute.manager [req-73a614cf-55f7-49a2-a84a-e0aaa2b4a735 req-8556e779-fdbb-4819-bddc-ac7f6c76a04e service nova] [instance: 47bd5998-8ded-4a9c-8b98-f0658a526f47] Neutron deleted interface fd31d06c-eab4-4e76-a35b-ca65d171d3c5; detaching it from the instance and deleting it from the info cache
Dec 01 19:17:53 user nova-compute[75066]: DEBUG nova.network.neutron [req-73a614cf-55f7-49a2-a84a-e0aaa2b4a735 req-8556e779-fdbb-4819-bddc-ac7f6c76a04e service nova] [instance: 47bd5998-8ded-4a9c-8b98-f0658a526f47] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:17:53 user nova-compute[75066]: INFO nova.compute.manager [-] [instance: 47bd5998-8ded-4a9c-8b98-f0658a526f47] Took 0.64 seconds to deallocate network for instance.
Dec 01 19:17:53 user nova-compute[75066]: DEBUG nova.compute.manager [req-73a614cf-55f7-49a2-a84a-e0aaa2b4a735 req-8556e779-fdbb-4819-bddc-ac7f6c76a04e service nova] [instance: 47bd5998-8ded-4a9c-8b98-f0658a526f47] Detach interface failed, port_id=fd31d06c-eab4-4e76-a35b-ca65d171d3c5, reason: Instance 47bd5998-8ded-4a9c-8b98-f0658a526f47 could not be found. {{(pid=75066) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 01 19:17:53 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5131542f-0967-42f8-a8b3-6db8e45945bb tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:17:53 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5131542f-0967-42f8-a8b3-6db8e45945bb tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:17:53 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] COPY block job progress, current cursor: 315621376 final cursor: 1073741824 {{(pid=75066) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 19:17:53 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-5131542f-0967-42f8-a8b3-6db8e45945bb tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:17:53 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-5131542f-0967-42f8-a8b3-6db8e45945bb tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:17:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5131542f-0967-42f8-a8b3-6db8e45945bb tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.453s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:17:54 user nova-compute[75066]: DEBUG nova.compute.manager [req-599dbe0f-e759-4678-8b92-44df6b0594cd req-4f50707b-421d-4e6e-ab79-1bacc2462d28 service nova] [instance: 47bd5998-8ded-4a9c-8b98-f0658a526f47] Received event network-vif-plugged-fd31d06c-eab4-4e76-a35b-ca65d171d3c5 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:17:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-599dbe0f-e759-4678-8b92-44df6b0594cd req-4f50707b-421d-4e6e-ab79-1bacc2462d28 service nova] Acquiring lock "47bd5998-8ded-4a9c-8b98-f0658a526f47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:17:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-599dbe0f-e759-4678-8b92-44df6b0594cd req-4f50707b-421d-4e6e-ab79-1bacc2462d28 service nova] Lock "47bd5998-8ded-4a9c-8b98-f0658a526f47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:17:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-599dbe0f-e759-4678-8b92-44df6b0594cd req-4f50707b-421d-4e6e-ab79-1bacc2462d28 service nova] Lock "47bd5998-8ded-4a9c-8b98-f0658a526f47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:17:54 user nova-compute[75066]: DEBUG nova.compute.manager [req-599dbe0f-e759-4678-8b92-44df6b0594cd req-4f50707b-421d-4e6e-ab79-1bacc2462d28 service nova] [instance: 47bd5998-8ded-4a9c-8b98-f0658a526f47] No waiting events found dispatching network-vif-plugged-fd31d06c-eab4-4e76-a35b-ca65d171d3c5 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:17:54 user nova-compute[75066]: WARNING nova.compute.manager [req-599dbe0f-e759-4678-8b92-44df6b0594cd req-4f50707b-421d-4e6e-ab79-1bacc2462d28 service nova] [instance: 47bd5998-8ded-4a9c-8b98-f0658a526f47] Received unexpected event network-vif-plugged-fd31d06c-eab4-4e76-a35b-ca65d171d3c5 for instance with vm_state deleted and task_state None.
Dec 01 19:17:54 user nova-compute[75066]: INFO nova.scheduler.client.report [None req-5131542f-0967-42f8-a8b3-6db8e45945bb tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Deleted allocations for instance 47bd5998-8ded-4a9c-8b98-f0658a526f47
Dec 01 19:17:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5131542f-0967-42f8-a8b3-6db8e45945bb tempest-VolumesActionsTest-580795590 tempest-VolumesActionsTest-580795590-project-member] Lock "47bd5998-8ded-4a9c-8b98-f0658a526f47" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.563s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:17:54 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] COPY block job progress, current cursor: 497025024 final cursor: 1073741824 {{(pid=75066) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 19:17:54 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] COPY block job progress, current cursor: 622854144 final cursor: 1073741824 {{(pid=75066) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 19:17:55 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] COPY block job progress, current cursor: 775946240 final cursor: 1073741824 {{(pid=75066) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 19:17:55 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:17:55 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] COPY block job progress, current cursor: 937426944 final cursor: 1073741824 {{(pid=75066) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 19:17:56 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] COPY block job progress, current cursor: 1029701632 final cursor: 1073741824 {{(pid=75066) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 19:17:56 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75066) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 19:17:56 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] calling os-brick to detach iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 19:17:56 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, {'target_iqn': 'iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FZWvItMl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:17:56 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:17:56 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:17:56 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:17:56 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:56 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:17:56 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:56 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c2bfe6-ef8b-466c-ba2d-b908d4b42245]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:56 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 19:17:56 user nova-compute[75066]: No targets found.
Dec 01 19:17:56 user nova-compute[75066]: iSNS:
Dec 01 19:17:56 user nova-compute[75066]: No targets found.
Dec 01 19:17:56 user nova-compute[75066]: STATIC:
Dec 01 19:17:56 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a
Dec 01 19:17:56 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:17:56 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:17:56 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829
Dec 01 19:17:56 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:17:56 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:17:56 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315
Dec 01 19:17:56 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:17:56 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:17:56 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a
Dec 01 19:17:56 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:17:56 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:17:56 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a
Dec 01 19:17:56 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:17:56 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:17:56 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d
Dec 01 19:17:56 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:17:56 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:17:56 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95
Dec 01 19:17:56 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:17:56 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:17:56 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b
Dec 01 19:17:56 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:17:56 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:17:56 user nova-compute[75066]: FIRMWARE:
Dec 01 19:17:56 user nova-compute[75066]: No targets found.
Dec 01 19:17:56 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:17:56 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 19:17:56 user nova-compute[75066]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 19:17:56 user nova-compute[75066]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75066) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 19:17:56 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a', 0)] {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 19:17:56 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:56 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:56 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e5452a3-ab11-4dee-8d0b-d101f75a1e01]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:56 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:57 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[723c6bcc-e68b-491c-93f5-e664939cba5c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:57 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95 (non-flash)
Dec 01 19:17:57 user nova-compute[75066]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)
Dec 01 19:17:57 user nova-compute[75066]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)
Dec 01 19:17:57 user nova-compute[75066]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a (non-flash)
Dec 01 19:17:57 user nova-compute[75066]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:17:57 user nova-compute[75066]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a (non-flash)
Dec 01 19:17:57 user nova-compute[75066]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b (non-flash)
Dec 01 19:17:57 user nova-compute[75066]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d (non-flash)
Dec 01 19:17:57 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:17:57 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95 (non-flash)
Dec 01 19:17:57 user nova-compute[75066]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)
Dec 01 19:17:57 user nova-compute[75066]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)
Dec 01 19:17:57 user nova-compute[75066]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a (non-flash)
Dec 01 19:17:57 user nova-compute[75066]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:17:57 user nova-compute[75066]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a (non-flash)
Dec 01 19:17:57 user nova-compute[75066]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b (non-flash)
Dec 01 19:17:57 user nova-compute[75066]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d (non-flash)
Dec 01 19:17:57 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:17:57 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f919062cee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a'): ({'sde'}, set())}) {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 19:17:57 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] Removing single pathed devices sde {{(pid=75066) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 19:17:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:57 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e0bb71-78b2-4040-b54e-cc098278dc49]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.016s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:57 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a2a0ab-8860-4e04-9d74-afdfad30671c]: (4, ('ok\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:57 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] Flushing IO for device /dev/sde {{(pid=75066) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 19:17:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:57 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b388c10-4e25-4df7-9961-5fd27f08988f]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:57 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75066) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 19:17:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.034s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:57 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aacfcfa-76f1-42b2-ba15-7607f9866aec]: (4, ('1', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:57 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 19:17:57 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] SCSI volumes sde have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 19:17:57 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a')] {{(pid=75066) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 19:17:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:57 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbb6b49-070b-4a12-977c-0b81e6262abc]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:57 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:17:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a -p 172.16.0.220:3260 --logout {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a -p 172.16.0.220:3260 --logout" returned: 0 in 0.102s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:57 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[d673677e-8341-4c78-af0d-370c1c38fa06]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:57 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a, portal: 172.16.0.220,3260]
Dec 01 19:17:57 user nova-compute[75066]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a, portal: 172.16.0.220,3260] successful.
Dec 01 19:17:57 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:17:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a -p 172.16.0.220:3260 --op delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:57 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[6adf1395-d86a-49a4-a875-c8bc0c4ec3a6]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:57 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:17:57 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:17:57 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] <== disconnect_volume: return (352ms) None {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:17:57 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Disconnected iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 19:17:57 user nova-compute[75066]: DEBUG nova.compute.manager [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JBmryjgn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': 'dd67db6c-8bd1-402e-93ce-9b2d7a405a6e', 'attached_at': '', 'detached_at': '', 'volume_id': 'c10d14d8-bbda-434e-9572-40dfc759bd95', 'serial'} {{(pid=75066) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Dec 01 19:17:57 user nova-compute[75066]: DEBUG nova.compute.manager [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] swap_volume: removing Cinder connection for volume ae6d6a5d-9de3-4500-80b2-7c4860102e9a {{(pid=75066) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Dec 01 19:17:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:17:58 user nova-compute[75066]: DEBUG nova.compute.manager [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] swap_volume: Updating volume ae6d6a5d-9de3-4500-80b2-7c4860102e9a BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "JBmryjgn", "auth_password": "WDurXSKhzjM184", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdi", "volume_id": "c10d14d8-bbda-434e-9572-40dfc759bd95"}, "status": "reserved", "instance": "dd67db6c-8bd1-402e-93ce-9b2d7a405a6e", "attached_at": "", "detached_at": "", "volume_id": "c10d14d8-bbda-434e-9572-40dfc759bd95", "serial": "c10d14d8-bbda-434e-9572-40dfc759bd95"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'c10d14d8-bbda-434e-9572-40dfc759bd95', 'no_device': None, 'attachment_id': '22994ef1-bb7e-40eb-9236-f2550254876e'} {{(pid=75066) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Dec 01 19:17:58 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-f6d387c5-0d34-41f1-a9f3-a0044d0771cf tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] Lock "dd67db6c-8bd1-402e-93ce-9b2d7a405a6e" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 18.732s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:17:58 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:17:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:17:58 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] Acquiring lock "dd67db6c-8bd1-402e-93ce-9b2d7a405a6e" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:17:58 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] Lock "dd67db6c-8bd1-402e-93ce-9b2d7a405a6e" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:17:58 user nova-compute[75066]: DEBUG os_brick.utils [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:17:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:58 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[1226ec5c-d52c-429b-b291-0beed87e933a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1959854982f\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:58 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[b395e792-bc04-4e61-92de-89d2e3fb0bf3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:58 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[336a0734-160a-4d26-a117-e1f340fe7a8e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:58 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06258bd-f098-432b-9147-69732cfb8384]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] Running cmd (subprocess): nvme version {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:17:58 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] nvme not present on system {{(pid=75066) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 19:17:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:17:58 user nova-compute[75066]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 19:17:58 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a98518-2535-42a4-a075-8a8a218f3e36]: (4, '') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:17:58 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75066) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 19:17:58 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 19:17:58 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] LIGHTOS: no hostnqn found. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 19:17:58 user nova-compute[75066]: DEBUG os_brick.utils [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1959854982f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:17:59 user nova-compute[75066]: INFO nova.compute.manager [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Swapping volume c10d14d8-bbda-434e-9572-40dfc759bd95 for ae6d6a5d-9de3-4500-80b2-7c4860102e9a
Dec 01 19:17:59 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:17:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:17:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:17:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:17:59 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75066) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 19:17:59 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:59 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:59 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:17:59 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:17:59 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f253bb0a-6cd0-4e62-8bcb-898537ce8c0b/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f253bb0a-6cd0-4e62-8bcb-898537ce8c0b/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f253bb0a-6cd0-4e62-8bcb-898537ce8c0b/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f253bb0a-6cd0-4e62-8bcb-898537ce8c0b/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67c5dd7c-88aa-4f2f-8f62-a9af0480c38e/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67c5dd7c-88aa-4f2f-8f62-a9af0480c38e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67c5dd7c-88aa-4f2f-8f62-a9af0480c38e/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67c5dd7c-88aa-4f2f-8f62-a9af0480c38e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00ff7dfa-1da6-4e32-a227-0c194a5aa28f/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00ff7dfa-1da6-4e32-a227-0c194a5aa28f/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00ff7dfa-1da6-4e32-a227-0c194a5aa28f/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00ff7dfa-1da6-4e32-a227-0c194a5aa28f/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd67db6c-8bd1-402e-93ce-9b2d7a405a6e/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd67db6c-8bd1-402e-93ce-9b2d7a405a6e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd67db6c-8bd1-402e-93ce-9b2d7a405a6e/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd67db6c-8bd1-402e-93ce-9b2d7a405a6e/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:18:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:01 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:02 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:18:02 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:18:02 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:18:02 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:18:02 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:18:02 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:18:02 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Hypervisor/Node resource view: name=user free_ram=7796MB free_disk=25.3074951171875GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75066) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 19:18:02 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:18:02 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:18:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:02 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:18:02 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance c223be70-8b9c-46d4-9b5a-3b83dfc05a17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:18:02 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance c3ceeca4-c16c-4cf5-adfd-7d5a2925f435 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:18:02 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance dd546862-fcd5-4b69-8ea3-a8fa4859a489 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:18:02 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance f253bb0a-6cd0-4e62-8bcb-898537ce8c0b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:18:02 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance dd67db6c-8bd1-402e-93ce-9b2d7a405a6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:18:02 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 00ff7dfa-1da6-4e32-a227-0c194a5aa28f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:18:02 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 6d2de2c4-0c0d-4238-933c-d0ef6538964e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:18:02 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 19:18:02 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 19:18:02 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:18:03 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:18:03 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Compute_service record updated for user:user {{(pid=75066) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 19:18:03 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.409s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:18:03 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:04 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:18:04 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:18:04 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Starting heal instance info cache {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 19:18:04 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "refresh_cache-c223be70-8b9c-46d4-9b5a-3b83dfc05a17" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:18:04 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquired lock "refresh_cache-c223be70-8b9c-46d4-9b5a-3b83dfc05a17" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:18:04 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Forcefully refreshing network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 19:18:04 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Updating instance_info_cache with network_info: [{"id": "2698607a-e8b6-4da8-bfc7-90dc528ade6b", "address": "fa:16:3e:52:d6:e9", "network": {"id": "9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-696310557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0f7516d1db4dd5bc7d77a0bd1d44d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2698607a-e8", "ovs_interfaceid": "2698607a-e8b6-4da8-bfc7-90dc528ade6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:18:04 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Releasing lock "refresh_cache-c223be70-8b9c-46d4-9b5a-3b83dfc05a17" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:18:04 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Updated the network info_cache for instance {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 19:18:04 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:18:04 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:18:04 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:18:04 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:18:04 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75066) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 19:18:05 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:06 user nova-compute[75066]: DEBUG nova.compute.manager [req-e478a57f-5fe2-49cd-8701-c378eef75505 req-8ae82f86-9ec2-4a59-9d31-9c4031ebdf46 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received event network-changed-b39c07b1-b2c2-45bf-bf1c-1865dfc9ceff {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:18:06 user nova-compute[75066]: DEBUG nova.compute.manager [req-e478a57f-5fe2-49cd-8701-c378eef75505 req-8ae82f86-9ec2-4a59-9d31-9c4031ebdf46 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Refreshing instance network info cache due to event network-changed-b39c07b1-b2c2-45bf-bf1c-1865dfc9ceff. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:18:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-e478a57f-5fe2-49cd-8701-c378eef75505 req-8ae82f86-9ec2-4a59-9d31-9c4031ebdf46 service nova] Acquiring lock "refresh_cache-6d2de2c4-0c0d-4238-933c-d0ef6538964e" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:18:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-e478a57f-5fe2-49cd-8701-c378eef75505 req-8ae82f86-9ec2-4a59-9d31-9c4031ebdf46 service nova] Acquired lock "refresh_cache-6d2de2c4-0c0d-4238-933c-d0ef6538964e" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:18:06 user nova-compute[75066]: DEBUG nova.network.neutron [req-e478a57f-5fe2-49cd-8701-c378eef75505 req-8ae82f86-9ec2-4a59-9d31-9c4031ebdf46 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Refreshing network info cache for port b39c07b1-b2c2-45bf-bf1c-1865dfc9ceff {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:18:06 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-1646ec75-e7c3-4e10-867d-c6888be74e93 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance f253bb0a-6cd0-4e62-8bcb-898537ce8c0b is timed out.
Dec 01 19:18:06 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-1646ec75-e7c3-4e10-867d-c6888be74e93 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Successfully detached device sdc from instance f253bb0a-6cd0-4e62-8bcb-898537ce8c0b from the live domain config.
Dec 01 19:18:06 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1646ec75-e7c3-4e10-867d-c6888be74e93 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] calling os-brick to detach iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 19:18:06 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1646ec75-e7c3-4e10-867d-c6888be74e93 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, {'target_iqn': 'iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fROQykSD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:18:06 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-1646ec75-e7c3-4e10-867d-c6888be74e93 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:18:06 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-1646ec75-e7c3-4e10-867d-c6888be74e93 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:18:06 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-1646ec75-e7c3-4e10-867d-c6888be74e93 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:18:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:06 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[8220ce2b-1162-43e3-b63d-e66eab7f9e9d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:06 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1646ec75-e7c3-4e10-867d-c6888be74e93 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 19:18:06 user nova-compute[75066]: No targets found.
Dec 01 19:18:06 user nova-compute[75066]: iSNS:
Dec 01 19:18:06 user nova-compute[75066]: No targets found.
Dec 01 19:18:06 user nova-compute[75066]: STATIC:
Dec 01 19:18:06 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a
Dec 01 19:18:06 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:18:06 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:18:06 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829
Dec 01 19:18:06 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:18:06 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:18:06 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315
Dec 01 19:18:06 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:18:06 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:18:06 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a
Dec 01 19:18:06 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:18:06 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:18:06 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d
Dec 01 19:18:06 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:18:06 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:18:06 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95
Dec 01 19:18:06 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:18:06 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:18:06 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b
Dec 01 19:18:06 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:18:06 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:18:06 user nova-compute[75066]: FIRMWARE:
Dec 01 19:18:06 user nova-compute[75066]: No targets found.
Dec 01 19:18:06 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:18:06 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1646ec75-e7c3-4e10-867d-c6888be74e93 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 19:18:06 user nova-compute[75066]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 19:18:06 user nova-compute[75066]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75066) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 19:18:06 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1646ec75-e7c3-4e10-867d-c6888be74e93 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b', 0)] {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 19:18:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:06 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc13c88-b137-429d-974d-1aa84f913be6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:06 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[7442651d-71ba-4419-9dae-40f973f4b9e3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:06 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1646ec75-e7c3-4e10-867d-c6888be74e93 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95 (non-flash)
Dec 01 19:18:06 user nova-compute[75066]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)
Dec 01 19:18:06 user nova-compute[75066]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)
Dec 01 19:18:06 user nova-compute[75066]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a (non-flash)
Dec 01 19:18:06 user nova-compute[75066]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:18:06 user nova-compute[75066]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b (non-flash)
Dec 01 19:18:06 user nova-compute[75066]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d (non-flash)
Dec 01 19:18:06 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:18:06 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1646ec75-e7c3-4e10-867d-c6888be74e93 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95 (non-flash)
Dec 01 19:18:06 user nova-compute[75066]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)
Dec 01 19:18:06 user nova-compute[75066]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)
Dec 01 19:18:06 user nova-compute[75066]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a (non-flash)
Dec 01 19:18:06 user nova-compute[75066]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:18:06 user nova-compute[75066]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b (non-flash)
Dec 01 19:18:06 user nova-compute[75066]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d (non-flash)
Dec 01 19:18:06 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:18:06 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1646ec75-e7c3-4e10-867d-c6888be74e93 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f919016bc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b'): ({'sdg'}, set())}) {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 19:18:06 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-1646ec75-e7c3-4e10-867d-c6888be74e93 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Removing single pathed devices sdg {{(pid=75066) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 19:18:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.016s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:06 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b30081e-2ece-4cc6-9cc2-c0ca1b6159fd]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:06 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ef2ce2c-201f-4eac-8406-6fb3dadfc210]: (4, ('ok\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:06 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-1646ec75-e7c3-4e10-867d-c6888be74e93 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Flushing IO for device /dev/sdg {{(pid=75066) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 19:18:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:06 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[15365ba9-147b-414a-a2b5-25e0c7c5a452]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:06 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-1646ec75-e7c3-4e10-867d-c6888be74e93 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75066) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 19:18:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.047s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:06 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[a71c2a3a-a668-4509-a5d3-0175f5ab01d1]: (4, ('1', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:06 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-1646ec75-e7c3-4e10-867d-c6888be74e93 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 19:18:06 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-1646ec75-e7c3-4e10-867d-c6888be74e93 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] SCSI volumes sdg have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 19:18:06 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1646ec75-e7c3-4e10-867d-c6888be74e93 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b')] {{(pid=75066) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 19:18:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:06 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[76899b96-cea2-40b8-b91c-09f8d0fdcb35]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:06 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1646ec75-e7c3-4e10-867d-c6888be74e93 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:18:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b -p 172.16.0.220:3260 --logout {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:06 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a618b5d-7d18-4b5c-90dc-4d129e20ce8d]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:06 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1646ec75-e7c3-4e10-867d-c6888be74e93 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b, portal: 172.16.0.220,3260]
Dec 01 19:18:06 user nova-compute[75066]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b, portal: 172.16.0.220,3260] successful.
Dec 01 19:18:06 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:18:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b -p 172.16.0.220:3260 --op delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6d9883cd-57eb-4dc1-aba6-442bb84b899b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:06 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[589f4328-dbf3-462a-973d-e272c7c1b89d]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:06 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1646ec75-e7c3-4e10-867d-c6888be74e93 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:18:06 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-1646ec75-e7c3-4e10-867d-c6888be74e93 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:18:06 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1646ec75-e7c3-4e10-867d-c6888be74e93 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] <== disconnect_volume: return (341ms) None {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:18:06 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1646ec75-e7c3-4e10-867d-c6888be74e93 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] Disconnected iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 19:18:06 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:07 user nova-compute[75066]: DEBUG nova.network.neutron [req-e478a57f-5fe2-49cd-8701-c378eef75505 req-8ae82f86-9ec2-4a59-9d31-9c4031ebdf46 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Updated VIF entry in instance network info cache for port b39c07b1-b2c2-45bf-bf1c-1865dfc9ceff. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:18:07 user nova-compute[75066]: DEBUG nova.network.neutron [req-e478a57f-5fe2-49cd-8701-c378eef75505 req-8ae82f86-9ec2-4a59-9d31-9c4031ebdf46 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Updating instance_info_cache with network_info: [{"id": "b39c07b1-b2c2-45bf-bf1c-1865dfc9ceff", "address": "fa:16:3e:f7:4a:d3", "network": {"id": "c77595ef-65b2-45cd-be6a-8bf0380a449b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-402289383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb39c07b1-b2", "ovs_interfaceid": "b39c07b1-b2c2-45bf-bf1c-1865dfc9ceff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6eea2787-921d-4d51-aa70-d843d187a47f", "address": "fa:16:3e:7b:03:0e", "network": {"id": "8f2b8b19-449f-4d10-8d47-356d5d5e5338", "bridge": "br-int", "label": "tempest-device-tagging-net1-967030387", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eea2787-92", "ovs_interfaceid": "6eea2787-921d-4d51-aa70-d843d187a47f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fbddb1ea-5cff-4ae8-ac1c-1ee726012aea", "address": "fa:16:3e:63:9b:41", "network": {"id": "8f2b8b19-449f-4d10-8d47-356d5d5e5338", "bridge": "br-int", "label": "tempest-device-tagging-net1-967030387", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbddb1ea-5c", "ovs_interfaceid": "fbddb1ea-5cff-4ae8-ac1c-1ee726012aea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "294424e7-040a-4720-9012-7353ff25f249", "address": "fa:16:3e:94:c6:01", "network": {"id": "8f2b8b19-449f-4d10-8d47-356d5d5e5338", "bridge": "br-int", "label": "tempest-device-tagging-net1-967030387", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294424e7-04", "ovs_interfaceid": "294424e7-040a-4720-9012-7353ff25f249", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "26418177-564a-4d5b-a37e-91c6334334e9", "address": "fa:16:3e:cc:74:51", "network": {"id": "8f2b8b19-449f-4d10-8d47-356d5d5e5338", "bridge": "br-int", "label": "tempest-device-tagging-net1-967030387", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26418177-56", "ovs_interfaceid": "26418177-564a-4d5b-a37e-91c6334334e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "21b7577f-898b-4d3b-9ecd-911568f3923f", "address": "fa:16:3e:52:1c:5b", "network": {"id": "88fd1225-bf6b-4d28-bc10-deb410395ac9", "bridge": "br-int", "label": "tempest-device-tagging-net2-224351536", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21b7577f-89", "ovs_interfaceid": "21b7577f-898b-4d3b-9ecd-911568f3923f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "10d4a23a-1f6c-4c81-b937-bfa19dcc3606", "address": "fa:16:3e:c3:1c:9d", "network": {"id": "88fd1225-bf6b-4d28-bc10-deb410395ac9", "bridge": "br-int", "label": "tempest-device-tagging-net2-224351536", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10d4a23a-1f", "ovs_interfaceid": "10d4a23a-1f6c-4c81-b937-bfa19dcc3606", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:18:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-e478a57f-5fe2-49cd-8701-c378eef75505 req-8ae82f86-9ec2-4a59-9d31-9c4031ebdf46 service nova] Releasing lock "refresh_cache-6d2de2c4-0c0d-4238-933c-d0ef6538964e" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:18:07 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:07 user nova-compute[75066]: DEBUG nova.objects.instance [None req-1646ec75-e7c3-4e10-867d-c6888be74e93 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Lazy-loading 'flavor' on Instance uuid f253bb0a-6cd0-4e62-8bcb-898537ce8c0b {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:18:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-1646ec75-e7c3-4e10-867d-c6888be74e93 tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Lock "f253bb0a-6cd0-4e62-8bcb-898537ce8c0b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.879s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:18:08 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-2f9b1fbb-d219-4548-92cd-a6f528048b07 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 00ff7dfa-1da6-4e32-a227-0c194a5aa28f is timed out.
Dec 01 19:18:08 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-2f9b1fbb-d219-4548-92cd-a6f528048b07 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] Successfully detached device vdb from instance 00ff7dfa-1da6-4e32-a227-0c194a5aa28f from the live domain config.
Dec 01 19:18:08 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f9b1fbb-d219-4548-92cd-a6f528048b07 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] calling os-brick to detach iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 19:18:08 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9b1fbb-d219-4548-92cd-a6f528048b07 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, {'target_iqn': 'iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UYOwfreh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:18:08 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-2f9b1fbb-d219-4548-92cd-a6f528048b07 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:18:08 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-2f9b1fbb-d219-4548-92cd-a6f528048b07 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:18:08 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-2f9b1fbb-d219-4548-92cd-a6f528048b07 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:18:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:08 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d68b5c00-3792-4af9-b71b-2258701d6bbd tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Acquiring lock "f253bb0a-6cd0-4e62-8bcb-898537ce8c0b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:18:08 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d68b5c00-3792-4af9-b71b-2258701d6bbd tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Lock "f253bb0a-6cd0-4e62-8bcb-898537ce8c0b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:18:08 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d68b5c00-3792-4af9-b71b-2258701d6bbd tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Acquiring lock "f253bb0a-6cd0-4e62-8bcb-898537ce8c0b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:18:08 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d68b5c00-3792-4af9-b71b-2258701d6bbd tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Lock "f253bb0a-6cd0-4e62-8bcb-898537ce8c0b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:18:08 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d68b5c00-3792-4af9-b71b-2258701d6bbd tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Lock "f253bb0a-6cd0-4e62-8bcb-898537ce8c0b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:18:08 user nova-compute[75066]: INFO nova.compute.manager [None req-d68b5c00-3792-4af9-b71b-2258701d6bbd tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] Terminating instance
Dec 01 19:18:08 user nova-compute[75066]: DEBUG nova.compute.manager [None req-d68b5c00-3792-4af9-b71b-2258701d6bbd tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] Start destroying the instance on the hypervisor. {{(pid=75066) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 19:18:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:08 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb810712-ce6d-46d9-ad85-5e91dd76637f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:08 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9b1fbb-d219-4548-92cd-a6f528048b07 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 19:18:08 user nova-compute[75066]: No targets found.
Dec 01 19:18:08 user nova-compute[75066]: iSNS:
Dec 01 19:18:08 user nova-compute[75066]: No targets found.
Dec 01 19:18:08 user nova-compute[75066]: STATIC:
Dec 01 19:18:08 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a
Dec 01 19:18:08 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:18:08 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:18:08 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829
Dec 01 19:18:08 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:18:08 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:18:08 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315
Dec 01 19:18:08 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:18:08 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:18:08 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a
Dec 01 19:18:08 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:18:08 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:18:08 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d
Dec 01 19:18:08 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:18:08 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:18:08 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95
Dec 01 19:18:08 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:18:08 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:18:08 user nova-compute[75066]: FIRMWARE:
Dec 01 19:18:08 user nova-compute[75066]: No targets found.
Dec 01 19:18:08 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:18:08 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9b1fbb-d219-4548-92cd-a6f528048b07 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 19:18:08 user nova-compute[75066]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 19:18:08 user nova-compute[75066]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75066) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 19:18:08 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9b1fbb-d219-4548-92cd-a6f528048b07 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d', 0)] {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 19:18:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:08 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c80a8af-94be-49aa-8e79-82914b544cc2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:08 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5bd0b8-6883-47e2-a74e-51475ae511a2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:08 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9b1fbb-d219-4548-92cd-a6f528048b07 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95 (non-flash)
Dec 01 19:18:08 user nova-compute[75066]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)
Dec 01 19:18:08 user nova-compute[75066]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)
Dec 01 19:18:08 user nova-compute[75066]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a (non-flash)
Dec 01 19:18:08 user nova-compute[75066]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:18:08 user nova-compute[75066]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d (non-flash)
Dec 01 19:18:08 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:18:08 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9b1fbb-d219-4548-92cd-a6f528048b07 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95 (non-flash)
Dec 01 19:18:08 user nova-compute[75066]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)
Dec 01 19:18:08 user nova-compute[75066]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)
Dec 01 19:18:08 user nova-compute[75066]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a (non-flash)
Dec 01 19:18:08 user nova-compute[75066]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:18:08 user nova-compute[75066]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d (non-flash)
Dec 01 19:18:08 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:18:08 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9b1fbb-d219-4548-92cd-a6f528048b07 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9190161510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d'): ({'sdh'}, set())}) {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 19:18:08 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-2f9b1fbb-d219-4548-92cd-a6f528048b07 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] Removing single pathed devices sdh {{(pid=75066) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 19:18:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5cc9d6-0556-40e0-b8f9-a10ddd148ad1]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6804550-7955-4a67-9a3a-100610ff3821]: (4, ('ok\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-2f9b1fbb-d219-4548-92cd-a6f528048b07 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] Flushing IO for device /dev/sdh {{(pid=75066) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae7bd55-2d38-41c6-a70a-fd542d412794]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-2f9b1fbb-d219-4548-92cd-a6f528048b07 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75066) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.034s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[beea292f-3eb5-46bd-8bd8-8f926acf4ace]: (4, ('1', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-2f9b1fbb-d219-4548-92cd-a6f528048b07 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-2f9b1fbb-d219-4548-92cd-a6f528048b07 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] SCSI volumes sdh have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9b1fbb-d219-4548-92cd-a6f528048b07 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d')] {{(pid=75066) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[669fa995-88c3-480e-9a9a-415b9c86153c]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9b1fbb-d219-4548-92cd-a6f528048b07 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d -p 172.16.0.220:3260 --logout {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Acquiring lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Acquiring lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG nova.compute.manager [req-caac8673-7b9c-431b-a9b8-d83e1bc73d37 req-265db055-6242-4eb7-ae2c-ca3ac33f3311 service nova] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] Received event network-vif-unplugged-ba7d09a3-d2cc-43ca-a1e8-278f841ae513 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-caac8673-7b9c-431b-a9b8-d83e1bc73d37 req-265db055-6242-4eb7-ae2c-ca3ac33f3311 service nova] Acquiring lock "f253bb0a-6cd0-4e62-8bcb-898537ce8c0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-caac8673-7b9c-431b-a9b8-d83e1bc73d37 req-265db055-6242-4eb7-ae2c-ca3ac33f3311 service nova] Lock "f253bb0a-6cd0-4e62-8bcb-898537ce8c0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-caac8673-7b9c-431b-a9b8-d83e1bc73d37 req-265db055-6242-4eb7-ae2c-ca3ac33f3311 service nova] Lock "f253bb0a-6cd0-4e62-8bcb-898537ce8c0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG nova.compute.manager [req-caac8673-7b9c-431b-a9b8-d83e1bc73d37 req-265db055-6242-4eb7-ae2c-ca3ac33f3311 service nova] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] No waiting events found dispatching network-vif-unplugged-ba7d09a3-d2cc-43ca-a1e8-278f841ae513 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG nova.compute.manager [req-caac8673-7b9c-431b-a9b8-d83e1bc73d37 req-265db055-6242-4eb7-ae2c-ca3ac33f3311 service nova] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] Received event network-vif-unplugged-ba7d09a3-d2cc-43ca-a1e8-278f841ae513 for instance with task_state deleting. {{(pid=75066) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 19:18:09 user nova-compute[75066]: INFO nova.compute.manager [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Terminating instance
Dec 01 19:18:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d -p 172.16.0.220:3260 --logout" returned: 0 in 0.122s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1b4a58-0aa0-4e41-b632-8bc3dc78cfbb]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9b1fbb-d219-4548-92cd-a6f528048b07 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d, portal: 172.16.0.220,3260]
Dec 01 19:18:09 user nova-compute[75066]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d, portal: 172.16.0.220,3260] successful.
Dec 01 19:18:09 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG nova.compute.manager [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Start destroying the instance on the hypervisor. {{(pid=75066) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d -p 172.16.0.220:3260 --op delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4bda540-193b-4278-a204-3c523dddb82d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[851d97e2-140f-4b09-b859-bbf8ff10ebc1]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9b1fbb-d219-4548-92cd-a6f528048b07 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-2f9b1fbb-d219-4548-92cd-a6f528048b07 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.401s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2f9b1fbb-d219-4548-92cd-a6f528048b07 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] <== disconnect_volume: return (402ms) None {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2f9b1fbb-d219-4548-92cd-a6f528048b07 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Disconnected iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG nova.compute.manager [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FZWvItMl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dd67db6c-8bd1-402e-93ce-9b2d7a405a6e', 'attached_at': '', 'detached_at': '', 'volume_id': 'ae6d6a5d-9de3-4500-80b2-7c4860102e9a', 'serial': 'ae6d6a5d-9de3-4500-80b2-7c4860102e9a'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JBmryjgn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'volume_id': 'c10d14d8-bbda-434e-9572-40dfc759bd95'}, 'status': 'reserved', 'instance': 'dd67db6c-8bd1-402e-93ce-9b2d7a405a6e', 'attached_at': '', 'detached_at': '', 'volume_id': 'c10d14d8-bbda-434e-9572-40dfc759bd95', 'serial'} {{(pid=75066) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Calling os-brick to attach iSCSI Volume {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FZWvItMl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:18:09 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:18:09 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:18:09 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:18:09 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:18:09 user nova-compute[75066]: INFO os_brick.initiator.connectors.iscsi [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 19:18:09 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] Instance destroyed successfully.
Dec 01 19:18:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a -p 172.16.0.220:3260 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG nova.objects.instance [None req-d68b5c00-3792-4af9-b71b-2258701d6bbd tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Lazy-loading 'resources' on Instance uuid f253bb0a-6cd0-4e62-8bcb-898537ce8c0b {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be951cf-d941-432b-9727-b27275e625bf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 19:18:09 user nova-compute[75066]:  {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a -p 172.16.0.220:3260 --interface default --op new {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-d68b5c00-3792-4af9-b71b-2258701d6bbd tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T19:15:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-511699554',display_name='tempest-AttachSCSIVolumeTestJSON-server-511699554',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-511699554',id=6,image_ref='d98f3a9d-0cc8-43f1-ad6a-f6fccc79c8d5',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/5y/+onwNQ0yQUF1C0+0Cg+L5t4fs8Z3P82IsbLznyyWhPH2ZJmMqnzlby9bZjF42g59vlyD8yof59OqWJscTlSmjo0sVCtaPmrTeHN9CdFhFpfaASkvM+C9pN33Q8/Q==',key_name='tempest-keypair-266429772',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:15:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='da44764312b448268176827b746f5c21',ramdisk_id='',reservation_id='r-6y0x0o6c',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='d98f3a9d-0cc8-43f1-ad6a-f6fccc79c8d5',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-879061882',owner_user_name='tempest-AttachSCSIVolumeTestJSON-879061882-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:15:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='be27c8b080da4a00886a5cf78bdabed1',uuid=f253bb0a-6cd0-4e62-8bcb-898537ce8c0b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba7d09a3-d2cc-43ca-a1e8-278f841ae513", "address": "fa:16:3e:88:28:51", "network": {"id": "69bb86af-79ca-4a0b-a0f7-8580fb07e2ce", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1708610135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da44764312b448268176827b746f5c21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba7d09a3-d2", "ovs_interfaceid": "ba7d09a3-d2cc-43ca-a1e8-278f841ae513", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-d68b5c00-3792-4af9-b71b-2258701d6bbd tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Converting VIF {"id": "ba7d09a3-d2cc-43ca-a1e8-278f841ae513", "address": "fa:16:3e:88:28:51", "network": {"id": "69bb86af-79ca-4a0b-a0f7-8580fb07e2ce", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1708610135-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "da44764312b448268176827b746f5c21", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba7d09a3-d2", "ovs_interfaceid": "ba7d09a3-d2cc-43ca-a1e8-278f841ae513", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-d68b5c00-3792-4af9-b71b-2258701d6bbd tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:28:51,bridge_name='br-int',has_traffic_filtering=True,id=ba7d09a3-d2cc-43ca-a1e8-278f841ae513,network=Network(69bb86af-79ca-4a0b-a0f7-8580fb07e2ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba7d09a3-d2') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG os_vif [None req-d68b5c00-3792-4af9-b71b-2258701d6bbd tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:28:51,bridge_name='br-int',has_traffic_filtering=True,id=ba7d09a3-d2cc-43ca-a1e8-278f841ae513,network=Network(69bb86af-79ca-4a0b-a0f7-8580fb07e2ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba7d09a3-d2') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapba7d09a3-d2, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c30284f-0583-4292-a613-c15211d26e74]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a] added\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a] added
Dec 01 19:18:09 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG nova.compute.manager [req-314cd9ad-13b9-40c2-9453-a8f1b7e41bca req-56be3d80-ec32-4ff8-b8cc-2c68226a75f1 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received event network-vif-unplugged-6eea2787-921d-4d51-aa70-d843d187a47f {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-314cd9ad-13b9-40c2-9453-a8f1b7e41bca req-56be3d80-ec32-4ff8-b8cc-2c68226a75f1 service nova] Acquiring lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-314cd9ad-13b9-40c2-9453-a8f1b7e41bca req-56be3d80-ec32-4ff8-b8cc-2c68226a75f1 service nova] Lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-314cd9ad-13b9-40c2-9453-a8f1b7e41bca req-56be3d80-ec32-4ff8-b8cc-2c68226a75f1 service nova] Lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG nova.compute.manager [req-314cd9ad-13b9-40c2-9453-a8f1b7e41bca req-56be3d80-ec32-4ff8-b8cc-2c68226a75f1 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] No waiting events found dispatching network-vif-unplugged-6eea2787-921d-4d51-aa70-d843d187a47f {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG nova.compute.manager [req-314cd9ad-13b9-40c2-9453-a8f1b7e41bca req-56be3d80-ec32-4ff8-b8cc-2c68226a75f1 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received event network-vif-unplugged-6eea2787-921d-4d51-aa70-d843d187a47f for instance with task_state deleting. {{(pid=75066) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[7718a12f-1c97-4fb6-86fb-ea6cb999c63b]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.033s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[a037a2a1-1b2a-438a-803d-267447fb872a]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FZWvItMl {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FZWvItMl" returned: 0 in 0.023s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[599b4d63-c271-4005-8fab-eb697a598a32]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FZWvItMl'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[f06428f3-cf63-47ee-9a16-af3354db4ff8]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8471668-5bb5-43a0-9b1d-31d4e07705e8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95 (non-flash)
Dec 01 19:18:09 user nova-compute[75066]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)
Dec 01 19:18:09 user nova-compute[75066]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)
Dec 01 19:18:09 user nova-compute[75066]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a (non-flash)
Dec 01 19:18:09 user nova-compute[75066]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:18:09 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95 (non-flash)
Dec 01 19:18:09 user nova-compute[75066]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)
Dec 01 19:18:09 user nova-compute[75066]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)
Dec 01 19:18:09 user nova-compute[75066]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a (non-flash)
Dec 01 19:18:09 user nova-compute[75066]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:18:09 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:18:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a -p 172.16.0.220:3260 --login {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=33cf4dfb-db82-4de8-a0ed-e0dd7b51804b) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:18:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:18:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a -p 172.16.0.220:3260 --login" returned: 0 in 0.098s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:10 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[9556b02a-30c1-4543-a1d4-d90602ea93f8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:10 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a, portal: 172.16.0.220,3260]
Dec 01 19:18:10 user nova-compute[75066]: Login to [iface: default, target: iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a, portal: 172.16.0.220,3260] successful.
Dec 01 19:18:10 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:18:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:10 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e189fc2-0491-4e6f-b3ab-0014c2bd09a2]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:10 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:18:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:10 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[55232131-047a-4fdc-aaa7-e11fc4312a04]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:10 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95 (non-flash)
Dec 01 19:18:10 user nova-compute[75066]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a (non-flash)
Dec 01 19:18:10 user nova-compute[75066]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)
Dec 01 19:18:10 user nova-compute[75066]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)
Dec 01 19:18:10 user nova-compute[75066]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a (non-flash)
Dec 01 19:18:10 user nova-compute[75066]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:18:10 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:18:10 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95 (non-flash)
Dec 01 19:18:10 user nova-compute[75066]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a (non-flash)
Dec 01 19:18:10 user nova-compute[75066]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)
Dec 01 19:18:10 user nova-compute[75066]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)
Dec 01 19:18:10 user nova-compute[75066]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a (non-flash)
Dec 01 19:18:10 user nova-compute[75066]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:18:10 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:18:10 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.430s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:18:10 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] Connected to 172.16.0.220:3260 {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 19:18:10 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] HCTL ('36', '-', '-', 0) found on session 11 with lun 0 {{(pid=75066) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 19:18:10 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=75066) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 19:18:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.032s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:10 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[252dcc27-f501-470d-88dc-6502dff4743a]: (4, ('- - 0', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:10 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] Searching for a device in session 11 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:18:10 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FZWvItMl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 19:18:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:10 user nova-compute[75066]: INFO os_vif [None req-d68b5c00-3792-4af9-b71b-2258701d6bbd tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:28:51,bridge_name='br-int',has_traffic_filtering=True,id=ba7d09a3-d2cc-43ca-a1e8-278f841ae513,network=Network(69bb86af-79ca-4a0b-a0f7-8580fb07e2ce),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba7d09a3-d2')
Dec 01 19:18:10 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-d68b5c00-3792-4af9-b71b-2258701d6bbd tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] Deleting instance files /opt/stack/data/nova/instances/f253bb0a-6cd0-4e62-8bcb-898537ce8c0b_del
Dec 01 19:18:10 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-d68b5c00-3792-4af9-b71b-2258701d6bbd tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] Deletion of /opt/stack/data/nova/instances/f253bb0a-6cd0-4e62-8bcb-898537ce8c0b_del complete
Dec 01 19:18:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:10 user nova-compute[75066]: INFO nova.compute.manager [None req-d68b5c00-3792-4af9-b71b-2258701d6bbd tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] Took 1.47 seconds to destroy the instance on the hypervisor.
Dec 01 19:18:10 user nova-compute[75066]: DEBUG oslo.service.loopingcall [None req-d68b5c00-3792-4af9-b71b-2258701d6bbd tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75066) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 19:18:10 user nova-compute[75066]: DEBUG nova.compute.manager [-] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] Deallocating network for instance {{(pid=75066) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 19:18:10 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] deallocate_for_instance() {{(pid=75066) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 19:18:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:10 user nova-compute[75066]: DEBUG nova.objects.instance [None req-2f9b1fbb-d219-4548-92cd-a6f528048b07 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] Lazy-loading 'flavor' on Instance uuid 00ff7dfa-1da6-4e32-a227-0c194a5aa28f {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:18:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-2f9b1fbb-d219-4548-92cd-a6f528048b07 tempest-VolumesAssistedSnapshotsTest-749373157 tempest-VolumesAssistedSnapshotsTest-749373157-project-admin] Lock "00ff7dfa-1da6-4e32-a227-0c194a5aa28f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.105s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:18:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:11 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Instance destroyed successfully.
Dec 01 19:18:11 user nova-compute[75066]: DEBUG nova.objects.instance [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Lazy-loading 'resources' on Instance uuid 6d2de2c4-0c0d-4238-933c-d0ef6538964e {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T19:16:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-247223983',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-247223983',id=10,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFtqCwylgyb0WG7sDs1o5pvYmHxawQEA+xG3Vj+g2ckKpssw5PEMOPCxErPCNd9MCv+qpEsvhzBeg1YY0i3jiFaY6IEPyg71FeHYLEjeyEgekY9hItoVOi960ErfPbPyA==',key_name='tempest-keypair-1359189134',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:16:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ea3c2552714a477396da7ad322703173',ramdisk_id='',reservation_id='r-nyf9qoti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-752167218',owner_user_name='tempest-TaggedBootDevicesTest-752167218-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:16:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f03c5da7e0e4205baafc13cbcbb7c5e',uuid=6d2de2c4-0c0d-4238-933c-d0ef6538964e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b39c07b1-b2c2-45bf-bf1c-1865dfc9ceff", "address": "fa:16:3e:f7:4a:d3", "network": {"id": "c77595ef-65b2-45cd-be6a-8bf0380a449b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-402289383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb39c07b1-b2", "ovs_interfaceid": "b39c07b1-b2c2-45bf-bf1c-1865dfc9ceff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Converting VIF {"id": "b39c07b1-b2c2-45bf-bf1c-1865dfc9ceff", "address": "fa:16:3e:f7:4a:d3", "network": {"id": "c77595ef-65b2-45cd-be6a-8bf0380a449b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-402289383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb39c07b1-b2", "ovs_interfaceid": "b39c07b1-b2c2-45bf-bf1c-1865dfc9ceff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f7:4a:d3,bridge_name='br-int',has_traffic_filtering=True,id=b39c07b1-b2c2-45bf-bf1c-1865dfc9ceff,network=Network(c77595ef-65b2-45cd-be6a-8bf0380a449b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb39c07b1-b2') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG os_vif [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:4a:d3,bridge_name='br-int',has_traffic_filtering=True,id=b39c07b1-b2c2-45bf-bf1c-1865dfc9ceff,network=Network(c77595ef-65b2-45cd-be6a-8bf0380a449b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb39c07b1-b2') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb39c07b1-b2, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b58e274c-213c-4bc9-ada5-1e9969bb8878) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.481s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] <== connect_volume: return (1483ms) {'type': 'block', 'scsi_wwn': '26632313830303533', 'path': '/dev/sde'} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632313830303533', 'path': '/dev/sde'} {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG nova.objects.instance [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] Lazy-loading 'flavor' on Instance uuid dd67db6c-8bd1-402e-93ce-9b2d7a405a6e {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:11 user nova-compute[75066]: INFO os_vif [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:4a:d3,bridge_name='br-int',has_traffic_filtering=True,id=b39c07b1-b2c2-45bf-bf1c-1865dfc9ceff,network=Network(c77595ef-65b2-45cd-be6a-8bf0380a449b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb39c07b1-b2')
Dec 01 19:18:11 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T19:16:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-247223983',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-247223983',id=10,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFtqCwylgyb0WG7sDs1o5pvYmHxawQEA+xG3Vj+g2ckKpssw5PEMOPCxErPCNd9MCv+qpEsvhzBeg1YY0i3jiFaY6IEPyg71FeHYLEjeyEgekY9hItoVOi960ErfPbPyA==',key_name='tempest-keypair-1359189134',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:16:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ea3c2552714a477396da7ad322703173',ramdisk_id='',reservation_id='r-nyf9qoti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-752167218',owner_user_name='tempest-TaggedBootDevicesTest-752167218-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:16:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f03c5da7e0e4205baafc13cbcbb7c5e',uuid=6d2de2c4-0c0d-4238-933c-d0ef6538964e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6eea2787-921d-4d51-aa70-d843d187a47f", "address": "fa:16:3e:7b:03:0e", "network": {"id": "8f2b8b19-449f-4d10-8d47-356d5d5e5338", "bridge": "br-int", "label": "tempest-device-tagging-net1-967030387", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eea2787-92", "ovs_interfaceid": "6eea2787-921d-4d51-aa70-d843d187a47f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Converting VIF {"id": "6eea2787-921d-4d51-aa70-d843d187a47f", "address": "fa:16:3e:7b:03:0e", "network": {"id": "8f2b8b19-449f-4d10-8d47-356d5d5e5338", "bridge": "br-int", "label": "tempest-device-tagging-net1-967030387", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eea2787-92", "ovs_interfaceid": "6eea2787-921d-4d51-aa70-d843d187a47f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:03:0e,bridge_name='br-int',has_traffic_filtering=True,id=6eea2787-921d-4d51-aa70-d843d187a47f,network=Network(8f2b8b19-449f-4d10-8d47-356d5d5e5338),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6eea2787-92') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG os_vif [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:03:0e,bridge_name='br-int',has_traffic_filtering=True,id=6eea2787-921d-4d51-aa70-d843d187a47f,network=Network(8f2b8b19-449f-4d10-8d47-356d5d5e5338),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6eea2787-92') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6eea2787-92, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=08b2bc11-c63c-43ba-a530-01572c155e01) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG nova.compute.manager [req-90d16ea9-e780-4a65-89e5-18130ca02216 req-db89fd0e-3cd9-432c-b7b7-8646df6560c2 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received event network-vif-unplugged-26418177-564a-4d5b-a37e-91c6334334e9 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-90d16ea9-e780-4a65-89e5-18130ca02216 req-db89fd0e-3cd9-432c-b7b7-8646df6560c2 service nova] Acquiring lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-90d16ea9-e780-4a65-89e5-18130ca02216 req-db89fd0e-3cd9-432c-b7b7-8646df6560c2 service nova] Lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-90d16ea9-e780-4a65-89e5-18130ca02216 req-db89fd0e-3cd9-432c-b7b7-8646df6560c2 service nova] Lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG nova.compute.manager [req-90d16ea9-e780-4a65-89e5-18130ca02216 req-db89fd0e-3cd9-432c-b7b7-8646df6560c2 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] No waiting events found dispatching network-vif-unplugged-26418177-564a-4d5b-a37e-91c6334334e9 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG nova.compute.manager [req-90d16ea9-e780-4a65-89e5-18130ca02216 req-db89fd0e-3cd9-432c-b7b7-8646df6560c2 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received event network-vif-unplugged-26418177-564a-4d5b-a37e-91c6334334e9 for instance with task_state deleting. {{(pid=75066) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG nova.compute.manager [req-55340069-ba32-4218-afd6-61a13ac16aaa req-17674fe2-f069-4032-8f52-037a20008269 service nova] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] Received event network-vif-plugged-ba7d09a3-d2cc-43ca-a1e8-278f841ae513 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-55340069-ba32-4218-afd6-61a13ac16aaa req-17674fe2-f069-4032-8f52-037a20008269 service nova] Acquiring lock "f253bb0a-6cd0-4e62-8bcb-898537ce8c0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-55340069-ba32-4218-afd6-61a13ac16aaa req-17674fe2-f069-4032-8f52-037a20008269 service nova] Lock "f253bb0a-6cd0-4e62-8bcb-898537ce8c0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-55340069-ba32-4218-afd6-61a13ac16aaa req-17674fe2-f069-4032-8f52-037a20008269 service nova] Lock "f253bb0a-6cd0-4e62-8bcb-898537ce8c0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG nova.compute.manager [req-55340069-ba32-4218-afd6-61a13ac16aaa req-17674fe2-f069-4032-8f52-037a20008269 service nova] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] No waiting events found dispatching network-vif-plugged-ba7d09a3-d2cc-43ca-a1e8-278f841ae513 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:18:11 user nova-compute[75066]: WARNING nova.compute.manager [req-55340069-ba32-4218-afd6-61a13ac16aaa req-17674fe2-f069-4032-8f52-037a20008269 service nova] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] Received unexpected event network-vif-plugged-ba7d09a3-d2cc-43ca-a1e8-278f841ae513 for instance with vm_state active and task_state deleting.
Dec 01 19:18:11 user nova-compute[75066]: DEBUG nova.compute.manager [req-55340069-ba32-4218-afd6-61a13ac16aaa req-17674fe2-f069-4032-8f52-037a20008269 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received event network-vif-unplugged-b39c07b1-b2c2-45bf-bf1c-1865dfc9ceff {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-55340069-ba32-4218-afd6-61a13ac16aaa req-17674fe2-f069-4032-8f52-037a20008269 service nova] Acquiring lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-55340069-ba32-4218-afd6-61a13ac16aaa req-17674fe2-f069-4032-8f52-037a20008269 service nova] Lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-55340069-ba32-4218-afd6-61a13ac16aaa req-17674fe2-f069-4032-8f52-037a20008269 service nova] Lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG nova.compute.manager [req-55340069-ba32-4218-afd6-61a13ac16aaa req-17674fe2-f069-4032-8f52-037a20008269 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] No waiting events found dispatching network-vif-unplugged-b39c07b1-b2c2-45bf-bf1c-1865dfc9ceff {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG nova.compute.manager [req-55340069-ba32-4218-afd6-61a13ac16aaa req-17674fe2-f069-4032-8f52-037a20008269 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received event network-vif-unplugged-b39c07b1-b2c2-45bf-bf1c-1865dfc9ceff for instance with task_state deleting. {{(pid=75066) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG nova.compute.manager [req-55340069-ba32-4218-afd6-61a13ac16aaa req-17674fe2-f069-4032-8f52-037a20008269 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received event network-vif-plugged-b39c07b1-b2c2-45bf-bf1c-1865dfc9ceff {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-55340069-ba32-4218-afd6-61a13ac16aaa req-17674fe2-f069-4032-8f52-037a20008269 service nova] Acquiring lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-55340069-ba32-4218-afd6-61a13ac16aaa req-17674fe2-f069-4032-8f52-037a20008269 service nova] Lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-55340069-ba32-4218-afd6-61a13ac16aaa req-17674fe2-f069-4032-8f52-037a20008269 service nova] Lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG nova.compute.manager [req-55340069-ba32-4218-afd6-61a13ac16aaa req-17674fe2-f069-4032-8f52-037a20008269 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] No waiting events found dispatching network-vif-plugged-b39c07b1-b2c2-45bf-bf1c-1865dfc9ceff {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:18:11 user nova-compute[75066]: WARNING nova.compute.manager [req-55340069-ba32-4218-afd6-61a13ac16aaa req-17674fe2-f069-4032-8f52-037a20008269 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received unexpected event network-vif-plugged-b39c07b1-b2c2-45bf-bf1c-1865dfc9ceff for instance with vm_state active and task_state deleting.
Dec 01 19:18:11 user nova-compute[75066]: DEBUG nova.compute.manager [req-55340069-ba32-4218-afd6-61a13ac16aaa req-17674fe2-f069-4032-8f52-037a20008269 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received event network-vif-unplugged-294424e7-040a-4720-9012-7353ff25f249 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-55340069-ba32-4218-afd6-61a13ac16aaa req-17674fe2-f069-4032-8f52-037a20008269 service nova] Acquiring lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-55340069-ba32-4218-afd6-61a13ac16aaa req-17674fe2-f069-4032-8f52-037a20008269 service nova] Lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-55340069-ba32-4218-afd6-61a13ac16aaa req-17674fe2-f069-4032-8f52-037a20008269 service nova] Lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG nova.compute.manager [req-55340069-ba32-4218-afd6-61a13ac16aaa req-17674fe2-f069-4032-8f52-037a20008269 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] No waiting events found dispatching network-vif-unplugged-294424e7-040a-4720-9012-7353ff25f249 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG nova.compute.manager [req-55340069-ba32-4218-afd6-61a13ac16aaa req-17674fe2-f069-4032-8f52-037a20008269 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received event network-vif-unplugged-294424e7-040a-4720-9012-7353ff25f249 for instance with task_state deleting. {{(pid=75066) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG nova.compute.manager [req-55340069-ba32-4218-afd6-61a13ac16aaa req-17674fe2-f069-4032-8f52-037a20008269 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received event network-vif-plugged-294424e7-040a-4720-9012-7353ff25f249 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-55340069-ba32-4218-afd6-61a13ac16aaa req-17674fe2-f069-4032-8f52-037a20008269 service nova] Acquiring lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-55340069-ba32-4218-afd6-61a13ac16aaa req-17674fe2-f069-4032-8f52-037a20008269 service nova] Lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-55340069-ba32-4218-afd6-61a13ac16aaa req-17674fe2-f069-4032-8f52-037a20008269 service nova] Lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG nova.compute.manager [req-55340069-ba32-4218-afd6-61a13ac16aaa req-17674fe2-f069-4032-8f52-037a20008269 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] No waiting events found dispatching network-vif-plugged-294424e7-040a-4720-9012-7353ff25f249 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:18:11 user nova-compute[75066]: WARNING nova.compute.manager [req-55340069-ba32-4218-afd6-61a13ac16aaa req-17674fe2-f069-4032-8f52-037a20008269 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received unexpected event network-vif-plugged-294424e7-040a-4720-9012-7353ff25f249 for instance with vm_state active and task_state deleting.
Dec 01 19:18:11 user nova-compute[75066]: DEBUG nova.compute.manager [req-55340069-ba32-4218-afd6-61a13ac16aaa req-17674fe2-f069-4032-8f52-037a20008269 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received event network-vif-unplugged-21b7577f-898b-4d3b-9ecd-911568f3923f {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-55340069-ba32-4218-afd6-61a13ac16aaa req-17674fe2-f069-4032-8f52-037a20008269 service nova] Acquiring lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-55340069-ba32-4218-afd6-61a13ac16aaa req-17674fe2-f069-4032-8f52-037a20008269 service nova] Lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-55340069-ba32-4218-afd6-61a13ac16aaa req-17674fe2-f069-4032-8f52-037a20008269 service nova] Lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG nova.compute.manager [req-55340069-ba32-4218-afd6-61a13ac16aaa req-17674fe2-f069-4032-8f52-037a20008269 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] No waiting events found dispatching network-vif-unplugged-21b7577f-898b-4d3b-9ecd-911568f3923f {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG nova.compute.manager [req-55340069-ba32-4218-afd6-61a13ac16aaa req-17674fe2-f069-4032-8f52-037a20008269 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received event network-vif-unplugged-21b7577f-898b-4d3b-9ecd-911568f3923f for instance with task_state deleting. {{(pid=75066) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:11 user nova-compute[75066]: INFO os_vif [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:03:0e,bridge_name='br-int',has_traffic_filtering=True,id=6eea2787-921d-4d51-aa70-d843d187a47f,network=Network(8f2b8b19-449f-4d10-8d47-356d5d5e5338),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap6eea2787-92')
Dec 01 19:18:11 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T19:16:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-247223983',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-247223983',id=10,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFtqCwylgyb0WG7sDs1o5pvYmHxawQEA+xG3Vj+g2ckKpssw5PEMOPCxErPCNd9MCv+qpEsvhzBeg1YY0i3jiFaY6IEPyg71FeHYLEjeyEgekY9hItoVOi960ErfPbPyA==',key_name='tempest-keypair-1359189134',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:16:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ea3c2552714a477396da7ad322703173',ramdisk_id='',reservation_id='r-nyf9qoti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-752167218',owner_user_name='tempest-TaggedBootDevicesTest-752167218-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:16:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f03c5da7e0e4205baafc13cbcbb7c5e',uuid=6d2de2c4-0c0d-4238-933c-d0ef6538964e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fbddb1ea-5cff-4ae8-ac1c-1ee726012aea", "address": "fa:16:3e:63:9b:41", "network": {"id": "8f2b8b19-449f-4d10-8d47-356d5d5e5338", "bridge": "br-int", "label": "tempest-device-tagging-net1-967030387", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbddb1ea-5c", "ovs_interfaceid": "fbddb1ea-5cff-4ae8-ac1c-1ee726012aea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Converting VIF {"id": "fbddb1ea-5cff-4ae8-ac1c-1ee726012aea", "address": "fa:16:3e:63:9b:41", "network": {"id": "8f2b8b19-449f-4d10-8d47-356d5d5e5338", "bridge": "br-int", "label": "tempest-device-tagging-net1-967030387", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbddb1ea-5c", "ovs_interfaceid": "fbddb1ea-5cff-4ae8-ac1c-1ee726012aea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:9b:41,bridge_name='br-int',has_traffic_filtering=True,id=fbddb1ea-5cff-4ae8-ac1c-1ee726012aea,network=Network(8f2b8b19-449f-4d10-8d47-356d5d5e5338),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfbddb1ea-5c') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG os_vif [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:9b:41,bridge_name='br-int',has_traffic_filtering=True,id=fbddb1ea-5cff-4ae8-ac1c-1ee726012aea,network=Network(8f2b8b19-449f-4d10-8d47-356d5d5e5338),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfbddb1ea-5c') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfbddb1ea-5c, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4fd2f996-ad37-4c30-acdc-7865902eded5) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:11 user nova-compute[75066]: INFO os_vif [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:9b:41,bridge_name='br-int',has_traffic_filtering=True,id=fbddb1ea-5cff-4ae8-ac1c-1ee726012aea,network=Network(8f2b8b19-449f-4d10-8d47-356d5d5e5338),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapfbddb1ea-5c')
Dec 01 19:18:11 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T19:16:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-247223983',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-247223983',id=10,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFtqCwylgyb0WG7sDs1o5pvYmHxawQEA+xG3Vj+g2ckKpssw5PEMOPCxErPCNd9MCv+qpEsvhzBeg1YY0i3jiFaY6IEPyg71FeHYLEjeyEgekY9hItoVOi960ErfPbPyA==',key_name='tempest-keypair-1359189134',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:16:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ea3c2552714a477396da7ad322703173',ramdisk_id='',reservation_id='r-nyf9qoti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-752167218',owner_user_name='tempest-TaggedBootDevicesTest-752167218-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:16:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f03c5da7e0e4205baafc13cbcbb7c5e',uuid=6d2de2c4-0c0d-4238-933c-d0ef6538964e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "294424e7-040a-4720-9012-7353ff25f249", "address": "fa:16:3e:94:c6:01", "network": {"id": "8f2b8b19-449f-4d10-8d47-356d5d5e5338", "bridge": "br-int", "label": "tempest-device-tagging-net1-967030387", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294424e7-04", "ovs_interfaceid": "294424e7-040a-4720-9012-7353ff25f249", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Converting VIF {"id": "294424e7-040a-4720-9012-7353ff25f249", "address": "fa:16:3e:94:c6:01", "network": {"id": "8f2b8b19-449f-4d10-8d47-356d5d5e5338", "bridge": "br-int", "label": "tempest-device-tagging-net1-967030387", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294424e7-04", "ovs_interfaceid": "294424e7-040a-4720-9012-7353ff25f249", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:94:c6:01,bridge_name='br-int',has_traffic_filtering=True,id=294424e7-040a-4720-9012-7353ff25f249,network=Network(8f2b8b19-449f-4d10-8d47-356d5d5e5338),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap294424e7-04') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG os_vif [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:c6:01,bridge_name='br-int',has_traffic_filtering=True,id=294424e7-040a-4720-9012-7353ff25f249,network=Network(8f2b8b19-449f-4d10-8d47-356d5d5e5338),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap294424e7-04') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap294424e7-04, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3127453c-c114-4adf-a157-7588afd6c1fc) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:11 user nova-compute[75066]: INFO os_vif [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:94:c6:01,bridge_name='br-int',has_traffic_filtering=True,id=294424e7-040a-4720-9012-7353ff25f249,network=Network(8f2b8b19-449f-4d10-8d47-356d5d5e5338),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap294424e7-04')
Dec 01 19:18:11 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T19:16:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-247223983',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-247223983',id=10,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFtqCwylgyb0WG7sDs1o5pvYmHxawQEA+xG3Vj+g2ckKpssw5PEMOPCxErPCNd9MCv+qpEsvhzBeg1YY0i3jiFaY6IEPyg71FeHYLEjeyEgekY9hItoVOi960ErfPbPyA==',key_name='tempest-keypair-1359189134',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:16:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ea3c2552714a477396da7ad322703173',ramdisk_id='',reservation_id='r-nyf9qoti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-752167218',owner_user_name='tempest-TaggedBootDevicesTest-752167218-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:16:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f03c5da7e0e4205baafc13cbcbb7c5e',uuid=6d2de2c4-0c0d-4238-933c-d0ef6538964e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26418177-564a-4d5b-a37e-91c6334334e9", "address": "fa:16:3e:cc:74:51", "network": {"id": "8f2b8b19-449f-4d10-8d47-356d5d5e5338", "bridge": "br-int", "label": "tempest-device-tagging-net1-967030387", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26418177-56", "ovs_interfaceid": "26418177-564a-4d5b-a37e-91c6334334e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Converting VIF {"id": "26418177-564a-4d5b-a37e-91c6334334e9", "address": "fa:16:3e:cc:74:51", "network": {"id": "8f2b8b19-449f-4d10-8d47-356d5d5e5338", "bridge": "br-int", "label": "tempest-device-tagging-net1-967030387", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.166", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26418177-56", "ovs_interfaceid": "26418177-564a-4d5b-a37e-91c6334334e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:74:51,bridge_name='br-int',has_traffic_filtering=True,id=26418177-564a-4d5b-a37e-91c6334334e9,network=Network(8f2b8b19-449f-4d10-8d47-356d5d5e5338),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26418177-56') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG os_vif [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:74:51,bridge_name='br-int',has_traffic_filtering=True,id=26418177-564a-4d5b-a37e-91c6334334e9,network=Network(8f2b8b19-449f-4d10-8d47-356d5d5e5338),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26418177-56') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26418177-56, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75066) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b0bc0e13-e07c-4bd0-acbd-0ebe9105e13f) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:11 user nova-compute[75066]: INFO os_vif [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:74:51,bridge_name='br-int',has_traffic_filtering=True,id=26418177-564a-4d5b-a37e-91c6334334e9,network=Network(8f2b8b19-449f-4d10-8d47-356d5d5e5338),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26418177-56')
Dec 01 19:18:11 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T19:16:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-247223983',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-247223983',id=10,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFtqCwylgyb0WG7sDs1o5pvYmHxawQEA+xG3Vj+g2ckKpssw5PEMOPCxErPCNd9MCv+qpEsvhzBeg1YY0i3jiFaY6IEPyg71FeHYLEjeyEgekY9hItoVOi960ErfPbPyA==',key_name='tempest-keypair-1359189134',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:16:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ea3c2552714a477396da7ad322703173',ramdisk_id='',reservation_id='r-nyf9qoti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-752167218',owner_user_name='tempest-TaggedBootDevicesTest-752167218-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:16:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f03c5da7e0e4205baafc13cbcbb7c5e',uuid=6d2de2c4-0c0d-4238-933c-d0ef6538964e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21b7577f-898b-4d3b-9ecd-911568f3923f", "address": "fa:16:3e:52:1c:5b", "network": {"id": "88fd1225-bf6b-4d28-bc10-deb410395ac9", "bridge": "br-int", "label": "tempest-device-tagging-net2-224351536", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21b7577f-89", "ovs_interfaceid": "21b7577f-898b-4d3b-9ecd-911568f3923f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Converting VIF {"id": "21b7577f-898b-4d3b-9ecd-911568f3923f", "address": "fa:16:3e:52:1c:5b", "network": {"id": "88fd1225-bf6b-4d28-bc10-deb410395ac9", "bridge": "br-int", "label": "tempest-device-tagging-net2-224351536", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21b7577f-89", "ovs_interfaceid": "21b7577f-898b-4d3b-9ecd-911568f3923f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:1c:5b,bridge_name='br-int',has_traffic_filtering=True,id=21b7577f-898b-4d3b-9ecd-911568f3923f,network=Network(88fd1225-bf6b-4d28-bc10-deb410395ac9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21b7577f-89') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG os_vif [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:1c:5b,bridge_name='br-int',has_traffic_filtering=True,id=21b7577f-898b-4d3b-9ecd-911568f3923f,network=Network(88fd1225-bf6b-4d28-bc10-deb410395ac9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21b7577f-89') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap21b7577f-89, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=669b4987-32e2-4590-9b77-a71e04408f0e) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:11 user nova-compute[75066]: INFO os_vif [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:1c:5b,bridge_name='br-int',has_traffic_filtering=True,id=21b7577f-898b-4d3b-9ecd-911568f3923f,network=Network(88fd1225-bf6b-4d28-bc10-deb410395ac9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21b7577f-89')
Dec 01 19:18:11 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T19:16:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-247223983',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-247223983',id=10,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFtqCwylgyb0WG7sDs1o5pvYmHxawQEA+xG3Vj+g2ckKpssw5PEMOPCxErPCNd9MCv+qpEsvhzBeg1YY0i3jiFaY6IEPyg71FeHYLEjeyEgekY9hItoVOi960ErfPbPyA==',key_name='tempest-keypair-1359189134',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:16:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ea3c2552714a477396da7ad322703173',ramdisk_id='',reservation_id='r-nyf9qoti',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-752167218',owner_user_name='tempest-TaggedBootDevicesTest-752167218-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:16:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f03c5da7e0e4205baafc13cbcbb7c5e',uuid=6d2de2c4-0c0d-4238-933c-d0ef6538964e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "10d4a23a-1f6c-4c81-b937-bfa19dcc3606", "address": "fa:16:3e:c3:1c:9d", "network": {"id": "88fd1225-bf6b-4d28-bc10-deb410395ac9", "bridge": "br-int", "label": "tempest-device-tagging-net2-224351536", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10d4a23a-1f", "ovs_interfaceid": "10d4a23a-1f6c-4c81-b937-bfa19dcc3606", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Converting VIF {"id": "10d4a23a-1f6c-4c81-b937-bfa19dcc3606", "address": "fa:16:3e:c3:1c:9d", "network": {"id": "88fd1225-bf6b-4d28-bc10-deb410395ac9", "bridge": "br-int", "label": "tempest-device-tagging-net2-224351536", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10d4a23a-1f", "ovs_interfaceid": "10d4a23a-1f6c-4c81-b937-bfa19dcc3606", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c3:1c:9d,bridge_name='br-int',has_traffic_filtering=True,id=10d4a23a-1f6c-4c81-b937-bfa19dcc3606,network=Network(88fd1225-bf6b-4d28-bc10-deb410395ac9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10d4a23a-1f') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG os_vif [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:1c:9d,bridge_name='br-int',has_traffic_filtering=True,id=10d4a23a-1f6c-4c81-b937-bfa19dcc3606,network=Network(88fd1225-bf6b-4d28-bc10-deb410395ac9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10d4a23a-1f') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap10d4a23a-1f, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=56825f90-1cef-450c-abeb-5d9534da8909) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:12 user nova-compute[75066]: INFO nova.compute.manager [-] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] Took 1.65 seconds to deallocate network for instance.
Dec 01 19:18:12 user nova-compute[75066]: INFO os_vif [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c3:1c:9d,bridge_name='br-int',has_traffic_filtering=True,id=10d4a23a-1f6c-4c81-b937-bfa19dcc3606,network=Network(88fd1225-bf6b-4d28-bc10-deb410395ac9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap10d4a23a-1f')
Dec 01 19:18:12 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] calling os-brick to detach iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, {'target_iqn': 'iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZvMkyNKW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:18:12 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:18:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.035s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[911a0218-2619-46f6-bfdd-9e8091db3ee4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 19:18:12 user nova-compute[75066]: No targets found.
Dec 01 19:18:12 user nova-compute[75066]: iSNS:
Dec 01 19:18:12 user nova-compute[75066]: No targets found.
Dec 01 19:18:12 user nova-compute[75066]: STATIC:
Dec 01 19:18:12 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a
Dec 01 19:18:12 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:18:12 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:18:12 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829
Dec 01 19:18:12 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:18:12 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:18:12 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315
Dec 01 19:18:12 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:18:12 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:18:12 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a
Dec 01 19:18:12 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:18:12 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:18:12 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a
Dec 01 19:18:12 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:18:12 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:18:12 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95
Dec 01 19:18:12 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:18:12 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:18:12 user nova-compute[75066]: FIRMWARE:
Dec 01 19:18:12 user nova-compute[75066]: No targets found.
Dec 01 19:18:12 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 19:18:12 user nova-compute[75066]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 19:18:12 user nova-compute[75066]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75066) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a', 0)] {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.032s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da4a59c-5a06-40fd-a6cb-12055eb2cd15]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d68b5c00-3792-4af9-b71b-2258701d6bbd tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d68b5c00-3792-4af9-b71b-2258701d6bbd tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG nova.compute.manager [req-19b085b0-ebcb-4ccf-8fcd-3f7eac16a728 req-1f173582-7681-4733-ae9e-1a052299d46a service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received event network-vif-plugged-6eea2787-921d-4d51-aa70-d843d187a47f {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-19b085b0-ebcb-4ccf-8fcd-3f7eac16a728 req-1f173582-7681-4733-ae9e-1a052299d46a service nova] Acquiring lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-19b085b0-ebcb-4ccf-8fcd-3f7eac16a728 req-1f173582-7681-4733-ae9e-1a052299d46a service nova] Lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-19b085b0-ebcb-4ccf-8fcd-3f7eac16a728 req-1f173582-7681-4733-ae9e-1a052299d46a service nova] Lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG nova.compute.manager [req-19b085b0-ebcb-4ccf-8fcd-3f7eac16a728 req-1f173582-7681-4733-ae9e-1a052299d46a service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] No waiting events found dispatching network-vif-plugged-6eea2787-921d-4d51-aa70-d843d187a47f {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:18:12 user nova-compute[75066]: WARNING nova.compute.manager [req-19b085b0-ebcb-4ccf-8fcd-3f7eac16a728 req-1f173582-7681-4733-ae9e-1a052299d46a service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received unexpected event network-vif-plugged-6eea2787-921d-4d51-aa70-d843d187a47f for instance with vm_state active and task_state deleting.
Dec 01 19:18:12 user nova-compute[75066]: DEBUG nova.compute.manager [req-19b085b0-ebcb-4ccf-8fcd-3f7eac16a728 req-1f173582-7681-4733-ae9e-1a052299d46a service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received event network-vif-unplugged-fbddb1ea-5cff-4ae8-ac1c-1ee726012aea {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-19b085b0-ebcb-4ccf-8fcd-3f7eac16a728 req-1f173582-7681-4733-ae9e-1a052299d46a service nova] Acquiring lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-19b085b0-ebcb-4ccf-8fcd-3f7eac16a728 req-1f173582-7681-4733-ae9e-1a052299d46a service nova] Lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-19b085b0-ebcb-4ccf-8fcd-3f7eac16a728 req-1f173582-7681-4733-ae9e-1a052299d46a service nova] Lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG nova.compute.manager [req-19b085b0-ebcb-4ccf-8fcd-3f7eac16a728 req-1f173582-7681-4733-ae9e-1a052299d46a service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] No waiting events found dispatching network-vif-unplugged-fbddb1ea-5cff-4ae8-ac1c-1ee726012aea {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG nova.compute.manager [req-19b085b0-ebcb-4ccf-8fcd-3f7eac16a728 req-1f173582-7681-4733-ae9e-1a052299d46a service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received event network-vif-unplugged-fbddb1ea-5cff-4ae8-ac1c-1ee726012aea for instance with task_state deleting. {{(pid=75066) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG nova.compute.manager [req-19b085b0-ebcb-4ccf-8fcd-3f7eac16a728 req-1f173582-7681-4733-ae9e-1a052299d46a service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received event network-vif-plugged-fbddb1ea-5cff-4ae8-ac1c-1ee726012aea {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-19b085b0-ebcb-4ccf-8fcd-3f7eac16a728 req-1f173582-7681-4733-ae9e-1a052299d46a service nova] Acquiring lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-19b085b0-ebcb-4ccf-8fcd-3f7eac16a728 req-1f173582-7681-4733-ae9e-1a052299d46a service nova] Lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-19b085b0-ebcb-4ccf-8fcd-3f7eac16a728 req-1f173582-7681-4733-ae9e-1a052299d46a service nova] Lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG nova.compute.manager [req-19b085b0-ebcb-4ccf-8fcd-3f7eac16a728 req-1f173582-7681-4733-ae9e-1a052299d46a service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] No waiting events found dispatching network-vif-plugged-fbddb1ea-5cff-4ae8-ac1c-1ee726012aea {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:18:12 user nova-compute[75066]: WARNING nova.compute.manager [req-19b085b0-ebcb-4ccf-8fcd-3f7eac16a728 req-1f173582-7681-4733-ae9e-1a052299d46a service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received unexpected event network-vif-plugged-fbddb1ea-5cff-4ae8-ac1c-1ee726012aea for instance with vm_state active and task_state deleting.
Dec 01 19:18:12 user nova-compute[75066]: DEBUG nova.compute.manager [req-19b085b0-ebcb-4ccf-8fcd-3f7eac16a728 req-1f173582-7681-4733-ae9e-1a052299d46a service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received event network-vif-unplugged-10d4a23a-1f6c-4c81-b937-bfa19dcc3606 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-19b085b0-ebcb-4ccf-8fcd-3f7eac16a728 req-1f173582-7681-4733-ae9e-1a052299d46a service nova] Acquiring lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-19b085b0-ebcb-4ccf-8fcd-3f7eac16a728 req-1f173582-7681-4733-ae9e-1a052299d46a service nova] Lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-19b085b0-ebcb-4ccf-8fcd-3f7eac16a728 req-1f173582-7681-4733-ae9e-1a052299d46a service nova] Lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG nova.compute.manager [req-19b085b0-ebcb-4ccf-8fcd-3f7eac16a728 req-1f173582-7681-4733-ae9e-1a052299d46a service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] No waiting events found dispatching network-vif-unplugged-10d4a23a-1f6c-4c81-b937-bfa19dcc3606 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG nova.compute.manager [req-19b085b0-ebcb-4ccf-8fcd-3f7eac16a728 req-1f173582-7681-4733-ae9e-1a052299d46a service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received event network-vif-unplugged-10d4a23a-1f6c-4c81-b937-bfa19dcc3606 for instance with task_state deleting. {{(pid=75066) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG nova.compute.manager [req-19b085b0-ebcb-4ccf-8fcd-3f7eac16a728 req-1f173582-7681-4733-ae9e-1a052299d46a service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received event network-vif-plugged-10d4a23a-1f6c-4c81-b937-bfa19dcc3606 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-19b085b0-ebcb-4ccf-8fcd-3f7eac16a728 req-1f173582-7681-4733-ae9e-1a052299d46a service nova] Acquiring lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-19b085b0-ebcb-4ccf-8fcd-3f7eac16a728 req-1f173582-7681-4733-ae9e-1a052299d46a service nova] Lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-19b085b0-ebcb-4ccf-8fcd-3f7eac16a728 req-1f173582-7681-4733-ae9e-1a052299d46a service nova] Lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG nova.compute.manager [req-19b085b0-ebcb-4ccf-8fcd-3f7eac16a728 req-1f173582-7681-4733-ae9e-1a052299d46a service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] No waiting events found dispatching network-vif-plugged-10d4a23a-1f6c-4c81-b937-bfa19dcc3606 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:18:12 user nova-compute[75066]: WARNING nova.compute.manager [req-19b085b0-ebcb-4ccf-8fcd-3f7eac16a728 req-1f173582-7681-4733-ae9e-1a052299d46a service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received unexpected event network-vif-plugged-10d4a23a-1f6c-4c81-b937-bfa19dcc3606 for instance with vm_state active and task_state deleting.
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac8f81b-581e-4f21-8855-d63b1ac81277]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95 (non-flash)
Dec 01 19:18:12 user nova-compute[75066]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a (non-flash)
Dec 01 19:18:12 user nova-compute[75066]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)
Dec 01 19:18:12 user nova-compute[75066]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)
Dec 01 19:18:12 user nova-compute[75066]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a (non-flash)
Dec 01 19:18:12 user nova-compute[75066]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:18:12 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95 (non-flash)
Dec 01 19:18:12 user nova-compute[75066]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a (non-flash)
Dec 01 19:18:12 user nova-compute[75066]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a (non-flash)
Dec 01 19:18:12 user nova-compute[75066]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)
Dec 01 19:18:12 user nova-compute[75066]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a (non-flash)
Dec 01 19:18:12 user nova-compute[75066]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:18:12 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91901612d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a'): ({'sdb'}, set())}) {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Removing single pathed devices sdb {{(pid=75066) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e84f84-dd57-46ec-b8b8-3dcf998159e0]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] COPY block job progress, current cursor: 169869312 final cursor: 1073741824 {{(pid=75066) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[83fe0c3a-8646-46e8-9cc3-9f62b011911a]: (4, ('ok\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Flushing IO for device /dev/sdb {{(pid=75066) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77bec99-ebe0-4e55-aa06-36ec9dc2fc93]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75066) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[d898b42b-3565-4d61-9efb-d26872ea8701]: (4, ('1', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] SCSI volumes sdb have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_6f83befe', '/dev/disk/by-id/scsi-23539363535616339', '/dev/disk/by-id/scsi-1SCST_BIO6f83befe-59655ac97273e318') {{(pid=86136) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Dec 01 19:18:12 user nova-compute[75066]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_6f83befe
Dec 01 19:18:12 user nova-compute[75066]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23539363535616339
Dec 01 19:18:12 user nova-compute[75066]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO6f83befe-59655ac97273e318
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a17cec-64c3-44a1-864b-da2a9725d014]: (4, None) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a')] {{(pid=75066) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bdec1f0-c201-4cb5-97ed-fb3e19cb03e6]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a -p 172.16.0.220:3260 --logout {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a -p 172.16.0.220:3260 --logout" returned: 0 in 0.093s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5c7735-5295-44d6-bd64-76fd1ab28bf6]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a, portal: 172.16.0.220,3260]
Dec 01 19:18:12 user nova-compute[75066]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a, portal: 172.16.0.220,3260] successful.
Dec 01 19:18:12 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a -p 172.16.0.220:3260 --op delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7e19af37-2e86-449b-83a6-4a58b63d0d3a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.046s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee0f22f-2897-4016-9046-b3e755c6afa2]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.504s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] <== disconnect_volume: return (506ms) None {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Disconnected iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] calling os-brick to detach iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, {'target_iqn': 'iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tTiXvpqN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:18:12 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:18:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-d68b5c00-3792-4af9-b71b-2258701d6bbd tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[64222085-8e0f-4e8e-a100-d5ffe4fd1207]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 19:18:12 user nova-compute[75066]: No targets found.
Dec 01 19:18:12 user nova-compute[75066]: iSNS:
Dec 01 19:18:12 user nova-compute[75066]: No targets found.
Dec 01 19:18:12 user nova-compute[75066]: STATIC:
Dec 01 19:18:12 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a
Dec 01 19:18:12 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:18:12 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:18:12 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829
Dec 01 19:18:12 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:18:12 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:18:12 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315
Dec 01 19:18:12 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:18:12 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:18:12 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a
Dec 01 19:18:12 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:18:12 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:18:12 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95
Dec 01 19:18:12 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:18:12 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:18:12 user nova-compute[75066]: FIRMWARE:
Dec 01 19:18:12 user nova-compute[75066]: No targets found.
Dec 01 19:18:12 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 19:18:12 user nova-compute[75066]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 19:18:12 user nova-compute[75066]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75066) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315', 0)] {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-d68b5c00-3792-4af9-b71b-2258701d6bbd tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6fffb8a-79f9-4001-9e80-44693a1ed469]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d68b5c00-3792-4af9-b71b-2258701d6bbd tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.507s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab3dddc7-29ee-4863-90ae-cee7488bc70e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95 (non-flash)
Dec 01 19:18:12 user nova-compute[75066]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a (non-flash)
Dec 01 19:18:12 user nova-compute[75066]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)
Dec 01 19:18:12 user nova-compute[75066]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a (non-flash)
Dec 01 19:18:12 user nova-compute[75066]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:18:12 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95 (non-flash)
Dec 01 19:18:12 user nova-compute[75066]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a (non-flash)
Dec 01 19:18:12 user nova-compute[75066]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 (non-flash)
Dec 01 19:18:12 user nova-compute[75066]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a (non-flash)
Dec 01 19:18:12 user nova-compute[75066]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:18:12 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9190169e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315'): ({'sdc'}, set())}) {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Removing single pathed devices sdc {{(pid=75066) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c5ce0a-61a5-4d0e-9128-111df1552e4c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[af46657f-b9cd-4c96-86b2-122c80384d05]: (4, ('ok\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Flushing IO for device /dev/sdc {{(pid=75066) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] COPY block job progress, current cursor: 296747008 final cursor: 1073741824 {{(pid=75066) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[35407495-585e-40a0-a5f6-e9e1ac518419]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75066) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:12 user nova-compute[75066]: INFO nova.scheduler.client.report [None req-d68b5c00-3792-4af9-b71b-2258701d6bbd tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Deleted allocations for instance f253bb0a-6cd0-4e62-8bcb-898537ce8c0b
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.060s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f925a49-ab88-46e9-be00-3ff681c7988c]: (4, ('1', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] SCSI volumes sdc have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315')] {{(pid=75066) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[42178294-00f9-420c-a303-a265959b9be2]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 -p 172.16.0.220:3260 --logout {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[872c610c-da1f-4117-9395-ffff643416a4]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315, portal: 172.16.0.220,3260]
Dec 01 19:18:12 user nova-compute[75066]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315, portal: 172.16.0.220,3260] successful.
Dec 01 19:18:12 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d68b5c00-3792-4af9-b71b-2258701d6bbd tempest-AttachSCSIVolumeTestJSON-879061882 tempest-AttachSCSIVolumeTestJSON-879061882-project-member] Lock "f253bb0a-6cd0-4e62-8bcb-898537ce8c0b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.057s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 -p 172.16.0.220:3260 --op delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2eb196a1-1efb-4bd5-9113-5745861c7315 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa811e22-1d83-41c4-a393-496cb96d6af0]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.430s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] <== disconnect_volume: return (433ms) None {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:18:12 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Disconnected iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 19:18:13 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] calling os-brick to detach iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 19:18:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, {'target_iqn': 'iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YXNclRnG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:18:13 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:18:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:18:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:18:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:13 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39c2441-8b26-48c6-b0d0-43d3496b12ed]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 19:18:13 user nova-compute[75066]: No targets found.
Dec 01 19:18:13 user nova-compute[75066]: iSNS:
Dec 01 19:18:13 user nova-compute[75066]: No targets found.
Dec 01 19:18:13 user nova-compute[75066]: STATIC:
Dec 01 19:18:13 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a
Dec 01 19:18:13 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:18:13 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:18:13 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829
Dec 01 19:18:13 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:18:13 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:18:13 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a
Dec 01 19:18:13 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:18:13 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:18:13 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95
Dec 01 19:18:13 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:18:13 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:18:13 user nova-compute[75066]: FIRMWARE:
Dec 01 19:18:13 user nova-compute[75066]: No targets found.
Dec 01 19:18:13 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:18:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 19:18:13 user nova-compute[75066]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 19:18:13 user nova-compute[75066]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75066) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 19:18:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a', 0)] {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 19:18:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:13 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[4443d37d-42e8-4720-9390-23663900641e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:13 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f098771-83c2-42a4-b112-54791f99499c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95 (non-flash)
Dec 01 19:18:13 user nova-compute[75066]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a (non-flash)
Dec 01 19:18:13 user nova-compute[75066]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a (non-flash)
Dec 01 19:18:13 user nova-compute[75066]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:18:13 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:18:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95 (non-flash)
Dec 01 19:18:13 user nova-compute[75066]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a (non-flash)
Dec 01 19:18:13 user nova-compute[75066]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a (non-flash)
Dec 01 19:18:13 user nova-compute[75066]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:18:13 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:18:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f919016ac20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a'): ({'sdd'}, set())}) {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 19:18:13 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Removing single pathed devices sdd {{(pid=75066) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 19:18:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.041s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:13 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e822636-fbbe-4a9b-9a12-93a76a00f67c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:13 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c8fc1a-dfcd-4047-bf5d-65620ff3019d]: (4, ('ok\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:13 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Flushing IO for device /dev/sdd {{(pid=75066) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 19:18:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:13 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe57dccf-1ab6-40a1-a7f0-344a7cdd73a7]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:13 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75066) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 19:18:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.053s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:13 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71e348b-3356-4f14-a126-3f076e8daaa6]: (4, ('1', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:13 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 19:18:13 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] SCSI volumes sdd have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 19:18:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a')] {{(pid=75066) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 19:18:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:13 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] COPY block job progress, current cursor: 473956352 final cursor: 1073741824 {{(pid=75066) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 19:18:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:13 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64c922c-a523-4212-a073-342e6cbb3aa2]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:18:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a -p 172.16.0.220:3260 --logout {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:13 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4cada1a-e88d-4451-a609-b0061f58a36f]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a, portal: 172.16.0.220,3260]
Dec 01 19:18:13 user nova-compute[75066]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a, portal: 172.16.0.220,3260] successful.
Dec 01 19:18:13 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:18:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a -p 172.16.0.220:3260 --op delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:13 user nova-compute[75066]: DEBUG nova.compute.manager [req-5d0e5762-9a0e-47b8-a97d-2b0af5d2f7dd req-92b1c412-f843-4247-be33-1a9878063997 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received event network-vif-plugged-26418177-564a-4d5b-a37e-91c6334334e9 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:18:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-5d0e5762-9a0e-47b8-a97d-2b0af5d2f7dd req-92b1c412-f843-4247-be33-1a9878063997 service nova] Acquiring lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:18:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-5d0e5762-9a0e-47b8-a97d-2b0af5d2f7dd req-92b1c412-f843-4247-be33-1a9878063997 service nova] Lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:18:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-5d0e5762-9a0e-47b8-a97d-2b0af5d2f7dd req-92b1c412-f843-4247-be33-1a9878063997 service nova] Lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:18:13 user nova-compute[75066]: DEBUG nova.compute.manager [req-5d0e5762-9a0e-47b8-a97d-2b0af5d2f7dd req-92b1c412-f843-4247-be33-1a9878063997 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] No waiting events found dispatching network-vif-plugged-26418177-564a-4d5b-a37e-91c6334334e9 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:18:13 user nova-compute[75066]: WARNING nova.compute.manager [req-5d0e5762-9a0e-47b8-a97d-2b0af5d2f7dd req-92b1c412-f843-4247-be33-1a9878063997 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received unexpected event network-vif-plugged-26418177-564a-4d5b-a37e-91c6334334e9 for instance with vm_state active and task_state deleting.
Dec 01 19:18:13 user nova-compute[75066]: DEBUG nova.compute.manager [req-c52b764b-8654-48e0-a271-0ec7081dc111 req-f2cc47b9-7c18-4d80-8eba-e7c90f29f61c service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received event network-vif-plugged-21b7577f-898b-4d3b-9ecd-911568f3923f {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:18:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-c52b764b-8654-48e0-a271-0ec7081dc111 req-f2cc47b9-7c18-4d80-8eba-e7c90f29f61c service nova] Acquiring lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:18:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-c52b764b-8654-48e0-a271-0ec7081dc111 req-f2cc47b9-7c18-4d80-8eba-e7c90f29f61c service nova] Lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:18:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-c52b764b-8654-48e0-a271-0ec7081dc111 req-f2cc47b9-7c18-4d80-8eba-e7c90f29f61c service nova] Lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:18:13 user nova-compute[75066]: DEBUG nova.compute.manager [req-c52b764b-8654-48e0-a271-0ec7081dc111 req-f2cc47b9-7c18-4d80-8eba-e7c90f29f61c service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] No waiting events found dispatching network-vif-plugged-21b7577f-898b-4d3b-9ecd-911568f3923f {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:18:13 user nova-compute[75066]: WARNING nova.compute.manager [req-c52b764b-8654-48e0-a271-0ec7081dc111 req-f2cc47b9-7c18-4d80-8eba-e7c90f29f61c service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received unexpected event network-vif-plugged-21b7577f-898b-4d3b-9ecd-911568f3923f for instance with vm_state active and task_state deleting.
Dec 01 19:18:13 user nova-compute[75066]: DEBUG nova.compute.manager [req-c52b764b-8654-48e0-a271-0ec7081dc111 req-f2cc47b9-7c18-4d80-8eba-e7c90f29f61c service nova] [instance: f253bb0a-6cd0-4e62-8bcb-898537ce8c0b] Received event network-vif-deleted-ba7d09a3-d2cc-43ca-a1e8-278f841ae513 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:18:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f81dcbf2-df0b-42ef-a856-a14ea3341d5a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:13 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[62eb121e-561b-4ecc-b81f-fbd4f00a86ab]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:18:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.431s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:18:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] <== disconnect_volume: return (431ms) None {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:18:13 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Disconnected iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 19:18:13 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Deleting instance files /opt/stack/data/nova/instances/6d2de2c4-0c0d-4238-933c-d0ef6538964e_del
Dec 01 19:18:13 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Deletion of /opt/stack/data/nova/instances/6d2de2c4-0c0d-4238-933c-d0ef6538964e_del complete
Dec 01 19:18:13 user nova-compute[75066]: INFO nova.compute.manager [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Took 4.29 seconds to destroy the instance on the hypervisor.
Dec 01 19:18:13 user nova-compute[75066]: DEBUG oslo.service.loopingcall [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75066) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 19:18:13 user nova-compute[75066]: DEBUG nova.compute.manager [-] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Deallocating network for instance {{(pid=75066) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 19:18:13 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] deallocate_for_instance() {{(pid=75066) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 19:18:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:13 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] COPY block job progress, current cursor: 613416960 final cursor: 1073741824 {{(pid=75066) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 19:18:14 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] COPY block job progress, current cursor: 775946240 final cursor: 1073741824 {{(pid=75066) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 19:18:14 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] COPY block job progress, current cursor: 945815552 final cursor: 1073741824 {{(pid=75066) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 19:18:15 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75066) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 19:18:15 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] calling os-brick to detach iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 19:18:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, {'target_iqn': 'iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JBmryjgn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'volume_id': 'c10d14d8-bbda-434e-9572-40dfc759bd95'}, None), 'kwargs': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:18:15 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:18:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:18:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:18:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:15 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[32dfba99-73ba-4356-932d-8f5b9058747e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 19:18:15 user nova-compute[75066]: No targets found.
Dec 01 19:18:15 user nova-compute[75066]: iSNS:
Dec 01 19:18:15 user nova-compute[75066]: No targets found.
Dec 01 19:18:15 user nova-compute[75066]: STATIC:
Dec 01 19:18:15 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829
Dec 01 19:18:15 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:18:15 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:18:15 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a
Dec 01 19:18:15 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:18:15 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:18:15 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95
Dec 01 19:18:15 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:18:15 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:18:15 user nova-compute[75066]: FIRMWARE:
Dec 01 19:18:15 user nova-compute[75066]: No targets found.
Dec 01 19:18:15 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:18:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 19:18:15 user nova-compute[75066]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 19:18:15 user nova-compute[75066]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75066) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 19:18:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95', 0)] {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 19:18:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:15 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2686e07-7866-44f9-b9e3-80cb7d0d485b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:15 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[af418160-a61b-451c-8ee2-27210ed1e2da]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95 (non-flash)
Dec 01 19:18:15 user nova-compute[75066]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a (non-flash)
Dec 01 19:18:15 user nova-compute[75066]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:18:15 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:18:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95 (non-flash)
Dec 01 19:18:15 user nova-compute[75066]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a (non-flash)
Dec 01 19:18:15 user nova-compute[75066]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:18:15 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:18:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9190550c10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95'): ({'sdi'}, set())}) {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 19:18:15 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] Removing single pathed devices sdi {{(pid=75066) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 19:18:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:15 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[717a33ee-2390-44d5-b0c1-c59624e39e30]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:15 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[d81fde55-f19d-4eaf-ad88-203001015723]: (4, ('ok\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:15 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] Flushing IO for device /dev/sdi {{(pid=75066) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 19:18:15 user nova-compute[75066]: DEBUG nova.compute.manager [req-83f384b0-3ea0-4d11-9dbf-d29dc7c49272 req-0fe3a704-4dfc-437a-9547-2e89313c19e6 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received event network-vif-deleted-26418177-564a-4d5b-a37e-91c6334334e9 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:18:15 user nova-compute[75066]: INFO nova.compute.manager [req-83f384b0-3ea0-4d11-9dbf-d29dc7c49272 req-0fe3a704-4dfc-437a-9547-2e89313c19e6 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Neutron deleted interface 26418177-564a-4d5b-a37e-91c6334334e9; detaching it from the instance and deleting it from the info cache
Dec 01 19:18:15 user nova-compute[75066]: DEBUG nova.network.neutron [req-83f384b0-3ea0-4d11-9dbf-d29dc7c49272 req-0fe3a704-4dfc-437a-9547-2e89313c19e6 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Updating instance_info_cache with network_info: [{"id": "b39c07b1-b2c2-45bf-bf1c-1865dfc9ceff", "address": "fa:16:3e:f7:4a:d3", "network": {"id": "c77595ef-65b2-45cd-be6a-8bf0380a449b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-402289383-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb39c07b1-b2", "ovs_interfaceid": "b39c07b1-b2c2-45bf-bf1c-1865dfc9ceff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6eea2787-921d-4d51-aa70-d843d187a47f", "address": "fa:16:3e:7b:03:0e", "network": {"id": "8f2b8b19-449f-4d10-8d47-356d5d5e5338", "bridge": "br-int", "label": "tempest-device-tagging-net1-967030387", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.89", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6eea2787-92", "ovs_interfaceid": "6eea2787-921d-4d51-aa70-d843d187a47f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "fbddb1ea-5cff-4ae8-ac1c-1ee726012aea", "address": "fa:16:3e:63:9b:41", "network": {"id": "8f2b8b19-449f-4d10-8d47-356d5d5e5338", "bridge": "br-int", "label": "tempest-device-tagging-net1-967030387", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.198", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbddb1ea-5c", "ovs_interfaceid": "fbddb1ea-5cff-4ae8-ac1c-1ee726012aea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "294424e7-040a-4720-9012-7353ff25f249", "address": "fa:16:3e:94:c6:01", "network": {"id": "8f2b8b19-449f-4d10-8d47-356d5d5e5338", "bridge": "br-int", "label": "tempest-device-tagging-net1-967030387", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap294424e7-04", "ovs_interfaceid": "294424e7-040a-4720-9012-7353ff25f249", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "21b7577f-898b-4d3b-9ecd-911568f3923f", "address": "fa:16:3e:52:1c:5b", "network": {"id": "88fd1225-bf6b-4d28-bc10-deb410395ac9", "bridge": "br-int", "label": "tempest-device-tagging-net2-224351536", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21b7577f-89", "ovs_interfaceid": "21b7577f-898b-4d3b-9ecd-911568f3923f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "10d4a23a-1f6c-4c81-b937-bfa19dcc3606", "address": "fa:16:3e:c3:1c:9d", "network": {"id": "88fd1225-bf6b-4d28-bc10-deb410395ac9", "bridge": "br-int", "label": "tempest-device-tagging-net2-224351536", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "ea3c2552714a477396da7ad322703173", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap10d4a23a-1f", "ovs_interfaceid": "10d4a23a-1f6c-4c81-b937-bfa19dcc3606", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:18:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.012s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:15 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8065449-0aae-4ba8-aaf4-974b74f36380]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:15 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75066) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 19:18:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:15 user nova-compute[75066]: DEBUG nova.compute.manager [req-83f384b0-3ea0-4d11-9dbf-d29dc7c49272 req-0fe3a704-4dfc-437a-9547-2e89313c19e6 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Detach interface failed, port_id=26418177-564a-4d5b-a37e-91c6334334e9, reason: Instance 6d2de2c4-0c0d-4238-933c-d0ef6538964e could not be found. {{(pid=75066) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 01 19:18:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.046s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:15 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[1221f8e3-0033-453c-9e7d-2bd97d3068b5]: (4, ('1', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:15 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 19:18:15 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] SCSI volumes sdi have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 19:18:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95')] {{(pid=75066) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 19:18:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:15 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ce7155-a0ea-4996-82fd-2083e4eb01c2]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:18:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95 -p 172.16.0.220:3260 --logout {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:15 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[862f01e3-ad74-452a-884b-2ef4bd361e48]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95, portal: 172.16.0.220,3260]
Dec 01 19:18:15 user nova-compute[75066]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95, portal: 172.16.0.220,3260] successful.
Dec 01 19:18:15 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:18:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95 -p 172.16.0.220:3260 --op delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c10d14d8-bbda-434e-9572-40dfc759bd95 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:15 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc83ed24-fa80-4d6a-8ace-33bb8a52935f]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:18:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:18:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] <== disconnect_volume: return (340ms) None {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:18:15 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Disconnected iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 19:18:15 user nova-compute[75066]: DEBUG nova.compute.manager [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FZWvItMl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'dd67db6c-8bd1-402e-93ce-9b2d7a405a6e', 'attached_at': '', 'detached_at': '', 'volume_id': 'ae6d6a5d-9de3-4500-80b2-7c4860102e9a', 'serial'} {{(pid=75066) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Dec 01 19:18:15 user nova-compute[75066]: DEBUG nova.compute.manager [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] swap_volume: removing Cinder connection for volume c10d14d8-bbda-434e-9572-40dfc759bd95 {{(pid=75066) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Dec 01 19:18:16 user nova-compute[75066]: DEBUG nova.compute.manager [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] swap_volume: Updating volume c10d14d8-bbda-434e-9572-40dfc759bd95 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "FZWvItMl", "auth_password": "49t5QVsIyGc8AW", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sde", "volume_id": "ae6d6a5d-9de3-4500-80b2-7c4860102e9a"}, "status": "reserved", "instance": "dd67db6c-8bd1-402e-93ce-9b2d7a405a6e", "attached_at": "", "detached_at": "", "volume_id": "ae6d6a5d-9de3-4500-80b2-7c4860102e9a", "serial": "ae6d6a5d-9de3-4500-80b2-7c4860102e9a"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'ae6d6a5d-9de3-4500-80b2-7c4860102e9a', 'no_device': None, 'attachment_id': '70ee0d00-0935-478c-bd8e-85eabb93e62a'} {{(pid=75066) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Dec 01 19:18:16 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-6e4ce9c9-5168-4638-850d-e932fce5a853 tempest-TestVolumeSwap-468168667 tempest-TestVolumeSwap-468168667-project-admin] Lock "dd67db6c-8bd1-402e-93ce-9b2d7a405a6e" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 17.951s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:18:17 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:17 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:17 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:18:17 user nova-compute[75066]: INFO nova.compute.manager [-] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Took 4.05 seconds to deallocate network for instance.
Dec 01 19:18:17 user nova-compute[75066]: DEBUG nova.compute.manager [req-1e7b0d51-8397-4547-a7f2-816db0cbd032 req-95c370e7-d1d1-48bf-ad01-4ce9b2640c47 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received event network-vif-deleted-21b7577f-898b-4d3b-9ecd-911568f3923f {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:18:17 user nova-compute[75066]: DEBUG nova.compute.manager [req-1e7b0d51-8397-4547-a7f2-816db0cbd032 req-95c370e7-d1d1-48bf-ad01-4ce9b2640c47 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received event network-vif-deleted-294424e7-040a-4720-9012-7353ff25f249 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:18:17 user nova-compute[75066]: DEBUG nova.compute.manager [req-1e7b0d51-8397-4547-a7f2-816db0cbd032 req-95c370e7-d1d1-48bf-ad01-4ce9b2640c47 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received event network-vif-deleted-10d4a23a-1f6c-4c81-b937-bfa19dcc3606 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:18:17 user nova-compute[75066]: DEBUG nova.compute.manager [req-1e7b0d51-8397-4547-a7f2-816db0cbd032 req-95c370e7-d1d1-48bf-ad01-4ce9b2640c47 service nova] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Received event network-vif-deleted-b39c07b1-b2c2-45bf-bf1c-1865dfc9ceff {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:18:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-9ba5b801-3b56-4c0a-90cd-5be582f74b17 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Acquiring lock "dd67db6c-8bd1-402e-93ce-9b2d7a405a6e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:18:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-9ba5b801-3b56-4c0a-90cd-5be582f74b17 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Lock "dd67db6c-8bd1-402e-93ce-9b2d7a405a6e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:18:17 user nova-compute[75066]: INFO nova.compute.manager [None req-9ba5b801-3b56-4c0a-90cd-5be582f74b17 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Detaching volume ae6d6a5d-9de3-4500-80b2-7c4860102e9a
Dec 01 19:18:17 user nova-compute[75066]: INFO nova.virt.block_device [None req-9ba5b801-3b56-4c0a-90cd-5be582f74b17 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Attempting to driver detach volume ae6d6a5d-9de3-4500-80b2-7c4860102e9a from mountpoint /dev/vdb
Dec 01 19:18:17 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-9ba5b801-3b56-4c0a-90cd-5be582f74b17 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Attempting to detach device vdb from instance dd67db6c-8bd1-402e-93ce-9b2d7a405a6e from the persistent domain config. {{(pid=75066) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 19:18:17 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-9ba5b801-3b56-4c0a-90cd-5be582f74b17 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 19:18:17 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:18:17 user nova-compute[75066]:   <source dev="/dev/sde"/>
Dec 01 19:18:17 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:18:17 user nova-compute[75066]:   <serial>ae6d6a5d-9de3-4500-80b2-7c4860102e9a</serial>
Dec 01 19:18:17 user nova-compute[75066]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 19:18:17 user nova-compute[75066]: </disk>
Dec 01 19:18:17 user nova-compute[75066]:  {{(pid=75066) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 19:18:17 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-9ba5b801-3b56-4c0a-90cd-5be582f74b17 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Successfully detached device vdb from instance dd67db6c-8bd1-402e-93ce-9b2d7a405a6e from the persistent domain config.
Dec 01 19:18:17 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-9ba5b801-3b56-4c0a-90cd-5be582f74b17 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance dd67db6c-8bd1-402e-93ce-9b2d7a405a6e from the live domain config. {{(pid=75066) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 19:18:17 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-9ba5b801-3b56-4c0a-90cd-5be582f74b17 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 19:18:17 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:18:17 user nova-compute[75066]:   <source dev="/dev/sde"/>
Dec 01 19:18:17 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:18:17 user nova-compute[75066]:   <serial>ae6d6a5d-9de3-4500-80b2-7c4860102e9a</serial>
Dec 01 19:18:17 user nova-compute[75066]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 19:18:17 user nova-compute[75066]: </disk>
Dec 01 19:18:17 user nova-compute[75066]:  {{(pid=75066) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 19:18:18 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-9ba5b801-3b56-4c0a-90cd-5be582f74b17 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance dd67db6c-8bd1-402e-93ce-9b2d7a405a6e {{(pid=75066) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 19:18:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:21 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:21 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:24 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:24 user nova-compute[75066]: INFO nova.compute.manager [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] [instance: 6d2de2c4-0c0d-4238-933c-d0ef6538964e] Took 7.41 seconds to detach 3 volumes for instance.
Dec 01 19:18:25 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:18:25 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:18:25 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:18:25 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:18:25 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.301s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:18:25 user nova-compute[75066]: INFO nova.scheduler.client.report [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Deleted allocations for instance 6d2de2c4-0c0d-4238-933c-d0ef6538964e
Dec 01 19:18:25 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-bd90bfc6-9fe1-48a3-a374-2bd940e98773 tempest-TaggedBootDevicesTest-752167218 tempest-TaggedBootDevicesTest-752167218-project-member] Lock "6d2de2c4-0c0d-4238-933c-d0ef6538964e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 16.269s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:18:25 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Acquiring lock "10fc72fa-64a3-4704-ad91-2e3ae88d5424" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:18:25 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Lock "10fc72fa-64a3-4704-ad91-2e3ae88d5424" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:18:25 user nova-compute[75066]: DEBUG nova.compute.manager [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Starting instance... {{(pid=75066) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 19:18:25 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:18:25 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:18:25 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75066) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 19:18:25 user nova-compute[75066]: INFO nova.compute.claims [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Claim successful on node user
Dec 01 19:18:26 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:18:26 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:18:26 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.323s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:18:26 user nova-compute[75066]: DEBUG nova.compute.manager [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Start building networks asynchronously for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 19:18:26 user nova-compute[75066]: DEBUG nova.compute.manager [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Allocating IP information in the background. {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 19:18:26 user nova-compute[75066]: DEBUG nova.network.neutron [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] allocate_for_instance() {{(pid=75066) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 19:18:26 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 19:18:26 user nova-compute[75066]: DEBUG nova.compute.manager [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Start building block device mappings for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 19:18:26 user nova-compute[75066]: DEBUG nova.policy [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f1f8fb37cb13473b84de443c51815b1d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5b79591b18f4d35bdd99365c816b55c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75066) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 19:18:26 user nova-compute[75066]: INFO nova.virt.block_device [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Booting with volume a0f565ac-cb88-4957-a726-5589e85dfd5c at /dev/vda
Dec 01 19:18:26 user nova-compute[75066]: DEBUG os_brick.utils [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:18:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:26 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee5dd15-bcae-4ee5-b94f-27ce9d520fd0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1959854982f\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:26 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c416c23-d3bb-4168-9f98-515dfbf1ae5e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:26 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a5f5e7-8601-4072-af59-a28e4e835160]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:26 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a09e457-4ad8-49d5-9eda-ede833f5d84d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Running cmd (subprocess): nvme version {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] 'nvme version' failed. Not Retrying. {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:18:26 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] nvme not present on system {{(pid=75066) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 19:18:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:18:26 user nova-compute[75066]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 19:18:26 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f97fbcb-883c-4073-a782-e018fcdea6c9]: (4, '') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:26 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75066) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 19:18:26 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 19:18:26 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] LIGHTOS: no hostnqn found. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 19:18:26 user nova-compute[75066]: DEBUG os_brick.utils [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1959854982f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:18:26 user nova-compute[75066]: DEBUG nova.virt.block_device [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Updating existing volume attachment record: 99581e80-acb8-4efa-9362-77991d23a957 {{(pid=75066) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 19:18:26 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:26 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:26 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:27 user nova-compute[75066]: DEBUG nova.network.neutron [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Successfully created port: d51d7391-af1b-4160-b3bb-c77d0507a0e0 {{(pid=75066) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 19:18:27 user nova-compute[75066]: DEBUG nova.network.neutron [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Successfully updated port: d51d7391-af1b-4160-b3bb-c77d0507a0e0 {{(pid=75066) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 19:18:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Acquiring lock "refresh_cache-10fc72fa-64a3-4704-ad91-2e3ae88d5424" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:18:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Acquired lock "refresh_cache-10fc72fa-64a3-4704-ad91-2e3ae88d5424" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:18:27 user nova-compute[75066]: DEBUG nova.network.neutron [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:18:27 user nova-compute[75066]: DEBUG nova.compute.manager [req-8254700f-6398-4ab9-913b-62821cf11aa6 req-2a321891-9802-4d98-b829-7f4b2bb198be service nova] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Received event network-changed-d51d7391-af1b-4160-b3bb-c77d0507a0e0 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:18:27 user nova-compute[75066]: DEBUG nova.compute.manager [req-8254700f-6398-4ab9-913b-62821cf11aa6 req-2a321891-9802-4d98-b829-7f4b2bb198be service nova] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Refreshing instance network info cache due to event network-changed-d51d7391-af1b-4160-b3bb-c77d0507a0e0. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:18:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-8254700f-6398-4ab9-913b-62821cf11aa6 req-2a321891-9802-4d98-b829-7f4b2bb198be service nova] Acquiring lock "refresh_cache-10fc72fa-64a3-4704-ad91-2e3ae88d5424" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:18:27 user nova-compute[75066]: DEBUG nova.network.neutron [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:18:28 user nova-compute[75066]: DEBUG nova.network.neutron [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Updating instance_info_cache with network_info: [{"id": "d51d7391-af1b-4160-b3bb-c77d0507a0e0", "address": "fa:16:3e:e9:da:9e", "network": {"id": "4b17d46f-fdbc-4cd7-991c-ca6981e0f20f", "bridge": "br-int", "label": "tempest-TestShelveInstance-2081974203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5b79591b18f4d35bdd99365c816b55c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd51d7391-af", "ovs_interfaceid": "d51d7391-af1b-4160-b3bb-c77d0507a0e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:18:28 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Releasing lock "refresh_cache-10fc72fa-64a3-4704-ad91-2e3ae88d5424" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:18:28 user nova-compute[75066]: DEBUG nova.compute.manager [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Instance network_info: |[{"id": "d51d7391-af1b-4160-b3bb-c77d0507a0e0", "address": "fa:16:3e:e9:da:9e", "network": {"id": "4b17d46f-fdbc-4cd7-991c-ca6981e0f20f", "bridge": "br-int", "label": "tempest-TestShelveInstance-2081974203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5b79591b18f4d35bdd99365c816b55c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd51d7391-af", "ovs_interfaceid": "d51d7391-af1b-4160-b3bb-c77d0507a0e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 19:18:28 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-8254700f-6398-4ab9-913b-62821cf11aa6 req-2a321891-9802-4d98-b829-7f4b2bb198be service nova] Acquired lock "refresh_cache-10fc72fa-64a3-4704-ad91-2e3ae88d5424" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:18:28 user nova-compute[75066]: DEBUG nova.network.neutron [req-8254700f-6398-4ab9-913b-62821cf11aa6 req-2a321891-9802-4d98-b829-7f4b2bb198be service nova] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Refreshing network info cache for port d51d7391-af1b-4160-b3bb-c77d0507a0e0 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:18:28 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Acquiring lock "90c49be6-97aa-45f1-bcbe-b9a3875226a7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:18:28 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "90c49be6-97aa-45f1-bcbe-b9a3875226a7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:18:28 user nova-compute[75066]: DEBUG nova.compute.manager [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Starting instance... {{(pid=75066) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 19:18:28 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:18:28 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:18:28 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75066) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 19:18:28 user nova-compute[75066]: INFO nova.compute.claims [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Claim successful on node user
Dec 01 19:18:28 user nova-compute[75066]: DEBUG nova.network.neutron [req-8254700f-6398-4ab9-913b-62821cf11aa6 req-2a321891-9802-4d98-b829-7f4b2bb198be service nova] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Updated VIF entry in instance network info cache for port d51d7391-af1b-4160-b3bb-c77d0507a0e0. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:18:28 user nova-compute[75066]: DEBUG nova.network.neutron [req-8254700f-6398-4ab9-913b-62821cf11aa6 req-2a321891-9802-4d98-b829-7f4b2bb198be service nova] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Updating instance_info_cache with network_info: [{"id": "d51d7391-af1b-4160-b3bb-c77d0507a0e0", "address": "fa:16:3e:e9:da:9e", "network": {"id": "4b17d46f-fdbc-4cd7-991c-ca6981e0f20f", "bridge": "br-int", "label": "tempest-TestShelveInstance-2081974203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5b79591b18f4d35bdd99365c816b55c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd51d7391-af", "ovs_interfaceid": "d51d7391-af1b-4160-b3bb-c77d0507a0e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:18:28 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-8254700f-6398-4ab9-913b-62821cf11aa6 req-2a321891-9802-4d98-b829-7f4b2bb198be service nova] Releasing lock "refresh_cache-10fc72fa-64a3-4704-ad91-2e3ae88d5424" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:18:28 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:18:28 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:18:28 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.416s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:18:28 user nova-compute[75066]: DEBUG nova.compute.manager [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Start building networks asynchronously for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 19:18:28 user nova-compute[75066]: DEBUG nova.compute.manager [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Allocating IP information in the background. {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 19:18:28 user nova-compute[75066]: DEBUG nova.network.neutron [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] allocate_for_instance() {{(pid=75066) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 19:18:28 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 19:18:28 user nova-compute[75066]: DEBUG nova.compute.manager [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Start building block device mappings for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 19:18:28 user nova-compute[75066]: DEBUG nova.policy [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '964c1681ca8745d0b3879266d24f507e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e000d89bca44cd8acba504256d8d1f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75066) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 19:18:29 user nova-compute[75066]: DEBUG nova.compute.manager [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Start spawning the instance on the hypervisor. {{(pid=75066) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 19:18:29 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Creating instance directory {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 19:18:29 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Creating image(s)
Dec 01 19:18:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Acquiring lock "/opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:18:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "/opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:18:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "/opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:18:29 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:29 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.174s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Acquiring lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:18:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:18:29 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:29 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.174s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:29 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk 1073741824 {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:29 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk 1073741824" returned: 0 in 0.052s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:18:29 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:29 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.195s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:29 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Checking if we can resize image /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk. size=1073741824 {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 19:18:29 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:29 user nova-compute[75066]: DEBUG nova.network.neutron [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Successfully created port: 5ccc5509-ab48-4e15-96b2-5757927fa168 {{(pid=75066) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 19:18:29 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:29 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Cannot resize image /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk to a smaller size. {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 19:18:29 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Created local disks {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 19:18:29 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Ensure instance console log exists: /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/console.log {{(pid=75066) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 19:18:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:18:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:18:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:18:30 user nova-compute[75066]: DEBUG nova.network.neutron [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Successfully updated port: 5ccc5509-ab48-4e15-96b2-5757927fa168 {{(pid=75066) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 19:18:30 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Acquiring lock "refresh_cache-90c49be6-97aa-45f1-bcbe-b9a3875226a7" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:18:30 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Acquired lock "refresh_cache-90c49be6-97aa-45f1-bcbe-b9a3875226a7" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:18:30 user nova-compute[75066]: DEBUG nova.network.neutron [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:18:30 user nova-compute[75066]: DEBUG nova.compute.manager [req-829f498c-19bb-444b-bed2-e2cd27d17220 req-92b8ceed-edc9-432c-939c-6261da56d90f service nova] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Received event network-changed-5ccc5509-ab48-4e15-96b2-5757927fa168 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:18:30 user nova-compute[75066]: DEBUG nova.compute.manager [req-829f498c-19bb-444b-bed2-e2cd27d17220 req-92b8ceed-edc9-432c-939c-6261da56d90f service nova] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Refreshing instance network info cache due to event network-changed-5ccc5509-ab48-4e15-96b2-5757927fa168. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:18:30 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-829f498c-19bb-444b-bed2-e2cd27d17220 req-92b8ceed-edc9-432c-939c-6261da56d90f service nova] Acquiring lock "refresh_cache-90c49be6-97aa-45f1-bcbe-b9a3875226a7" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:18:30 user nova-compute[75066]: DEBUG nova.network.neutron [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:18:30 user nova-compute[75066]: DEBUG nova.network.neutron [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Updating instance_info_cache with network_info: [{"id": "5ccc5509-ab48-4e15-96b2-5757927fa168", "address": "fa:16:3e:eb:66:d7", "network": {"id": "6b0f48b7-3db2-49b2-a238-8fd811b52d62", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1688127634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e000d89bca44cd8acba504256d8d1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccc5509-ab", "ovs_interfaceid": "5ccc5509-ab48-4e15-96b2-5757927fa168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:18:30 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Releasing lock "refresh_cache-90c49be6-97aa-45f1-bcbe-b9a3875226a7" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:18:30 user nova-compute[75066]: DEBUG nova.compute.manager [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Instance network_info: |[{"id": "5ccc5509-ab48-4e15-96b2-5757927fa168", "address": "fa:16:3e:eb:66:d7", "network": {"id": "6b0f48b7-3db2-49b2-a238-8fd811b52d62", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1688127634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e000d89bca44cd8acba504256d8d1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccc5509-ab", "ovs_interfaceid": "5ccc5509-ab48-4e15-96b2-5757927fa168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 19:18:30 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-829f498c-19bb-444b-bed2-e2cd27d17220 req-92b8ceed-edc9-432c-939c-6261da56d90f service nova] Acquired lock "refresh_cache-90c49be6-97aa-45f1-bcbe-b9a3875226a7" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:18:30 user nova-compute[75066]: DEBUG nova.network.neutron [req-829f498c-19bb-444b-bed2-e2cd27d17220 req-92b8ceed-edc9-432c-939c-6261da56d90f service nova] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Refreshing network info cache for port 5ccc5509-ab48-4e15-96b2-5757927fa168 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:18:30 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Start _get_guest_xml network_info=[{"id": "5ccc5509-ab48-4e15-96b2-5757927fa168", "address": "fa:16:3e:eb:66:d7", "network": {"id": "6b0f48b7-3db2-49b2-a238-8fd811b52d62", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1688127634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e000d89bca44cd8acba504256d8d1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccc5509-ab", "ovs_interfaceid": "5ccc5509-ab48-4e15-96b2-5757927fa168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'image_id': '900b237b-e99c-4fdd-a44f-dcb7a08baa86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:18:30 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:18:30 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:18:30 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:18:30 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:18:30 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:18:30 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:18:30 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:18:30 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:18:30 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:18:30 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:18:30 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:18:30 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:18:30 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:18:30 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:18:30 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:18:30 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:18:30 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:18:30 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:18:30 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:18:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1301412549',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1301412549',id=12,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e000d89bca44cd8acba504256d8d1f1',ramdisk_id='',reservation_id='r-xam9baff',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-454493649',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:18:29Z,user_data=None,user_id='964c1681ca8745d0b3879266d24f507e',uuid=90c49be6-97aa-45f1-bcbe-b9a3875226a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ccc5509-ab48-4e15-96b2-5757927fa168", "address": "fa:16:3e:eb:66:d7", "network": {"id": "6b0f48b7-3db2-49b2-a238-8fd811b52d62", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1688127634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e000d89bca44cd8acba504256d8d1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccc5509-ab", "ovs_interfaceid": "5ccc5509-ab48-4e15-96b2-5757927fa168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:18:30 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Converting VIF {"id": "5ccc5509-ab48-4e15-96b2-5757927fa168", "address": "fa:16:3e:eb:66:d7", "network": {"id": "6b0f48b7-3db2-49b2-a238-8fd811b52d62", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1688127634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e000d89bca44cd8acba504256d8d1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccc5509-ab", "ovs_interfaceid": "5ccc5509-ab48-4e15-96b2-5757927fa168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:18:30 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:66:d7,bridge_name='br-int',has_traffic_filtering=True,id=5ccc5509-ab48-4e15-96b2-5757927fa168,network=Network(6b0f48b7-3db2-49b2-a238-8fd811b52d62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ccc5509-ab') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:18:30 user nova-compute[75066]: DEBUG nova.objects.instance [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lazy-loading 'pci_devices' on Instance uuid 90c49be6-97aa-45f1-bcbe-b9a3875226a7 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:18:30 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:18:30 user nova-compute[75066]:   <uuid>90c49be6-97aa-45f1-bcbe-b9a3875226a7</uuid>
Dec 01 19:18:30 user nova-compute[75066]:   <name>instance-0000000c</name>
Dec 01 19:18:30 user nova-compute[75066]:   <memory>524288</memory>
Dec 01 19:18:30 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:18:30 user nova-compute[75066]:   <metadata>
Dec 01 19:18:30 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:18:30 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:18:30 user nova-compute[75066]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1301412549</nova:name>
Dec 01 19:18:30 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:18:30</nova:creationTime>
Dec 01 19:18:30 user nova-compute[75066]:       <nova:flavor name="m1.tiny">
Dec 01 19:18:30 user nova-compute[75066]:         <nova:memory>512</nova:memory>
Dec 01 19:18:30 user nova-compute[75066]:         <nova:disk>1</nova:disk>
Dec 01 19:18:30 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:18:30 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:18:30 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:18:30 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:18:30 user nova-compute[75066]:       <nova:owner>
Dec 01 19:18:30 user nova-compute[75066]:         <nova:user uuid="964c1681ca8745d0b3879266d24f507e">tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member</nova:user>
Dec 01 19:18:30 user nova-compute[75066]:         <nova:project uuid="2e000d89bca44cd8acba504256d8d1f1">tempest-ServerBootFromVolumeStableRescueTest-454493649</nova:project>
Dec 01 19:18:30 user nova-compute[75066]:       </nova:owner>
Dec 01 19:18:30 user nova-compute[75066]:       <nova:root type="image" uuid="900b237b-e99c-4fdd-a44f-dcb7a08baa86"/>
Dec 01 19:18:30 user nova-compute[75066]:       <nova:ports>
Dec 01 19:18:30 user nova-compute[75066]:         <nova:port uuid="5ccc5509-ab48-4e15-96b2-5757927fa168">
Dec 01 19:18:30 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Dec 01 19:18:30 user nova-compute[75066]:         </nova:port>
Dec 01 19:18:30 user nova-compute[75066]:       </nova:ports>
Dec 01 19:18:30 user nova-compute[75066]:     </nova:instance>
Dec 01 19:18:30 user nova-compute[75066]:   </metadata>
Dec 01 19:18:30 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:18:30 user nova-compute[75066]:     <system>
Dec 01 19:18:30 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:18:30 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:18:30 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:18:30 user nova-compute[75066]:       <entry name="serial">90c49be6-97aa-45f1-bcbe-b9a3875226a7</entry>
Dec 01 19:18:30 user nova-compute[75066]:       <entry name="uuid">90c49be6-97aa-45f1-bcbe-b9a3875226a7</entry>
Dec 01 19:18:30 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:18:30 user nova-compute[75066]:     </system>
Dec 01 19:18:30 user nova-compute[75066]:   </sysinfo>
Dec 01 19:18:30 user nova-compute[75066]:   <os>
Dec 01 19:18:30 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:18:30 user nova-compute[75066]:     <boot dev="hd"/>
Dec 01 19:18:30 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:18:30 user nova-compute[75066]:   </os>
Dec 01 19:18:30 user nova-compute[75066]:   <features>
Dec 01 19:18:30 user nova-compute[75066]:     <acpi/>
Dec 01 19:18:30 user nova-compute[75066]:     <apic/>
Dec 01 19:18:30 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:18:30 user nova-compute[75066]:   </features>
Dec 01 19:18:30 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:18:30 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:18:30 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:18:30 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:18:30 user nova-compute[75066]:   </clock>
Dec 01 19:18:30 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:18:30 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:18:30 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:18:30 user nova-compute[75066]:   </cpu>
Dec 01 19:18:30 user nova-compute[75066]:   <devices>
Dec 01 19:18:30 user nova-compute[75066]:     <disk type="file" device="disk">
Dec 01 19:18:30 user nova-compute[75066]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 19:18:30 user nova-compute[75066]:       <source file="/opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk"/>
Dec 01 19:18:30 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:18:30 user nova-compute[75066]:     </disk>
Dec 01 19:18:30 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:18:30 user nova-compute[75066]:       <mac address="fa:16:3e:eb:66:d7"/>
Dec 01 19:18:30 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:18:30 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:18:30 user nova-compute[75066]:       <target dev="tap5ccc5509-ab"/>
Dec 01 19:18:30 user nova-compute[75066]:     </interface>
Dec 01 19:18:30 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:18:30 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/console.log" append="off"/>
Dec 01 19:18:30 user nova-compute[75066]:     </serial>
Dec 01 19:18:30 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:18:30 user nova-compute[75066]:     <video>
Dec 01 19:18:30 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:18:30 user nova-compute[75066]:     </video>
Dec 01 19:18:30 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:18:30 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:18:30 user nova-compute[75066]:     </rng>
Dec 01 19:18:30 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:18:30 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:18:30 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:18:30 user nova-compute[75066]:     </memballoon>
Dec 01 19:18:30 user nova-compute[75066]:   </devices>
Dec 01 19:18:30 user nova-compute[75066]: </domain>
Dec 01 19:18:30 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:18:30 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:18:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1301412549',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1301412549',id=12,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e000d89bca44cd8acba504256d8d1f1',ramdisk_id='',reservation_id='r-xam9baff',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-454493649',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:18:29Z,user_data=None,user_id='964c1681ca8745d0b3879266d24f507e',uuid=90c49be6-97aa-45f1-bcbe-b9a3875226a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ccc5509-ab48-4e15-96b2-5757927fa168", "address": "fa:16:3e:eb:66:d7", "network": {"id": "6b0f48b7-3db2-49b2-a238-8fd811b52d62", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1688127634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e000d89bca44cd8acba504256d8d1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccc5509-ab", "ovs_interfaceid": "5ccc5509-ab48-4e15-96b2-5757927fa168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:18:30 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Converting VIF {"id": "5ccc5509-ab48-4e15-96b2-5757927fa168", "address": "fa:16:3e:eb:66:d7", "network": {"id": "6b0f48b7-3db2-49b2-a238-8fd811b52d62", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1688127634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e000d89bca44cd8acba504256d8d1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccc5509-ab", "ovs_interfaceid": "5ccc5509-ab48-4e15-96b2-5757927fa168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:18:30 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:66:d7,bridge_name='br-int',has_traffic_filtering=True,id=5ccc5509-ab48-4e15-96b2-5757927fa168,network=Network(6b0f48b7-3db2-49b2-a238-8fd811b52d62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ccc5509-ab') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:18:30 user nova-compute[75066]: DEBUG os_vif [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:66:d7,bridge_name='br-int',has_traffic_filtering=True,id=5ccc5509-ab48-4e15-96b2-5757927fa168,network=Network(6b0f48b7-3db2-49b2-a238-8fd811b52d62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ccc5509-ab') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:18:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:18:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:18:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bf5c8a9e-a123-5fd0-a496-779de62c65b6', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:18:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:18:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ccc5509-ab, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:18:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5ccc5509-ab, col_values=(('qos', UUID('759d17ae-36f0-4d6c-8983-62a258798bc1')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:18:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5ccc5509-ab, col_values=(('external_ids', {'iface-id': '5ccc5509-ab48-4e15-96b2-5757927fa168', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:66:d7', 'vm-uuid': '90c49be6-97aa-45f1-bcbe-b9a3875226a7'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:18:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:18:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:30 user nova-compute[75066]: INFO os_vif [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:66:d7,bridge_name='br-int',has_traffic_filtering=True,id=5ccc5509-ab48-4e15-96b2-5757927fa168,network=Network(6b0f48b7-3db2-49b2-a238-8fd811b52d62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ccc5509-ab')
Dec 01 19:18:31 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:18:31 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] No VIF found with MAC fa:16:3e:eb:66:d7, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:18:31 user nova-compute[75066]: DEBUG nova.network.neutron [req-829f498c-19bb-444b-bed2-e2cd27d17220 req-92b8ceed-edc9-432c-939c-6261da56d90f service nova] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Updated VIF entry in instance network info cache for port 5ccc5509-ab48-4e15-96b2-5757927fa168. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:18:31 user nova-compute[75066]: DEBUG nova.network.neutron [req-829f498c-19bb-444b-bed2-e2cd27d17220 req-92b8ceed-edc9-432c-939c-6261da56d90f service nova] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Updating instance_info_cache with network_info: [{"id": "5ccc5509-ab48-4e15-96b2-5757927fa168", "address": "fa:16:3e:eb:66:d7", "network": {"id": "6b0f48b7-3db2-49b2-a238-8fd811b52d62", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1688127634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e000d89bca44cd8acba504256d8d1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccc5509-ab", "ovs_interfaceid": "5ccc5509-ab48-4e15-96b2-5757927fa168", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:18:31 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-829f498c-19bb-444b-bed2-e2cd27d17220 req-92b8ceed-edc9-432c-939c-6261da56d90f service nova] Releasing lock "refresh_cache-90c49be6-97aa-45f1-bcbe-b9a3875226a7" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:18:31 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:32 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:32 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:32 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:32 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:32 user nova-compute[75066]: DEBUG nova.compute.manager [req-ed728d47-8745-4cb1-a11c-d85947e6e6f4 req-633f4cc0-1fbd-43a6-9a08-4621f0dff01c service nova] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Received event network-vif-plugged-5ccc5509-ab48-4e15-96b2-5757927fa168 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:18:32 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-ed728d47-8745-4cb1-a11c-d85947e6e6f4 req-633f4cc0-1fbd-43a6-9a08-4621f0dff01c service nova] Acquiring lock "90c49be6-97aa-45f1-bcbe-b9a3875226a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:18:32 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-ed728d47-8745-4cb1-a11c-d85947e6e6f4 req-633f4cc0-1fbd-43a6-9a08-4621f0dff01c service nova] Lock "90c49be6-97aa-45f1-bcbe-b9a3875226a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:18:32 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-ed728d47-8745-4cb1-a11c-d85947e6e6f4 req-633f4cc0-1fbd-43a6-9a08-4621f0dff01c service nova] Lock "90c49be6-97aa-45f1-bcbe-b9a3875226a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:18:32 user nova-compute[75066]: DEBUG nova.compute.manager [req-ed728d47-8745-4cb1-a11c-d85947e6e6f4 req-633f4cc0-1fbd-43a6-9a08-4621f0dff01c service nova] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] No waiting events found dispatching network-vif-plugged-5ccc5509-ab48-4e15-96b2-5757927fa168 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:18:32 user nova-compute[75066]: WARNING nova.compute.manager [req-ed728d47-8745-4cb1-a11c-d85947e6e6f4 req-633f4cc0-1fbd-43a6-9a08-4621f0dff01c service nova] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Received unexpected event network-vif-plugged-5ccc5509-ab48-4e15-96b2-5757927fa168 for instance with vm_state building and task_state spawning.
Dec 01 19:18:32 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:34 user nova-compute[75066]: DEBUG nova.compute.manager [req-e08cf4ec-8717-4c56-bec7-221e56bf6482 req-f972aeba-7edd-4148-8940-ed5fc8c53312 service nova] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Received event network-vif-plugged-5ccc5509-ab48-4e15-96b2-5757927fa168 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:18:34 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-e08cf4ec-8717-4c56-bec7-221e56bf6482 req-f972aeba-7edd-4148-8940-ed5fc8c53312 service nova] Acquiring lock "90c49be6-97aa-45f1-bcbe-b9a3875226a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:18:34 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-e08cf4ec-8717-4c56-bec7-221e56bf6482 req-f972aeba-7edd-4148-8940-ed5fc8c53312 service nova] Lock "90c49be6-97aa-45f1-bcbe-b9a3875226a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:18:34 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-e08cf4ec-8717-4c56-bec7-221e56bf6482 req-f972aeba-7edd-4148-8940-ed5fc8c53312 service nova] Lock "90c49be6-97aa-45f1-bcbe-b9a3875226a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:18:34 user nova-compute[75066]: DEBUG nova.compute.manager [req-e08cf4ec-8717-4c56-bec7-221e56bf6482 req-f972aeba-7edd-4148-8940-ed5fc8c53312 service nova] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] No waiting events found dispatching network-vif-plugged-5ccc5509-ab48-4e15-96b2-5757927fa168 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:18:34 user nova-compute[75066]: WARNING nova.compute.manager [req-e08cf4ec-8717-4c56-bec7-221e56bf6482 req-f972aeba-7edd-4148-8940-ed5fc8c53312 service nova] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Received unexpected event network-vif-plugged-5ccc5509-ab48-4e15-96b2-5757927fa168 for instance with vm_state building and task_state spawning.
Dec 01 19:18:34 user nova-compute[75066]: DEBUG nova.compute.manager [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Instance event wait completed in 0 seconds for  {{(pid=75066) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 19:18:34 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Guest created on hypervisor {{(pid=75066) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 19:18:34 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Instance spawned successfully.
Dec 01 19:18:34 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 19:18:34 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Found default for hw_cdrom_bus of ide {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:18:34 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Found default for hw_disk_bus of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:18:34 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Found default for hw_input_bus of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:18:34 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Found default for hw_pointer_model of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:18:34 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Found default for hw_video_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:18:34 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Found default for hw_vif_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:18:34 user nova-compute[75066]: INFO nova.compute.manager [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Took 5.91 seconds to spawn the instance on the hypervisor.
Dec 01 19:18:34 user nova-compute[75066]: DEBUG nova.compute.manager [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:18:35 user nova-compute[75066]: INFO nova.compute.manager [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Took 6.71 seconds to build instance.
Dec 01 19:18:35 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-3328f9dd-575a-4e15-9b0a-15026e4eca1f tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "90c49be6-97aa-45f1-bcbe-b9a3875226a7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.839s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:18:35 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG nova.compute.manager [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Start spawning the instance on the hypervisor. {{(pid=75066) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Creating instance directory {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 19:18:36 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Creating image(s)
Dec 01 19:18:36 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Did not create local disks {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Ensure instance console log exists: /opt/stack/data/nova/instances/10fc72fa-64a3-4704-ad91-2e3ae88d5424/console.log {{(pid=75066) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Start _get_guest_xml network_info=[{"id": "d51d7391-af1b-4160-b3bb-c77d0507a0e0", "address": "fa:16:3e:e9:da:9e", "network": {"id": "4b17d46f-fdbc-4cd7-991c-ca6981e0f20f", "bridge": "br-int", "label": "tempest-TestShelveInstance-2081974203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5b79591b18f4d35bdd99365c816b55c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd51d7391-af", "ovs_interfaceid": "d51d7391-af1b-4160-b3bb-c77d0507a0e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': True, 'attachment_id': '99581e80-acb8-4efa-9362-77991d23a957', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wmuOJlqG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '10fc72fa-64a3-4704-ad91-2e3ae88d5424', 'attached_at': '', 'detached_at': '', 'volume_id': 'a0f565ac-cb88-4957-a726-5589e85dfd5c', 'serial': 'a0f565ac-cb88-4957-a726-5589e85dfd5c'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:18:36 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:18:36 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:18:36 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Calling os-brick to attach iSCSI Volume {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wmuOJlqG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:18:36 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:18:36 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:18:36 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:18:36 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:18:36 user nova-compute[75066]: INFO os_brick.initiator.connectors.iscsi [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 19:18:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c -p 172.16.0.220:3260 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[812df71b-3553-45e2-8097-87f4caa416fa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 19:18:36 user nova-compute[75066]:  {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c -p 172.16.0.220:3260 --interface default --op new {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[cefc5546-e510-4707-91dc-3f0590705dca]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c] added\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c] added
Dec 01 19:18:36 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c23aa1c-5a21-48ea-b175-fd3251e99ae6]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f220e8a-4450-41c9-9ce9-69824463e81c]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wmuOJlqG {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wmuOJlqG" returned: 0 in 0.016s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf46f911-cf5c-4b79-90d7-2b2c187873f6]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wmuOJlqG'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7afef33-50dc-426a-b517-6deda1bd6534]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab857b1-4f4e-46ba-b009-7acddeee2042]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a (non-flash)
Dec 01 19:18:36 user nova-compute[75066]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:18:36 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a (non-flash)
Dec 01 19:18:36 user nova-compute[75066]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:18:36 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c -p 172.16.0.220:3260 --login {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b005d56-583e-4ddd-8ba8-2a0f254ea062]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c, portal: 172.16.0.220,3260]
Dec 01 19:18:36 user nova-compute[75066]: Login to [iface: default, target: iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c, portal: 172.16.0.220,3260] successful.
Dec 01 19:18:36 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.063s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb27735-5b5f-4a82-9007-b79d1a01f203]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[115485d5-3dcb-4ec5-a733-f1556b0b272c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a (non-flash)
Dec 01 19:18:36 user nova-compute[75066]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)
Dec 01 19:18:36 user nova-compute[75066]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:18:36 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a (non-flash)
Dec 01 19:18:36 user nova-compute[75066]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)
Dec 01 19:18:36 user nova-compute[75066]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:18:36 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Connected to 172.16.0.220:3260 {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] HCTL ('33', '-', '-', 0) found on session 12 with lun 0 {{(pid=75066) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75066) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.049s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[3503969a-2ec5-439d-beb8-fa43c7358b7f]: (4, ('- - 0', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Searching for a device in session 12 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wmuOJlqG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 19:18:36 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:37 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.376s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:18:37 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] <== connect_volume: return (1377ms) {'type': 'block', 'scsi_wwn': '23566316565613133', 'path': '/dev/sdb'} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:18:37 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23566316565613133', 'path': '/dev/sdb'} {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 19:18:37 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:18:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-599780298',display_name='tempest-TestShelveInstance-server-599780298',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-599780298',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOYMosdOMr3YsggFBWlatcebyefVvtCf4/e1UEHGdqfc/vbH6hEB++iXmGS2/+7YSOkIMjPRUBdmwX9FH/UkGY12pJtMicJWhONuHwVC52MSXXi4pg9ytKnzTre4nG3Ezg==',key_name='tempest-TestShelveInstance-1519500384',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f5b79591b18f4d35bdd99365c816b55c',ramdisk_id='',reservation_id='r-qdcti0kh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1574356427',owner_user_name='tempest-TestShelveInstance-1574356427-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:18:26Z,user_data=None,user_id='f1f8fb37cb13473b84de443c51815b1d',uuid=10fc72fa-64a3-4704-ad91-2e3ae88d5424,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d51d7391-af1b-4160-b3bb-c77d0507a0e0", "address": "fa:16:3e:e9:da:9e", "network": {"id": "4b17d46f-fdbc-4cd7-991c-ca6981e0f20f", "bridge": "br-int", "label": "tempest-TestShelveInstance-2081974203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5b79591b18f4d35bdd99365c816b55c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd51d7391-af", "ovs_interfaceid": "d51d7391-af1b-4160-b3bb-c77d0507a0e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:18:37 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Converting VIF {"id": "d51d7391-af1b-4160-b3bb-c77d0507a0e0", "address": "fa:16:3e:e9:da:9e", "network": {"id": "4b17d46f-fdbc-4cd7-991c-ca6981e0f20f", "bridge": "br-int", "label": "tempest-TestShelveInstance-2081974203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5b79591b18f4d35bdd99365c816b55c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd51d7391-af", "ovs_interfaceid": "d51d7391-af1b-4160-b3bb-c77d0507a0e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:18:37 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:da:9e,bridge_name='br-int',has_traffic_filtering=True,id=d51d7391-af1b-4160-b3bb-c77d0507a0e0,network=Network(4b17d46f-fdbc-4cd7-991c-ca6981e0f20f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd51d7391-af') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:18:37 user nova-compute[75066]: DEBUG nova.objects.instance [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Lazy-loading 'pci_devices' on Instance uuid 10fc72fa-64a3-4704-ad91-2e3ae88d5424 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:18:37 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:18:37 user nova-compute[75066]:   <uuid>10fc72fa-64a3-4704-ad91-2e3ae88d5424</uuid>
Dec 01 19:18:37 user nova-compute[75066]:   <name>instance-0000000b</name>
Dec 01 19:18:37 user nova-compute[75066]:   <memory>524288</memory>
Dec 01 19:18:37 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:18:37 user nova-compute[75066]:   <metadata>
Dec 01 19:18:37 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:18:37 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:18:37 user nova-compute[75066]:       <nova:name>tempest-TestShelveInstance-server-599780298</nova:name>
Dec 01 19:18:37 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:18:36</nova:creationTime>
Dec 01 19:18:37 user nova-compute[75066]:       <nova:flavor name="m1.tiny">
Dec 01 19:18:37 user nova-compute[75066]:         <nova:memory>512</nova:memory>
Dec 01 19:18:37 user nova-compute[75066]:         <nova:disk>1</nova:disk>
Dec 01 19:18:37 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:18:37 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:18:37 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:18:37 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:18:37 user nova-compute[75066]:       <nova:owner>
Dec 01 19:18:37 user nova-compute[75066]:         <nova:user uuid="f1f8fb37cb13473b84de443c51815b1d">tempest-TestShelveInstance-1574356427-project-member</nova:user>
Dec 01 19:18:37 user nova-compute[75066]:         <nova:project uuid="f5b79591b18f4d35bdd99365c816b55c">tempest-TestShelveInstance-1574356427</nova:project>
Dec 01 19:18:37 user nova-compute[75066]:       </nova:owner>
Dec 01 19:18:37 user nova-compute[75066]:       <nova:ports>
Dec 01 19:18:37 user nova-compute[75066]:         <nova:port uuid="d51d7391-af1b-4160-b3bb-c77d0507a0e0">
Dec 01 19:18:37 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Dec 01 19:18:37 user nova-compute[75066]:         </nova:port>
Dec 01 19:18:37 user nova-compute[75066]:       </nova:ports>
Dec 01 19:18:37 user nova-compute[75066]:     </nova:instance>
Dec 01 19:18:37 user nova-compute[75066]:   </metadata>
Dec 01 19:18:37 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:18:37 user nova-compute[75066]:     <system>
Dec 01 19:18:37 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:18:37 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:18:37 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:18:37 user nova-compute[75066]:       <entry name="serial">10fc72fa-64a3-4704-ad91-2e3ae88d5424</entry>
Dec 01 19:18:37 user nova-compute[75066]:       <entry name="uuid">10fc72fa-64a3-4704-ad91-2e3ae88d5424</entry>
Dec 01 19:18:37 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:18:37 user nova-compute[75066]:     </system>
Dec 01 19:18:37 user nova-compute[75066]:   </sysinfo>
Dec 01 19:18:37 user nova-compute[75066]:   <os>
Dec 01 19:18:37 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:18:37 user nova-compute[75066]:     <boot dev="hd"/>
Dec 01 19:18:37 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:18:37 user nova-compute[75066]:   </os>
Dec 01 19:18:37 user nova-compute[75066]:   <features>
Dec 01 19:18:37 user nova-compute[75066]:     <acpi/>
Dec 01 19:18:37 user nova-compute[75066]:     <apic/>
Dec 01 19:18:37 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:18:37 user nova-compute[75066]:   </features>
Dec 01 19:18:37 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:18:37 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:18:37 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:18:37 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:18:37 user nova-compute[75066]:   </clock>
Dec 01 19:18:37 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:18:37 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:18:37 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:18:37 user nova-compute[75066]:   </cpu>
Dec 01 19:18:37 user nova-compute[75066]:   <devices>
Dec 01 19:18:37 user nova-compute[75066]:     <disk type="block" device="disk">
Dec 01 19:18:37 user nova-compute[75066]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:18:37 user nova-compute[75066]:       <source dev="/dev/sdb"/>
Dec 01 19:18:37 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:18:37 user nova-compute[75066]:       <serial>a0f565ac-cb88-4957-a726-5589e85dfd5c</serial>
Dec 01 19:18:37 user nova-compute[75066]:     </disk>
Dec 01 19:18:37 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:18:37 user nova-compute[75066]:       <mac address="fa:16:3e:e9:da:9e"/>
Dec 01 19:18:37 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:18:37 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:18:37 user nova-compute[75066]:       <target dev="tapd51d7391-af"/>
Dec 01 19:18:37 user nova-compute[75066]:     </interface>
Dec 01 19:18:37 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:18:37 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/10fc72fa-64a3-4704-ad91-2e3ae88d5424/console.log" append="off"/>
Dec 01 19:18:37 user nova-compute[75066]:     </serial>
Dec 01 19:18:37 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:18:37 user nova-compute[75066]:     <video>
Dec 01 19:18:37 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:18:37 user nova-compute[75066]:     </video>
Dec 01 19:18:37 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:18:37 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:18:37 user nova-compute[75066]:     </rng>
Dec 01 19:18:37 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:18:37 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:18:37 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:18:37 user nova-compute[75066]:     </memballoon>
Dec 01 19:18:37 user nova-compute[75066]:   </devices>
Dec 01 19:18:37 user nova-compute[75066]: </domain>
Dec 01 19:18:37 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:18:37 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:18:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-599780298',display_name='tempest-TestShelveInstance-server-599780298',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-599780298',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOYMosdOMr3YsggFBWlatcebyefVvtCf4/e1UEHGdqfc/vbH6hEB++iXmGS2/+7YSOkIMjPRUBdmwX9FH/UkGY12pJtMicJWhONuHwVC52MSXXi4pg9ytKnzTre4nG3Ezg==',key_name='tempest-TestShelveInstance-1519500384',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f5b79591b18f4d35bdd99365c816b55c',ramdisk_id='',reservation_id='r-qdcti0kh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1574356427',owner_user_name='tempest-TestShelveInstance-1574356427-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:18:26Z,user_data=None,user_id='f1f8fb37cb13473b84de443c51815b1d',uuid=10fc72fa-64a3-4704-ad91-2e3ae88d5424,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d51d7391-af1b-4160-b3bb-c77d0507a0e0", "address": "fa:16:3e:e9:da:9e", "network": {"id": "4b17d46f-fdbc-4cd7-991c-ca6981e0f20f", "bridge": "br-int", "label": "tempest-TestShelveInstance-2081974203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5b79591b18f4d35bdd99365c816b55c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd51d7391-af", "ovs_interfaceid": "d51d7391-af1b-4160-b3bb-c77d0507a0e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:18:37 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Converting VIF {"id": "d51d7391-af1b-4160-b3bb-c77d0507a0e0", "address": "fa:16:3e:e9:da:9e", "network": {"id": "4b17d46f-fdbc-4cd7-991c-ca6981e0f20f", "bridge": "br-int", "label": "tempest-TestShelveInstance-2081974203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5b79591b18f4d35bdd99365c816b55c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd51d7391-af", "ovs_interfaceid": "d51d7391-af1b-4160-b3bb-c77d0507a0e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:18:37 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:da:9e,bridge_name='br-int',has_traffic_filtering=True,id=d51d7391-af1b-4160-b3bb-c77d0507a0e0,network=Network(4b17d46f-fdbc-4cd7-991c-ca6981e0f20f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd51d7391-af') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:18:37 user nova-compute[75066]: DEBUG os_vif [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:da:9e,bridge_name='br-int',has_traffic_filtering=True,id=d51d7391-af1b-4160-b3bb-c77d0507a0e0,network=Network(4b17d46f-fdbc-4cd7-991c-ca6981e0f20f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd51d7391-af') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:18:37 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:37 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:18:37 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:18:37 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:37 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5090397c-a1be-5c7f-ba44-8e789b2fa442', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:18:37 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:18:37 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:37 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:37 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd51d7391-af, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:18:37 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd51d7391-af, col_values=(('qos', UUID('b29774ee-ca81-4e21-af61-955ec7013301')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:18:37 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd51d7391-af, col_values=(('external_ids', {'iface-id': 'd51d7391-af1b-4160-b3bb-c77d0507a0e0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:da:9e', 'vm-uuid': '10fc72fa-64a3-4704-ad91-2e3ae88d5424'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:18:37 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:18:37 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:37 user nova-compute[75066]: INFO os_vif [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:da:9e,bridge_name='br-int',has_traffic_filtering=True,id=d51d7391-af1b-4160-b3bb-c77d0507a0e0,network=Network(4b17d46f-fdbc-4cd7-991c-ca6981e0f20f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd51d7391-af')
Dec 01 19:18:37 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:18:37 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] No VIF found with MAC fa:16:3e:e9:da:9e, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:18:38 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-9ba5b801-3b56-4c0a-90cd-5be582f74b17 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance dd67db6c-8bd1-402e-93ce-9b2d7a405a6e is timed out.
Dec 01 19:18:38 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-9ba5b801-3b56-4c0a-90cd-5be582f74b17 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Successfully detached device vdb from instance dd67db6c-8bd1-402e-93ce-9b2d7a405a6e from the live domain config.
Dec 01 19:18:38 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ba5b801-3b56-4c0a-90cd-5be582f74b17 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] calling os-brick to detach iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 19:18:38 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba5b801-3b56-4c0a-90cd-5be582f74b17 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, {'target_iqn': 'iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FZWvItMl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': 'ae6d6a5d-9de3-4500-80b2-7c4860102e9a'}, None), 'kwargs': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:18:38 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-9ba5b801-3b56-4c0a-90cd-5be582f74b17 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:18:38 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-9ba5b801-3b56-4c0a-90cd-5be582f74b17 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:18:38 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-9ba5b801-3b56-4c0a-90cd-5be582f74b17 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:18:38 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:38 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:38 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[3289523a-7287-46ed-bae4-9ac376758577]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:38 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba5b801-3b56-4c0a-90cd-5be582f74b17 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 19:18:38 user nova-compute[75066]: No targets found.
Dec 01 19:18:38 user nova-compute[75066]: iSNS:
Dec 01 19:18:38 user nova-compute[75066]: No targets found.
Dec 01 19:18:38 user nova-compute[75066]: STATIC:
Dec 01 19:18:38 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829
Dec 01 19:18:38 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:18:38 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:18:38 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a
Dec 01 19:18:38 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:18:38 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:18:38 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c
Dec 01 19:18:38 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:18:38 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:18:38 user nova-compute[75066]: FIRMWARE:
Dec 01 19:18:38 user nova-compute[75066]: No targets found.
Dec 01 19:18:38 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:18:38 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba5b801-3b56-4c0a-90cd-5be582f74b17 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 19:18:38 user nova-compute[75066]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 19:18:38 user nova-compute[75066]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75066) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 19:18:38 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba5b801-3b56-4c0a-90cd-5be582f74b17 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a', 0)] {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 19:18:38 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:38 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:38 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[429588c6-4f08-404c-a175-173b103a9677]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:38 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:38 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:38 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44d2a89-1922-496b-854b-96076113b340]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:38 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba5b801-3b56-4c0a-90cd-5be582f74b17 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a (non-flash)
Dec 01 19:18:38 user nova-compute[75066]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)
Dec 01 19:18:38 user nova-compute[75066]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:18:38 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:18:38 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba5b801-3b56-4c0a-90cd-5be582f74b17 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a (non-flash)
Dec 01 19:18:38 user nova-compute[75066]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)
Dec 01 19:18:38 user nova-compute[75066]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:18:38 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:18:38 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba5b801-3b56-4c0a-90cd-5be582f74b17 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9190515630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a'): ({'sde'}, set())}) {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 19:18:38 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-9ba5b801-3b56-4c0a-90cd-5be582f74b17 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Removing single pathed devices sde {{(pid=75066) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 19:18:38 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:38 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:38 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf40f7c3-b9d9-4898-89b9-212285b96d21]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:38 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:38 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:38 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[57dce343-41c2-4aa5-b57d-120d0362bd86]: (4, ('ok\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:38 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-9ba5b801-3b56-4c0a-90cd-5be582f74b17 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Flushing IO for device /dev/sde {{(pid=75066) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 19:18:38 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:38 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:38 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8567c95-fd5a-4971-8ca4-f94307cace95]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:38 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-9ba5b801-3b56-4c0a-90cd-5be582f74b17 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75066) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 19:18:38 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:38 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.036s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:38 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[f087a683-21ed-450c-aa7e-1e510fff2b96]: (4, ('1', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:38 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-9ba5b801-3b56-4c0a-90cd-5be582f74b17 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 19:18:38 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-9ba5b801-3b56-4c0a-90cd-5be582f74b17 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] SCSI volumes sde have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 19:18:38 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba5b801-3b56-4c0a-90cd-5be582f74b17 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a')] {{(pid=75066) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 19:18:38 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:38 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:38 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[091f3bca-83f2-4ed3-8fc2-c6151a7b9a38]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:38 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba5b801-3b56-4c0a-90cd-5be582f74b17 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:18:38 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a -p 172.16.0.220:3260 --logout {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:38 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:38 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a16ed5-8ae4-4c2c-b020-d98a1f451bcb]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:38 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba5b801-3b56-4c0a-90cd-5be582f74b17 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a, portal: 172.16.0.220,3260]
Dec 01 19:18:38 user nova-compute[75066]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a, portal: 172.16.0.220,3260] successful.
Dec 01 19:18:38 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:18:38 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a -p 172.16.0.220:3260 --op delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:38 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ae6d6a5d-9de3-4500-80b2-7c4860102e9a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:38 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab6931f0-a234-4b4a-98c3-1670c891765f]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:38 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba5b801-3b56-4c0a-90cd-5be582f74b17 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:18:38 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-9ba5b801-3b56-4c0a-90cd-5be582f74b17 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:18:38 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba5b801-3b56-4c0a-90cd-5be582f74b17 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] <== disconnect_volume: return (338ms) None {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:18:38 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ba5b801-3b56-4c0a-90cd-5be582f74b17 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Disconnected iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 19:18:39 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:39 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:39 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:39 user nova-compute[75066]: DEBUG nova.compute.manager [req-0d7f9ef0-a25d-4ef7-97ee-02d07e7eb199 req-a25b6273-db8c-47da-90fb-80264aac41e9 service nova] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Received event network-vif-plugged-d51d7391-af1b-4160-b3bb-c77d0507a0e0 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:18:39 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-0d7f9ef0-a25d-4ef7-97ee-02d07e7eb199 req-a25b6273-db8c-47da-90fb-80264aac41e9 service nova] Acquiring lock "10fc72fa-64a3-4704-ad91-2e3ae88d5424-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:18:39 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-0d7f9ef0-a25d-4ef7-97ee-02d07e7eb199 req-a25b6273-db8c-47da-90fb-80264aac41e9 service nova] Lock "10fc72fa-64a3-4704-ad91-2e3ae88d5424-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:18:39 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-0d7f9ef0-a25d-4ef7-97ee-02d07e7eb199 req-a25b6273-db8c-47da-90fb-80264aac41e9 service nova] Lock "10fc72fa-64a3-4704-ad91-2e3ae88d5424-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:18:39 user nova-compute[75066]: DEBUG nova.compute.manager [req-0d7f9ef0-a25d-4ef7-97ee-02d07e7eb199 req-a25b6273-db8c-47da-90fb-80264aac41e9 service nova] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] No waiting events found dispatching network-vif-plugged-d51d7391-af1b-4160-b3bb-c77d0507a0e0 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:18:39 user nova-compute[75066]: WARNING nova.compute.manager [req-0d7f9ef0-a25d-4ef7-97ee-02d07e7eb199 req-a25b6273-db8c-47da-90fb-80264aac41e9 service nova] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Received unexpected event network-vif-plugged-d51d7391-af1b-4160-b3bb-c77d0507a0e0 for instance with vm_state building and task_state spawning.
Dec 01 19:18:39 user nova-compute[75066]: DEBUG nova.objects.instance [None req-9ba5b801-3b56-4c0a-90cd-5be582f74b17 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Lazy-loading 'flavor' on Instance uuid dd67db6c-8bd1-402e-93ce-9b2d7a405a6e {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:18:39 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-9ba5b801-3b56-4c0a-90cd-5be582f74b17 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Lock "dd67db6c-8bd1-402e-93ce-9b2d7a405a6e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.942s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:18:39 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:40 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:40 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:40 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:40 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:41 user nova-compute[75066]: DEBUG nova.compute.manager [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Instance event wait completed in 0 seconds for  {{(pid=75066) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 19:18:41 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Guest created on hypervisor {{(pid=75066) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 19:18:41 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Instance spawned successfully.
Dec 01 19:18:41 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 19:18:41 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Found default for hw_cdrom_bus of ide {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:18:41 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Found default for hw_disk_bus of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:18:41 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Found default for hw_input_bus of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:18:41 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Found default for hw_pointer_model of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:18:41 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Found default for hw_video_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:18:41 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Found default for hw_vif_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:18:41 user nova-compute[75066]: DEBUG nova.compute.manager [req-0067bfc2-0390-4f6e-b5b3-38a03f73c34a req-24f66364-6307-4af5-85dc-c04d28b2a26b service nova] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Received event network-vif-plugged-d51d7391-af1b-4160-b3bb-c77d0507a0e0 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:18:41 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-0067bfc2-0390-4f6e-b5b3-38a03f73c34a req-24f66364-6307-4af5-85dc-c04d28b2a26b service nova] Acquiring lock "10fc72fa-64a3-4704-ad91-2e3ae88d5424-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:18:41 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-0067bfc2-0390-4f6e-b5b3-38a03f73c34a req-24f66364-6307-4af5-85dc-c04d28b2a26b service nova] Lock "10fc72fa-64a3-4704-ad91-2e3ae88d5424-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:18:41 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-0067bfc2-0390-4f6e-b5b3-38a03f73c34a req-24f66364-6307-4af5-85dc-c04d28b2a26b service nova] Lock "10fc72fa-64a3-4704-ad91-2e3ae88d5424-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:18:41 user nova-compute[75066]: DEBUG nova.compute.manager [req-0067bfc2-0390-4f6e-b5b3-38a03f73c34a req-24f66364-6307-4af5-85dc-c04d28b2a26b service nova] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] No waiting events found dispatching network-vif-plugged-d51d7391-af1b-4160-b3bb-c77d0507a0e0 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:18:41 user nova-compute[75066]: WARNING nova.compute.manager [req-0067bfc2-0390-4f6e-b5b3-38a03f73c34a req-24f66364-6307-4af5-85dc-c04d28b2a26b service nova] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Received unexpected event network-vif-plugged-d51d7391-af1b-4160-b3bb-c77d0507a0e0 for instance with vm_state building and task_state spawning.
Dec 01 19:18:41 user nova-compute[75066]: INFO nova.compute.manager [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Took 5.43 seconds to spawn the instance on the hypervisor.
Dec 01 19:18:41 user nova-compute[75066]: DEBUG nova.compute.manager [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:18:41 user nova-compute[75066]: INFO nova.compute.manager [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Took 15.93 seconds to build instance.
Dec 01 19:18:41 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5da4fb10-aa8d-4241-9e12-54dd6a1be870 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Lock "10fc72fa-64a3-4704-ad91-2e3ae88d5424" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.197s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:18:41 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:42 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:43 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e6c9faac-9a50-4696-b978-28a882938113 tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Acquiring lock "00ff7dfa-1da6-4e32-a227-0c194a5aa28f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:18:43 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e6c9faac-9a50-4696-b978-28a882938113 tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Lock "00ff7dfa-1da6-4e32-a227-0c194a5aa28f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:18:43 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e6c9faac-9a50-4696-b978-28a882938113 tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Acquiring lock "00ff7dfa-1da6-4e32-a227-0c194a5aa28f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:18:43 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e6c9faac-9a50-4696-b978-28a882938113 tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Lock "00ff7dfa-1da6-4e32-a227-0c194a5aa28f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:18:43 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e6c9faac-9a50-4696-b978-28a882938113 tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Lock "00ff7dfa-1da6-4e32-a227-0c194a5aa28f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:18:43 user nova-compute[75066]: INFO nova.compute.manager [None req-e6c9faac-9a50-4696-b978-28a882938113 tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Terminating instance
Dec 01 19:18:43 user nova-compute[75066]: DEBUG nova.compute.manager [None req-e6c9faac-9a50-4696-b978-28a882938113 tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Start destroying the instance on the hypervisor. {{(pid=75066) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 19:18:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:43 user nova-compute[75066]: DEBUG nova.compute.manager [req-3c0fb5a1-910e-498f-a566-5018c88e7e9c req-0cc4bb8e-5cbe-47ba-bc84-0edbe932b8e9 service nova] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Received event network-vif-unplugged-a6d11620-ab4c-4475-a3c6-3e2354955f95 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:18:43 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-3c0fb5a1-910e-498f-a566-5018c88e7e9c req-0cc4bb8e-5cbe-47ba-bc84-0edbe932b8e9 service nova] Acquiring lock "00ff7dfa-1da6-4e32-a227-0c194a5aa28f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:18:43 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-3c0fb5a1-910e-498f-a566-5018c88e7e9c req-0cc4bb8e-5cbe-47ba-bc84-0edbe932b8e9 service nova] Lock "00ff7dfa-1da6-4e32-a227-0c194a5aa28f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:18:43 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-3c0fb5a1-910e-498f-a566-5018c88e7e9c req-0cc4bb8e-5cbe-47ba-bc84-0edbe932b8e9 service nova] Lock "00ff7dfa-1da6-4e32-a227-0c194a5aa28f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:18:43 user nova-compute[75066]: DEBUG nova.compute.manager [req-3c0fb5a1-910e-498f-a566-5018c88e7e9c req-0cc4bb8e-5cbe-47ba-bc84-0edbe932b8e9 service nova] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] No waiting events found dispatching network-vif-unplugged-a6d11620-ab4c-4475-a3c6-3e2354955f95 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:18:43 user nova-compute[75066]: DEBUG nova.compute.manager [req-3c0fb5a1-910e-498f-a566-5018c88e7e9c req-0cc4bb8e-5cbe-47ba-bc84-0edbe932b8e9 service nova] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Received event network-vif-unplugged-a6d11620-ab4c-4475-a3c6-3e2354955f95 for instance with task_state deleting. {{(pid=75066) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 19:18:44 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Instance destroyed successfully.
Dec 01 19:18:44 user nova-compute[75066]: DEBUG nova.objects.instance [None req-e6c9faac-9a50-4696-b978-28a882938113 tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Lazy-loading 'resources' on Instance uuid 00ff7dfa-1da6-4e32-a227-0c194a5aa28f {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:18:44 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-e6c9faac-9a50-4696-b978-28a882938113 tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:15:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-754956822',display_name='tempest-VolumesAssistedSnapshotsTest-server-754956822',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-754956822',id=8,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJcfIcSljhGnHBDfEY4LYrFEGDFITQ5UoUxDih5goPenKoR6cUULRG6a7mVBN0TWe+/Kir7BdkC5ipIJgbA0Lxz2jt/gnuCjIJSLvehy8XOBaWGsKNS/oxOH3OChHCLNQ==',key_name='tempest-keypair-1580116847',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:15:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='212e84a5aed6451fb2aa40a87de287d5',ramdisk_id='',reservation_id='r-gug9ywdu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-773941717',owner_user_name='tempest-VolumesAssistedSnapshotsTest-773941717-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:15:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7aa029cbe5094890bcc390ad6b8dc477',uuid=00ff7dfa-1da6-4e32-a227-0c194a5aa28f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a6d11620-ab4c-4475-a3c6-3e2354955f95", "address": "fa:16:3e:93:04:1d", "network": {"id": "9a1a0a90-7233-4d75-93a7-3cb72a60e8dc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1583104105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "212e84a5aed6451fb2aa40a87de287d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d11620-ab", "ovs_interfaceid": "a6d11620-ab4c-4475-a3c6-3e2354955f95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:18:44 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-e6c9faac-9a50-4696-b978-28a882938113 tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Converting VIF {"id": "a6d11620-ab4c-4475-a3c6-3e2354955f95", "address": "fa:16:3e:93:04:1d", "network": {"id": "9a1a0a90-7233-4d75-93a7-3cb72a60e8dc", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1583104105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "212e84a5aed6451fb2aa40a87de287d5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6d11620-ab", "ovs_interfaceid": "a6d11620-ab4c-4475-a3c6-3e2354955f95", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:18:44 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-e6c9faac-9a50-4696-b978-28a882938113 tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:93:04:1d,bridge_name='br-int',has_traffic_filtering=True,id=a6d11620-ab4c-4475-a3c6-3e2354955f95,network=Network(9a1a0a90-7233-4d75-93a7-3cb72a60e8dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6d11620-ab') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:18:44 user nova-compute[75066]: DEBUG os_vif [None req-e6c9faac-9a50-4696-b978-28a882938113 tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:04:1d,bridge_name='br-int',has_traffic_filtering=True,id=a6d11620-ab4c-4475-a3c6-3e2354955f95,network=Network(9a1a0a90-7233-4d75-93a7-3cb72a60e8dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6d11620-ab') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:18:44 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:44 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa6d11620-ab, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:18:44 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:44 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:18:44 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:44 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:44 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=039ef674-d680-4ba1-87a9-9a66a8ed597a) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:18:44 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:44 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:18:44 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:44 user nova-compute[75066]: INFO os_vif [None req-e6c9faac-9a50-4696-b978-28a882938113 tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:93:04:1d,bridge_name='br-int',has_traffic_filtering=True,id=a6d11620-ab4c-4475-a3c6-3e2354955f95,network=Network(9a1a0a90-7233-4d75-93a7-3cb72a60e8dc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6d11620-ab')
Dec 01 19:18:44 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-e6c9faac-9a50-4696-b978-28a882938113 tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Deleting instance files /opt/stack/data/nova/instances/00ff7dfa-1da6-4e32-a227-0c194a5aa28f_del
Dec 01 19:18:44 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-e6c9faac-9a50-4696-b978-28a882938113 tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Deletion of /opt/stack/data/nova/instances/00ff7dfa-1da6-4e32-a227-0c194a5aa28f_del complete
Dec 01 19:18:44 user nova-compute[75066]: INFO nova.compute.manager [None req-e6c9faac-9a50-4696-b978-28a882938113 tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Took 1.01 seconds to destroy the instance on the hypervisor.
Dec 01 19:18:44 user nova-compute[75066]: DEBUG oslo.service.loopingcall [None req-e6c9faac-9a50-4696-b978-28a882938113 tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75066) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 19:18:44 user nova-compute[75066]: DEBUG nova.compute.manager [-] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Deallocating network for instance {{(pid=75066) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 19:18:44 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] deallocate_for_instance() {{(pid=75066) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 19:18:45 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:18:45 user nova-compute[75066]: INFO nova.compute.manager [-] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Took 0.98 seconds to deallocate network for instance.
Dec 01 19:18:45 user nova-compute[75066]: DEBUG nova.compute.manager [req-72fda111-e690-4eeb-a4ec-58e1615796df req-b3a63137-3fd6-45cd-84b7-485c6a7e83d8 service nova] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Received event network-vif-deleted-a6d11620-ab4c-4475-a3c6-3e2354955f95 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:18:45 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e6c9faac-9a50-4696-b978-28a882938113 tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:18:45 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e6c9faac-9a50-4696-b978-28a882938113 tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:18:45 user nova-compute[75066]: DEBUG nova.compute.manager [req-6e8f60c5-aa9b-4a5c-a7fe-12f0f58ec68e req-f43307ac-9893-4778-9eaf-f8b4cb89b9b7 service nova] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Received event network-vif-plugged-a6d11620-ab4c-4475-a3c6-3e2354955f95 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:18:45 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-6e8f60c5-aa9b-4a5c-a7fe-12f0f58ec68e req-f43307ac-9893-4778-9eaf-f8b4cb89b9b7 service nova] Acquiring lock "00ff7dfa-1da6-4e32-a227-0c194a5aa28f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:18:45 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-6e8f60c5-aa9b-4a5c-a7fe-12f0f58ec68e req-f43307ac-9893-4778-9eaf-f8b4cb89b9b7 service nova] Lock "00ff7dfa-1da6-4e32-a227-0c194a5aa28f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:18:45 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-6e8f60c5-aa9b-4a5c-a7fe-12f0f58ec68e req-f43307ac-9893-4778-9eaf-f8b4cb89b9b7 service nova] Lock "00ff7dfa-1da6-4e32-a227-0c194a5aa28f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:18:45 user nova-compute[75066]: DEBUG nova.compute.manager [req-6e8f60c5-aa9b-4a5c-a7fe-12f0f58ec68e req-f43307ac-9893-4778-9eaf-f8b4cb89b9b7 service nova] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] No waiting events found dispatching network-vif-plugged-a6d11620-ab4c-4475-a3c6-3e2354955f95 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:18:45 user nova-compute[75066]: WARNING nova.compute.manager [req-6e8f60c5-aa9b-4a5c-a7fe-12f0f58ec68e req-f43307ac-9893-4778-9eaf-f8b4cb89b9b7 service nova] [instance: 00ff7dfa-1da6-4e32-a227-0c194a5aa28f] Received unexpected event network-vif-plugged-a6d11620-ab4c-4475-a3c6-3e2354955f95 for instance with vm_state deleted and task_state None.
Dec 01 19:18:45 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-e6c9faac-9a50-4696-b978-28a882938113 tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:18:45 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-e6c9faac-9a50-4696-b978-28a882938113 tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:18:45 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e6c9faac-9a50-4696-b978-28a882938113 tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.537s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:18:45 user nova-compute[75066]: INFO nova.scheduler.client.report [None req-e6c9faac-9a50-4696-b978-28a882938113 tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Deleted allocations for instance 00ff7dfa-1da6-4e32-a227-0c194a5aa28f
Dec 01 19:18:46 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e6c9faac-9a50-4696-b978-28a882938113 tempest-VolumesAssistedSnapshotsTest-773941717 tempest-VolumesAssistedSnapshotsTest-773941717-project-member] Lock "00ff7dfa-1da6-4e32-a227-0c194a5aa28f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.805s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:18:47 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-234a887a-1b57-4d79-a630-f899ebf181d9 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Acquiring lock "67c5dd7c-88aa-4f2f-8f62-a9af0480c38e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:18:47 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-234a887a-1b57-4d79-a630-f899ebf181d9 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Lock "67c5dd7c-88aa-4f2f-8f62-a9af0480c38e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:18:47 user nova-compute[75066]: DEBUG nova.objects.instance [None req-234a887a-1b57-4d79-a630-f899ebf181d9 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Lazy-loading 'flavor' on Instance uuid 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:18:48 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-234a887a-1b57-4d79-a630-f899ebf181d9 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Lock "67c5dd7c-88aa-4f2f-8f62-a9af0480c38e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:18:48 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-234a887a-1b57-4d79-a630-f899ebf181d9 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Acquiring lock "67c5dd7c-88aa-4f2f-8f62-a9af0480c38e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:18:48 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-234a887a-1b57-4d79-a630-f899ebf181d9 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Lock "67c5dd7c-88aa-4f2f-8f62-a9af0480c38e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:18:48 user nova-compute[75066]: INFO nova.compute.manager [None req-234a887a-1b57-4d79-a630-f899ebf181d9 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Attaching volume 40dba61d-f444-45f9-b949-2138807215fa to /dev/vdb
Dec 01 19:18:48 user nova-compute[75066]: DEBUG os_brick.utils [None req-234a887a-1b57-4d79-a630-f899ebf181d9 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:18:48 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:48 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:48 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2bb6a7-0123-45e6-8e43-7bdd199753cc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1959854982f\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:48 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:48 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:48 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc918892-d057-4087-bd0c-ad1c12441cd7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:48 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:48 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:48 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df010a2-2172-46c3-a208-e8ad4547983a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:48 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b8326a-3d53-4e9c-b7fa-ba0097fb8f4b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:48 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-234a887a-1b57-4d79-a630-f899ebf181d9 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Running cmd (subprocess): nvme version {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:48 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-234a887a-1b57-4d79-a630-f899ebf181d9 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] 'nvme version' failed. Not Retrying. {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:18:48 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.nvmeof [None req-234a887a-1b57-4d79-a630-f899ebf181d9 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] nvme not present on system {{(pid=75066) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 19:18:48 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:48 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:18:48 user nova-compute[75066]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 19:18:48 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[efabd81e-ca98-4e05-86d1-e09f60f8db39]: (4, '') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:48 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-234a887a-1b57-4d79-a630-f899ebf181d9 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75066) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 19:18:48 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-234a887a-1b57-4d79-a630-f899ebf181d9 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 19:18:48 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-234a887a-1b57-4d79-a630-f899ebf181d9 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] LIGHTOS: no hostnqn found. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 19:18:48 user nova-compute[75066]: DEBUG os_brick.utils [None req-234a887a-1b57-4d79-a630-f899ebf181d9 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1959854982f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:18:48 user nova-compute[75066]: DEBUG nova.virt.block_device [None req-234a887a-1b57-4d79-a630-f899ebf181d9 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Updating existing volume attachment record: b51d3131-eab5-4144-af8c-c9e64abc86ec {{(pid=75066) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 19:18:49 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:54 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Acquiring lock "3d340166-c58b-4213-b8d3-5036ade48d2d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:18:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "3d340166-c58b-4213-b8d3-5036ade48d2d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:18:54 user nova-compute[75066]: DEBUG nova.compute.manager [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Starting instance... {{(pid=75066) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 19:18:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:18:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:18:54 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75066) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 19:18:54 user nova-compute[75066]: INFO nova.compute.claims [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Claim successful on node user
Dec 01 19:18:55 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:18:55 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:18:55 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.403s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:18:55 user nova-compute[75066]: DEBUG nova.compute.manager [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Start building networks asynchronously for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 19:18:55 user nova-compute[75066]: DEBUG nova.compute.manager [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Allocating IP information in the background. {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 19:18:55 user nova-compute[75066]: DEBUG nova.network.neutron [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] allocate_for_instance() {{(pid=75066) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 19:18:55 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 19:18:55 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:18:55 user nova-compute[75066]: DEBUG nova.compute.manager [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Start building block device mappings for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 19:18:55 user nova-compute[75066]: DEBUG nova.compute.manager [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Start spawning the instance on the hypervisor. {{(pid=75066) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 19:18:55 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Creating instance directory {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 19:18:55 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Creating image(s)
Dec 01 19:18:55 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Acquiring lock "/opt/stack/data/nova/instances/3d340166-c58b-4213-b8d3-5036ade48d2d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:18:55 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "/opt/stack/data/nova/instances/3d340166-c58b-4213-b8d3-5036ade48d2d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:18:55 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "/opt/stack/data/nova/instances/3d340166-c58b-4213-b8d3-5036ade48d2d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:18:55 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:55 user nova-compute[75066]: DEBUG nova.policy [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cfb3e7b4b0444223af282b16da9bd919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0f7516d1db4dd5bc7d77a0bd1d44d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75066) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 19:18:55 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.205s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:55 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Acquiring lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:18:55 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:18:55 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:55 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.224s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:55 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/3d340166-c58b-4213-b8d3-5036ade48d2d/disk 1073741824 {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:55 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/3d340166-c58b-4213-b8d3-5036ade48d2d/disk 1073741824" returned: 0 in 0.097s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:55 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.328s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:18:55 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:56 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.187s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:56 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3d340166-c58b-4213-b8d3-5036ade48d2d/disk. size=1073741824 {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 19:18:56 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d340166-c58b-4213-b8d3-5036ade48d2d/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:56 user nova-compute[75066]: DEBUG nova.network.neutron [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Successfully created port: 01c08ead-7eed-4e1a-839a-234fce1ba605 {{(pid=75066) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 19:18:56 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:18:56 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d340166-c58b-4213-b8d3-5036ade48d2d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:56 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Cannot resize image /opt/stack/data/nova/instances/3d340166-c58b-4213-b8d3-5036ade48d2d/disk to a smaller size. {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 19:18:56 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Created local disks {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 19:18:56 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Ensure instance console log exists: /opt/stack/data/nova/instances/3d340166-c58b-4213-b8d3-5036ade48d2d/console.log {{(pid=75066) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 19:18:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:18:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:18:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:18:56 user nova-compute[75066]: DEBUG nova.network.neutron [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Successfully updated port: 01c08ead-7eed-4e1a-839a-234fce1ba605 {{(pid=75066) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 19:18:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Acquiring lock "refresh_cache-3d340166-c58b-4213-b8d3-5036ade48d2d" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:18:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Acquired lock "refresh_cache-3d340166-c58b-4213-b8d3-5036ade48d2d" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:18:56 user nova-compute[75066]: DEBUG nova.network.neutron [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:18:56 user nova-compute[75066]: DEBUG nova.compute.manager [req-885f1990-ce7b-4671-80a1-f9d92fe45f8d req-c51090b5-d936-41d5-8eec-3873fd798575 service nova] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Received event network-changed-01c08ead-7eed-4e1a-839a-234fce1ba605 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:18:56 user nova-compute[75066]: DEBUG nova.compute.manager [req-885f1990-ce7b-4671-80a1-f9d92fe45f8d req-c51090b5-d936-41d5-8eec-3873fd798575 service nova] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Refreshing instance network info cache due to event network-changed-01c08ead-7eed-4e1a-839a-234fce1ba605. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:18:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-885f1990-ce7b-4671-80a1-f9d92fe45f8d req-c51090b5-d936-41d5-8eec-3873fd798575 service nova] Acquiring lock "refresh_cache-3d340166-c58b-4213-b8d3-5036ade48d2d" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:18:56 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:57 user nova-compute[75066]: DEBUG nova.network.neutron [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:18:57 user nova-compute[75066]: DEBUG nova.network.neutron [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Updating instance_info_cache with network_info: [{"id": "01c08ead-7eed-4e1a-839a-234fce1ba605", "address": "fa:16:3e:6e:53:26", "network": {"id": "9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-696310557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0f7516d1db4dd5bc7d77a0bd1d44d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01c08ead-7e", "ovs_interfaceid": "01c08ead-7eed-4e1a-839a-234fce1ba605", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:18:57 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Releasing lock "refresh_cache-3d340166-c58b-4213-b8d3-5036ade48d2d" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:18:57 user nova-compute[75066]: DEBUG nova.compute.manager [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Instance network_info: |[{"id": "01c08ead-7eed-4e1a-839a-234fce1ba605", "address": "fa:16:3e:6e:53:26", "network": {"id": "9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-696310557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0f7516d1db4dd5bc7d77a0bd1d44d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01c08ead-7e", "ovs_interfaceid": "01c08ead-7eed-4e1a-839a-234fce1ba605", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 19:18:57 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-885f1990-ce7b-4671-80a1-f9d92fe45f8d req-c51090b5-d936-41d5-8eec-3873fd798575 service nova] Acquired lock "refresh_cache-3d340166-c58b-4213-b8d3-5036ade48d2d" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:18:57 user nova-compute[75066]: DEBUG nova.network.neutron [req-885f1990-ce7b-4671-80a1-f9d92fe45f8d req-c51090b5-d936-41d5-8eec-3873fd798575 service nova] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Refreshing network info cache for port 01c08ead-7eed-4e1a-839a-234fce1ba605 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:18:57 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Start _get_guest_xml network_info=[{"id": "01c08ead-7eed-4e1a-839a-234fce1ba605", "address": "fa:16:3e:6e:53:26", "network": {"id": "9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-696310557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0f7516d1db4dd5bc7d77a0bd1d44d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01c08ead-7e", "ovs_interfaceid": "01c08ead-7eed-4e1a-839a-234fce1ba605", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'image_id': '900b237b-e99c-4fdd-a44f-dcb7a08baa86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:18:57 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:18:57 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:18:57 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:18:57 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:18:57 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:18:57 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:18:57 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:18:57 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:18:57 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:18:57 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:18:57 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:18:57 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:18:57 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:18:57 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:18:57 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:18:57 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:18:57 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:18:57 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:18:57 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:18:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-88799949',display_name='tempest-tempest.common.compute-instance-88799949',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-88799949',id=13,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeOjka3O2yOSG7PgvQxwfceH9ScZixOK/oKEDoZu88X4E6S58dhbFi5q4+c/guiL9cBe6OBGVWUQ58KJXvXMJo6fjs42odNZigfHcTvBLGpR1adq29cPDQW/Rp9UoL0ag==',key_name='tempest-keypair-202509697',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb0f7516d1db4dd5bc7d77a0bd1d44d7',ramdisk_id='',reservation_id='r-dyxm9b0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1700253921',owner_user_name='tempest-ServerActionsTestOtherA-1700253921-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:18:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfb3e7b4b0444223af282b16da9bd919',uuid=3d340166-c58b-4213-b8d3-5036ade48d2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01c08ead-7eed-4e1a-839a-234fce1ba605", "address": "fa:16:3e:6e:53:26", "network": {"id": "9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-696310557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0f7516d1db4dd5bc7d77a0bd1d44d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01c08ead-7e", "ovs_interfaceid": "01c08ead-7eed-4e1a-839a-234fce1ba605", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:18:57 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Converting VIF {"id": "01c08ead-7eed-4e1a-839a-234fce1ba605", "address": "fa:16:3e:6e:53:26", "network": {"id": "9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-696310557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0f7516d1db4dd5bc7d77a0bd1d44d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01c08ead-7e", "ovs_interfaceid": "01c08ead-7eed-4e1a-839a-234fce1ba605", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:18:57 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:53:26,bridge_name='br-int',has_traffic_filtering=True,id=01c08ead-7eed-4e1a-839a-234fce1ba605,network=Network(9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01c08ead-7e') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:18:57 user nova-compute[75066]: DEBUG nova.objects.instance [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lazy-loading 'pci_devices' on Instance uuid 3d340166-c58b-4213-b8d3-5036ade48d2d {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:18:57 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:18:57 user nova-compute[75066]:   <uuid>3d340166-c58b-4213-b8d3-5036ade48d2d</uuid>
Dec 01 19:18:57 user nova-compute[75066]:   <name>instance-0000000d</name>
Dec 01 19:18:57 user nova-compute[75066]:   <memory>524288</memory>
Dec 01 19:18:57 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:18:57 user nova-compute[75066]:   <metadata>
Dec 01 19:18:57 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:18:57 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:18:57 user nova-compute[75066]:       <nova:name>tempest-tempest.common.compute-instance-88799949</nova:name>
Dec 01 19:18:57 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:18:57</nova:creationTime>
Dec 01 19:18:57 user nova-compute[75066]:       <nova:flavor name="m1.tiny">
Dec 01 19:18:57 user nova-compute[75066]:         <nova:memory>512</nova:memory>
Dec 01 19:18:57 user nova-compute[75066]:         <nova:disk>1</nova:disk>
Dec 01 19:18:57 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:18:57 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:18:57 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:18:57 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:18:57 user nova-compute[75066]:       <nova:owner>
Dec 01 19:18:57 user nova-compute[75066]:         <nova:user uuid="cfb3e7b4b0444223af282b16da9bd919">tempest-ServerActionsTestOtherA-1700253921-project-member</nova:user>
Dec 01 19:18:57 user nova-compute[75066]:         <nova:project uuid="fb0f7516d1db4dd5bc7d77a0bd1d44d7">tempest-ServerActionsTestOtherA-1700253921</nova:project>
Dec 01 19:18:57 user nova-compute[75066]:       </nova:owner>
Dec 01 19:18:57 user nova-compute[75066]:       <nova:root type="image" uuid="900b237b-e99c-4fdd-a44f-dcb7a08baa86"/>
Dec 01 19:18:57 user nova-compute[75066]:       <nova:ports>
Dec 01 19:18:57 user nova-compute[75066]:         <nova:port uuid="01c08ead-7eed-4e1a-839a-234fce1ba605">
Dec 01 19:18:57 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 01 19:18:57 user nova-compute[75066]:         </nova:port>
Dec 01 19:18:57 user nova-compute[75066]:       </nova:ports>
Dec 01 19:18:57 user nova-compute[75066]:     </nova:instance>
Dec 01 19:18:57 user nova-compute[75066]:   </metadata>
Dec 01 19:18:57 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:18:57 user nova-compute[75066]:     <system>
Dec 01 19:18:57 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:18:57 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:18:57 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:18:57 user nova-compute[75066]:       <entry name="serial">3d340166-c58b-4213-b8d3-5036ade48d2d</entry>
Dec 01 19:18:57 user nova-compute[75066]:       <entry name="uuid">3d340166-c58b-4213-b8d3-5036ade48d2d</entry>
Dec 01 19:18:57 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:18:57 user nova-compute[75066]:     </system>
Dec 01 19:18:57 user nova-compute[75066]:   </sysinfo>
Dec 01 19:18:57 user nova-compute[75066]:   <os>
Dec 01 19:18:57 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:18:57 user nova-compute[75066]:     <boot dev="hd"/>
Dec 01 19:18:57 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:18:57 user nova-compute[75066]:   </os>
Dec 01 19:18:57 user nova-compute[75066]:   <features>
Dec 01 19:18:57 user nova-compute[75066]:     <acpi/>
Dec 01 19:18:57 user nova-compute[75066]:     <apic/>
Dec 01 19:18:57 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:18:57 user nova-compute[75066]:   </features>
Dec 01 19:18:57 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:18:57 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:18:57 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:18:57 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:18:57 user nova-compute[75066]:   </clock>
Dec 01 19:18:57 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:18:57 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:18:57 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:18:57 user nova-compute[75066]:   </cpu>
Dec 01 19:18:57 user nova-compute[75066]:   <devices>
Dec 01 19:18:57 user nova-compute[75066]:     <disk type="file" device="disk">
Dec 01 19:18:57 user nova-compute[75066]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 19:18:57 user nova-compute[75066]:       <source file="/opt/stack/data/nova/instances/3d340166-c58b-4213-b8d3-5036ade48d2d/disk"/>
Dec 01 19:18:57 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:18:57 user nova-compute[75066]:     </disk>
Dec 01 19:18:57 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:18:57 user nova-compute[75066]:       <mac address="fa:16:3e:6e:53:26"/>
Dec 01 19:18:57 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:18:57 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:18:57 user nova-compute[75066]:       <target dev="tap01c08ead-7e"/>
Dec 01 19:18:57 user nova-compute[75066]:     </interface>
Dec 01 19:18:57 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:18:57 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/3d340166-c58b-4213-b8d3-5036ade48d2d/console.log" append="off"/>
Dec 01 19:18:57 user nova-compute[75066]:     </serial>
Dec 01 19:18:57 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:18:57 user nova-compute[75066]:     <video>
Dec 01 19:18:57 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:18:57 user nova-compute[75066]:     </video>
Dec 01 19:18:57 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:18:57 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:18:57 user nova-compute[75066]:     </rng>
Dec 01 19:18:57 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:18:57 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:18:57 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:18:57 user nova-compute[75066]:     </memballoon>
Dec 01 19:18:57 user nova-compute[75066]:   </devices>
Dec 01 19:18:57 user nova-compute[75066]: </domain>
Dec 01 19:18:57 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:18:57 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:18:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-88799949',display_name='tempest-tempest.common.compute-instance-88799949',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-88799949',id=13,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeOjka3O2yOSG7PgvQxwfceH9ScZixOK/oKEDoZu88X4E6S58dhbFi5q4+c/guiL9cBe6OBGVWUQ58KJXvXMJo6fjs42odNZigfHcTvBLGpR1adq29cPDQW/Rp9UoL0ag==',key_name='tempest-keypair-202509697',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb0f7516d1db4dd5bc7d77a0bd1d44d7',ramdisk_id='',reservation_id='r-dyxm9b0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1700253921',owner_user_name='tempest-ServerActionsTestOtherA-1700253921-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:18:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfb3e7b4b0444223af282b16da9bd919',uuid=3d340166-c58b-4213-b8d3-5036ade48d2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01c08ead-7eed-4e1a-839a-234fce1ba605", "address": "fa:16:3e:6e:53:26", "network": {"id": "9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-696310557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0f7516d1db4dd5bc7d77a0bd1d44d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01c08ead-7e", "ovs_interfaceid": "01c08ead-7eed-4e1a-839a-234fce1ba605", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:18:57 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Converting VIF {"id": "01c08ead-7eed-4e1a-839a-234fce1ba605", "address": "fa:16:3e:6e:53:26", "network": {"id": "9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-696310557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0f7516d1db4dd5bc7d77a0bd1d44d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01c08ead-7e", "ovs_interfaceid": "01c08ead-7eed-4e1a-839a-234fce1ba605", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:18:57 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:53:26,bridge_name='br-int',has_traffic_filtering=True,id=01c08ead-7eed-4e1a-839a-234fce1ba605,network=Network(9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01c08ead-7e') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:18:57 user nova-compute[75066]: DEBUG os_vif [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:53:26,bridge_name='br-int',has_traffic_filtering=True,id=01c08ead-7eed-4e1a-839a-234fce1ba605,network=Network(9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01c08ead-7e') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:18:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:18:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:18:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ec4a5a22-8006-57be-8116-33fcd9ca118a', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:18:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:18:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap01c08ead-7e, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:18:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap01c08ead-7e, col_values=(('qos', UUID('2e7e3202-6060-4d3a-8928-714e7e406c66')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:18:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap01c08ead-7e, col_values=(('external_ids', {'iface-id': '01c08ead-7eed-4e1a-839a-234fce1ba605', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:53:26', 'vm-uuid': '3d340166-c58b-4213-b8d3-5036ade48d2d'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:18:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:18:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:57 user nova-compute[75066]: INFO os_vif [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:53:26,bridge_name='br-int',has_traffic_filtering=True,id=01c08ead-7eed-4e1a-839a-234fce1ba605,network=Network(9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01c08ead-7e')
Dec 01 19:18:57 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:18:57 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] No VIF found with MAC fa:16:3e:6e:53:26, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:18:57 user nova-compute[75066]: DEBUG nova.network.neutron [req-885f1990-ce7b-4671-80a1-f9d92fe45f8d req-c51090b5-d936-41d5-8eec-3873fd798575 service nova] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Updated VIF entry in instance network info cache for port 01c08ead-7eed-4e1a-839a-234fce1ba605. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:18:57 user nova-compute[75066]: DEBUG nova.network.neutron [req-885f1990-ce7b-4671-80a1-f9d92fe45f8d req-c51090b5-d936-41d5-8eec-3873fd798575 service nova] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Updating instance_info_cache with network_info: [{"id": "01c08ead-7eed-4e1a-839a-234fce1ba605", "address": "fa:16:3e:6e:53:26", "network": {"id": "9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-696310557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0f7516d1db4dd5bc7d77a0bd1d44d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01c08ead-7e", "ovs_interfaceid": "01c08ead-7eed-4e1a-839a-234fce1ba605", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:18:57 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-885f1990-ce7b-4671-80a1-f9d92fe45f8d req-c51090b5-d936-41d5-8eec-3873fd798575 service nova] Releasing lock "refresh_cache-3d340166-c58b-4213-b8d3-5036ade48d2d" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:18:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:59 user nova-compute[75066]: DEBUG nova.compute.manager [req-d6aeb80e-7c20-4f3c-a177-da2a816075fb req-4319af5b-99ca-435c-bffb-6de8cf2d3916 service nova] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Received event network-vif-plugged-01c08ead-7eed-4e1a-839a-234fce1ba605 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:18:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d6aeb80e-7c20-4f3c-a177-da2a816075fb req-4319af5b-99ca-435c-bffb-6de8cf2d3916 service nova] Acquiring lock "3d340166-c58b-4213-b8d3-5036ade48d2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:18:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d6aeb80e-7c20-4f3c-a177-da2a816075fb req-4319af5b-99ca-435c-bffb-6de8cf2d3916 service nova] Lock "3d340166-c58b-4213-b8d3-5036ade48d2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:18:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d6aeb80e-7c20-4f3c-a177-da2a816075fb req-4319af5b-99ca-435c-bffb-6de8cf2d3916 service nova] Lock "3d340166-c58b-4213-b8d3-5036ade48d2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:18:59 user nova-compute[75066]: DEBUG nova.compute.manager [req-d6aeb80e-7c20-4f3c-a177-da2a816075fb req-4319af5b-99ca-435c-bffb-6de8cf2d3916 service nova] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] No waiting events found dispatching network-vif-plugged-01c08ead-7eed-4e1a-839a-234fce1ba605 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:18:59 user nova-compute[75066]: WARNING nova.compute.manager [req-d6aeb80e-7c20-4f3c-a177-da2a816075fb req-4319af5b-99ca-435c-bffb-6de8cf2d3916 service nova] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Received unexpected event network-vif-plugged-01c08ead-7eed-4e1a-839a-234fce1ba605 for instance with vm_state building and task_state spawning.
Dec 01 19:18:59 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:59 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:59 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:18:59 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:18:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:18:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:18:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:18:59 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75066) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 19:18:59 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:18:59 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-60240de6-d9cc-49f9-b4bd-2020b1c5934d tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Acquiring lock "dd546862-fcd5-4b69-8ea3-a8fa4859a489" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:18:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-60240de6-d9cc-49f9-b4bd-2020b1c5934d tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Lock "dd546862-fcd5-4b69-8ea3-a8fa4859a489" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:18:59 user nova-compute[75066]: DEBUG nova.objects.instance [None req-60240de6-d9cc-49f9-b4bd-2020b1c5934d tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Lazy-loading 'flavor' on Instance uuid dd546862-fcd5-4b69-8ea3-a8fa4859a489 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:18:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-60240de6-d9cc-49f9-b4bd-2020b1c5934d tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Lock "dd546862-fcd5-4b69-8ea3-a8fa4859a489" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:18:59 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:59 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-60240de6-d9cc-49f9-b4bd-2020b1c5934d tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Acquiring lock "dd546862-fcd5-4b69-8ea3-a8fa4859a489" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:18:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-60240de6-d9cc-49f9-b4bd-2020b1c5934d tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Lock "dd546862-fcd5-4b69-8ea3-a8fa4859a489" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.004s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:18:59 user nova-compute[75066]: INFO nova.compute.manager [None req-60240de6-d9cc-49f9-b4bd-2020b1c5934d tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Attaching volume b6e9e54d-57f4-4413-9c76-50da506906d2 to /dev/vdb
Dec 01 19:18:59 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:59 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d340166-c58b-4213-b8d3-5036ade48d2d/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:59 user nova-compute[75066]: DEBUG os_brick.utils [None req-60240de6-d9cc-49f9-b4bd-2020b1c5934d tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:18:59 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:18:59 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:18:59 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d01ea0c-f5d0-468a-97d6-a2c94808d6ca]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1959854982f\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:18:59 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:00 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eda709c-b7a3-47fc-9591-39c67ed82ffa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:00 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[171b04dd-e519-43c6-bd54-ae33580c3479]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:00 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1ca522-fec8-4700-962c-b4eba425f9da]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-60240de6-d9cc-49f9-b4bd-2020b1c5934d tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Running cmd (subprocess): nvme version {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-60240de6-d9cc-49f9-b4bd-2020b1c5934d tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] 'nvme version' failed. Not Retrying. {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:19:00 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.nvmeof [None req-60240de6-d9cc-49f9-b4bd-2020b1c5934d tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] nvme not present on system {{(pid=75066) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 19:19:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:19:00 user nova-compute[75066]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 19:19:00 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[a47b176b-ac18-468f-aba5-cd9fb76a1c7e]: (4, '') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:00 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-60240de6-d9cc-49f9-b4bd-2020b1c5934d tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75066) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 19:19:00 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-60240de6-d9cc-49f9-b4bd-2020b1c5934d tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 19:19:00 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-60240de6-d9cc-49f9-b4bd-2020b1c5934d tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] LIGHTOS: no hostnqn found. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 19:19:00 user nova-compute[75066]: DEBUG os_brick.utils [None req-60240de6-d9cc-49f9-b4bd-2020b1c5934d tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1959854982f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:19:00 user nova-compute[75066]: DEBUG nova.virt.block_device [None req-60240de6-d9cc-49f9-b4bd-2020b1c5934d tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Updating existing volume attachment record: 8b387527-1e2a-4d1a-953f-fdd17ec7f3ee {{(pid=75066) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 19:19:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d340166-c58b-4213-b8d3-5036ade48d2d/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d340166-c58b-4213-b8d3-5036ade48d2d/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d340166-c58b-4213-b8d3-5036ade48d2d/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67c5dd7c-88aa-4f2f-8f62-a9af0480c38e/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67c5dd7c-88aa-4f2f-8f62-a9af0480c38e/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67c5dd7c-88aa-4f2f-8f62-a9af0480c38e/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67c5dd7c-88aa-4f2f-8f62-a9af0480c38e/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:01 user nova-compute[75066]: DEBUG nova.compute.manager [req-de2fe724-c6fa-4752-9588-e6fd3d71e854 req-b3bf4e69-422f-4a21-8bf1-b7fb38174134 service nova] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Received event network-vif-plugged-01c08ead-7eed-4e1a-839a-234fce1ba605 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:19:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-de2fe724-c6fa-4752-9588-e6fd3d71e854 req-b3bf4e69-422f-4a21-8bf1-b7fb38174134 service nova] Acquiring lock "3d340166-c58b-4213-b8d3-5036ade48d2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:19:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-de2fe724-c6fa-4752-9588-e6fd3d71e854 req-b3bf4e69-422f-4a21-8bf1-b7fb38174134 service nova] Lock "3d340166-c58b-4213-b8d3-5036ade48d2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:19:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-de2fe724-c6fa-4752-9588-e6fd3d71e854 req-b3bf4e69-422f-4a21-8bf1-b7fb38174134 service nova] Lock "3d340166-c58b-4213-b8d3-5036ade48d2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:19:01 user nova-compute[75066]: DEBUG nova.compute.manager [req-de2fe724-c6fa-4752-9588-e6fd3d71e854 req-b3bf4e69-422f-4a21-8bf1-b7fb38174134 service nova] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] No waiting events found dispatching network-vif-plugged-01c08ead-7eed-4e1a-839a-234fce1ba605 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:19:01 user nova-compute[75066]: WARNING nova.compute.manager [req-de2fe724-c6fa-4752-9588-e6fd3d71e854 req-b3bf4e69-422f-4a21-8bf1-b7fb38174134 service nova] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Received unexpected event network-vif-plugged-01c08ead-7eed-4e1a-839a-234fce1ba605 for instance with vm_state building and task_state spawning.
Dec 01 19:19:01 user nova-compute[75066]: DEBUG nova.compute.manager [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Instance event wait completed in 0 seconds for  {{(pid=75066) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 19:19:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Guest created on hypervisor {{(pid=75066) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 19:19:01 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Instance spawned successfully.
Dec 01 19:19:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 19:19:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Found default for hw_cdrom_bus of ide {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:19:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Found default for hw_disk_bus of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:19:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Found default for hw_input_bus of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:19:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Found default for hw_pointer_model of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:19:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Found default for hw_video_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:19:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Found default for hw_vif_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:19:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd67db6c-8bd1-402e-93ce-9b2d7a405a6e/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:01 user nova-compute[75066]: INFO nova.compute.manager [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Took 5.88 seconds to spawn the instance on the hypervisor.
Dec 01 19:19:01 user nova-compute[75066]: DEBUG nova.compute.manager [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:19:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd67db6c-8bd1-402e-93ce-9b2d7a405a6e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd67db6c-8bd1-402e-93ce-9b2d7a405a6e/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:01 user nova-compute[75066]: INFO nova.compute.manager [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Took 6.71 seconds to build instance.
Dec 01 19:19:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-7c11d724-887b-47ee-b38a-47447c4f0133 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "3d340166-c58b-4213-b8d3-5036ade48d2d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.858s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:19:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd67db6c-8bd1-402e-93ce-9b2d7a405a6e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:19:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:02 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-234a887a-1b57-4d79-a630-f899ebf181d9 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Calling os-brick to attach iSCSI Volume {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 19:19:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-234a887a-1b57-4d79-a630-f899ebf181d9 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'desDpvUl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:19:02 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-234a887a-1b57-4d79-a630-f899ebf181d9 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:19:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-234a887a-1b57-4d79-a630-f899ebf181d9 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:19:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-234a887a-1b57-4d79-a630-f899ebf181d9 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:19:02 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-234a887a-1b57-4d79-a630-f899ebf181d9 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:19:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-234a887a-1b57-4d79-a630-f899ebf181d9 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:19:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-234a887a-1b57-4d79-a630-f899ebf181d9 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:19:02 user nova-compute[75066]: INFO os_brick.initiator.connectors.iscsi [None req-234a887a-1b57-4d79-a630-f899ebf181d9 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 19:19:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa -p 172.16.0.220:3260 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:02 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[5189247b-37cc-441b-8f15-9ef00adf9931]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-234a887a-1b57-4d79-a630-f899ebf181d9 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 19:19:02 user nova-compute[75066]:  {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:19:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa -p 172.16.0.220:3260 --interface default --op new {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:02 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[498eb1c3-58c7-49ae-976a-b35be7ad749d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa] added\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-234a887a-1b57-4d79-a630-f899ebf181d9 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa] added
Dec 01 19:19:02 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:19:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:02 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3137bf-5603-4327-8e5a-4f50172eece5]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-234a887a-1b57-4d79-a630-f899ebf181d9 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:19:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:02 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b77928f-3153-4ce1-a30d-20621b1c3d6a]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-234a887a-1b57-4d79-a630-f899ebf181d9 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:19:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v desDpvUl {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:02 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:19:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v desDpvUl" returned: 0 in 0.021s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:02 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[621543f3-834f-4cd4-bff7-209a99cb8ea4]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-234a887a-1b57-4d79-a630-f899ebf181d9 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'desDpvUl'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:19:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:02 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cee616c-cc52-4669-a6ab-56631879834b]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-234a887a-1b57-4d79-a630-f899ebf181d9 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:19:03 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:03 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:03 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd678a5-9f40-43b2-965b-b3cfe307fbe1]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:03 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-234a887a-1b57-4d79-a630-f899ebf181d9 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)
Dec 01 19:19:03 user nova-compute[75066]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:19:03 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:19:03 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-234a887a-1b57-4d79-a630-f899ebf181d9 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)
Dec 01 19:19:03 user nova-compute[75066]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:19:03 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:19:03 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa -p 172.16.0.220:3260 --login {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:03 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:19:03 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:19:03 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Hypervisor/Node resource view: name=user free_ram=8052MB free_disk=25.31295394897461GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75066) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 19:19:03 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:19:03 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:19:03 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:03 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddb7066e-a543-4627-ab0f-d34bcecfa6fc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:03 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-234a887a-1b57-4d79-a630-f899ebf181d9 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa, portal: 172.16.0.220,3260]
Dec 01 19:19:03 user nova-compute[75066]: Login to [iface: default, target: iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa, portal: 172.16.0.220,3260] successful.
Dec 01 19:19:03 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:19:03 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:03 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:03 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[042ce0de-dda1-48cf-80b8-462e84f8712e]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:03 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-234a887a-1b57-4d79-a630-f899ebf181d9 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:19:03 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:03 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:03 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[5681c830-bd46-40e1-90f4-6e1bc014c598]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:03 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-234a887a-1b57-4d79-a630-f899ebf181d9 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)
Dec 01 19:19:03 user nova-compute[75066]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)
Dec 01 19:19:03 user nova-compute[75066]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:19:03 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:19:03 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-234a887a-1b57-4d79-a630-f899ebf181d9 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)
Dec 01 19:19:03 user nova-compute[75066]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)
Dec 01 19:19:03 user nova-compute[75066]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:19:03 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:19:03 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-234a887a-1b57-4d79-a630-f899ebf181d9 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.980s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:19:03 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-234a887a-1b57-4d79-a630-f899ebf181d9 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Connected to 172.16.0.220:3260 {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 19:19:03 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-234a887a-1b57-4d79-a630-f899ebf181d9 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] HCTL ('34', '-', '-', 0) found on session 13 with lun 0 {{(pid=75066) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 19:19:03 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-234a887a-1b57-4d79-a630-f899ebf181d9 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75066) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 19:19:03 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:03 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:03 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[261ebc95-4b42-497e-88e7-4b0f237e1f4f]: (4, ('- - 0', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:03 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-234a887a-1b57-4d79-a630-f899ebf181d9 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Searching for a device in session 13 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:19:03 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-234a887a-1b57-4d79-a630-f899ebf181d9 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'desDpvUl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 19:19:03 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:19:03 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance c223be70-8b9c-46d4-9b5a-3b83dfc05a17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:19:03 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance c3ceeca4-c16c-4cf5-adfd-7d5a2925f435 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:19:03 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance dd546862-fcd5-4b69-8ea3-a8fa4859a489 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:19:03 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance dd67db6c-8bd1-402e-93ce-9b2d7a405a6e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:19:03 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 10fc72fa-64a3-4704-ad91-2e3ae88d5424 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:19:03 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 90c49be6-97aa-45f1-bcbe-b9a3875226a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:19:03 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 3d340166-c58b-4213-b8d3-5036ade48d2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:19:03 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 19:19:03 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 19:19:03 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:19:03 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:19:03 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Compute_service record updated for user:user {{(pid=75066) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 19:19:03 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.599s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:19:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-234a887a-1b57-4d79-a630-f899ebf181d9 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.026s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:19:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-234a887a-1b57-4d79-a630-f899ebf181d9 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] <== connect_volume: return (2029ms) {'type': 'block', 'scsi_wwn': '23765643064313233', 'path': '/dev/sdc'} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:19:04 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-234a887a-1b57-4d79-a630-f899ebf181d9 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765643064313233', 'path': '/dev/sdc'} {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 19:19:04 user nova-compute[75066]: DEBUG nova.objects.instance [None req-234a887a-1b57-4d79-a630-f899ebf181d9 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Lazy-loading 'flavor' on Instance uuid 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:19:04 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-234a887a-1b57-4d79-a630-f899ebf181d9 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 19:19:04 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:19:04 user nova-compute[75066]:   <source dev="/dev/sdc"/>
Dec 01 19:19:04 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:19:04 user nova-compute[75066]:   <serial>40dba61d-f444-45f9-b949-2138807215fa</serial>
Dec 01 19:19:04 user nova-compute[75066]: </disk>
Dec 01 19:19:04 user nova-compute[75066]:  {{(pid=75066) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 19:19:04 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:19:04 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:19:04 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Starting heal instance info cache {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 19:19:04 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-234a887a-1b57-4d79-a630-f899ebf181d9 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:19:04 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-234a887a-1b57-4d79-a630-f899ebf181d9 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:19:04 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-234a887a-1b57-4d79-a630-f899ebf181d9 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] No VIF found with MAC fa:16:3e:5a:73:a4, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:19:04 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "refresh_cache-c3ceeca4-c16c-4cf5-adfd-7d5a2925f435" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:19:04 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquired lock "refresh_cache-c3ceeca4-c16c-4cf5-adfd-7d5a2925f435" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:19:04 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Forcefully refreshing network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 19:19:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-234a887a-1b57-4d79-a630-f899ebf181d9 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Lock "67c5dd7c-88aa-4f2f-8f62-a9af0480c38e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.839s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:19:05 user nova-compute[75066]: INFO nova.compute.manager [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Rescuing
Dec 01 19:19:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Acquiring lock "refresh_cache-67c5dd7c-88aa-4f2f-8f62-a9af0480c38e" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:19:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Acquired lock "refresh_cache-67c5dd7c-88aa-4f2f-8f62-a9af0480c38e" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:19:05 user nova-compute[75066]: DEBUG nova.network.neutron [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:19:05 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Updating instance_info_cache with network_info: [{"id": "c9353199-d4a3-488f-857d-b0ebdb31a68f", "address": "fa:16:3e:d4:7c:91", "network": {"id": "4a6c6c26-4d29-486c-b11e-fc53769083ea", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1139388453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "492e0b2da61e4e4f9ea991df15531e24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9353199-d4", "ovs_interfaceid": "c9353199-d4a3-488f-857d-b0ebdb31a68f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:19:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Releasing lock "refresh_cache-c3ceeca4-c16c-4cf5-adfd-7d5a2925f435" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:19:06 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Updated the network info_cache for instance {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 19:19:06 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:19:06 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:19:06 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:19:06 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:19:06 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75066) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 19:19:06 user nova-compute[75066]: DEBUG nova.network.neutron [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Updating instance_info_cache with network_info: [{"id": "73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2", "address": "fa:16:3e:5a:73:a4", "network": {"id": "fdb3c017-aafb-4c3e-a08c-a73a68be9f70", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1696445417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "306d3049e90647fa9f1c90a104eac0e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bdff9a-3a", "ovs_interfaceid": "73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:19:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Releasing lock "refresh_cache-67c5dd7c-88aa-4f2f-8f62-a9af0480c38e" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:19:06 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:06 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:06 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:06 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:07 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:07 user nova-compute[75066]: DEBUG nova.compute.manager [req-0a35ccb5-ec2d-445b-9eed-48a96caa5701 req-1ab6fdfc-0ac2-4e47-a6e9-ab48e4e33997 service nova] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Received event network-vif-unplugged-73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:19:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-0a35ccb5-ec2d-445b-9eed-48a96caa5701 req-1ab6fdfc-0ac2-4e47-a6e9-ab48e4e33997 service nova] Acquiring lock "67c5dd7c-88aa-4f2f-8f62-a9af0480c38e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:19:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-0a35ccb5-ec2d-445b-9eed-48a96caa5701 req-1ab6fdfc-0ac2-4e47-a6e9-ab48e4e33997 service nova] Lock "67c5dd7c-88aa-4f2f-8f62-a9af0480c38e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:19:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-0a35ccb5-ec2d-445b-9eed-48a96caa5701 req-1ab6fdfc-0ac2-4e47-a6e9-ab48e4e33997 service nova] Lock "67c5dd7c-88aa-4f2f-8f62-a9af0480c38e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:19:07 user nova-compute[75066]: DEBUG nova.compute.manager [req-0a35ccb5-ec2d-445b-9eed-48a96caa5701 req-1ab6fdfc-0ac2-4e47-a6e9-ab48e4e33997 service nova] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] No waiting events found dispatching network-vif-unplugged-73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:19:07 user nova-compute[75066]: WARNING nova.compute.manager [req-0a35ccb5-ec2d-445b-9eed-48a96caa5701 req-1ab6fdfc-0ac2-4e47-a6e9-ab48e4e33997 service nova] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Received unexpected event network-vif-unplugged-73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2 for instance with vm_state active and task_state rescuing.
Dec 01 19:19:07 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Instance destroyed successfully.
Dec 01 19:19:07 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:07 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Attempting a stable device rescue
Dec 01 19:19:07 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75066) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4314}}
Dec 01 19:19:07 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Instance directory exists: not creating {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4719}}
Dec 01 19:19:07 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Creating image(s)
Dec 01 19:19:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Acquiring lock "/opt/stack/data/nova/instances/67c5dd7c-88aa-4f2f-8f62-a9af0480c38e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:19:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Lock "/opt/stack/data/nova/instances/67c5dd7c-88aa-4f2f-8f62-a9af0480c38e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:19:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Lock "/opt/stack/data/nova/instances/67c5dd7c-88aa-4f2f-8f62-a9af0480c38e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.022s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:19:07 user nova-compute[75066]: DEBUG nova.objects.instance [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Lazy-loading 'trusted_certs' on Instance uuid 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:19:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Acquiring lock "6baa4c062a4b2b2913bcdfa8d3bd1e10ee669d4f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:19:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Lock "6baa4c062a4b2b2913bcdfa8d3bd1e10ee669d4f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:19:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6baa4c062a4b2b2913bcdfa8d3bd1e10ee669d4f.part --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:08 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-0c886ba1-1732-4cf3-a1b3-b59c63857c64 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Acquiring lock "dd67db6c-8bd1-402e-93ce-9b2d7a405a6e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:19:08 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-0c886ba1-1732-4cf3-a1b3-b59c63857c64 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Lock "dd67db6c-8bd1-402e-93ce-9b2d7a405a6e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:19:08 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-0c886ba1-1732-4cf3-a1b3-b59c63857c64 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Acquiring lock "dd67db6c-8bd1-402e-93ce-9b2d7a405a6e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:19:08 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-0c886ba1-1732-4cf3-a1b3-b59c63857c64 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Lock "dd67db6c-8bd1-402e-93ce-9b2d7a405a6e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:19:08 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-0c886ba1-1732-4cf3-a1b3-b59c63857c64 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Lock "dd67db6c-8bd1-402e-93ce-9b2d7a405a6e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:19:08 user nova-compute[75066]: INFO nova.compute.manager [None req-0c886ba1-1732-4cf3-a1b3-b59c63857c64 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Terminating instance
Dec 01 19:19:08 user nova-compute[75066]: DEBUG nova.compute.manager [None req-0c886ba1-1732-4cf3-a1b3-b59c63857c64 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Start destroying the instance on the hypervisor. {{(pid=75066) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 19:19:09 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6baa4c062a4b2b2913bcdfa8d3bd1e10ee669d4f.part --force-share --output=json" returned: 0 in 0.242s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:09 user nova-compute[75066]: DEBUG nova.virt.images [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] 1f6f4c65-862d-4675-8a4d-d062627e1164 was qcow2, converting to raw {{(pid=75066) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 01 19:19:09 user nova-compute[75066]: DEBUG nova.privsep.utils [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75066) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 01 19:19:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6baa4c062a4b2b2913bcdfa8d3bd1e10ee669d4f.part /opt/stack/data/nova/instances/_base/6baa4c062a4b2b2913bcdfa8d3bd1e10ee669d4f.converted {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:09 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:09 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:09 user nova-compute[75066]: DEBUG nova.compute.manager [req-70cff01b-f419-4504-a99e-3b7b37e3d4fc req-28d8efee-a7ca-4f73-8ba0-fe2f616aefe3 service nova] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Received event network-vif-plugged-73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:19:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-70cff01b-f419-4504-a99e-3b7b37e3d4fc req-28d8efee-a7ca-4f73-8ba0-fe2f616aefe3 service nova] Acquiring lock "67c5dd7c-88aa-4f2f-8f62-a9af0480c38e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:19:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-70cff01b-f419-4504-a99e-3b7b37e3d4fc req-28d8efee-a7ca-4f73-8ba0-fe2f616aefe3 service nova] Lock "67c5dd7c-88aa-4f2f-8f62-a9af0480c38e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:19:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-70cff01b-f419-4504-a99e-3b7b37e3d4fc req-28d8efee-a7ca-4f73-8ba0-fe2f616aefe3 service nova] Lock "67c5dd7c-88aa-4f2f-8f62-a9af0480c38e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:19:09 user nova-compute[75066]: DEBUG nova.compute.manager [req-70cff01b-f419-4504-a99e-3b7b37e3d4fc req-28d8efee-a7ca-4f73-8ba0-fe2f616aefe3 service nova] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] No waiting events found dispatching network-vif-plugged-73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:19:09 user nova-compute[75066]: WARNING nova.compute.manager [req-70cff01b-f419-4504-a99e-3b7b37e3d4fc req-28d8efee-a7ca-4f73-8ba0-fe2f616aefe3 service nova] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Received unexpected event network-vif-plugged-73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2 for instance with vm_state active and task_state rescuing.
Dec 01 19:19:09 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:09 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:09 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Instance destroyed successfully.
Dec 01 19:19:09 user nova-compute[75066]: DEBUG nova.objects.instance [None req-0c886ba1-1732-4cf3-a1b3-b59c63857c64 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Lazy-loading 'resources' on Instance uuid dd67db6c-8bd1-402e-93ce-9b2d7a405a6e {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-0c886ba1-1732-4cf3-a1b3-b59c63857c64 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:15:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-900353537',display_name='tempest-TestVolumeSwap-server-900353537',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-900353537',id=7,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFiW2QbPGRYvL2NqqQbQ6Y9GMFMiDePQw5kKWCdg0HsDib5pR/cZzbwkv86TmgVdgocEJzjGsYBabIUT5Ho+tIh8QbuHUA8NfI3kz6OsX0wXzopjfW6SdnRuMw4HF0ZB6A==',key_name='tempest-keypair-65114224',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:15:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='163a9f68fa59476290f11dd2de613d79',ramdisk_id='',reservation_id='r-91mlod53',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1546773416',owner_user_name='tempest-TestVolumeSwap-1546773416-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:15:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='87b72f05df6847889abed27a497addf8',uuid=dd67db6c-8bd1-402e-93ce-9b2d7a405a6e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0a73848e-3c30-4e3a-a8ef-3092afe91d25", "address": "fa:16:3e:14:de:da", "network": {"id": "8ab1e58c-73ec-479c-9da7-3fbb9b968fd7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-579378626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "163a9f68fa59476290f11dd2de613d79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a73848e-3c", "ovs_interfaceid": "0a73848e-3c30-4e3a-a8ef-3092afe91d25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-0c886ba1-1732-4cf3-a1b3-b59c63857c64 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Converting VIF {"id": "0a73848e-3c30-4e3a-a8ef-3092afe91d25", "address": "fa:16:3e:14:de:da", "network": {"id": "8ab1e58c-73ec-479c-9da7-3fbb9b968fd7", "bridge": "br-int", "label": "tempest-TestVolumeSwap-579378626-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "163a9f68fa59476290f11dd2de613d79", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a73848e-3c", "ovs_interfaceid": "0a73848e-3c30-4e3a-a8ef-3092afe91d25", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-0c886ba1-1732-4cf3-a1b3-b59c63857c64 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:de:da,bridge_name='br-int',has_traffic_filtering=True,id=0a73848e-3c30-4e3a-a8ef-3092afe91d25,network=Network(8ab1e58c-73ec-479c-9da7-3fbb9b968fd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a73848e-3c') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG os_vif [None req-0c886ba1-1732-4cf3-a1b3-b59c63857c64 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:de:da,bridge_name='br-int',has_traffic_filtering=True,id=0a73848e-3c30-4e3a-a8ef-3092afe91d25,network=Network(8ab1e58c-73ec-479c-9da7-3fbb9b968fd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a73848e-3c') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0a73848e-3c, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ef371682-13db-46a7-9d60-950258a02b62) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:10 user nova-compute[75066]: INFO os_vif [None req-0c886ba1-1732-4cf3-a1b3-b59c63857c64 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:de:da,bridge_name='br-int',has_traffic_filtering=True,id=0a73848e-3c30-4e3a-a8ef-3092afe91d25,network=Network(8ab1e58c-73ec-479c-9da7-3fbb9b968fd7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0a73848e-3c')
Dec 01 19:19:10 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-0c886ba1-1732-4cf3-a1b3-b59c63857c64 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Deleting instance files /opt/stack/data/nova/instances/dd67db6c-8bd1-402e-93ce-9b2d7a405a6e_del
Dec 01 19:19:10 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-0c886ba1-1732-4cf3-a1b3-b59c63857c64 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Deletion of /opt/stack/data/nova/instances/dd67db6c-8bd1-402e-93ce-9b2d7a405a6e_del complete
Dec 01 19:19:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6baa4c062a4b2b2913bcdfa8d3bd1e10ee669d4f.part /opt/stack/data/nova/instances/_base/6baa4c062a4b2b2913bcdfa8d3bd1e10ee669d4f.converted" returned: 0 in 1.035s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6baa4c062a4b2b2913bcdfa8d3bd1e10ee669d4f.converted --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:10 user nova-compute[75066]: INFO nova.compute.manager [None req-0c886ba1-1732-4cf3-a1b3-b59c63857c64 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Took 1.31 seconds to destroy the instance on the hypervisor.
Dec 01 19:19:10 user nova-compute[75066]: DEBUG oslo.service.loopingcall [None req-0c886ba1-1732-4cf3-a1b3-b59c63857c64 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75066) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG nova.compute.manager [-] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Deallocating network for instance {{(pid=75066) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] deallocate_for_instance() {{(pid=75066) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6baa4c062a4b2b2913bcdfa8d3bd1e10ee669d4f.converted --force-share --output=json" returned: 0 in 0.191s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Lock "6baa4c062a4b2b2913bcdfa8d3bd1e10ee669d4f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.691s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Acquiring lock "6baa4c062a4b2b2913bcdfa8d3bd1e10ee669d4f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Lock "6baa4c062a4b2b2913bcdfa8d3bd1e10ee669d4f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6baa4c062a4b2b2913bcdfa8d3bd1e10ee669d4f --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6baa4c062a4b2b2913bcdfa8d3bd1e10ee669d4f --force-share --output=json" returned: 0 in 0.195s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6baa4c062a4b2b2913bcdfa8d3bd1e10ee669d4f,backing_fmt=raw /opt/stack/data/nova/instances/67c5dd7c-88aa-4f2f-8f62-a9af0480c38e/disk.rescue {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6baa4c062a4b2b2913bcdfa8d3bd1e10ee669d4f,backing_fmt=raw /opt/stack/data/nova/instances/67c5dd7c-88aa-4f2f-8f62-a9af0480c38e/disk.rescue" returned: 0 in 0.054s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Lock "6baa4c062a4b2b2913bcdfa8d3bd1e10ee669d4f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG nova.objects.instance [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Lazy-loading 'migration_context' on Instance uuid 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG nova.objects.base [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Object Instance<67c5dd7c-88aa-4f2f-8f62-a9af0480c38e> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75066) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Created local disks {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Start _get_guest_xml network_info=[{"id": "73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2", "address": "fa:16:3e:5a:73:a4", "network": {"id": "fdb3c017-aafb-4c3e-a08c-a73a68be9f70", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1696445417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1696445417-network", "vif_mac": "fa:16:3e:5a:73:a4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "306d3049e90647fa9f1c90a104eac0e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bdff9a-3a", "ovs_interfaceid": "73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '1f6f4c65-862d-4675-8a4d-d062627e1164', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'image_id': '900b237b-e99c-4fdd-a44f-dcb7a08baa86'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'mount_device': '/dev/vdb', 'guest_format': None, 'delete_on_termination': False, 'attachment_id': 'b51d3131-eab5-4144-af8c-c9e64abc86ec', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'desDpvUl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '67c5dd7c-88aa-4f2f-8f62-a9af0480c38e', 'attached_at': '', 'detached_at': '', 'volume_id': '40dba61d-f444-45f9-b949-2138807215fa', 'serial': '40dba61d-f444-45f9-b949-2138807215fa'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG nova.objects.instance [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Lazy-loading 'resources' on Instance uuid 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG nova.objects.base [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Object Instance<67c5dd7c-88aa-4f2f-8f62-a9af0480c38e> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75066) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG nova.objects.instance [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Lazy-loading 'numa_topology' on Instance uuid 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG nova.objects.base [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Object Instance<67c5dd7c-88aa-4f2f-8f62-a9af0480c38e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75066) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 19:19:10 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:19:10 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:19:10 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG nova.objects.instance [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Lazy-loading 'vcpu_model' on Instance uuid 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG nova.objects.base [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Object Instance<67c5dd7c-88aa-4f2f-8f62-a9af0480c38e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75066) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Calling os-brick to attach iSCSI Volume {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'desDpvUl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:19:10 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:19:10 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:19:10 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:19:10 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:19:10 user nova-compute[75066]: INFO os_brick.initiator.connectors.iscsi [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 19:19:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa -p 172.16.0.220:3260 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa -p 172.16.0.220:3260" returned: 0 in 0.023s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da0175f-a482-4036-be08-360742b16645]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = desDpvUl\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Dec 01 19:19:10 user nova-compute[75066]: node.name = iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa
Dec 01 19:19:10 user nova-compute[75066]: node.tpgt = -1
Dec 01 19:19:10 user nova-compute[75066]: node.startup = automatic
Dec 01 19:19:10 user nova-compute[75066]: node.leading_login = No
Dec 01 19:19:10 user nova-compute[75066]: iface.iscsi_ifacename = default
Dec 01 19:19:10 user nova-compute[75066]: iface.net_ifacename = <empty>
Dec 01 19:19:10 user nova-compute[75066]: iface.ipaddress = <empty>
Dec 01 19:19:10 user nova-compute[75066]: iface.prefix_len = 0
Dec 01 19:19:10 user nova-compute[75066]: iface.hwaddress = <empty>
Dec 01 19:19:10 user nova-compute[75066]: iface.transport_name = tcp
Dec 01 19:19:10 user nova-compute[75066]: iface.initiatorname = <empty>
Dec 01 19:19:10 user nova-compute[75066]: iface.state = <empty>
Dec 01 19:19:10 user nova-compute[75066]: iface.vlan_id = 0
Dec 01 19:19:10 user nova-compute[75066]: iface.vlan_priority = 0
Dec 01 19:19:10 user nova-compute[75066]: iface.vlan_state = <empty>
Dec 01 19:19:10 user nova-compute[75066]: iface.iface_num = 0
Dec 01 19:19:10 user nova-compute[75066]: iface.mtu = 0
Dec 01 19:19:10 user nova-compute[75066]: iface.port = 0
Dec 01 19:19:10 user nova-compute[75066]: iface.bootproto = <empty>
Dec 01 19:19:10 user nova-compute[75066]: iface.subnet_mask = <empty>
Dec 01 19:19:10 user nova-compute[75066]: iface.gateway = <empty>
Dec 01 19:19:10 user nova-compute[75066]: iface.dhcp_alt_client_id_state = <empty>
Dec 01 19:19:10 user nova-compute[75066]: iface.dhcp_alt_client_id = <empty>
Dec 01 19:19:10 user nova-compute[75066]: iface.dhcp_dns = <empty>
Dec 01 19:19:10 user nova-compute[75066]: iface.dhcp_learn_iqn = <empty>
Dec 01 19:19:10 user nova-compute[75066]: iface.dhcp_req_vendor_id_state = <empty>
Dec 01 19:19:10 user nova-compute[75066]: iface.dhcp_vendor_id_state = <empty>
Dec 01 19:19:10 user nova-compute[75066]: iface.dhcp_vendor_id = <empty>
Dec 01 19:19:10 user nova-compute[75066]: iface.dhcp_slp_da = <empty>
Dec 01 19:19:10 user nova-compute[75066]: iface.fragmentation = <empty>
Dec 01 19:19:10 user nova-compute[75066]: iface.gratuitous_arp = <empty>
Dec 01 19:19:10 user nova-compute[75066]: iface.incoming_forwarding = <empty>
Dec 01 19:19:10 user nova-compute[75066]: iface.tos_state = <empty>
Dec 01 19:19:10 user nova-compute[75066]: iface.tos = 0
Dec 01 19:19:10 user nova-compute[75066]: iface.ttl = 0
Dec 01 19:19:10 user nova-compute[75066]: iface.delayed_ack = <empty>
Dec 01 19:19:10 user nova-compute[75066]: iface.tcp_nagle = <empty>
Dec 01 19:19:10 user nova-compute[75066]: iface.tcp_wsf_state = <empty>
Dec 01 19:19:10 user nova-compute[75066]: iface.tcp_wsf = 0
Dec 01 19:19:10 user nova-compute[75066]: iface.tcp_timer_scale = 0
Dec 01 19:19:10 user nova-compute[75066]: iface.tcp_timestamp = <empty>
Dec 01 19:19:10 user nova-compute[75066]: iface.redirect = <empty>
Dec 01 19:19:10 user nova-compute[75066]: iface.def_task_mgmt_timeout = 0
Dec 01 19:19:10 user nova-compute[75066]: iface.header_digest = <empty>
Dec 01 19:19:10 user nova-compute[75066]: iface.data_digest = <empty>
Dec 01 19:19:10 user nova-compute[75066]: iface.immediate_data = <empty>
Dec 01 19:19:10 user nova-compute[75066]: iface.initial_r2t = <empty>
Dec 01 19:19:10 user nova-compute[75066]: iface.data_seq_inorder = <empty>
Dec 01 19:19:10 user nova-compute[75066]: iface.data_pdu_inorder = <empty>
Dec 01 19:19:10 user nova-compute[75066]: iface.erl = 0
Dec 01 19:19:10 user nova-compute[75066]: iface.max_receive_data_len = 0
Dec 01 19:19:10 user nova-compute[75066]: iface.first_burst_len = 0
Dec 01 19:19:10 user nova-compute[75066]: iface.max_outstanding_r2t = 0
Dec 01 19:19:10 user nova-compute[75066]: iface.max_burst_len = 0
Dec 01 19:19:10 user nova-compute[75066]: iface.chap_auth = <empty>
Dec 01 19:19:10 user nova-compute[75066]: iface.bidi_chap = <empty>
Dec 01 19:19:10 user nova-compute[75066]: iface.strict_login_compliance = <empty>
Dec 01 19:19:10 user nova-compute[75066]: iface.discovery_auth = <empty>
Dec 01 19:19:10 user nova-compute[75066]: iface.discovery_logout = <empty>
Dec 01 19:19:10 user nova-compute[75066]: node.discovery_address = <empty>
Dec 01 19:19:10 user nova-compute[75066]: node.discovery_port = 0
Dec 01 19:19:10 user nova-compute[75066]: node.discovery_type = static
Dec 01 19:19:10 user nova-compute[75066]: node.session.initial_cmdsn = 0
Dec 01 19:19:10 user nova-compute[75066]: node.session.initial_login_retry_max = 8
Dec 01 19:19:10 user nova-compute[75066]: node.session.xmit_thread_priority = -20
Dec 01 19:19:10 user nova-compute[75066]: node.session.cmds_max = 128
Dec 01 19:19:10 user nova-compute[75066]: node.session.queue_depth = 32
Dec 01 19:19:10 user nova-compute[75066]: node.session.nr_sessions = 1
Dec 01 19:19:10 user nova-compute[75066]: node.session.auth.authmethod = CHAP
Dec 01 19:19:10 user nova-compute[75066]: node.session.auth.username = desDpvUl
Dec 01 19:19:10 user nova-compute[75066]: node.session.auth.password = ***
Dec 01 19:19:10 user nova-compute[75066]: node.session.auth.username_in = <empty>
Dec 01 19:19:10 user nova-compute[75066]: node.session.auth.password_in = <empty>
Dec 01 19:19:10 user nova-compute[75066]: node.session.auth.chap_algs = MD5
Dec 01 19:19:10 user nova-compute[75066]: node.session.timeo.replacement_timeout = 120
Dec 01 19:19:10 user nova-compute[75066]: node.session.err_timeo.abort_timeout = 15
Dec 01 19:19:10 user nova-compute[75066]: node.session.err_timeo.lu_reset_timeout = 30
Dec 01 19:19:10 user nova-compute[75066]: node.session.err_timeo.tgt_reset_timeout = 30
Dec 01 19:19:10 user nova-compute[75066]: node.session.err_timeo.host_reset_timeout = 60
Dec 01 19:19:10 user nova-compute[75066]: node.session.iscsi.FastAbort = Yes
Dec 01 19:19:10 user nova-compute[75066]: node.session.iscsi.InitialR2T = No
Dec 01 19:19:10 user nova-compute[75066]: node.session.iscsi.ImmediateData = Yes
Dec 01 19:19:10 user nova-compute[75066]: node.session.iscsi.FirstBurstLength = 262144
Dec 01 19:19:10 user nova-compute[75066]: node.session.iscsi.MaxBurstLength = 16776192
Dec 01 19:19:10 user nova-compute[75066]: node.session.iscsi.DefaultTime2Retain = 0
Dec 01 19:19:10 user nova-compute[75066]: node.session.iscsi.DefaultTime2Wait = 2
Dec 01 19:19:10 user nova-compute[75066]: node.session.iscsi.MaxConnections = 1
Dec 01 19:19:10 user nova-compute[75066]: node.session.iscsi.MaxOutstandingR2T = 1
Dec 01 19:19:10 user nova-compute[75066]: node.session.iscsi.ERL = 0
Dec 01 19:19:10 user nova-compute[75066]: node.session.scan = manual
Dec 01 19:19:10 user nova-compute[75066]: node.session.reopen_max = 0
Dec 01 19:19:10 user nova-compute[75066]: node.conn[0].address = 172.16.0.220
Dec 01 19:19:10 user nova-compute[75066]: node.conn[0].port = 3260
Dec 01 19:19:10 user nova-compute[75066]: node.conn[0].startup = manual
Dec 01 19:19:10 user nova-compute[75066]: node.conn[0].tcp.window_size = 524288
Dec 01 19:19:10 user nova-compute[75066]: node.conn[0].tcp.type_of_service = 0
Dec 01 19:19:10 user nova-compute[75066]: node.conn[0].timeo.logout_timeout = 15
Dec 01 19:19:10 user nova-compute[75066]: node.conn[0].timeo.login_timeout = 15
Dec 01 19:19:10 user nova-compute[75066]: node.conn[0].timeo.auth_timeout = 45
Dec 01 19:19:10 user nova-compute[75066]: node.conn[0].timeo.noop_out_interval = 5
Dec 01 19:19:10 user nova-compute[75066]: node.conn[0].timeo.noop_out_timeout = 5
Dec 01 19:19:10 user nova-compute[75066]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Dec 01 19:19:10 user nova-compute[75066]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Dec 01 19:19:10 user nova-compute[75066]: node.conn[0].iscsi.HeaderDigest = None
Dec 01 19:19:10 user nova-compute[75066]: node.conn[0].iscsi.DataDigest = None
Dec 01 19:19:10 user nova-compute[75066]: node.conn[0].iscsi.IFMarker = No
Dec 01 19:19:10 user nova-compute[75066]: node.conn[0].iscsi.OFMarker = No
Dec 01 19:19:10 user nova-compute[75066]: # END RECORD
Dec 01 19:19:10 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc62c63e-cf62-4285-8183-4ed531b352e5]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d92264-eb67-4b7a-b357-6f29d3035731]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v desDpvUl {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v desDpvUl" returned: 0 in 0.021s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea53e771-2379-4dc1-ad1a-7a05f8825773]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'desDpvUl'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f378d2-4136-4184-a407-b6377bddc534]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60240de6-d9cc-49f9-b4bd-2020b1c5934d tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Calling os-brick to attach iSCSI Volume {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-60240de6-d9cc-49f9-b4bd-2020b1c5934d tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gUkyhEaX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:19:10 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-60240de6-d9cc-49f9-b4bd-2020b1c5934d tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:19:10 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-60240de6-d9cc-49f9-b4bd-2020b1c5934d tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[2205cd84-dd3e-4e1f-b424-9b6b261fb55f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)
Dec 01 19:19:10 user nova-compute[75066]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)
Dec 01 19:19:10 user nova-compute[75066]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:19:10 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)
Dec 01 19:19:10 user nova-compute[75066]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)
Dec 01 19:19:10 user nova-compute[75066]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:19:10 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.171s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Connected to 172.16.0.220:3260 {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] HCTL ('34', '0', '0', 0) found on session 13 with lun 0 {{(pid=75066) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=75066) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.013s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dcecc01-c6dc-49f7-b61f-d63aa70a195c]: (4, ('0 0 0', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Searching for a device in session 13 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'desDpvUl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.195s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] <== connect_volume: return (196ms) {'type': 'block', 'scsi_wwn': '23765643064313233', 'path': '/dev/sdc'} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765643064313233', 'path': '/dev/sdc'} {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-60240de6-d9cc-49f9-b4bd-2020b1c5934d tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.049s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:19:10 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-60240de6-d9cc-49f9-b4bd-2020b1c5934d tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:19:10 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-60240de6-d9cc-49f9-b4bd-2020b1c5934d tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-60240de6-d9cc-49f9-b4bd-2020b1c5934d tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:19:10 user nova-compute[75066]: INFO os_brick.initiator.connectors.iscsi [None req-60240de6-d9cc-49f9-b4bd-2020b1c5934d tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 19:19:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 -p 172.16.0.220:3260 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b43e71-cd9e-4026-9eb5-ad236e032d7f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-60240de6-d9cc-49f9-b4bd-2020b1c5934d tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 19:19:10 user nova-compute[75066]:  {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:15:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-116335834',display_name='tempest-ServerStableDeviceRescueTest-server-116335834',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-116335834',id=1,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNNwUw2DY7Q5YGZ9SklK7Yt6zDNAMAKbqWf0bjfGOIr+Bf73P/Vb8HVUq1DDGOQfShaQxirLaBE1zWK7StLIdvMV/O9laZqIqcEwHqJJUVd7PEVzmYYja/8XpEumf+mt5Q==',key_name='tempest-keypair-572874473',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:15:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='306d3049e90647fa9f1c90a104eac0e7',ramdisk_id='',reservation_id='r-vlwek4pb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1936445064',owner_user_name='tempest-ServerStableDeviceRescueTest-1936445064-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:17:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fbd6bed08164f359471592ccc78a43d',uuid=67c5dd7c-88aa-4f2f-8f62-a9af0480c38e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2", "address": "fa:16:3e:5a:73:a4", "network": {"id": "fdb3c017-aafb-4c3e-a08c-a73a68be9f70", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1696445417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1696445417-network", "vif_mac": "fa:16:3e:5a:73:a4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "306d3049e90647fa9f1c90a104eac0e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bdff9a-3a", "ovs_interfaceid": "73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Converting VIF {"id": "73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2", "address": "fa:16:3e:5a:73:a4", "network": {"id": "fdb3c017-aafb-4c3e-a08c-a73a68be9f70", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1696445417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1696445417-network", "vif_mac": "fa:16:3e:5a:73:a4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "306d3049e90647fa9f1c90a104eac0e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bdff9a-3a", "ovs_interfaceid": "73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5a:73:a4,bridge_name='br-int',has_traffic_filtering=True,id=73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2,network=Network(fdb3c017-aafb-4c3e-a08c-a73a68be9f70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73bdff9a-3a') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:19:10 user nova-compute[75066]: DEBUG nova.objects.instance [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Lazy-loading 'pci_devices' on Instance uuid 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45d3e7e-6b78-43ea-a15c-137fd2b67740]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2] added\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-60240de6-d9cc-49f9-b4bd-2020b1c5934d tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2] added
Dec 01 19:19:11 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG nova.objects.base [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Object Instance<67c5dd7c-88aa-4f2f-8f62-a9af0480c38e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75066) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:19:11 user nova-compute[75066]:   <uuid>67c5dd7c-88aa-4f2f-8f62-a9af0480c38e</uuid>
Dec 01 19:19:11 user nova-compute[75066]:   <name>instance-00000001</name>
Dec 01 19:19:11 user nova-compute[75066]:   <memory>524288</memory>
Dec 01 19:19:11 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:19:11 user nova-compute[75066]:   <metadata>
Dec 01 19:19:11 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:19:11 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:19:11 user nova-compute[75066]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-116335834</nova:name>
Dec 01 19:19:11 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:19:10</nova:creationTime>
Dec 01 19:19:11 user nova-compute[75066]:       <nova:flavor name="m1.tiny">
Dec 01 19:19:11 user nova-compute[75066]:         <nova:memory>512</nova:memory>
Dec 01 19:19:11 user nova-compute[75066]:         <nova:disk>1</nova:disk>
Dec 01 19:19:11 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:19:11 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:19:11 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:19:11 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:19:11 user nova-compute[75066]:       <nova:owner>
Dec 01 19:19:11 user nova-compute[75066]:         <nova:user uuid="1fbd6bed08164f359471592ccc78a43d">tempest-ServerStableDeviceRescueTest-1936445064-project-member</nova:user>
Dec 01 19:19:11 user nova-compute[75066]:         <nova:project uuid="306d3049e90647fa9f1c90a104eac0e7">tempest-ServerStableDeviceRescueTest-1936445064</nova:project>
Dec 01 19:19:11 user nova-compute[75066]:       </nova:owner>
Dec 01 19:19:11 user nova-compute[75066]:       <nova:root type="image" uuid="900b237b-e99c-4fdd-a44f-dcb7a08baa86"/>
Dec 01 19:19:11 user nova-compute[75066]:       <nova:ports>
Dec 01 19:19:11 user nova-compute[75066]:         <nova:port uuid="73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2">
Dec 01 19:19:11 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Dec 01 19:19:11 user nova-compute[75066]:         </nova:port>
Dec 01 19:19:11 user nova-compute[75066]:       </nova:ports>
Dec 01 19:19:11 user nova-compute[75066]:     </nova:instance>
Dec 01 19:19:11 user nova-compute[75066]:   </metadata>
Dec 01 19:19:11 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:19:11 user nova-compute[75066]:     <system>
Dec 01 19:19:11 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:19:11 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:19:11 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:19:11 user nova-compute[75066]:       <entry name="serial">67c5dd7c-88aa-4f2f-8f62-a9af0480c38e</entry>
Dec 01 19:19:11 user nova-compute[75066]:       <entry name="uuid">67c5dd7c-88aa-4f2f-8f62-a9af0480c38e</entry>
Dec 01 19:19:11 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:19:11 user nova-compute[75066]:     </system>
Dec 01 19:19:11 user nova-compute[75066]:   </sysinfo>
Dec 01 19:19:11 user nova-compute[75066]:   <os>
Dec 01 19:19:11 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:19:11 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:19:11 user nova-compute[75066]:   </os>
Dec 01 19:19:11 user nova-compute[75066]:   <features>
Dec 01 19:19:11 user nova-compute[75066]:     <acpi/>
Dec 01 19:19:11 user nova-compute[75066]:     <apic/>
Dec 01 19:19:11 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:19:11 user nova-compute[75066]:   </features>
Dec 01 19:19:11 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:19:11 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:19:11 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:19:11 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:19:11 user nova-compute[75066]:   </clock>
Dec 01 19:19:11 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:19:11 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:19:11 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:19:11 user nova-compute[75066]:   </cpu>
Dec 01 19:19:11 user nova-compute[75066]:   <devices>
Dec 01 19:19:11 user nova-compute[75066]:     <disk type="file" device="disk">
Dec 01 19:19:11 user nova-compute[75066]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 19:19:11 user nova-compute[75066]:       <source file="/opt/stack/data/nova/instances/67c5dd7c-88aa-4f2f-8f62-a9af0480c38e/disk"/>
Dec 01 19:19:11 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:19:11 user nova-compute[75066]:     </disk>
Dec 01 19:19:11 user nova-compute[75066]:     <disk type="block" device="disk">
Dec 01 19:19:11 user nova-compute[75066]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:19:11 user nova-compute[75066]:       <source dev="/dev/sdc"/>
Dec 01 19:19:11 user nova-compute[75066]:       <target dev="vdb" bus="virtio"/>
Dec 01 19:19:11 user nova-compute[75066]:       <serial>40dba61d-f444-45f9-b949-2138807215fa</serial>
Dec 01 19:19:11 user nova-compute[75066]:     </disk>
Dec 01 19:19:11 user nova-compute[75066]:     <disk type="file" device="disk">
Dec 01 19:19:11 user nova-compute[75066]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 19:19:11 user nova-compute[75066]:       <source file="/opt/stack/data/nova/instances/67c5dd7c-88aa-4f2f-8f62-a9af0480c38e/disk.rescue"/>
Dec 01 19:19:11 user nova-compute[75066]:       <target dev="vdc" bus="virtio"/>
Dec 01 19:19:11 user nova-compute[75066]:       <boot order="1"/>
Dec 01 19:19:11 user nova-compute[75066]:     </disk>
Dec 01 19:19:11 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:19:11 user nova-compute[75066]:       <mac address="fa:16:3e:5a:73:a4"/>
Dec 01 19:19:11 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:19:11 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:19:11 user nova-compute[75066]:       <target dev="tap73bdff9a-3a"/>
Dec 01 19:19:11 user nova-compute[75066]:     </interface>
Dec 01 19:19:11 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:19:11 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/67c5dd7c-88aa-4f2f-8f62-a9af0480c38e/console.log" append="off"/>
Dec 01 19:19:11 user nova-compute[75066]:     </serial>
Dec 01 19:19:11 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:19:11 user nova-compute[75066]:     <video>
Dec 01 19:19:11 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:19:11 user nova-compute[75066]:     </video>
Dec 01 19:19:11 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:19:11 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:19:11 user nova-compute[75066]:     </rng>
Dec 01 19:19:11 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:19:11 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:19:11 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:19:11 user nova-compute[75066]:     </memballoon>
Dec 01 19:19:11 user nova-compute[75066]:   </devices>
Dec 01 19:19:11 user nova-compute[75066]: </domain>
Dec 01 19:19:11 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:19:11 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Instance destroyed successfully.
Dec 01 19:19:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0134cbd-2a0c-42e7-9eb9-9545d1158a81]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-60240de6-d9cc-49f9-b4bd-2020b1c5934d tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[200830ca-7093-4cae-8b92-104fc3a67e5c]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-60240de6-d9cc-49f9-b4bd-2020b1c5934d tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gUkyhEaX {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] No VIF found with MAC fa:16:3e:5a:73:a4, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gUkyhEaX" returned: 0 in 0.023s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf32b29-71b7-4dda-b7cd-93c993ec93b4]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-60240de6-d9cc-49f9-b4bd-2020b1c5934d tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gUkyhEaX'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5732d13-3855-4758-afed-96e4b65e1d63]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-60240de6-d9cc-49f9-b4bd-2020b1c5934d tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[0440eebe-f8f6-44dd-a2a8-4ef623acb41a]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-60240de6-d9cc-49f9-b4bd-2020b1c5934d tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)
Dec 01 19:19:11 user nova-compute[75066]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)
Dec 01 19:19:11 user nova-compute[75066]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:19:11 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-60240de6-d9cc-49f9-b4bd-2020b1c5934d tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)
Dec 01 19:19:11 user nova-compute[75066]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)
Dec 01 19:19:11 user nova-compute[75066]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:19:11 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 -p 172.16.0.220:3260 --login {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG nova.compute.manager [req-7de1af70-9253-405b-8b76-54c650b56090 req-ed9ea40a-76c1-4335-ad2c-73067e1790d0 service nova] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Received event network-vif-unplugged-0a73848e-3c30-4e3a-a8ef-3092afe91d25 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-7de1af70-9253-405b-8b76-54c650b56090 req-ed9ea40a-76c1-4335-ad2c-73067e1790d0 service nova] Acquiring lock "dd67db6c-8bd1-402e-93ce-9b2d7a405a6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-7de1af70-9253-405b-8b76-54c650b56090 req-ed9ea40a-76c1-4335-ad2c-73067e1790d0 service nova] Lock "dd67db6c-8bd1-402e-93ce-9b2d7a405a6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-7de1af70-9253-405b-8b76-54c650b56090 req-ed9ea40a-76c1-4335-ad2c-73067e1790d0 service nova] Lock "dd67db6c-8bd1-402e-93ce-9b2d7a405a6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG nova.compute.manager [req-7de1af70-9253-405b-8b76-54c650b56090 req-ed9ea40a-76c1-4335-ad2c-73067e1790d0 service nova] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] No waiting events found dispatching network-vif-unplugged-0a73848e-3c30-4e3a-a8ef-3092afe91d25 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG nova.compute.manager [req-7de1af70-9253-405b-8b76-54c650b56090 req-ed9ea40a-76c1-4335-ad2c-73067e1790d0 service nova] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Received event network-vif-unplugged-0a73848e-3c30-4e3a-a8ef-3092afe91d25 for instance with task_state deleting. {{(pid=75066) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG nova.compute.manager [req-7de1af70-9253-405b-8b76-54c650b56090 req-ed9ea40a-76c1-4335-ad2c-73067e1790d0 service nova] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Received event network-vif-plugged-0a73848e-3c30-4e3a-a8ef-3092afe91d25 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-7de1af70-9253-405b-8b76-54c650b56090 req-ed9ea40a-76c1-4335-ad2c-73067e1790d0 service nova] Acquiring lock "dd67db6c-8bd1-402e-93ce-9b2d7a405a6e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-7de1af70-9253-405b-8b76-54c650b56090 req-ed9ea40a-76c1-4335-ad2c-73067e1790d0 service nova] Lock "dd67db6c-8bd1-402e-93ce-9b2d7a405a6e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-7de1af70-9253-405b-8b76-54c650b56090 req-ed9ea40a-76c1-4335-ad2c-73067e1790d0 service nova] Lock "dd67db6c-8bd1-402e-93ce-9b2d7a405a6e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG nova.compute.manager [req-7de1af70-9253-405b-8b76-54c650b56090 req-ed9ea40a-76c1-4335-ad2c-73067e1790d0 service nova] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] No waiting events found dispatching network-vif-plugged-0a73848e-3c30-4e3a-a8ef-3092afe91d25 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:19:11 user nova-compute[75066]: WARNING nova.compute.manager [req-7de1af70-9253-405b-8b76-54c650b56090 req-ed9ea40a-76c1-4335-ad2c-73067e1790d0 service nova] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Received unexpected event network-vif-plugged-0a73848e-3c30-4e3a-a8ef-3092afe91d25 for instance with vm_state active and task_state deleting.
Dec 01 19:19:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be05c51-f7df-4ff8-b2cf-a7d09508c5f6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG nova.compute.manager [req-c4dd9020-918a-4766-9129-f64af343ea09 req-2433985f-2a9d-4545-9476-b668ec6fa503 service nova] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Received event network-vif-deleted-0a73848e-3c30-4e3a-a8ef-3092afe91d25 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:19:11 user nova-compute[75066]: INFO nova.compute.manager [req-c4dd9020-918a-4766-9129-f64af343ea09 req-2433985f-2a9d-4545-9476-b668ec6fa503 service nova] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Neutron deleted interface 0a73848e-3c30-4e3a-a8ef-3092afe91d25; detaching it from the instance and deleting it from the info cache
Dec 01 19:19:11 user nova-compute[75066]: DEBUG nova.network.neutron [req-c4dd9020-918a-4766-9129-f64af343ea09 req-2433985f-2a9d-4545-9476-b668ec6fa503 service nova] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-60240de6-d9cc-49f9-b4bd-2020b1c5934d tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2, portal: 172.16.0.220,3260]
Dec 01 19:19:11 user nova-compute[75066]: Login to [iface: default, target: iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2, portal: 172.16.0.220,3260] successful.
Dec 01 19:19:11 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:11 user nova-compute[75066]: INFO nova.compute.manager [-] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Took 1.03 seconds to deallocate network for instance.
Dec 01 19:19:11 user nova-compute[75066]: DEBUG nova.compute.manager [req-c4dd9020-918a-4766-9129-f64af343ea09 req-2433985f-2a9d-4545-9476-b668ec6fa503 service nova] [instance: dd67db6c-8bd1-402e-93ce-9b2d7a405a6e] Detach interface failed, port_id=0a73848e-3c30-4e3a-a8ef-3092afe91d25, reason: Instance dd67db6c-8bd1-402e-93ce-9b2d7a405a6e could not be found. {{(pid=75066) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[82205546-1508-4b8e-8dd3-1b56584076ce]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-60240de6-d9cc-49f9-b4bd-2020b1c5934d tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8dbc648-a620-40f9-84ca-e09255f12485]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-60240de6-d9cc-49f9-b4bd-2020b1c5934d tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)
Dec 01 19:19:11 user nova-compute[75066]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)
Dec 01 19:19:11 user nova-compute[75066]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)
Dec 01 19:19:11 user nova-compute[75066]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:19:11 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-60240de6-d9cc-49f9-b4bd-2020b1c5934d tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)
Dec 01 19:19:11 user nova-compute[75066]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)
Dec 01 19:19:11 user nova-compute[75066]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)
Dec 01 19:19:11 user nova-compute[75066]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:19:11 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-60240de6-d9cc-49f9-b4bd-2020b1c5934d tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.407s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-60240de6-d9cc-49f9-b4bd-2020b1c5934d tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Connected to 172.16.0.220:3260 {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-60240de6-d9cc-49f9-b4bd-2020b1c5934d tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] HCTL ('35', '-', '-', 0) found on session 14 with lun 0 {{(pid=75066) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-60240de6-d9cc-49f9-b4bd-2020b1c5934d tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75066) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[1080295e-c2b4-4f2f-8ad5-f0309c0eaa39]: (4, ('- - 0', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-60240de6-d9cc-49f9-b4bd-2020b1c5934d tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Searching for a device in session 14 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-60240de6-d9cc-49f9-b4bd-2020b1c5934d tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gUkyhEaX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-0c886ba1-1732-4cf3-a1b3-b59c63857c64 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-0c886ba1-1732-4cf3-a1b3-b59c63857c64 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-0c886ba1-1732-4cf3-a1b3-b59c63857c64 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-0c886ba1-1732-4cf3-a1b3-b59c63857c64 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:19:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-0c886ba1-1732-4cf3-a1b3-b59c63857c64 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.421s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:19:11 user nova-compute[75066]: INFO nova.scheduler.client.report [None req-0c886ba1-1732-4cf3-a1b3-b59c63857c64 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Deleted allocations for instance dd67db6c-8bd1-402e-93ce-9b2d7a405a6e
Dec 01 19:19:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-0c886ba1-1732-4cf3-a1b3-b59c63857c64 tempest-TestVolumeSwap-1546773416 tempest-TestVolumeSwap-1546773416-project-member] Lock "dd67db6c-8bd1-402e-93ce-9b2d7a405a6e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.066s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:19:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-60240de6-d9cc-49f9-b4bd-2020b1c5934d tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.446s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:19:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-60240de6-d9cc-49f9-b4bd-2020b1c5934d tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] <== connect_volume: return (1495ms) {'type': 'block', 'scsi_wwn': '23132323935306161', 'path': '/dev/sdd'} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:19:12 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60240de6-d9cc-49f9-b4bd-2020b1c5934d tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23132323935306161', 'path': '/dev/sdd'} {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 19:19:12 user nova-compute[75066]: DEBUG nova.objects.instance [None req-60240de6-d9cc-49f9-b4bd-2020b1c5934d tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Lazy-loading 'flavor' on Instance uuid dd546862-fcd5-4b69-8ea3-a8fa4859a489 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:19:12 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-60240de6-d9cc-49f9-b4bd-2020b1c5934d tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 19:19:12 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:19:12 user nova-compute[75066]:   <source dev="/dev/sdd"/>
Dec 01 19:19:12 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:19:12 user nova-compute[75066]:   <serial>b6e9e54d-57f4-4413-9c76-50da506906d2</serial>
Dec 01 19:19:12 user nova-compute[75066]: </disk>
Dec 01 19:19:12 user nova-compute[75066]:  {{(pid=75066) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 19:19:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:13 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-60240de6-d9cc-49f9-b4bd-2020b1c5934d tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:19:13 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-60240de6-d9cc-49f9-b4bd-2020b1c5934d tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:19:13 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-60240de6-d9cc-49f9-b4bd-2020b1c5934d tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] No VIF found with MAC fa:16:3e:9a:26:f6, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:19:13 user nova-compute[75066]: DEBUG nova.objects.instance [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lazy-loading 'flavor' on Instance uuid c3ceeca4-c16c-4cf5-adfd-7d5a2925f435 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:19:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Acquiring lock "refresh_cache-c3ceeca4-c16c-4cf5-adfd-7d5a2925f435" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:19:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Acquired lock "refresh_cache-c3ceeca4-c16c-4cf5-adfd-7d5a2925f435" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:19:13 user nova-compute[75066]: DEBUG nova.network.neutron [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:19:13 user nova-compute[75066]: DEBUG nova.objects.instance [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lazy-loading 'info_cache' on Instance uuid c3ceeca4-c16c-4cf5-adfd-7d5a2925f435 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:19:13 user nova-compute[75066]: DEBUG nova.objects.base [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Object Instance<c3ceeca4-c16c-4cf5-adfd-7d5a2925f435> lazy-loaded attributes: flavor,info_cache {{(pid=75066) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 19:19:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-60240de6-d9cc-49f9-b4bd-2020b1c5934d tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Lock "dd546862-fcd5-4b69-8ea3-a8fa4859a489" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.387s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:19:13 user nova-compute[75066]: DEBUG nova.compute.manager [req-70912e5b-3092-48cb-927d-3b85ffd9afd0 req-bf35202e-0b6e-46dd-a30d-e56280bb6cb7 service nova] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Received event network-vif-plugged-73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:19:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-70912e5b-3092-48cb-927d-3b85ffd9afd0 req-bf35202e-0b6e-46dd-a30d-e56280bb6cb7 service nova] Acquiring lock "67c5dd7c-88aa-4f2f-8f62-a9af0480c38e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:19:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-70912e5b-3092-48cb-927d-3b85ffd9afd0 req-bf35202e-0b6e-46dd-a30d-e56280bb6cb7 service nova] Lock "67c5dd7c-88aa-4f2f-8f62-a9af0480c38e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:19:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-70912e5b-3092-48cb-927d-3b85ffd9afd0 req-bf35202e-0b6e-46dd-a30d-e56280bb6cb7 service nova] Lock "67c5dd7c-88aa-4f2f-8f62-a9af0480c38e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:19:13 user nova-compute[75066]: DEBUG nova.compute.manager [req-70912e5b-3092-48cb-927d-3b85ffd9afd0 req-bf35202e-0b6e-46dd-a30d-e56280bb6cb7 service nova] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] No waiting events found dispatching network-vif-plugged-73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:19:13 user nova-compute[75066]: WARNING nova.compute.manager [req-70912e5b-3092-48cb-927d-3b85ffd9afd0 req-bf35202e-0b6e-46dd-a30d-e56280bb6cb7 service nova] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Received unexpected event network-vif-plugged-73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2 for instance with vm_state active and task_state rescuing.
Dec 01 19:19:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:13 user nova-compute[75066]: DEBUG nova.network.neutron [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Updating instance_info_cache with network_info: [{"id": "c9353199-d4a3-488f-857d-b0ebdb31a68f", "address": "fa:16:3e:d4:7c:91", "network": {"id": "4a6c6c26-4d29-486c-b11e-fc53769083ea", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1139388453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "492e0b2da61e4e4f9ea991df15531e24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9353199-d4", "ovs_interfaceid": "c9353199-d4a3-488f-857d-b0ebdb31a68f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:19:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Releasing lock "refresh_cache-c3ceeca4-c16c-4cf5-adfd-7d5a2925f435" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:19:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:13 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Instance destroyed successfully.
Dec 01 19:19:13 user nova-compute[75066]: DEBUG nova.objects.instance [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lazy-loading 'resources' on Instance uuid c3ceeca4-c16c-4cf5-adfd-7d5a2925f435 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:19:13 user nova-compute[75066]: DEBUG nova.objects.base [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Object Instance<c3ceeca4-c16c-4cf5-adfd-7d5a2925f435> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75066) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 19:19:13 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:15:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-24114443',display_name='tempest-AttachVolumeTestJSON-server-24114443',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-24114443',id=4,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGLScdrbjNBUKzk1xw2/kR+RAsIU9zFWMcYM+4wt8kIDoD28bEQj/IZzhB52jLd7ItVSKAdt9hCSnaKdaqoB8QmfEIsszcxk4SoK4okQhg235yQ27ClCZrLdhVk+g2LNPw==',key_name='tempest-keypair-1548189004',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:15:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='492e0b2da61e4e4f9ea991df15531e24',ramdisk_id='',reservation_id='r-f8zkyh7r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1914192398',owner_user_name='tempest-AttachVolumeTestJSON-1914192398-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:17:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e047112719c414d900ccb2adccf963a',uuid=c3ceeca4-c16c-4cf5-adfd-7d5a2925f435,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "c9353199-d4a3-488f-857d-b0ebdb31a68f", "address": "fa:16:3e:d4:7c:91", "network": {"id": "4a6c6c26-4d29-486c-b11e-fc53769083ea", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1139388453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "492e0b2da61e4e4f9ea991df15531e24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9353199-d4", "ovs_interfaceid": "c9353199-d4a3-488f-857d-b0ebdb31a68f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:19:13 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Converting VIF {"id": "c9353199-d4a3-488f-857d-b0ebdb31a68f", "address": "fa:16:3e:d4:7c:91", "network": {"id": "4a6c6c26-4d29-486c-b11e-fc53769083ea", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1139388453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "492e0b2da61e4e4f9ea991df15531e24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9353199-d4", "ovs_interfaceid": "c9353199-d4a3-488f-857d-b0ebdb31a68f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:19:13 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:7c:91,bridge_name='br-int',has_traffic_filtering=True,id=c9353199-d4a3-488f-857d-b0ebdb31a68f,network=Network(4a6c6c26-4d29-486c-b11e-fc53769083ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9353199-d4') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:19:13 user nova-compute[75066]: DEBUG os_vif [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:7c:91,bridge_name='br-int',has_traffic_filtering=True,id=c9353199-d4a3-488f-857d-b0ebdb31a68f,network=Network(4a6c6c26-4d29-486c-b11e-fc53769083ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9353199-d4') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:19:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc9353199-d4, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:19:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:19:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a1b1b3bf-fa8c-4a78-bdea-2a52c55c759a) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:19:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:13 user nova-compute[75066]: INFO os_vif [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:7c:91,bridge_name='br-int',has_traffic_filtering=True,id=c9353199-d4a3-488f-857d-b0ebdb31a68f,network=Network(4a6c6c26-4d29-486c-b11e-fc53769083ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9353199-d4')
Dec 01 19:19:13 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] calling os-brick to detach iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 19:19:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, {'target_iqn': 'iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qYPJGAzg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:19:13 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:19:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:19:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:19:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:13 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[980f9a17-f2b4-4cd4-95ad-9ec1c16a428e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 19:19:13 user nova-compute[75066]: No targets found.
Dec 01 19:19:13 user nova-compute[75066]: iSNS:
Dec 01 19:19:13 user nova-compute[75066]: No targets found.
Dec 01 19:19:13 user nova-compute[75066]: STATIC:
Dec 01 19:19:13 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829
Dec 01 19:19:13 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:19:13 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:19:13 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa
Dec 01 19:19:13 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:19:13 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:19:13 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2
Dec 01 19:19:13 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:19:13 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:19:13 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c
Dec 01 19:19:13 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:19:13 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:19:13 user nova-compute[75066]: FIRMWARE:
Dec 01 19:19:13 user nova-compute[75066]: No targets found.
Dec 01 19:19:13 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:19:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 19:19:13 user nova-compute[75066]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 19:19:13 user nova-compute[75066]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75066) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 19:19:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829', 0)] {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 19:19:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:13 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e73ea1-467d-4590-9e2c-316c6d264c1f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:13 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd75d3cd-567e-4f49-9066-1e7515357ff8]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)
Dec 01 19:19:13 user nova-compute[75066]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)
Dec 01 19:19:13 user nova-compute[75066]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)
Dec 01 19:19:13 user nova-compute[75066]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:19:13 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:19:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)
Dec 01 19:19:13 user nova-compute[75066]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)
Dec 01 19:19:13 user nova-compute[75066]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)
Dec 01 19:19:13 user nova-compute[75066]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:19:13 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:19:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f919018fe20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829'): ({'sdf'}, set())}) {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 19:19:13 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Removing single pathed devices sdf {{(pid=75066) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 19:19:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef3cc49-d114-4c7a-bb5f-e4ffe846553a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.037s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ecc54cd-892b-43aa-8b48-e7e456e8f213]: (4, ('ok\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Flushing IO for device /dev/sdf {{(pid=75066) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ba423f-324d-40f3-a1fa-cef476e9268c]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75066) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fcdc8df-9b0d-4071-bb83-ba45ea393ad2]: (4, ('1', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] SCSI volumes sdf have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829')] {{(pid=75066) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e6ad32-63bc-41cc-b225-cf58de9a30b9]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 -p 172.16.0.220:3260 --logout {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[68667295-a4e9-4706-ba59-8441accd43f8]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829, portal: 172.16.0.220,3260]
Dec 01 19:19:14 user nova-compute[75066]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829, portal: 172.16.0.220,3260] successful.
Dec 01 19:19:14 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 -p 172.16.0.220:3260 --op delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c48472-128a-45bd-9659-6d0cac33facb]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.382s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] <== disconnect_volume: return (383ms) None {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Disconnected iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Start _get_guest_xml network_info=[{"id": "c9353199-d4a3-488f-857d-b0ebdb31a68f", "address": "fa:16:3e:d4:7c:91", "network": {"id": "4a6c6c26-4d29-486c-b11e-fc53769083ea", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1139388453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "492e0b2da61e4e4f9ea991df15531e24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9353199-d4", "ovs_interfaceid": "c9353199-d4a3-488f-857d-b0ebdb31a68f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'image_id': '900b237b-e99c-4fdd-a44f-dcb7a08baa86'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'mount_device': '/dev/vdb', 'guest_format': None, 'delete_on_termination': False, 'attachment_id': '3197229d-bf5a-4fb4-90d0-1a4d0efb7291', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qYPJGAzg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'c3ceeca4-c16c-4cf5-adfd-7d5a2925f435', 'attached_at': '', 'detached_at': '', 'volume_id': 'f32073d6-c4aa-49cc-a329-e000fd930829', 'serial': 'f32073d6-c4aa-49cc-a329-e000fd930829'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG nova.objects.instance [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lazy-loading 'numa_topology' on Instance uuid c3ceeca4-c16c-4cf5-adfd-7d5a2925f435 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG nova.objects.base [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Object Instance<c3ceeca4-c16c-4cf5-adfd-7d5a2925f435> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75066) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 19:19:14 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:19:14 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:19:14 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG nova.objects.instance [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lazy-loading 'vcpu_model' on Instance uuid c3ceeca4-c16c-4cf5-adfd-7d5a2925f435 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG nova.objects.base [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Object Instance<c3ceeca4-c16c-4cf5-adfd-7d5a2925f435> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75066) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Calling os-brick to attach iSCSI Volume {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qYPJGAzg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:19:14 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:19:14 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:19:14 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:19:14 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:19:14 user nova-compute[75066]: INFO os_brick.initiator.connectors.iscsi [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 19:19:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 -p 172.16.0.220:3260 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae93655b-9b7b-4f21-8769-dcac37e798fa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 19:19:14 user nova-compute[75066]:  {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 -p 172.16.0.220:3260 --interface default --op new {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c57466-0b94-438f-814a-8cdd0dad8cc4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829] added\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829] added
Dec 01 19:19:14 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b65fccd-efcf-4cdd-8c6b-8795b95c640b]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb9db57-75e7-4040-8c46-a5d2c4aa59ae]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qYPJGAzg {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qYPJGAzg" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d5fdd0-b06e-4ce8-bd10-31ad1353b20f]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qYPJGAzg'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c09475a-009f-4251-82ea-2856ca23d0b9]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[78419a74-50be-404b-8d65-5f3ea4321d7a]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)
Dec 01 19:19:14 user nova-compute[75066]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)
Dec 01 19:19:14 user nova-compute[75066]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)
Dec 01 19:19:14 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)
Dec 01 19:19:14 user nova-compute[75066]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)
Dec 01 19:19:14 user nova-compute[75066]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)
Dec 01 19:19:14 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 -p 172.16.0.220:3260 --login {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[308f9038-842f-487a-aa79-3449f0197359]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829, portal: 172.16.0.220,3260]
Dec 01 19:19:14 user nova-compute[75066]: Login to [iface: default, target: iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829, portal: 172.16.0.220,3260] successful.
Dec 01 19:19:14 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[50df5050-c1dc-4ef4-b145-f4753df33a8e]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[818ad491-0e74-4c67-be05-56a501d633b3]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)
Dec 01 19:19:14 user nova-compute[75066]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)
Dec 01 19:19:14 user nova-compute[75066]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)
Dec 01 19:19:14 user nova-compute[75066]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:19:14 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)
Dec 01 19:19:14 user nova-compute[75066]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)
Dec 01 19:19:14 user nova-compute[75066]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)
Dec 01 19:19:14 user nova-compute[75066]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:19:14 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Connected to 172.16.0.220:3260 {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] HCTL ('36', '-', '-', 0) found on session 15 with lun 0 {{(pid=75066) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75066) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.025s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3f36b6-2ea7-48eb-918a-9362d4859dd4]: (4, ('- - 0', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Searching for a device in session 15 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:19:14 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qYPJGAzg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 19:19:15 user nova-compute[75066]: DEBUG nova.compute.manager [None req-0ddd3642-9ff6-40f1-b1c9-d51d23d14115 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:19:15 user nova-compute[75066]: DEBUG nova.compute.manager [req-5acfcaf9-d82e-4fe5-bb46-e60f6b62e635 req-f58c587e-84b2-4e77-91e3-8007facb7cd7 service nova] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Received event network-vif-plugged-73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:19:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-5acfcaf9-d82e-4fe5-bb46-e60f6b62e635 req-f58c587e-84b2-4e77-91e3-8007facb7cd7 service nova] Acquiring lock "67c5dd7c-88aa-4f2f-8f62-a9af0480c38e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:19:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-5acfcaf9-d82e-4fe5-bb46-e60f6b62e635 req-f58c587e-84b2-4e77-91e3-8007facb7cd7 service nova] Lock "67c5dd7c-88aa-4f2f-8f62-a9af0480c38e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:19:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-5acfcaf9-d82e-4fe5-bb46-e60f6b62e635 req-f58c587e-84b2-4e77-91e3-8007facb7cd7 service nova] Lock "67c5dd7c-88aa-4f2f-8f62-a9af0480c38e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:19:15 user nova-compute[75066]: DEBUG nova.compute.manager [req-5acfcaf9-d82e-4fe5-bb46-e60f6b62e635 req-f58c587e-84b2-4e77-91e3-8007facb7cd7 service nova] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] No waiting events found dispatching network-vif-plugged-73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:19:15 user nova-compute[75066]: WARNING nova.compute.manager [req-5acfcaf9-d82e-4fe5-bb46-e60f6b62e635 req-f58c587e-84b2-4e77-91e3-8007facb7cd7 service nova] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Received unexpected event network-vif-plugged-73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2 for instance with vm_state active and task_state rescuing.
Dec 01 19:19:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.420s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:19:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] <== connect_volume: return (1422ms) {'type': 'block', 'scsi_wwn': '23464303338666462', 'path': '/dev/sde'} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:19:15 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464303338666462', 'path': '/dev/sde'} {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 19:19:15 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:15:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-24114443',display_name='tempest-AttachVolumeTestJSON-server-24114443',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-24114443',id=4,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGLScdrbjNBUKzk1xw2/kR+RAsIU9zFWMcYM+4wt8kIDoD28bEQj/IZzhB52jLd7ItVSKAdt9hCSnaKdaqoB8QmfEIsszcxk4SoK4okQhg235yQ27ClCZrLdhVk+g2LNPw==',key_name='tempest-keypair-1548189004',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:15:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='492e0b2da61e4e4f9ea991df15531e24',ramdisk_id='',reservation_id='r-f8zkyh7r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1914192398',owner_user_name='tempest-AttachVolumeTestJSON-1914192398-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:17:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e047112719c414d900ccb2adccf963a',uuid=c3ceeca4-c16c-4cf5-adfd-7d5a2925f435,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "c9353199-d4a3-488f-857d-b0ebdb31a68f", "address": "fa:16:3e:d4:7c:91", "network": {"id": "4a6c6c26-4d29-486c-b11e-fc53769083ea", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1139388453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "492e0b2da61e4e4f9ea991df15531e24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9353199-d4", "ovs_interfaceid": "c9353199-d4a3-488f-857d-b0ebdb31a68f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:19:15 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Converting VIF {"id": "c9353199-d4a3-488f-857d-b0ebdb31a68f", "address": "fa:16:3e:d4:7c:91", "network": {"id": "4a6c6c26-4d29-486c-b11e-fc53769083ea", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1139388453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "492e0b2da61e4e4f9ea991df15531e24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9353199-d4", "ovs_interfaceid": "c9353199-d4a3-488f-857d-b0ebdb31a68f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:19:15 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:7c:91,bridge_name='br-int',has_traffic_filtering=True,id=c9353199-d4a3-488f-857d-b0ebdb31a68f,network=Network(4a6c6c26-4d29-486c-b11e-fc53769083ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9353199-d4') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:19:15 user nova-compute[75066]: DEBUG nova.objects.instance [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lazy-loading 'pci_devices' on Instance uuid c3ceeca4-c16c-4cf5-adfd-7d5a2925f435 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:19:15 user nova-compute[75066]: DEBUG nova.objects.base [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Object Instance<c3ceeca4-c16c-4cf5-adfd-7d5a2925f435> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75066) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 19:19:15 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:19:15 user nova-compute[75066]:   <uuid>c3ceeca4-c16c-4cf5-adfd-7d5a2925f435</uuid>
Dec 01 19:19:15 user nova-compute[75066]:   <name>instance-00000004</name>
Dec 01 19:19:15 user nova-compute[75066]:   <memory>524288</memory>
Dec 01 19:19:15 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:19:15 user nova-compute[75066]:   <metadata>
Dec 01 19:19:15 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:19:15 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:19:15 user nova-compute[75066]:       <nova:name>tempest-AttachVolumeTestJSON-server-24114443</nova:name>
Dec 01 19:19:15 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:19:14</nova:creationTime>
Dec 01 19:19:15 user nova-compute[75066]:       <nova:flavor name="m1.tiny">
Dec 01 19:19:15 user nova-compute[75066]:         <nova:memory>512</nova:memory>
Dec 01 19:19:15 user nova-compute[75066]:         <nova:disk>1</nova:disk>
Dec 01 19:19:15 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:19:15 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:19:15 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:19:15 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:19:15 user nova-compute[75066]:       <nova:owner>
Dec 01 19:19:15 user nova-compute[75066]:         <nova:user uuid="2e047112719c414d900ccb2adccf963a">tempest-AttachVolumeTestJSON-1914192398-project-member</nova:user>
Dec 01 19:19:15 user nova-compute[75066]:         <nova:project uuid="492e0b2da61e4e4f9ea991df15531e24">tempest-AttachVolumeTestJSON-1914192398</nova:project>
Dec 01 19:19:15 user nova-compute[75066]:       </nova:owner>
Dec 01 19:19:15 user nova-compute[75066]:       <nova:root type="image" uuid="900b237b-e99c-4fdd-a44f-dcb7a08baa86"/>
Dec 01 19:19:15 user nova-compute[75066]:       <nova:ports>
Dec 01 19:19:15 user nova-compute[75066]:         <nova:port uuid="c9353199-d4a3-488f-857d-b0ebdb31a68f">
Dec 01 19:19:15 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 01 19:19:15 user nova-compute[75066]:         </nova:port>
Dec 01 19:19:15 user nova-compute[75066]:       </nova:ports>
Dec 01 19:19:15 user nova-compute[75066]:     </nova:instance>
Dec 01 19:19:15 user nova-compute[75066]:   </metadata>
Dec 01 19:19:15 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:19:15 user nova-compute[75066]:     <system>
Dec 01 19:19:15 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:19:15 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:19:15 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:19:15 user nova-compute[75066]:       <entry name="serial">c3ceeca4-c16c-4cf5-adfd-7d5a2925f435</entry>
Dec 01 19:19:15 user nova-compute[75066]:       <entry name="uuid">c3ceeca4-c16c-4cf5-adfd-7d5a2925f435</entry>
Dec 01 19:19:15 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:19:15 user nova-compute[75066]:     </system>
Dec 01 19:19:15 user nova-compute[75066]:   </sysinfo>
Dec 01 19:19:15 user nova-compute[75066]:   <os>
Dec 01 19:19:15 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:19:15 user nova-compute[75066]:     <boot dev="hd"/>
Dec 01 19:19:15 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:19:15 user nova-compute[75066]:   </os>
Dec 01 19:19:15 user nova-compute[75066]:   <features>
Dec 01 19:19:15 user nova-compute[75066]:     <acpi/>
Dec 01 19:19:15 user nova-compute[75066]:     <apic/>
Dec 01 19:19:15 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:19:15 user nova-compute[75066]:   </features>
Dec 01 19:19:15 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:19:15 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:19:15 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:19:15 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:19:15 user nova-compute[75066]:   </clock>
Dec 01 19:19:15 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:19:15 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:19:15 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:19:15 user nova-compute[75066]:   </cpu>
Dec 01 19:19:15 user nova-compute[75066]:   <devices>
Dec 01 19:19:15 user nova-compute[75066]:     <disk type="file" device="disk">
Dec 01 19:19:15 user nova-compute[75066]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 19:19:15 user nova-compute[75066]:       <source file="/opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk"/>
Dec 01 19:19:15 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:19:15 user nova-compute[75066]:     </disk>
Dec 01 19:19:15 user nova-compute[75066]:     <disk type="block" device="disk">
Dec 01 19:19:15 user nova-compute[75066]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:19:15 user nova-compute[75066]:       <source dev="/dev/sde"/>
Dec 01 19:19:15 user nova-compute[75066]:       <target dev="vdb" bus="virtio"/>
Dec 01 19:19:15 user nova-compute[75066]:       <serial>f32073d6-c4aa-49cc-a329-e000fd930829</serial>
Dec 01 19:19:15 user nova-compute[75066]:     </disk>
Dec 01 19:19:15 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:19:15 user nova-compute[75066]:       <mac address="fa:16:3e:d4:7c:91"/>
Dec 01 19:19:15 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:19:15 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:19:15 user nova-compute[75066]:       <target dev="tapc9353199-d4"/>
Dec 01 19:19:15 user nova-compute[75066]:     </interface>
Dec 01 19:19:15 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:19:15 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/console.log" append="off"/>
Dec 01 19:19:15 user nova-compute[75066]:     </serial>
Dec 01 19:19:15 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:19:15 user nova-compute[75066]:     <video>
Dec 01 19:19:15 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:19:15 user nova-compute[75066]:     </video>
Dec 01 19:19:15 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:19:15 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:19:15 user nova-compute[75066]:     </rng>
Dec 01 19:19:15 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:19:15 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:19:15 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:19:15 user nova-compute[75066]:     </memballoon>
Dec 01 19:19:15 user nova-compute[75066]:   </devices>
Dec 01 19:19:15 user nova-compute[75066]: </domain>
Dec 01 19:19:15 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:19:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:16 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:19:16 user nova-compute[75066]: DEBUG nova.objects.instance [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lazy-loading 'trusted_certs' on Instance uuid c3ceeca4-c16c-4cf5-adfd-7d5a2925f435 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:19:16 user nova-compute[75066]: DEBUG nova.objects.base [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Object Instance<c3ceeca4-c16c-4cf5-adfd-7d5a2925f435> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75066) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 19:19:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:16 user nova-compute[75066]: DEBUG nova.compute.manager [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Stashing vm_state: active {{(pid=75066) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Dec 01 19:19:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.204s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:16 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk. size=1073741824 {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 19:19:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:16 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:19:16 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:19:16 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75066) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 19:19:16 user nova-compute[75066]: INFO nova.compute.claims [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Claim successful on node user
Dec 01 19:19:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:16 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Cannot resize image /opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk to a smaller size. {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 19:19:16 user nova-compute[75066]: DEBUG nova.objects.instance [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lazy-loading 'migration_context' on Instance uuid c3ceeca4-c16c-4cf5-adfd-7d5a2925f435 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:19:16 user nova-compute[75066]: DEBUG nova.objects.base [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Object Instance<c3ceeca4-c16c-4cf5-adfd-7d5a2925f435> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75066) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 19:19:16 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:15:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-24114443',display_name='tempest-AttachVolumeTestJSON-server-24114443',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-24114443',id=4,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGLScdrbjNBUKzk1xw2/kR+RAsIU9zFWMcYM+4wt8kIDoD28bEQj/IZzhB52jLd7ItVSKAdt9hCSnaKdaqoB8QmfEIsszcxk4SoK4okQhg235yQ27ClCZrLdhVk+g2LNPw==',key_name='tempest-keypair-1548189004',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:15:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='492e0b2da61e4e4f9ea991df15531e24',ramdisk_id='',reservation_id='r-f8zkyh7r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1914192398',owner_user_name='tempest-AttachVolumeTestJSON-1914192398-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:17:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e047112719c414d900ccb2adccf963a',uuid=c3ceeca4-c16c-4cf5-adfd-7d5a2925f435,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "c9353199-d4a3-488f-857d-b0ebdb31a68f", "address": "fa:16:3e:d4:7c:91", "network": {"id": "4a6c6c26-4d29-486c-b11e-fc53769083ea", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1139388453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "492e0b2da61e4e4f9ea991df15531e24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9353199-d4", "ovs_interfaceid": "c9353199-d4a3-488f-857d-b0ebdb31a68f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:19:16 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Converting VIF {"id": "c9353199-d4a3-488f-857d-b0ebdb31a68f", "address": "fa:16:3e:d4:7c:91", "network": {"id": "4a6c6c26-4d29-486c-b11e-fc53769083ea", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1139388453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "492e0b2da61e4e4f9ea991df15531e24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9353199-d4", "ovs_interfaceid": "c9353199-d4a3-488f-857d-b0ebdb31a68f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:19:16 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:7c:91,bridge_name='br-int',has_traffic_filtering=True,id=c9353199-d4a3-488f-857d-b0ebdb31a68f,network=Network(4a6c6c26-4d29-486c-b11e-fc53769083ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9353199-d4') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:19:16 user nova-compute[75066]: DEBUG os_vif [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:7c:91,bridge_name='br-int',has_traffic_filtering=True,id=c9353199-d4a3-488f-857d-b0ebdb31a68f,network=Network(4a6c6c26-4d29-486c-b11e-fc53769083ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9353199-d4') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:19:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:19:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:19:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0408b5d0-0c90-551f-96b6-b0660c946d93', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:19:16 user nova-compute[75066]: INFO nova.compute.resource_tracker [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Updating resource usage from migration 302310ba-671b-4252-8786-3afb5d194147
Dec 01 19:19:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:19:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc9353199-d4, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:19:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc9353199-d4, col_values=(('qos', UUID('d2f9b8b9-6b1c-456f-8c1a-d5314127e66f')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:19:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc9353199-d4, col_values=(('external_ids', {'iface-id': 'c9353199-d4a3-488f-857d-b0ebdb31a68f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:7c:91', 'vm-uuid': 'c3ceeca4-c16c-4cf5-adfd-7d5a2925f435'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:19:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:19:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:16 user nova-compute[75066]: INFO os_vif [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:7c:91,bridge_name='br-int',has_traffic_filtering=True,id=c9353199-d4a3-488f-857d-b0ebdb31a68f,network=Network(4a6c6c26-4d29-486c-b11e-fc53769083ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9353199-d4')
Dec 01 19:19:17 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:17 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:19:17 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:19:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.470s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:19:17 user nova-compute[75066]: INFO nova.compute.manager [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Migrating
Dec 01 19:19:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:19:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:19:17 user nova-compute[75066]: INFO nova.compute.rpcapi [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Dec 01 19:19:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:19:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Acquiring lock "refresh_cache-dd546862-fcd5-4b69-8ea3-a8fa4859a489" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:19:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Acquired lock "refresh_cache-dd546862-fcd5-4b69-8ea3-a8fa4859a489" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:19:17 user nova-compute[75066]: DEBUG nova.network.neutron [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:19:17 user nova-compute[75066]: DEBUG nova.network.neutron [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Updating instance_info_cache with network_info: [{"id": "478e7aea-9546-4659-bdac-09213bd9cb82", "address": "fa:16:3e:9a:26:f6", "network": {"id": "d182d3d1-113a-4bf5-b325-f073247f0547", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-325272674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2830de7697db4d5e8b9c358dab7f4368", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap478e7aea-95", "ovs_interfaceid": "478e7aea-9546-4659-bdac-09213bd9cb82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:19:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Releasing lock "refresh_cache-dd546862-fcd5-4b69-8ea3-a8fa4859a489" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:19:17 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Starting migrate_disk_and_power_off {{(pid=75066) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11481}}
Dec 01 19:19:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:18 user nova-compute[75066]: DEBUG nova.compute.manager [req-7908a338-4f0e-4d53-8942-ebe29e857d23 req-244a3b3d-1bfb-4588-bfd7-feef0600c234 service nova] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Received event network-vif-unplugged-478e7aea-9546-4659-bdac-09213bd9cb82 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:19:18 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-7908a338-4f0e-4d53-8942-ebe29e857d23 req-244a3b3d-1bfb-4588-bfd7-feef0600c234 service nova] Acquiring lock "dd546862-fcd5-4b69-8ea3-a8fa4859a489-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:19:18 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-7908a338-4f0e-4d53-8942-ebe29e857d23 req-244a3b3d-1bfb-4588-bfd7-feef0600c234 service nova] Lock "dd546862-fcd5-4b69-8ea3-a8fa4859a489-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:19:18 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-7908a338-4f0e-4d53-8942-ebe29e857d23 req-244a3b3d-1bfb-4588-bfd7-feef0600c234 service nova] Lock "dd546862-fcd5-4b69-8ea3-a8fa4859a489-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:19:18 user nova-compute[75066]: DEBUG nova.compute.manager [req-7908a338-4f0e-4d53-8942-ebe29e857d23 req-244a3b3d-1bfb-4588-bfd7-feef0600c234 service nova] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] No waiting events found dispatching network-vif-unplugged-478e7aea-9546-4659-bdac-09213bd9cb82 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:19:18 user nova-compute[75066]: WARNING nova.compute.manager [req-7908a338-4f0e-4d53-8942-ebe29e857d23 req-244a3b3d-1bfb-4588-bfd7-feef0600c234 service nova] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Received unexpected event network-vif-unplugged-478e7aea-9546-4659-bdac-09213bd9cb82 for instance with vm_state active and task_state resize_migrating.
Dec 01 19:19:18 user nova-compute[75066]: DEBUG nova.compute.manager [req-e008c5d8-628f-47ac-af56-54a8e947f6c6 req-c9179037-311c-4f89-954e-6da1d04a5b86 service nova] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Received event network-vif-plugged-c9353199-d4a3-488f-857d-b0ebdb31a68f {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:19:18 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-e008c5d8-628f-47ac-af56-54a8e947f6c6 req-c9179037-311c-4f89-954e-6da1d04a5b86 service nova] Acquiring lock "c3ceeca4-c16c-4cf5-adfd-7d5a2925f435-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:19:18 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-e008c5d8-628f-47ac-af56-54a8e947f6c6 req-c9179037-311c-4f89-954e-6da1d04a5b86 service nova] Lock "c3ceeca4-c16c-4cf5-adfd-7d5a2925f435-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:19:18 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-e008c5d8-628f-47ac-af56-54a8e947f6c6 req-c9179037-311c-4f89-954e-6da1d04a5b86 service nova] Lock "c3ceeca4-c16c-4cf5-adfd-7d5a2925f435-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:19:18 user nova-compute[75066]: DEBUG nova.compute.manager [req-e008c5d8-628f-47ac-af56-54a8e947f6c6 req-c9179037-311c-4f89-954e-6da1d04a5b86 service nova] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] No waiting events found dispatching network-vif-plugged-c9353199-d4a3-488f-857d-b0ebdb31a68f {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:19:18 user nova-compute[75066]: WARNING nova.compute.manager [req-e008c5d8-628f-47ac-af56-54a8e947f6c6 req-c9179037-311c-4f89-954e-6da1d04a5b86 service nova] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Received unexpected event network-vif-plugged-c9353199-d4a3-488f-857d-b0ebdb31a68f for instance with vm_state stopped and task_state powering-on.
Dec 01 19:19:19 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:19 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Instance destroyed successfully.
Dec 01 19:19:19 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:15:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-360735581',display_name='tempest-ServerActionsTestOtherB-server-360735581',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-360735581',id=5,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOGqD/77ZPXT6+uFjy9YkzZfO6BpJHbV+zzx/mIYY08bckUat50Cdx1l30v4s1jcybtm106xn+eO4W484wI5lg1LoXDJHliGvHVijdeGBF2TMVA7/KP/EGT4mweXKritFQ==',key_name='tempest-keypair-842148615',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:15:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2830de7697db4d5e8b9c358dab7f4368',ramdisk_id='',reservation_id='r-tl7vmif9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2122210178',owner_user_name='tempest-ServerActionsTestOtherB-2122210178-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:19:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e363b559098f48d4bc5478c657d7de6a',uuid=dd546862-fcd5-4b69-8ea3-a8fa4859a489,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "478e7aea-9546-4659-bdac-09213bd9cb82", "address": "fa:16:3e:9a:26:f6", "network": {"id": "d182d3d1-113a-4bf5-b325-f073247f0547", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-325272674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-325272674-network", "vif_mac": "fa:16:3e:9a:26:f6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2830de7697db4d5e8b9c358dab7f4368", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap478e7aea-95", "ovs_interfaceid": "478e7aea-9546-4659-bdac-09213bd9cb82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Converting VIF {"id": "478e7aea-9546-4659-bdac-09213bd9cb82", "address": "fa:16:3e:9a:26:f6", "network": {"id": "d182d3d1-113a-4bf5-b325-f073247f0547", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-325272674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-325272674-network", "vif_mac": "fa:16:3e:9a:26:f6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2830de7697db4d5e8b9c358dab7f4368", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap478e7aea-95", "ovs_interfaceid": "478e7aea-9546-4659-bdac-09213bd9cb82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:26:f6,bridge_name='br-int',has_traffic_filtering=True,id=478e7aea-9546-4659-bdac-09213bd9cb82,network=Network(d182d3d1-113a-4bf5-b325-f073247f0547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap478e7aea-95') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG os_vif [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:26:f6,bridge_name='br-int',has_traffic_filtering=True,id=478e7aea-9546-4659-bdac-09213bd9cb82,network=Network(d182d3d1-113a-4bf5-b325-f073247f0547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap478e7aea-95') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap478e7aea-95, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4c7ef5aa-be20-411d-b7d2-e1e49cf04630) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:19:19 user nova-compute[75066]: INFO os_vif [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:26:f6,bridge_name='br-int',has_traffic_filtering=True,id=478e7aea-9546-4659-bdac-09213bd9cb82,network=Network(d182d3d1-113a-4bf5-b325-f073247f0547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap478e7aea-95')
Dec 01 19:19:19 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] calling os-brick to detach iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, {'target_iqn': 'iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gUkyhEaX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:19:19 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:19:19 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[91db38ea-1d59-4362-945a-bcf15b1aaddf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 19:19:19 user nova-compute[75066]: No targets found.
Dec 01 19:19:19 user nova-compute[75066]: iSNS:
Dec 01 19:19:19 user nova-compute[75066]: No targets found.
Dec 01 19:19:19 user nova-compute[75066]: STATIC:
Dec 01 19:19:19 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829
Dec 01 19:19:19 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:19:19 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:19:19 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa
Dec 01 19:19:19 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:19:19 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:19:19 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2
Dec 01 19:19:19 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:19:19 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:19:19 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c
Dec 01 19:19:19 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:19:19 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:19:19 user nova-compute[75066]: FIRMWARE:
Dec 01 19:19:19 user nova-compute[75066]: No targets found.
Dec 01 19:19:19 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 19:19:19 user nova-compute[75066]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 19:19:19 user nova-compute[75066]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75066) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2', 0)] {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee686c7b-6e45-43e3-8960-dd301c90d026]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9a9b0f-2343-4c30-a783-22756fd2b112]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)
Dec 01 19:19:19 user nova-compute[75066]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)
Dec 01 19:19:19 user nova-compute[75066]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)
Dec 01 19:19:19 user nova-compute[75066]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:19:19 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)
Dec 01 19:19:19 user nova-compute[75066]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)
Dec 01 19:19:19 user nova-compute[75066]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)
Dec 01 19:19:19 user nova-compute[75066]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:19:19 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9190550790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2'): ({'sdd'}, set())}) {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Removing single pathed devices sdd {{(pid=75066) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0068857-6d27-4094-9ea6-27caa41c2f7f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.028s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d91752a-bb9f-42a3-aeff-ec8afb8681a3]: (4, ('ok\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Flushing IO for device /dev/sdd {{(pid=75066) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[541ece80-f664-4693-8e84-04e4796b16b4]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75066) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c59dde4-1576-4935-a722-48fb7c5de977]: (4, ('1', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] SCSI volumes sdd have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2')] {{(pid=75066) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[d153e49a-49fa-447f-972b-815a868a3503]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 -p 172.16.0.220:3260 --logout {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c543230-e5ce-454d-9cdd-7219c3305b72]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2, portal: 172.16.0.220,3260]
Dec 01 19:19:19 user nova-compute[75066]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2, portal: 172.16.0.220,3260] successful.
Dec 01 19:19:19 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 -p 172.16.0.220:3260 --op delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd9ee37-61a3-49b3-8af2-b3304b8a5451]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.387s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] <== disconnect_volume: return (389ms) None {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Disconnected iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:20 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:19:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489_resize/disk /opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489/disk {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] CMD "cp -r /opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489_resize/disk /opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489/disk" returned: 0 in 0.382s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489_resize/disk.info /opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489/disk.info {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] CMD "cp -r /opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489_resize/disk.info /opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489/disk.info" returned: 0 in 0.040s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:20 user nova-compute[75066]: DEBUG nova.compute.manager [req-bbd5ce28-1a07-4ab2-a195-2352cfa94f53 req-4254def3-3e80-4b2e-8d14-2a08d83bd210 service nova] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Received event network-vif-plugged-478e7aea-9546-4659-bdac-09213bd9cb82 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:19:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-bbd5ce28-1a07-4ab2-a195-2352cfa94f53 req-4254def3-3e80-4b2e-8d14-2a08d83bd210 service nova] Acquiring lock "dd546862-fcd5-4b69-8ea3-a8fa4859a489-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:19:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-bbd5ce28-1a07-4ab2-a195-2352cfa94f53 req-4254def3-3e80-4b2e-8d14-2a08d83bd210 service nova] Lock "dd546862-fcd5-4b69-8ea3-a8fa4859a489-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:19:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-bbd5ce28-1a07-4ab2-a195-2352cfa94f53 req-4254def3-3e80-4b2e-8d14-2a08d83bd210 service nova] Lock "dd546862-fcd5-4b69-8ea3-a8fa4859a489-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:19:20 user nova-compute[75066]: DEBUG nova.compute.manager [req-bbd5ce28-1a07-4ab2-a195-2352cfa94f53 req-4254def3-3e80-4b2e-8d14-2a08d83bd210 service nova] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] No waiting events found dispatching network-vif-plugged-478e7aea-9546-4659-bdac-09213bd9cb82 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:19:20 user nova-compute[75066]: WARNING nova.compute.manager [req-bbd5ce28-1a07-4ab2-a195-2352cfa94f53 req-4254def3-3e80-4b2e-8d14-2a08d83bd210 service nova] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Received unexpected event network-vif-plugged-478e7aea-9546-4659-bdac-09213bd9cb82 for instance with vm_state active and task_state resize_migrating.
Dec 01 19:19:20 user nova-compute[75066]: DEBUG nova.compute.manager [req-fded4fee-5236-45d1-b962-65e256dc2288 req-ca1d265d-8431-4ae4-9a73-3ba3c5353f81 service nova] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Received event network-vif-plugged-c9353199-d4a3-488f-857d-b0ebdb31a68f {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:19:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-fded4fee-5236-45d1-b962-65e256dc2288 req-ca1d265d-8431-4ae4-9a73-3ba3c5353f81 service nova] Acquiring lock "c3ceeca4-c16c-4cf5-adfd-7d5a2925f435-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:19:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-fded4fee-5236-45d1-b962-65e256dc2288 req-ca1d265d-8431-4ae4-9a73-3ba3c5353f81 service nova] Lock "c3ceeca4-c16c-4cf5-adfd-7d5a2925f435-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:19:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-fded4fee-5236-45d1-b962-65e256dc2288 req-ca1d265d-8431-4ae4-9a73-3ba3c5353f81 service nova] Lock "c3ceeca4-c16c-4cf5-adfd-7d5a2925f435-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:19:20 user nova-compute[75066]: DEBUG nova.compute.manager [req-fded4fee-5236-45d1-b962-65e256dc2288 req-ca1d265d-8431-4ae4-9a73-3ba3c5353f81 service nova] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] No waiting events found dispatching network-vif-plugged-c9353199-d4a3-488f-857d-b0ebdb31a68f {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:19:20 user nova-compute[75066]: WARNING nova.compute.manager [req-fded4fee-5236-45d1-b962-65e256dc2288 req-ca1d265d-8431-4ae4-9a73-3ba3c5353f81 service nova] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Received unexpected event network-vif-plugged-c9353199-d4a3-488f-857d-b0ebdb31a68f for instance with vm_state stopped and task_state powering-on.
Dec 01 19:19:21 user nova-compute[75066]: DEBUG nova.compute.manager [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Instance event wait completed in 0 seconds for  {{(pid=75066) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 19:19:21 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Instance rebooted successfully.
Dec 01 19:19:21 user nova-compute[75066]: DEBUG nova.compute.manager [None req-f482bf13-d654-4e8c-a267-8d17d7e35085 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:19:21 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:21 user nova-compute[75066]: DEBUG nova.network.neutron [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Port 478e7aea-9546-4659-bdac-09213bd9cb82 binding to destination host user is already ACTIVE {{(pid=75066) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Dec 01 19:19:21 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Acquiring lock "dd546862-fcd5-4b69-8ea3-a8fa4859a489-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:19:21 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Lock "dd546862-fcd5-4b69-8ea3-a8fa4859a489-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:19:21 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Lock "dd546862-fcd5-4b69-8ea3-a8fa4859a489-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:19:22 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Acquiring lock "refresh_cache-dd546862-fcd5-4b69-8ea3-a8fa4859a489" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:19:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Acquired lock "refresh_cache-dd546862-fcd5-4b69-8ea3-a8fa4859a489" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:19:22 user nova-compute[75066]: DEBUG nova.network.neutron [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:19:22 user nova-compute[75066]: DEBUG nova.network.neutron [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Updating instance_info_cache with network_info: [{"id": "478e7aea-9546-4659-bdac-09213bd9cb82", "address": "fa:16:3e:9a:26:f6", "network": {"id": "d182d3d1-113a-4bf5-b325-f073247f0547", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-325272674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2830de7697db4d5e8b9c358dab7f4368", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap478e7aea-95", "ovs_interfaceid": "478e7aea-9546-4659-bdac-09213bd9cb82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:19:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Releasing lock "refresh_cache-dd546862-fcd5-4b69-8ea3-a8fa4859a489" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:19:22 user nova-compute[75066]: DEBUG os_brick.utils [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:19:22 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:22 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:22 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02db521-0154-4454-8d65-ba6df47cd861]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1959854982f\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:22 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:22 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:22 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f7ec250-228f-47ef-8b92-ab19537edf32]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:22 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:22 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:22 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[0427d3e4-6e83-4d9b-ad16-0909062c3791]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:22 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd6fcb9-9800-4130-be17-9f01daa19dfe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:22 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Running cmd (subprocess): nvme version {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:22 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] 'nvme version' failed. Not Retrying. {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:19:22 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] nvme not present on system {{(pid=75066) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 19:19:22 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:22 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:19:22 user nova-compute[75066]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 19:19:22 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25b785c-622b-4a48-b2d2-a24975da5765]: (4, '') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:22 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75066) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 19:19:22 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 19:19:22 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] LIGHTOS: no hostnqn found. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 19:19:22 user nova-compute[75066]: DEBUG os_brick.utils [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1959854982f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:19:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:24 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:27 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:29 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:32 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:32 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:34 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Starting finish_migration {{(pid=75066) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11668}}
Dec 01 19:19:34 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Instance directory exists: not creating {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4719}}
Dec 01 19:19:34 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Creating image(s)
Dec 01 19:19:34 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:34 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:34 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.198s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:34 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489/disk. size=21474836480 {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 19:19:34 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:34 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:34 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489/disk 21474836480 {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:34 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489/disk 21474836480" returned: 0 in 0.065s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:34 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Acquiring lock "b7d86a5a-c62e-41f7-9f33-1a0c61af6a49" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:19:34 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Lock "b7d86a5a-c62e-41f7-9f33-1a0c61af6a49" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:19:34 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Did not create local disks {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Dec 01 19:19:34 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Ensure instance console log exists: /opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489/console.log {{(pid=75066) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 19:19:34 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:19:34 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:19:34 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:19:34 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Start _get_guest_xml network_info=[{"id": "478e7aea-9546-4659-bdac-09213bd9cb82", "address": "fa:16:3e:9a:26:f6", "network": {"id": "d182d3d1-113a-4bf5-b325-f073247f0547", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-325272674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-325272674-network", "vif_mac": "fa:16:3e:9a:26:f6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2830de7697db4d5e8b9c358dab7f4368", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap478e7aea-95", "ovs_interfaceid": "478e7aea-9546-4659-bdac-09213bd9cb82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'image_id': '900b237b-e99c-4fdd-a44f-dcb7a08baa86'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'mount_device': '/dev/vdb', 'guest_format': None, 'delete_on_termination': False, 'attachment_id': '36aaf5e6-e154-40e1-a2e3-7dbe4cf46543', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gUkyhEaX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'dd546862-fcd5-4b69-8ea3-a8fa4859a489', 'attached_at': '2023-12-01T19:19:34.000000', 'detached_at': '', 'volume_id': 'b6e9e54d-57f4-4413-9c76-50da506906d2', 'serial': 'b6e9e54d-57f4-4413-9c76-50da506906d2'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:19:34 user nova-compute[75066]: DEBUG nova.compute.manager [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] Starting instance... {{(pid=75066) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 19:19:34 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:19:34 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:19:34 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:19:34 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:19:34 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:19:34 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:19:34 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:19:34 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:19:34 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:19:34 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:19:34 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:19:34 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:19:34 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:19:34 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:19:34 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:19:34 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:19:34 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:19:34 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:19:34 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Calling os-brick to attach iSCSI Volume {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 19:19:34 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gUkyhEaX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:19:34 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:19:34 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:19:34 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:19:34 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:19:34 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:19:34 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:19:34 user nova-compute[75066]: INFO os_brick.initiator.connectors.iscsi [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 19:19:34 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 -p 172.16.0.220:3260 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:34 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:34 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf05836-0246-4ef8-b084-9dbb5e6193fb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:34 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 19:19:34 user nova-compute[75066]:  {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:19:34 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:35 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:19:35 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:19:35 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:35 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b72f99b-2f39-4ef3-b0d1-0198812c659f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2] added\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:35 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2] added
Dec 01 19:19:35 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:19:35 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75066) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 19:19:35 user nova-compute[75066]: INFO nova.compute.claims [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] Claim successful on node user
Dec 01 19:19:35 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:35 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:35 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[37de0202-ec25-4484-9c76-dd335ea662c2]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:35 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:19:35 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:35 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:35 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9f702c-3b79-4305-95dd-3f4091a1b092]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:35 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:19:35 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gUkyhEaX {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:35 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gUkyhEaX" returned: 0 in 0.025s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:35 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[794bb757-8243-4480-8cbe-9f5b62bfcc4f]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:35 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gUkyhEaX'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:19:35 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:35 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:35 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8693cc-e7ac-4507-9b47-42b6e629b7cf]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:35 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:19:35 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:35 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:35 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5e1f76-7773-492a-8b99-3126f8d5fd49]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:35 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)
Dec 01 19:19:35 user nova-compute[75066]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)
Dec 01 19:19:35 user nova-compute[75066]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:19:35 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:19:35 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)
Dec 01 19:19:35 user nova-compute[75066]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)
Dec 01 19:19:35 user nova-compute[75066]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:19:35 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:19:35 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 -p 172.16.0.220:3260 --login {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:35 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:35 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6130fc9-5715-4ab9-863d-e0642231bb8f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:35 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2, portal: 172.16.0.220,3260]
Dec 01 19:19:35 user nova-compute[75066]: Login to [iface: default, target: iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2, portal: 172.16.0.220,3260] successful.
Dec 01 19:19:35 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:19:35 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:35 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:35 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8e89a2-358b-4cac-83ed-f1ab8fba62f4]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:35 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:19:35 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:35 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:35 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0402bf5-45e1-4a9e-826c-6abfaa3f22df]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:35 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)
Dec 01 19:19:35 user nova-compute[75066]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)
Dec 01 19:19:35 user nova-compute[75066]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:19:35 user nova-compute[75066]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)
Dec 01 19:19:35 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:19:35 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)
Dec 01 19:19:35 user nova-compute[75066]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)
Dec 01 19:19:35 user nova-compute[75066]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:19:35 user nova-compute[75066]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)
Dec 01 19:19:35 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:19:35 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:19:35 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Connected to 172.16.0.220:3260 {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 19:19:35 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] HCTL ('35', '-', '-', 0) found on session 16 with lun 0 {{(pid=75066) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 19:19:35 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75066) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 19:19:35 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:35 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:35 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[d24d33f5-a6a2-4b09-ba92-839b363c0606]: (4, ('- - 0', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:19:35 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Searching for a device in session 16 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:19:35 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gUkyhEaX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 19:19:35 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:19:35 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:19:35 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.545s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:19:35 user nova-compute[75066]: DEBUG nova.compute.manager [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] Start building networks asynchronously for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 19:19:35 user nova-compute[75066]: DEBUG nova.compute.manager [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] Allocating IP information in the background. {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 19:19:35 user nova-compute[75066]: DEBUG nova.network.neutron [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] allocate_for_instance() {{(pid=75066) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 19:19:35 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 19:19:35 user nova-compute[75066]: DEBUG nova.compute.manager [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] Start building block device mappings for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 19:19:35 user nova-compute[75066]: DEBUG nova.policy [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8f807bcec6a5479cb3a97c85d7110afe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec09f9e9cee4b46a5adda7a2811e991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75066) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 19:19:36 user nova-compute[75066]: DEBUG nova.compute.manager [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] Start spawning the instance on the hypervisor. {{(pid=75066) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 19:19:36 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] Creating instance directory {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 19:19:36 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] Creating image(s)
Dec 01 19:19:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Acquiring lock "/opt/stack/data/nova/instances/b7d86a5a-c62e-41f7-9f33-1a0c61af6a49/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:19:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Lock "/opt/stack/data/nova/instances/b7d86a5a-c62e-41f7-9f33-1a0c61af6a49/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:19:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Lock "/opt/stack/data/nova/instances/b7d86a5a-c62e-41f7-9f33-1a0c61af6a49/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.154s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:19:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.201s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Acquiring lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:19:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:19:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:36 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.385s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:19:36 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] <== connect_volume: return (1389ms) {'type': 'block', 'scsi_wwn': '23132323935306161', 'path': '/dev/sdd'} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:19:36 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23132323935306161', 'path': '/dev/sdd'} {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 19:19:36 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:15:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-360735581',display_name='tempest-ServerActionsTestOtherB-server-360735581',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-360735581',id=5,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOGqD/77ZPXT6+uFjy9YkzZfO6BpJHbV+zzx/mIYY08bckUat50Cdx1l30v4s1jcybtm106xn+eO4W484wI5lg1LoXDJHliGvHVijdeGBF2TMVA7/KP/EGT4mweXKritFQ==',key_name='tempest-keypair-842148615',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:15:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2830de7697db4d5e8b9c358dab7f4368',ramdisk_id='',reservation_id='r-tl7vmif9',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2122210178',owner_user_name='tempest-ServerActionsTestOtherB-2122210178-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:19:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e363b559098f48d4bc5478c657d7de6a',uuid=dd546862-fcd5-4b69-8ea3-a8fa4859a489,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "478e7aea-9546-4659-bdac-09213bd9cb82", "address": "fa:16:3e:9a:26:f6", "network": {"id": "d182d3d1-113a-4bf5-b325-f073247f0547", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-325272674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-325272674-network", "vif_mac": "fa:16:3e:9a:26:f6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2830de7697db4d5e8b9c358dab7f4368", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap478e7aea-95", "ovs_interfaceid": "478e7aea-9546-4659-bdac-09213bd9cb82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:19:36 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Converting VIF {"id": "478e7aea-9546-4659-bdac-09213bd9cb82", "address": "fa:16:3e:9a:26:f6", "network": {"id": "d182d3d1-113a-4bf5-b325-f073247f0547", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-325272674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-325272674-network", "vif_mac": "fa:16:3e:9a:26:f6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2830de7697db4d5e8b9c358dab7f4368", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap478e7aea-95", "ovs_interfaceid": "478e7aea-9546-4659-bdac-09213bd9cb82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:19:36 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:26:f6,bridge_name='br-int',has_traffic_filtering=True,id=478e7aea-9546-4659-bdac-09213bd9cb82,network=Network(d182d3d1-113a-4bf5-b325-f073247f0547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap478e7aea-95') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:19:36 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:19:36 user nova-compute[75066]:   <uuid>dd546862-fcd5-4b69-8ea3-a8fa4859a489</uuid>
Dec 01 19:19:36 user nova-compute[75066]:   <name>instance-00000005</name>
Dec 01 19:19:36 user nova-compute[75066]:   <memory>2097152</memory>
Dec 01 19:19:36 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:19:36 user nova-compute[75066]:   <metadata>
Dec 01 19:19:36 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:19:36 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:19:36 user nova-compute[75066]:       <nova:name>tempest-ServerActionsTestOtherB-server-360735581</nova:name>
Dec 01 19:19:36 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:19:34</nova:creationTime>
Dec 01 19:19:36 user nova-compute[75066]:       <nova:flavor name="m1.small">
Dec 01 19:19:36 user nova-compute[75066]:         <nova:memory>2048</nova:memory>
Dec 01 19:19:36 user nova-compute[75066]:         <nova:disk>20</nova:disk>
Dec 01 19:19:36 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:19:36 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:19:36 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:19:36 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:19:36 user nova-compute[75066]:       <nova:owner>
Dec 01 19:19:36 user nova-compute[75066]:         <nova:user uuid="e363b559098f48d4bc5478c657d7de6a">tempest-ServerActionsTestOtherB-2122210178-project-member</nova:user>
Dec 01 19:19:36 user nova-compute[75066]:         <nova:project uuid="2830de7697db4d5e8b9c358dab7f4368">tempest-ServerActionsTestOtherB-2122210178</nova:project>
Dec 01 19:19:36 user nova-compute[75066]:       </nova:owner>
Dec 01 19:19:36 user nova-compute[75066]:       <nova:root type="image" uuid="900b237b-e99c-4fdd-a44f-dcb7a08baa86"/>
Dec 01 19:19:36 user nova-compute[75066]:       <nova:ports>
Dec 01 19:19:36 user nova-compute[75066]:         <nova:port uuid="478e7aea-9546-4659-bdac-09213bd9cb82">
Dec 01 19:19:36 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 01 19:19:36 user nova-compute[75066]:         </nova:port>
Dec 01 19:19:36 user nova-compute[75066]:       </nova:ports>
Dec 01 19:19:36 user nova-compute[75066]:     </nova:instance>
Dec 01 19:19:36 user nova-compute[75066]:   </metadata>
Dec 01 19:19:36 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:19:36 user nova-compute[75066]:     <system>
Dec 01 19:19:36 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:19:36 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:19:36 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:19:36 user nova-compute[75066]:       <entry name="serial">dd546862-fcd5-4b69-8ea3-a8fa4859a489</entry>
Dec 01 19:19:36 user nova-compute[75066]:       <entry name="uuid">dd546862-fcd5-4b69-8ea3-a8fa4859a489</entry>
Dec 01 19:19:36 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:19:36 user nova-compute[75066]:     </system>
Dec 01 19:19:36 user nova-compute[75066]:   </sysinfo>
Dec 01 19:19:36 user nova-compute[75066]:   <os>
Dec 01 19:19:36 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:19:36 user nova-compute[75066]:     <boot dev="hd"/>
Dec 01 19:19:36 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:19:36 user nova-compute[75066]:   </os>
Dec 01 19:19:36 user nova-compute[75066]:   <features>
Dec 01 19:19:36 user nova-compute[75066]:     <acpi/>
Dec 01 19:19:36 user nova-compute[75066]:     <apic/>
Dec 01 19:19:36 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:19:36 user nova-compute[75066]:   </features>
Dec 01 19:19:36 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:19:36 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:19:36 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:19:36 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:19:36 user nova-compute[75066]:   </clock>
Dec 01 19:19:36 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:19:36 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:19:36 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:19:36 user nova-compute[75066]:   </cpu>
Dec 01 19:19:36 user nova-compute[75066]:   <devices>
Dec 01 19:19:36 user nova-compute[75066]:     <disk type="file" device="disk">
Dec 01 19:19:36 user nova-compute[75066]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 19:19:36 user nova-compute[75066]:       <source file="/opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489/disk"/>
Dec 01 19:19:36 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:19:36 user nova-compute[75066]:     </disk>
Dec 01 19:19:36 user nova-compute[75066]:     <disk type="block" device="disk">
Dec 01 19:19:36 user nova-compute[75066]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:19:36 user nova-compute[75066]:       <source dev="/dev/sdd"/>
Dec 01 19:19:36 user nova-compute[75066]:       <target dev="vdb" bus="virtio"/>
Dec 01 19:19:36 user nova-compute[75066]:       <serial>b6e9e54d-57f4-4413-9c76-50da506906d2</serial>
Dec 01 19:19:36 user nova-compute[75066]:     </disk>
Dec 01 19:19:36 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:19:36 user nova-compute[75066]:       <mac address="fa:16:3e:9a:26:f6"/>
Dec 01 19:19:36 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:19:36 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:19:36 user nova-compute[75066]:       <target dev="tap478e7aea-95"/>
Dec 01 19:19:36 user nova-compute[75066]:     </interface>
Dec 01 19:19:36 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:19:36 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489/console.log" append="off"/>
Dec 01 19:19:36 user nova-compute[75066]:     </serial>
Dec 01 19:19:36 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:19:36 user nova-compute[75066]:     <video>
Dec 01 19:19:36 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:19:36 user nova-compute[75066]:     </video>
Dec 01 19:19:36 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:19:36 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:19:36 user nova-compute[75066]:     </rng>
Dec 01 19:19:36 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:19:36 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:19:36 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:19:36 user nova-compute[75066]:     </memballoon>
Dec 01 19:19:36 user nova-compute[75066]:   </devices>
Dec 01 19:19:36 user nova-compute[75066]: </domain>
Dec 01 19:19:36 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:19:36 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:15:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-360735581',display_name='tempest-ServerActionsTestOtherB-server-360735581',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-360735581',id=5,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOGqD/77ZPXT6+uFjy9YkzZfO6BpJHbV+zzx/mIYY08bckUat50Cdx1l30v4s1jcybtm106xn+eO4W484wI5lg1LoXDJHliGvHVijdeGBF2TMVA7/KP/EGT4mweXKritFQ==',key_name='tempest-keypair-842148615',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:15:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2830de7697db4d5e8b9c358dab7f4368',ramdisk_id='',reservation_id='r-tl7vmif9',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2122210178',owner_user_name='tempest-ServerActionsTestOtherB-2122210178-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:19:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e363b559098f48d4bc5478c657d7de6a',uuid=dd546862-fcd5-4b69-8ea3-a8fa4859a489,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "478e7aea-9546-4659-bdac-09213bd9cb82", "address": "fa:16:3e:9a:26:f6", "network": {"id": "d182d3d1-113a-4bf5-b325-f073247f0547", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-325272674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-325272674-network", "vif_mac": "fa:16:3e:9a:26:f6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2830de7697db4d5e8b9c358dab7f4368", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap478e7aea-95", "ovs_interfaceid": "478e7aea-9546-4659-bdac-09213bd9cb82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:19:36 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Converting VIF {"id": "478e7aea-9546-4659-bdac-09213bd9cb82", "address": "fa:16:3e:9a:26:f6", "network": {"id": "d182d3d1-113a-4bf5-b325-f073247f0547", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-325272674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-325272674-network", "vif_mac": "fa:16:3e:9a:26:f6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2830de7697db4d5e8b9c358dab7f4368", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap478e7aea-95", "ovs_interfaceid": "478e7aea-9546-4659-bdac-09213bd9cb82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:19:36 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:26:f6,bridge_name='br-int',has_traffic_filtering=True,id=478e7aea-9546-4659-bdac-09213bd9cb82,network=Network(d182d3d1-113a-4bf5-b325-f073247f0547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap478e7aea-95') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:19:36 user nova-compute[75066]: DEBUG os_vif [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:26:f6,bridge_name='br-int',has_traffic_filtering=True,id=478e7aea-9546-4659-bdac-09213bd9cb82,network=Network(d182d3d1-113a-4bf5-b325-f073247f0547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap478e7aea-95') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:19:36 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:36 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:19:36 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:19:36 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:36 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8df8152a-87d1-5502-b08a-0d94887ddb2c', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:19:36 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:36 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:19:36 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:36 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap478e7aea-95, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:19:36 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap478e7aea-95, col_values=(('qos', UUID('425ed131-c69b-489d-82d4-2833c65994ef')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:19:36 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap478e7aea-95, col_values=(('external_ids', {'iface-id': '478e7aea-9546-4659-bdac-09213bd9cb82', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:26:f6', 'vm-uuid': 'dd546862-fcd5-4b69-8ea3-a8fa4859a489'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:19:36 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:36 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:19:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.209s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/b7d86a5a-c62e-41f7-9f33-1a0c61af6a49/disk 1073741824 {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:36 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:36 user nova-compute[75066]: INFO os_vif [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:26:f6,bridge_name='br-int',has_traffic_filtering=True,id=478e7aea-9546-4659-bdac-09213bd9cb82,network=Network(d182d3d1-113a-4bf5-b325-f073247f0547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap478e7aea-95')
Dec 01 19:19:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/b7d86a5a-c62e-41f7-9f33-1a0c61af6a49/disk 1073741824" returned: 0 in 0.053s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:19:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:36 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:19:36 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:19:36 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] No VIF found with MAC fa:16:3e:9a:26:f6, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:19:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.174s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:36 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b7d86a5a-c62e-41f7-9f33-1a0c61af6a49/disk. size=1073741824 {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 19:19:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d86a5a-c62e-41f7-9f33-1a0c61af6a49/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d86a5a-c62e-41f7-9f33-1a0c61af6a49/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:36 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Cannot resize image /opt/stack/data/nova/instances/b7d86a5a-c62e-41f7-9f33-1a0c61af6a49/disk to a smaller size. {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 19:19:36 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] Created local disks {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 19:19:36 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] Ensure instance console log exists: /opt/stack/data/nova/instances/b7d86a5a-c62e-41f7-9f33-1a0c61af6a49/console.log {{(pid=75066) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 19:19:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:19:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:19:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:19:37 user nova-compute[75066]: DEBUG nova.network.neutron [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] Successfully created port: 6c3db9c1-34b1-4671-9553-c3d71eeacb3d {{(pid=75066) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 19:19:37 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:37 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:37 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:37 user nova-compute[75066]: DEBUG nova.network.neutron [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] Successfully updated port: 6c3db9c1-34b1-4671-9553-c3d71eeacb3d {{(pid=75066) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 19:19:37 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Acquiring lock "refresh_cache-b7d86a5a-c62e-41f7-9f33-1a0c61af6a49" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:19:37 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Acquired lock "refresh_cache-b7d86a5a-c62e-41f7-9f33-1a0c61af6a49" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:19:37 user nova-compute[75066]: DEBUG nova.network.neutron [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:19:37 user nova-compute[75066]: DEBUG nova.compute.manager [req-5c0005f5-b776-466a-8092-9dd3e94fa2b9 req-28579dca-72f4-4b78-9fe3-d769fc44c625 service nova] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] Received event network-changed-6c3db9c1-34b1-4671-9553-c3d71eeacb3d {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:19:37 user nova-compute[75066]: DEBUG nova.compute.manager [req-5c0005f5-b776-466a-8092-9dd3e94fa2b9 req-28579dca-72f4-4b78-9fe3-d769fc44c625 service nova] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] Refreshing instance network info cache due to event network-changed-6c3db9c1-34b1-4671-9553-c3d71eeacb3d. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:19:37 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-5c0005f5-b776-466a-8092-9dd3e94fa2b9 req-28579dca-72f4-4b78-9fe3-d769fc44c625 service nova] Acquiring lock "refresh_cache-b7d86a5a-c62e-41f7-9f33-1a0c61af6a49" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:19:37 user nova-compute[75066]: DEBUG nova.network.neutron [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:19:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:38 user nova-compute[75066]: DEBUG nova.network.neutron [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] Updating instance_info_cache with network_info: [{"id": "6c3db9c1-34b1-4671-9553-c3d71eeacb3d", "address": "fa:16:3e:14:52:b4", "network": {"id": "5380ccc0-6aee-42e3-a3e7-b2219a2eb53a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-952289001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ec09f9e9cee4b46a5adda7a2811e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c3db9c1-34", "ovs_interfaceid": "6c3db9c1-34b1-4671-9553-c3d71eeacb3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:19:38 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Releasing lock "refresh_cache-b7d86a5a-c62e-41f7-9f33-1a0c61af6a49" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:19:38 user nova-compute[75066]: DEBUG nova.compute.manager [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] Instance network_info: |[{"id": "6c3db9c1-34b1-4671-9553-c3d71eeacb3d", "address": "fa:16:3e:14:52:b4", "network": {"id": "5380ccc0-6aee-42e3-a3e7-b2219a2eb53a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-952289001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ec09f9e9cee4b46a5adda7a2811e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c3db9c1-34", "ovs_interfaceid": "6c3db9c1-34b1-4671-9553-c3d71eeacb3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 19:19:38 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-5c0005f5-b776-466a-8092-9dd3e94fa2b9 req-28579dca-72f4-4b78-9fe3-d769fc44c625 service nova] Acquired lock "refresh_cache-b7d86a5a-c62e-41f7-9f33-1a0c61af6a49" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:19:38 user nova-compute[75066]: DEBUG nova.network.neutron [req-5c0005f5-b776-466a-8092-9dd3e94fa2b9 req-28579dca-72f4-4b78-9fe3-d769fc44c625 service nova] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] Refreshing network info cache for port 6c3db9c1-34b1-4671-9553-c3d71eeacb3d {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:19:38 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] Start _get_guest_xml network_info=[{"id": "6c3db9c1-34b1-4671-9553-c3d71eeacb3d", "address": "fa:16:3e:14:52:b4", "network": {"id": "5380ccc0-6aee-42e3-a3e7-b2219a2eb53a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-952289001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ec09f9e9cee4b46a5adda7a2811e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c3db9c1-34", "ovs_interfaceid": "6c3db9c1-34b1-4671-9553-c3d71eeacb3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'image_id': '900b237b-e99c-4fdd-a44f-dcb7a08baa86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:19:38 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:19:38 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:19:38 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:19:38 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:19:38 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:19:38 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:19:38 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:19:38 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:19:38 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:19:38 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:19:38 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:19:38 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:19:38 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:19:38 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:19:38 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:19:38 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:19:38 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:19:38 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:19:38 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:19:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-225298201',display_name='tempest-VolumesAdminNegativeTest-server-225298201',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-225298201',id=14,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJYa7lspaHF6uGyOjLtn1sci2/tw0fthGU4QB8aTV/Oz9I+myxZ7AViioQ/JCBrcj1D0b10pOk5q+re4WYghaItiL9DtxD1+MNlLQrROAPT///nBrH4M4hUUiJdjanAwbg==',key_name='tempest-keypair-339063041',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6ec09f9e9cee4b46a5adda7a2811e991',ramdisk_id='',reservation_id='r-d5ea3q8g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1973855036',owner_user_name='tempest-VolumesAdminNegativeTest-1973855036-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:19:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f807bcec6a5479cb3a97c85d7110afe',uuid=b7d86a5a-c62e-41f7-9f33-1a0c61af6a49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c3db9c1-34b1-4671-9553-c3d71eeacb3d", "address": "fa:16:3e:14:52:b4", "network": {"id": "5380ccc0-6aee-42e3-a3e7-b2219a2eb53a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-952289001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ec09f9e9cee4b46a5adda7a2811e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c3db9c1-34", "ovs_interfaceid": "6c3db9c1-34b1-4671-9553-c3d71eeacb3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:19:38 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Converting VIF {"id": "6c3db9c1-34b1-4671-9553-c3d71eeacb3d", "address": "fa:16:3e:14:52:b4", "network": {"id": "5380ccc0-6aee-42e3-a3e7-b2219a2eb53a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-952289001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ec09f9e9cee4b46a5adda7a2811e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c3db9c1-34", "ovs_interfaceid": "6c3db9c1-34b1-4671-9553-c3d71eeacb3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:19:38 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:52:b4,bridge_name='br-int',has_traffic_filtering=True,id=6c3db9c1-34b1-4671-9553-c3d71eeacb3d,network=Network(5380ccc0-6aee-42e3-a3e7-b2219a2eb53a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c3db9c1-34') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:19:38 user nova-compute[75066]: DEBUG nova.objects.instance [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Lazy-loading 'pci_devices' on Instance uuid b7d86a5a-c62e-41f7-9f33-1a0c61af6a49 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:19:38 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:19:38 user nova-compute[75066]:   <uuid>b7d86a5a-c62e-41f7-9f33-1a0c61af6a49</uuid>
Dec 01 19:19:38 user nova-compute[75066]:   <name>instance-0000000e</name>
Dec 01 19:19:38 user nova-compute[75066]:   <memory>524288</memory>
Dec 01 19:19:38 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:19:38 user nova-compute[75066]:   <metadata>
Dec 01 19:19:38 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:19:38 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:19:38 user nova-compute[75066]:       <nova:name>tempest-VolumesAdminNegativeTest-server-225298201</nova:name>
Dec 01 19:19:38 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:19:38</nova:creationTime>
Dec 01 19:19:38 user nova-compute[75066]:       <nova:flavor name="m1.tiny">
Dec 01 19:19:38 user nova-compute[75066]:         <nova:memory>512</nova:memory>
Dec 01 19:19:38 user nova-compute[75066]:         <nova:disk>1</nova:disk>
Dec 01 19:19:38 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:19:38 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:19:38 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:19:38 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:19:38 user nova-compute[75066]:       <nova:owner>
Dec 01 19:19:38 user nova-compute[75066]:         <nova:user uuid="8f807bcec6a5479cb3a97c85d7110afe">tempest-VolumesAdminNegativeTest-1973855036-project-member</nova:user>
Dec 01 19:19:38 user nova-compute[75066]:         <nova:project uuid="6ec09f9e9cee4b46a5adda7a2811e991">tempest-VolumesAdminNegativeTest-1973855036</nova:project>
Dec 01 19:19:38 user nova-compute[75066]:       </nova:owner>
Dec 01 19:19:38 user nova-compute[75066]:       <nova:root type="image" uuid="900b237b-e99c-4fdd-a44f-dcb7a08baa86"/>
Dec 01 19:19:38 user nova-compute[75066]:       <nova:ports>
Dec 01 19:19:38 user nova-compute[75066]:         <nova:port uuid="6c3db9c1-34b1-4671-9553-c3d71eeacb3d">
Dec 01 19:19:38 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 01 19:19:38 user nova-compute[75066]:         </nova:port>
Dec 01 19:19:38 user nova-compute[75066]:       </nova:ports>
Dec 01 19:19:38 user nova-compute[75066]:     </nova:instance>
Dec 01 19:19:38 user nova-compute[75066]:   </metadata>
Dec 01 19:19:38 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:19:38 user nova-compute[75066]:     <system>
Dec 01 19:19:38 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:19:38 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:19:38 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:19:38 user nova-compute[75066]:       <entry name="serial">b7d86a5a-c62e-41f7-9f33-1a0c61af6a49</entry>
Dec 01 19:19:38 user nova-compute[75066]:       <entry name="uuid">b7d86a5a-c62e-41f7-9f33-1a0c61af6a49</entry>
Dec 01 19:19:38 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:19:38 user nova-compute[75066]:     </system>
Dec 01 19:19:38 user nova-compute[75066]:   </sysinfo>
Dec 01 19:19:38 user nova-compute[75066]:   <os>
Dec 01 19:19:38 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:19:38 user nova-compute[75066]:     <boot dev="hd"/>
Dec 01 19:19:38 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:19:38 user nova-compute[75066]:   </os>
Dec 01 19:19:38 user nova-compute[75066]:   <features>
Dec 01 19:19:38 user nova-compute[75066]:     <acpi/>
Dec 01 19:19:38 user nova-compute[75066]:     <apic/>
Dec 01 19:19:38 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:19:38 user nova-compute[75066]:   </features>
Dec 01 19:19:38 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:19:38 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:19:38 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:19:38 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:19:38 user nova-compute[75066]:   </clock>
Dec 01 19:19:38 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:19:38 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:19:38 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:19:38 user nova-compute[75066]:   </cpu>
Dec 01 19:19:38 user nova-compute[75066]:   <devices>
Dec 01 19:19:38 user nova-compute[75066]:     <disk type="file" device="disk">
Dec 01 19:19:38 user nova-compute[75066]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 19:19:38 user nova-compute[75066]:       <source file="/opt/stack/data/nova/instances/b7d86a5a-c62e-41f7-9f33-1a0c61af6a49/disk"/>
Dec 01 19:19:38 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:19:38 user nova-compute[75066]:     </disk>
Dec 01 19:19:38 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:19:38 user nova-compute[75066]:       <mac address="fa:16:3e:14:52:b4"/>
Dec 01 19:19:38 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:19:38 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:19:38 user nova-compute[75066]:       <target dev="tap6c3db9c1-34"/>
Dec 01 19:19:38 user nova-compute[75066]:     </interface>
Dec 01 19:19:38 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:19:38 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/b7d86a5a-c62e-41f7-9f33-1a0c61af6a49/console.log" append="off"/>
Dec 01 19:19:38 user nova-compute[75066]:     </serial>
Dec 01 19:19:38 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:19:38 user nova-compute[75066]:     <video>
Dec 01 19:19:38 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:19:38 user nova-compute[75066]:     </video>
Dec 01 19:19:38 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:19:38 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:19:38 user nova-compute[75066]:     </rng>
Dec 01 19:19:38 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:19:38 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:19:38 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:19:38 user nova-compute[75066]:     </memballoon>
Dec 01 19:19:38 user nova-compute[75066]:   </devices>
Dec 01 19:19:38 user nova-compute[75066]: </domain>
Dec 01 19:19:38 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:19:38 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:19:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-225298201',display_name='tempest-VolumesAdminNegativeTest-server-225298201',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-225298201',id=14,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJYa7lspaHF6uGyOjLtn1sci2/tw0fthGU4QB8aTV/Oz9I+myxZ7AViioQ/JCBrcj1D0b10pOk5q+re4WYghaItiL9DtxD1+MNlLQrROAPT///nBrH4M4hUUiJdjanAwbg==',key_name='tempest-keypair-339063041',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6ec09f9e9cee4b46a5adda7a2811e991',ramdisk_id='',reservation_id='r-d5ea3q8g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1973855036',owner_user_name='tempest-VolumesAdminNegativeTest-1973855036-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:19:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f807bcec6a5479cb3a97c85d7110afe',uuid=b7d86a5a-c62e-41f7-9f33-1a0c61af6a49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c3db9c1-34b1-4671-9553-c3d71eeacb3d", "address": "fa:16:3e:14:52:b4", "network": {"id": "5380ccc0-6aee-42e3-a3e7-b2219a2eb53a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-952289001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ec09f9e9cee4b46a5adda7a2811e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c3db9c1-34", "ovs_interfaceid": "6c3db9c1-34b1-4671-9553-c3d71eeacb3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:19:38 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Converting VIF {"id": "6c3db9c1-34b1-4671-9553-c3d71eeacb3d", "address": "fa:16:3e:14:52:b4", "network": {"id": "5380ccc0-6aee-42e3-a3e7-b2219a2eb53a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-952289001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ec09f9e9cee4b46a5adda7a2811e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c3db9c1-34", "ovs_interfaceid": "6c3db9c1-34b1-4671-9553-c3d71eeacb3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:19:38 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:14:52:b4,bridge_name='br-int',has_traffic_filtering=True,id=6c3db9c1-34b1-4671-9553-c3d71eeacb3d,network=Network(5380ccc0-6aee-42e3-a3e7-b2219a2eb53a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c3db9c1-34') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:19:38 user nova-compute[75066]: DEBUG os_vif [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:52:b4,bridge_name='br-int',has_traffic_filtering=True,id=6c3db9c1-34b1-4671-9553-c3d71eeacb3d,network=Network(5380ccc0-6aee-42e3-a3e7-b2219a2eb53a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c3db9c1-34') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:19:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:19:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:19:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c31c6067-d4df-55c8-80f4-e960472edd84', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:19:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:19:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6c3db9c1-34, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:19:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6c3db9c1-34, col_values=(('qos', UUID('f39c6dc9-a6b7-4fbe-8670-780093b17dde')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:19:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6c3db9c1-34, col_values=(('external_ids', {'iface-id': '6c3db9c1-34b1-4671-9553-c3d71eeacb3d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:14:52:b4', 'vm-uuid': 'b7d86a5a-c62e-41f7-9f33-1a0c61af6a49'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:19:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:19:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:38 user nova-compute[75066]: INFO os_vif [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:14:52:b4,bridge_name='br-int',has_traffic_filtering=True,id=6c3db9c1-34b1-4671-9553-c3d71eeacb3d,network=Network(5380ccc0-6aee-42e3-a3e7-b2219a2eb53a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c3db9c1-34')
Dec 01 19:19:38 user nova-compute[75066]: DEBUG nova.compute.manager [req-237fd640-4fc4-4576-9d69-a6e58ce1d114 req-eca1feab-e5dc-4108-9f12-04bb500d01a5 service nova] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Received event network-vif-plugged-478e7aea-9546-4659-bdac-09213bd9cb82 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:19:38 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-237fd640-4fc4-4576-9d69-a6e58ce1d114 req-eca1feab-e5dc-4108-9f12-04bb500d01a5 service nova] Acquiring lock "dd546862-fcd5-4b69-8ea3-a8fa4859a489-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:19:38 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-237fd640-4fc4-4576-9d69-a6e58ce1d114 req-eca1feab-e5dc-4108-9f12-04bb500d01a5 service nova] Lock "dd546862-fcd5-4b69-8ea3-a8fa4859a489-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:19:38 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-237fd640-4fc4-4576-9d69-a6e58ce1d114 req-eca1feab-e5dc-4108-9f12-04bb500d01a5 service nova] Lock "dd546862-fcd5-4b69-8ea3-a8fa4859a489-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:19:38 user nova-compute[75066]: DEBUG nova.compute.manager [req-237fd640-4fc4-4576-9d69-a6e58ce1d114 req-eca1feab-e5dc-4108-9f12-04bb500d01a5 service nova] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] No waiting events found dispatching network-vif-plugged-478e7aea-9546-4659-bdac-09213bd9cb82 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:19:38 user nova-compute[75066]: WARNING nova.compute.manager [req-237fd640-4fc4-4576-9d69-a6e58ce1d114 req-eca1feab-e5dc-4108-9f12-04bb500d01a5 service nova] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Received unexpected event network-vif-plugged-478e7aea-9546-4659-bdac-09213bd9cb82 for instance with vm_state active and task_state resize_finish.
Dec 01 19:19:38 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:19:38 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] No VIF found with MAC fa:16:3e:14:52:b4, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:19:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:39 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:39 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:39 user nova-compute[75066]: DEBUG nova.network.neutron [req-5c0005f5-b776-466a-8092-9dd3e94fa2b9 req-28579dca-72f4-4b78-9fe3-d769fc44c625 service nova] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] Updated VIF entry in instance network info cache for port 6c3db9c1-34b1-4671-9553-c3d71eeacb3d. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:19:39 user nova-compute[75066]: DEBUG nova.network.neutron [req-5c0005f5-b776-466a-8092-9dd3e94fa2b9 req-28579dca-72f4-4b78-9fe3-d769fc44c625 service nova] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] Updating instance_info_cache with network_info: [{"id": "6c3db9c1-34b1-4671-9553-c3d71eeacb3d", "address": "fa:16:3e:14:52:b4", "network": {"id": "5380ccc0-6aee-42e3-a3e7-b2219a2eb53a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-952289001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ec09f9e9cee4b46a5adda7a2811e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c3db9c1-34", "ovs_interfaceid": "6c3db9c1-34b1-4671-9553-c3d71eeacb3d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:19:39 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-5c0005f5-b776-466a-8092-9dd3e94fa2b9 req-28579dca-72f4-4b78-9fe3-d769fc44c625 service nova] Releasing lock "refresh_cache-b7d86a5a-c62e-41f7-9f33-1a0c61af6a49" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:19:40 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:40 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:40 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:40 user nova-compute[75066]: DEBUG nova.compute.manager [req-f7fe237a-020c-4fe9-aba8-3026bcd1a409 req-faa9e217-f52e-4e8c-946a-05bfc41bbb1e service nova] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] Received event network-vif-plugged-6c3db9c1-34b1-4671-9553-c3d71eeacb3d {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:19:40 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-f7fe237a-020c-4fe9-aba8-3026bcd1a409 req-faa9e217-f52e-4e8c-946a-05bfc41bbb1e service nova] Acquiring lock "b7d86a5a-c62e-41f7-9f33-1a0c61af6a49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:19:40 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-f7fe237a-020c-4fe9-aba8-3026bcd1a409 req-faa9e217-f52e-4e8c-946a-05bfc41bbb1e service nova] Lock "b7d86a5a-c62e-41f7-9f33-1a0c61af6a49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:19:40 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-f7fe237a-020c-4fe9-aba8-3026bcd1a409 req-faa9e217-f52e-4e8c-946a-05bfc41bbb1e service nova] Lock "b7d86a5a-c62e-41f7-9f33-1a0c61af6a49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:19:40 user nova-compute[75066]: DEBUG nova.compute.manager [req-f7fe237a-020c-4fe9-aba8-3026bcd1a409 req-faa9e217-f52e-4e8c-946a-05bfc41bbb1e service nova] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] No waiting events found dispatching network-vif-plugged-6c3db9c1-34b1-4671-9553-c3d71eeacb3d {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:19:40 user nova-compute[75066]: WARNING nova.compute.manager [req-f7fe237a-020c-4fe9-aba8-3026bcd1a409 req-faa9e217-f52e-4e8c-946a-05bfc41bbb1e service nova] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] Received unexpected event network-vif-plugged-6c3db9c1-34b1-4671-9553-c3d71eeacb3d for instance with vm_state building and task_state spawning.
Dec 01 19:19:40 user nova-compute[75066]: DEBUG nova.compute.manager [req-dca9288b-299e-4a37-9f29-90dd4bbf5705 req-d4fc5618-b755-4155-8cf1-697201c1ee92 service nova] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Received event network-vif-plugged-478e7aea-9546-4659-bdac-09213bd9cb82 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:19:40 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-dca9288b-299e-4a37-9f29-90dd4bbf5705 req-d4fc5618-b755-4155-8cf1-697201c1ee92 service nova] Acquiring lock "dd546862-fcd5-4b69-8ea3-a8fa4859a489-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:19:40 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-dca9288b-299e-4a37-9f29-90dd4bbf5705 req-d4fc5618-b755-4155-8cf1-697201c1ee92 service nova] Lock "dd546862-fcd5-4b69-8ea3-a8fa4859a489-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:19:40 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-dca9288b-299e-4a37-9f29-90dd4bbf5705 req-d4fc5618-b755-4155-8cf1-697201c1ee92 service nova] Lock "dd546862-fcd5-4b69-8ea3-a8fa4859a489-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:19:40 user nova-compute[75066]: DEBUG nova.compute.manager [req-dca9288b-299e-4a37-9f29-90dd4bbf5705 req-d4fc5618-b755-4155-8cf1-697201c1ee92 service nova] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] No waiting events found dispatching network-vif-plugged-478e7aea-9546-4659-bdac-09213bd9cb82 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:19:40 user nova-compute[75066]: WARNING nova.compute.manager [req-dca9288b-299e-4a37-9f29-90dd4bbf5705 req-d4fc5618-b755-4155-8cf1-697201c1ee92 service nova] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Received unexpected event network-vif-plugged-478e7aea-9546-4659-bdac-09213bd9cb82 for instance with vm_state active and task_state resize_finish.
Dec 01 19:19:40 user nova-compute[75066]: DEBUG nova.compute.manager [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Instance event wait completed in 0 seconds for  {{(pid=75066) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 19:19:40 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Instance running successfully.
Dec 01 19:19:40 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Failed to set time: agent not configured {{(pid=75066) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Dec 01 19:19:40 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-dde191c4-fab2-40c7-b457-cf29bb7cb334 tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] finish_migration finished successfully. {{(pid=75066) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11763}}
Dec 01 19:19:40 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:41 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:42 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:42 user nova-compute[75066]: DEBUG nova.compute.manager [req-d3104182-757d-44a3-b95b-49ab5411fb68 req-80d856d1-9e91-45e3-b78c-b9a0d1406283 service nova] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] Received event network-vif-plugged-6c3db9c1-34b1-4671-9553-c3d71eeacb3d {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:19:42 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d3104182-757d-44a3-b95b-49ab5411fb68 req-80d856d1-9e91-45e3-b78c-b9a0d1406283 service nova] Acquiring lock "b7d86a5a-c62e-41f7-9f33-1a0c61af6a49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:19:42 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d3104182-757d-44a3-b95b-49ab5411fb68 req-80d856d1-9e91-45e3-b78c-b9a0d1406283 service nova] Lock "b7d86a5a-c62e-41f7-9f33-1a0c61af6a49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:19:42 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d3104182-757d-44a3-b95b-49ab5411fb68 req-80d856d1-9e91-45e3-b78c-b9a0d1406283 service nova] Lock "b7d86a5a-c62e-41f7-9f33-1a0c61af6a49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:19:42 user nova-compute[75066]: DEBUG nova.compute.manager [req-d3104182-757d-44a3-b95b-49ab5411fb68 req-80d856d1-9e91-45e3-b78c-b9a0d1406283 service nova] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] No waiting events found dispatching network-vif-plugged-6c3db9c1-34b1-4671-9553-c3d71eeacb3d {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:19:42 user nova-compute[75066]: WARNING nova.compute.manager [req-d3104182-757d-44a3-b95b-49ab5411fb68 req-80d856d1-9e91-45e3-b78c-b9a0d1406283 service nova] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] Received unexpected event network-vif-plugged-6c3db9c1-34b1-4671-9553-c3d71eeacb3d for instance with vm_state building and task_state spawning.
Dec 01 19:19:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:43 user nova-compute[75066]: DEBUG nova.compute.manager [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] Instance event wait completed in 0 seconds for  {{(pid=75066) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 19:19:43 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] Guest created on hypervisor {{(pid=75066) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 19:19:43 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] Instance spawned successfully.
Dec 01 19:19:43 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 19:19:43 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] Found default for hw_cdrom_bus of ide {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:19:43 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] Found default for hw_disk_bus of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:19:43 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] Found default for hw_input_bus of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:19:43 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] Found default for hw_pointer_model of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:19:43 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] Found default for hw_video_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:19:43 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] Found default for hw_vif_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:19:43 user nova-compute[75066]: INFO nova.compute.manager [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] Took 7.50 seconds to spawn the instance on the hypervisor.
Dec 01 19:19:43 user nova-compute[75066]: DEBUG nova.compute.manager [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:19:43 user nova-compute[75066]: INFO nova.compute.manager [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] Took 8.52 seconds to build instance.
Dec 01 19:19:43 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-24bf9ddb-60ff-45a6-bd1d-1190382c7a52 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Lock "b7d86a5a-c62e-41f7-9f33-1a0c61af6a49" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.675s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:19:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:47 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:47 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:48 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:48 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:50 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Acquiring lock "d564b128-598b-4ad4-8618-afa4dc8a7347" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:19:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "d564b128-598b-4ad4-8618-afa4dc8a7347" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:19:51 user nova-compute[75066]: DEBUG nova.compute.manager [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Starting instance... {{(pid=75066) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 19:19:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:19:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:19:51 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75066) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 19:19:51 user nova-compute[75066]: INFO nova.compute.claims [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Claim successful on node user
Dec 01 19:19:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:52 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:19:52 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:19:52 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.531s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:19:52 user nova-compute[75066]: DEBUG nova.compute.manager [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Start building networks asynchronously for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 19:19:52 user nova-compute[75066]: DEBUG nova.compute.manager [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Allocating IP information in the background. {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 19:19:52 user nova-compute[75066]: DEBUG nova.network.neutron [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] allocate_for_instance() {{(pid=75066) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 19:19:52 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 19:19:52 user nova-compute[75066]: DEBUG nova.compute.manager [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Start building block device mappings for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 19:19:52 user nova-compute[75066]: DEBUG nova.policy [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e6ee9ed4a8d8418082a59be8db20cf2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943324a514a84cb4947dbab93abc4f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75066) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 19:19:52 user nova-compute[75066]: DEBUG nova.compute.manager [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Start spawning the instance on the hypervisor. {{(pid=75066) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 19:19:52 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Creating instance directory {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 19:19:52 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Creating image(s)
Dec 01 19:19:52 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Acquiring lock "/opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:19:52 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "/opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:19:52 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "/opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:19:52 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:53 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.252s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:53 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Acquiring lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:19:53 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:19:53 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:53 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Acquiring lock "14de9d20-9e66-4517-b904-2967e0a06a97" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:19:53 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "14de9d20-9e66-4517-b904-2967e0a06a97" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:19:53 user nova-compute[75066]: DEBUG nova.compute.manager [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Starting instance... {{(pid=75066) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 19:19:53 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.236s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:53 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk 1073741824 {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:53 user nova-compute[75066]: DEBUG nova.network.neutron [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Successfully created port: 4850dc75-0d93-4536-abc1-a981dd385d96 {{(pid=75066) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 19:19:53 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk 1073741824" returned: 0 in 0.073s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:53 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.313s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:19:53 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:53 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:19:53 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:19:53 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75066) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 19:19:53 user nova-compute[75066]: INFO nova.compute.claims [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Claim successful on node user
Dec 01 19:19:53 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:53 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.225s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:53 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk. size=1073741824 {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 19:19:53 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:53 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:53 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Cannot resize image /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk to a smaller size. {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 19:19:53 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Created local disks {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 19:19:53 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Ensure instance console log exists: /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/console.log {{(pid=75066) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 19:19:53 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:19:53 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:19:53 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:19:54 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:19:54 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:19:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.758s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:19:54 user nova-compute[75066]: DEBUG nova.compute.manager [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Start building networks asynchronously for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 19:19:54 user nova-compute[75066]: DEBUG nova.compute.manager [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Allocating IP information in the background. {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 19:19:54 user nova-compute[75066]: DEBUG nova.network.neutron [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] allocate_for_instance() {{(pid=75066) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 19:19:54 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 19:19:54 user nova-compute[75066]: DEBUG nova.compute.manager [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Start building block device mappings for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 19:19:54 user nova-compute[75066]: DEBUG nova.policy [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e6ee9ed4a8d8418082a59be8db20cf2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943324a514a84cb4947dbab93abc4f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75066) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 19:19:54 user nova-compute[75066]: DEBUG nova.compute.manager [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Start spawning the instance on the hypervisor. {{(pid=75066) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 19:19:54 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Creating instance directory {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 19:19:54 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Creating image(s)
Dec 01 19:19:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Acquiring lock "/opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:19:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "/opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:19:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "/opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:19:54 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:54 user nova-compute[75066]: DEBUG nova.network.neutron [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Successfully updated port: 4850dc75-0d93-4536-abc1-a981dd385d96 {{(pid=75066) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 19:19:54 user nova-compute[75066]: DEBUG nova.compute.manager [req-429f8d9b-22a0-466c-9d5c-34d20ec97957 req-75f2be66-c06d-4145-9a98-c92abad7b1ba service nova] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Received event network-changed-4850dc75-0d93-4536-abc1-a981dd385d96 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:19:54 user nova-compute[75066]: DEBUG nova.compute.manager [req-429f8d9b-22a0-466c-9d5c-34d20ec97957 req-75f2be66-c06d-4145-9a98-c92abad7b1ba service nova] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Refreshing instance network info cache due to event network-changed-4850dc75-0d93-4536-abc1-a981dd385d96. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:19:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-429f8d9b-22a0-466c-9d5c-34d20ec97957 req-75f2be66-c06d-4145-9a98-c92abad7b1ba service nova] Acquiring lock "refresh_cache-d564b128-598b-4ad4-8618-afa4dc8a7347" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:19:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-429f8d9b-22a0-466c-9d5c-34d20ec97957 req-75f2be66-c06d-4145-9a98-c92abad7b1ba service nova] Acquired lock "refresh_cache-d564b128-598b-4ad4-8618-afa4dc8a7347" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:19:54 user nova-compute[75066]: DEBUG nova.network.neutron [req-429f8d9b-22a0-466c-9d5c-34d20ec97957 req-75f2be66-c06d-4145-9a98-c92abad7b1ba service nova] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Refreshing network info cache for port 4850dc75-0d93-4536-abc1-a981dd385d96 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:19:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Acquiring lock "refresh_cache-d564b128-598b-4ad4-8618-afa4dc8a7347" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:19:54 user nova-compute[75066]: DEBUG nova.network.neutron [req-429f8d9b-22a0-466c-9d5c-34d20ec97957 req-75f2be66-c06d-4145-9a98-c92abad7b1ba service nova] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:19:54 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.222s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Acquiring lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:19:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:19:54 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:55 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.254s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:55 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk 1073741824 {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:55 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk 1073741824" returned: 0 in 0.069s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:55 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.332s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:19:55 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:55 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.194s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:55 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Checking if we can resize image /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk. size=1073741824 {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 19:19:55 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:19:55 user nova-compute[75066]: DEBUG nova.network.neutron [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Successfully created port: 4ab99734-a7a9-43f9-b75e-f02d33a7a50d {{(pid=75066) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 19:19:55 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:19:55 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Cannot resize image /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk to a smaller size. {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 19:19:55 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Created local disks {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 19:19:55 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Ensure instance console log exists: /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/console.log {{(pid=75066) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 19:19:55 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:19:55 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:19:55 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:19:55 user nova-compute[75066]: DEBUG nova.network.neutron [req-429f8d9b-22a0-466c-9d5c-34d20ec97957 req-75f2be66-c06d-4145-9a98-c92abad7b1ba service nova] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:19:55 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-429f8d9b-22a0-466c-9d5c-34d20ec97957 req-75f2be66-c06d-4145-9a98-c92abad7b1ba service nova] Releasing lock "refresh_cache-d564b128-598b-4ad4-8618-afa4dc8a7347" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:19:55 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Acquired lock "refresh_cache-d564b128-598b-4ad4-8618-afa4dc8a7347" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:19:55 user nova-compute[75066]: DEBUG nova.network.neutron [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:19:55 user nova-compute[75066]: DEBUG nova.network.neutron [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:19:55 user nova-compute[75066]: DEBUG nova.network.neutron [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Updating instance_info_cache with network_info: [{"id": "4850dc75-0d93-4536-abc1-a981dd385d96", "address": "fa:16:3e:fc:d1:96", "network": {"id": "47c850ae-6dcb-4977-a02a-e32cd3df4749", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-475363603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "943324a514a84cb4947dbab93abc4f6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4850dc75-0d", "ovs_interfaceid": "4850dc75-0d93-4536-abc1-a981dd385d96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Releasing lock "refresh_cache-d564b128-598b-4ad4-8618-afa4dc8a7347" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG nova.compute.manager [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Instance network_info: |[{"id": "4850dc75-0d93-4536-abc1-a981dd385d96", "address": "fa:16:3e:fc:d1:96", "network": {"id": "47c850ae-6dcb-4977-a02a-e32cd3df4749", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-475363603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "943324a514a84cb4947dbab93abc4f6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4850dc75-0d", "ovs_interfaceid": "4850dc75-0d93-4536-abc1-a981dd385d96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Start _get_guest_xml network_info=[{"id": "4850dc75-0d93-4536-abc1-a981dd385d96", "address": "fa:16:3e:fc:d1:96", "network": {"id": "47c850ae-6dcb-4977-a02a-e32cd3df4749", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-475363603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "943324a514a84cb4947dbab93abc4f6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4850dc75-0d", "ovs_interfaceid": "4850dc75-0d93-4536-abc1-a981dd385d96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'image_id': '900b237b-e99c-4fdd-a44f-dcb7a08baa86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:19:56 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:19:56 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:19:56 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:19:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1777670164',display_name='tempest-ServerRescueNegativeTestJSON-server-1777670164',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1777670164',id=15,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='943324a514a84cb4947dbab93abc4f6c',ramdisk_id='',reservation_id='r-nreed1q4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-146516797',owner_user_name='tempest-ServerRescueNegativeTestJSON-146516797-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:19:53Z,user_data=None,user_id='e6ee9ed4a8d8418082a59be8db20cf2e',uuid=d564b128-598b-4ad4-8618-afa4dc8a7347,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4850dc75-0d93-4536-abc1-a981dd385d96", "address": "fa:16:3e:fc:d1:96", "network": {"id": "47c850ae-6dcb-4977-a02a-e32cd3df4749", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-475363603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "943324a514a84cb4947dbab93abc4f6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4850dc75-0d", "ovs_interfaceid": "4850dc75-0d93-4536-abc1-a981dd385d96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Converting VIF {"id": "4850dc75-0d93-4536-abc1-a981dd385d96", "address": "fa:16:3e:fc:d1:96", "network": {"id": "47c850ae-6dcb-4977-a02a-e32cd3df4749", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-475363603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "943324a514a84cb4947dbab93abc4f6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4850dc75-0d", "ovs_interfaceid": "4850dc75-0d93-4536-abc1-a981dd385d96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:d1:96,bridge_name='br-int',has_traffic_filtering=True,id=4850dc75-0d93-4536-abc1-a981dd385d96,network=Network(47c850ae-6dcb-4977-a02a-e32cd3df4749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4850dc75-0d') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG nova.objects.instance [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lazy-loading 'pci_devices' on Instance uuid d564b128-598b-4ad4-8618-afa4dc8a7347 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:19:56 user nova-compute[75066]:   <uuid>d564b128-598b-4ad4-8618-afa4dc8a7347</uuid>
Dec 01 19:19:56 user nova-compute[75066]:   <name>instance-0000000f</name>
Dec 01 19:19:56 user nova-compute[75066]:   <memory>524288</memory>
Dec 01 19:19:56 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:19:56 user nova-compute[75066]:   <metadata>
Dec 01 19:19:56 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:19:56 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:19:56 user nova-compute[75066]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1777670164</nova:name>
Dec 01 19:19:56 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:19:56</nova:creationTime>
Dec 01 19:19:56 user nova-compute[75066]:       <nova:flavor name="m1.tiny">
Dec 01 19:19:56 user nova-compute[75066]:         <nova:memory>512</nova:memory>
Dec 01 19:19:56 user nova-compute[75066]:         <nova:disk>1</nova:disk>
Dec 01 19:19:56 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:19:56 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:19:56 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:19:56 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:19:56 user nova-compute[75066]:       <nova:owner>
Dec 01 19:19:56 user nova-compute[75066]:         <nova:user uuid="e6ee9ed4a8d8418082a59be8db20cf2e">tempest-ServerRescueNegativeTestJSON-146516797-project-member</nova:user>
Dec 01 19:19:56 user nova-compute[75066]:         <nova:project uuid="943324a514a84cb4947dbab93abc4f6c">tempest-ServerRescueNegativeTestJSON-146516797</nova:project>
Dec 01 19:19:56 user nova-compute[75066]:       </nova:owner>
Dec 01 19:19:56 user nova-compute[75066]:       <nova:root type="image" uuid="900b237b-e99c-4fdd-a44f-dcb7a08baa86"/>
Dec 01 19:19:56 user nova-compute[75066]:       <nova:ports>
Dec 01 19:19:56 user nova-compute[75066]:         <nova:port uuid="4850dc75-0d93-4536-abc1-a981dd385d96">
Dec 01 19:19:56 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Dec 01 19:19:56 user nova-compute[75066]:         </nova:port>
Dec 01 19:19:56 user nova-compute[75066]:       </nova:ports>
Dec 01 19:19:56 user nova-compute[75066]:     </nova:instance>
Dec 01 19:19:56 user nova-compute[75066]:   </metadata>
Dec 01 19:19:56 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:19:56 user nova-compute[75066]:     <system>
Dec 01 19:19:56 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:19:56 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:19:56 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:19:56 user nova-compute[75066]:       <entry name="serial">d564b128-598b-4ad4-8618-afa4dc8a7347</entry>
Dec 01 19:19:56 user nova-compute[75066]:       <entry name="uuid">d564b128-598b-4ad4-8618-afa4dc8a7347</entry>
Dec 01 19:19:56 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:19:56 user nova-compute[75066]:     </system>
Dec 01 19:19:56 user nova-compute[75066]:   </sysinfo>
Dec 01 19:19:56 user nova-compute[75066]:   <os>
Dec 01 19:19:56 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:19:56 user nova-compute[75066]:     <boot dev="hd"/>
Dec 01 19:19:56 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:19:56 user nova-compute[75066]:   </os>
Dec 01 19:19:56 user nova-compute[75066]:   <features>
Dec 01 19:19:56 user nova-compute[75066]:     <acpi/>
Dec 01 19:19:56 user nova-compute[75066]:     <apic/>
Dec 01 19:19:56 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:19:56 user nova-compute[75066]:   </features>
Dec 01 19:19:56 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:19:56 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:19:56 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:19:56 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:19:56 user nova-compute[75066]:   </clock>
Dec 01 19:19:56 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:19:56 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:19:56 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:19:56 user nova-compute[75066]:   </cpu>
Dec 01 19:19:56 user nova-compute[75066]:   <devices>
Dec 01 19:19:56 user nova-compute[75066]:     <disk type="file" device="disk">
Dec 01 19:19:56 user nova-compute[75066]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 19:19:56 user nova-compute[75066]:       <source file="/opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk"/>
Dec 01 19:19:56 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:19:56 user nova-compute[75066]:     </disk>
Dec 01 19:19:56 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:19:56 user nova-compute[75066]:       <mac address="fa:16:3e:fc:d1:96"/>
Dec 01 19:19:56 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:19:56 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:19:56 user nova-compute[75066]:       <target dev="tap4850dc75-0d"/>
Dec 01 19:19:56 user nova-compute[75066]:     </interface>
Dec 01 19:19:56 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:19:56 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/console.log" append="off"/>
Dec 01 19:19:56 user nova-compute[75066]:     </serial>
Dec 01 19:19:56 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:19:56 user nova-compute[75066]:     <video>
Dec 01 19:19:56 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:19:56 user nova-compute[75066]:     </video>
Dec 01 19:19:56 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:19:56 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:19:56 user nova-compute[75066]:     </rng>
Dec 01 19:19:56 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:19:56 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:19:56 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:19:56 user nova-compute[75066]:     </memballoon>
Dec 01 19:19:56 user nova-compute[75066]:   </devices>
Dec 01 19:19:56 user nova-compute[75066]: </domain>
Dec 01 19:19:56 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:19:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1777670164',display_name='tempest-ServerRescueNegativeTestJSON-server-1777670164',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1777670164',id=15,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='943324a514a84cb4947dbab93abc4f6c',ramdisk_id='',reservation_id='r-nreed1q4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-146516797',owner_user_name='tempest-ServerRescueNegativeTestJSON-146516797-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:19:53Z,user_data=None,user_id='e6ee9ed4a8d8418082a59be8db20cf2e',uuid=d564b128-598b-4ad4-8618-afa4dc8a7347,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4850dc75-0d93-4536-abc1-a981dd385d96", "address": "fa:16:3e:fc:d1:96", "network": {"id": "47c850ae-6dcb-4977-a02a-e32cd3df4749", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-475363603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "943324a514a84cb4947dbab93abc4f6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4850dc75-0d", "ovs_interfaceid": "4850dc75-0d93-4536-abc1-a981dd385d96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Converting VIF {"id": "4850dc75-0d93-4536-abc1-a981dd385d96", "address": "fa:16:3e:fc:d1:96", "network": {"id": "47c850ae-6dcb-4977-a02a-e32cd3df4749", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-475363603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "943324a514a84cb4947dbab93abc4f6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4850dc75-0d", "ovs_interfaceid": "4850dc75-0d93-4536-abc1-a981dd385d96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:d1:96,bridge_name='br-int',has_traffic_filtering=True,id=4850dc75-0d93-4536-abc1-a981dd385d96,network=Network(47c850ae-6dcb-4977-a02a-e32cd3df4749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4850dc75-0d') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG os_vif [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:d1:96,bridge_name='br-int',has_traffic_filtering=True,id=4850dc75-0d93-4536-abc1-a981dd385d96,network=Network(47c850ae-6dcb-4977-a02a-e32cd3df4749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4850dc75-0d') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bb495b8d-c3d4-5aec-bce8-963354515350', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4850dc75-0d, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4850dc75-0d, col_values=(('qos', UUID('79a4a53d-fbd2-4a80-a6a2-f1d31e0b59fb')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4850dc75-0d, col_values=(('external_ids', {'iface-id': '4850dc75-0d93-4536-abc1-a981dd385d96', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:d1:96', 'vm-uuid': 'd564b128-598b-4ad4-8618-afa4dc8a7347'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG nova.network.neutron [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Successfully updated port: 4ab99734-a7a9-43f9-b75e-f02d33a7a50d {{(pid=75066) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:56 user nova-compute[75066]: INFO os_vif [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:d1:96,bridge_name='br-int',has_traffic_filtering=True,id=4850dc75-0d93-4536-abc1-a981dd385d96,network=Network(47c850ae-6dcb-4977-a02a-e32cd3df4749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4850dc75-0d')
Dec 01 19:19:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Acquiring lock "refresh_cache-14de9d20-9e66-4517-b904-2967e0a06a97" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Acquired lock "refresh_cache-14de9d20-9e66-4517-b904-2967e0a06a97" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG nova.network.neutron [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG nova.compute.manager [req-7782a432-b588-4b52-b8c6-af1ab46f74f7 req-ad28c19e-554c-49cc-abd3-3885b3eca04c service nova] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Received event network-changed-4ab99734-a7a9-43f9-b75e-f02d33a7a50d {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG nova.compute.manager [req-7782a432-b588-4b52-b8c6-af1ab46f74f7 req-ad28c19e-554c-49cc-abd3-3885b3eca04c service nova] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Refreshing instance network info cache due to event network-changed-4ab99734-a7a9-43f9-b75e-f02d33a7a50d. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-7782a432-b588-4b52-b8c6-af1ab46f74f7 req-ad28c19e-554c-49cc-abd3-3885b3eca04c service nova] Acquiring lock "refresh_cache-14de9d20-9e66-4517-b904-2967e0a06a97" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] No VIF found with MAC fa:16:3e:fc:d1:96, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG nova.network.neutron [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG nova.network.neutron [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Updating instance_info_cache with network_info: [{"id": "4ab99734-a7a9-43f9-b75e-f02d33a7a50d", "address": "fa:16:3e:54:2d:24", "network": {"id": "47c850ae-6dcb-4977-a02a-e32cd3df4749", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-475363603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "943324a514a84cb4947dbab93abc4f6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ab99734-a7", "ovs_interfaceid": "4ab99734-a7a9-43f9-b75e-f02d33a7a50d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Releasing lock "refresh_cache-14de9d20-9e66-4517-b904-2967e0a06a97" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG nova.compute.manager [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Instance network_info: |[{"id": "4ab99734-a7a9-43f9-b75e-f02d33a7a50d", "address": "fa:16:3e:54:2d:24", "network": {"id": "47c850ae-6dcb-4977-a02a-e32cd3df4749", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-475363603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "943324a514a84cb4947dbab93abc4f6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ab99734-a7", "ovs_interfaceid": "4ab99734-a7a9-43f9-b75e-f02d33a7a50d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-7782a432-b588-4b52-b8c6-af1ab46f74f7 req-ad28c19e-554c-49cc-abd3-3885b3eca04c service nova] Acquired lock "refresh_cache-14de9d20-9e66-4517-b904-2967e0a06a97" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG nova.network.neutron [req-7782a432-b588-4b52-b8c6-af1ab46f74f7 req-ad28c19e-554c-49cc-abd3-3885b3eca04c service nova] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Refreshing network info cache for port 4ab99734-a7a9-43f9-b75e-f02d33a7a50d {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Start _get_guest_xml network_info=[{"id": "4ab99734-a7a9-43f9-b75e-f02d33a7a50d", "address": "fa:16:3e:54:2d:24", "network": {"id": "47c850ae-6dcb-4977-a02a-e32cd3df4749", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-475363603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "943324a514a84cb4947dbab93abc4f6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ab99734-a7", "ovs_interfaceid": "4ab99734-a7a9-43f9-b75e-f02d33a7a50d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'image_id': '900b237b-e99c-4fdd-a44f-dcb7a08baa86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:19:56 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:19:56 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:19:56 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:19:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-186779241',display_name='tempest-ServerRescueNegativeTestJSON-server-186779241',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-186779241',id=16,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='943324a514a84cb4947dbab93abc4f6c',ramdisk_id='',reservation_id='r-z616xe6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-146516797',owner_user_name='tempest-ServerRescueNegativeTestJSON-146516797-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:19:54Z,user_data=None,user_id='e6ee9ed4a8d8418082a59be8db20cf2e',uuid=14de9d20-9e66-4517-b904-2967e0a06a97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ab99734-a7a9-43f9-b75e-f02d33a7a50d", "address": "fa:16:3e:54:2d:24", "network": {"id": "47c850ae-6dcb-4977-a02a-e32cd3df4749", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-475363603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "943324a514a84cb4947dbab93abc4f6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ab99734-a7", "ovs_interfaceid": "4ab99734-a7a9-43f9-b75e-f02d33a7a50d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Converting VIF {"id": "4ab99734-a7a9-43f9-b75e-f02d33a7a50d", "address": "fa:16:3e:54:2d:24", "network": {"id": "47c850ae-6dcb-4977-a02a-e32cd3df4749", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-475363603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "943324a514a84cb4947dbab93abc4f6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ab99734-a7", "ovs_interfaceid": "4ab99734-a7a9-43f9-b75e-f02d33a7a50d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:2d:24,bridge_name='br-int',has_traffic_filtering=True,id=4ab99734-a7a9-43f9-b75e-f02d33a7a50d,network=Network(47c850ae-6dcb-4977-a02a-e32cd3df4749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ab99734-a7') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG nova.objects.instance [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lazy-loading 'pci_devices' on Instance uuid 14de9d20-9e66-4517-b904-2967e0a06a97 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:19:56 user nova-compute[75066]:   <uuid>14de9d20-9e66-4517-b904-2967e0a06a97</uuid>
Dec 01 19:19:56 user nova-compute[75066]:   <name>instance-00000010</name>
Dec 01 19:19:56 user nova-compute[75066]:   <memory>524288</memory>
Dec 01 19:19:56 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:19:56 user nova-compute[75066]:   <metadata>
Dec 01 19:19:56 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:19:56 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:19:56 user nova-compute[75066]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-186779241</nova:name>
Dec 01 19:19:56 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:19:56</nova:creationTime>
Dec 01 19:19:56 user nova-compute[75066]:       <nova:flavor name="m1.tiny">
Dec 01 19:19:56 user nova-compute[75066]:         <nova:memory>512</nova:memory>
Dec 01 19:19:56 user nova-compute[75066]:         <nova:disk>1</nova:disk>
Dec 01 19:19:56 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:19:56 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:19:56 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:19:56 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:19:56 user nova-compute[75066]:       <nova:owner>
Dec 01 19:19:56 user nova-compute[75066]:         <nova:user uuid="e6ee9ed4a8d8418082a59be8db20cf2e">tempest-ServerRescueNegativeTestJSON-146516797-project-member</nova:user>
Dec 01 19:19:56 user nova-compute[75066]:         <nova:project uuid="943324a514a84cb4947dbab93abc4f6c">tempest-ServerRescueNegativeTestJSON-146516797</nova:project>
Dec 01 19:19:56 user nova-compute[75066]:       </nova:owner>
Dec 01 19:19:56 user nova-compute[75066]:       <nova:root type="image" uuid="900b237b-e99c-4fdd-a44f-dcb7a08baa86"/>
Dec 01 19:19:56 user nova-compute[75066]:       <nova:ports>
Dec 01 19:19:56 user nova-compute[75066]:         <nova:port uuid="4ab99734-a7a9-43f9-b75e-f02d33a7a50d">
Dec 01 19:19:56 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Dec 01 19:19:56 user nova-compute[75066]:         </nova:port>
Dec 01 19:19:56 user nova-compute[75066]:       </nova:ports>
Dec 01 19:19:56 user nova-compute[75066]:     </nova:instance>
Dec 01 19:19:56 user nova-compute[75066]:   </metadata>
Dec 01 19:19:56 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:19:56 user nova-compute[75066]:     <system>
Dec 01 19:19:56 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:19:56 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:19:56 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:19:56 user nova-compute[75066]:       <entry name="serial">14de9d20-9e66-4517-b904-2967e0a06a97</entry>
Dec 01 19:19:56 user nova-compute[75066]:       <entry name="uuid">14de9d20-9e66-4517-b904-2967e0a06a97</entry>
Dec 01 19:19:56 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:19:56 user nova-compute[75066]:     </system>
Dec 01 19:19:56 user nova-compute[75066]:   </sysinfo>
Dec 01 19:19:56 user nova-compute[75066]:   <os>
Dec 01 19:19:56 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:19:56 user nova-compute[75066]:     <boot dev="hd"/>
Dec 01 19:19:56 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:19:56 user nova-compute[75066]:   </os>
Dec 01 19:19:56 user nova-compute[75066]:   <features>
Dec 01 19:19:56 user nova-compute[75066]:     <acpi/>
Dec 01 19:19:56 user nova-compute[75066]:     <apic/>
Dec 01 19:19:56 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:19:56 user nova-compute[75066]:   </features>
Dec 01 19:19:56 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:19:56 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:19:56 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:19:56 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:19:56 user nova-compute[75066]:   </clock>
Dec 01 19:19:56 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:19:56 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:19:56 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:19:56 user nova-compute[75066]:   </cpu>
Dec 01 19:19:56 user nova-compute[75066]:   <devices>
Dec 01 19:19:56 user nova-compute[75066]:     <disk type="file" device="disk">
Dec 01 19:19:56 user nova-compute[75066]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 19:19:56 user nova-compute[75066]:       <source file="/opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk"/>
Dec 01 19:19:56 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:19:56 user nova-compute[75066]:     </disk>
Dec 01 19:19:56 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:19:56 user nova-compute[75066]:       <mac address="fa:16:3e:54:2d:24"/>
Dec 01 19:19:56 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:19:56 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:19:56 user nova-compute[75066]:       <target dev="tap4ab99734-a7"/>
Dec 01 19:19:56 user nova-compute[75066]:     </interface>
Dec 01 19:19:56 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:19:56 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/console.log" append="off"/>
Dec 01 19:19:56 user nova-compute[75066]:     </serial>
Dec 01 19:19:56 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:19:56 user nova-compute[75066]:     <video>
Dec 01 19:19:56 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:19:56 user nova-compute[75066]:     </video>
Dec 01 19:19:56 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:19:56 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:19:56 user nova-compute[75066]:     </rng>
Dec 01 19:19:56 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:19:56 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:19:56 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:19:56 user nova-compute[75066]:     </memballoon>
Dec 01 19:19:56 user nova-compute[75066]:   </devices>
Dec 01 19:19:56 user nova-compute[75066]: </domain>
Dec 01 19:19:56 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:19:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-186779241',display_name='tempest-ServerRescueNegativeTestJSON-server-186779241',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-186779241',id=16,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='943324a514a84cb4947dbab93abc4f6c',ramdisk_id='',reservation_id='r-z616xe6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-146516797',owner_user_name='tempest-ServerRescueNegativeTestJSON-146516797-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:19:54Z,user_data=None,user_id='e6ee9ed4a8d8418082a59be8db20cf2e',uuid=14de9d20-9e66-4517-b904-2967e0a06a97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ab99734-a7a9-43f9-b75e-f02d33a7a50d", "address": "fa:16:3e:54:2d:24", "network": {"id": "47c850ae-6dcb-4977-a02a-e32cd3df4749", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-475363603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "943324a514a84cb4947dbab93abc4f6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ab99734-a7", "ovs_interfaceid": "4ab99734-a7a9-43f9-b75e-f02d33a7a50d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Converting VIF {"id": "4ab99734-a7a9-43f9-b75e-f02d33a7a50d", "address": "fa:16:3e:54:2d:24", "network": {"id": "47c850ae-6dcb-4977-a02a-e32cd3df4749", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-475363603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "943324a514a84cb4947dbab93abc4f6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ab99734-a7", "ovs_interfaceid": "4ab99734-a7a9-43f9-b75e-f02d33a7a50d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:54:2d:24,bridge_name='br-int',has_traffic_filtering=True,id=4ab99734-a7a9-43f9-b75e-f02d33a7a50d,network=Network(47c850ae-6dcb-4977-a02a-e32cd3df4749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ab99734-a7') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG os_vif [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:2d:24,bridge_name='br-int',has_traffic_filtering=True,id=4ab99734-a7a9-43f9-b75e-f02d33a7a50d,network=Network(47c850ae-6dcb-4977-a02a-e32cd3df4749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ab99734-a7') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '562c77a7-48cf-5f39-9753-e11429992a7c', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ab99734-a7, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4ab99734-a7, col_values=(('qos', UUID('5ef40564-ec57-48f7-86e4-2d61a5f6ec8f')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4ab99734-a7, col_values=(('external_ids', {'iface-id': '4ab99734-a7a9-43f9-b75e-f02d33a7a50d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:54:2d:24', 'vm-uuid': '14de9d20-9e66-4517-b904-2967e0a06a97'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:56 user nova-compute[75066]: INFO os_vif [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:54:2d:24,bridge_name='br-int',has_traffic_filtering=True,id=4ab99734-a7a9-43f9-b75e-f02d33a7a50d,network=Network(47c850ae-6dcb-4977-a02a-e32cd3df4749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ab99734-a7')
Dec 01 19:19:56 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:19:56 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] No VIF found with MAC fa:16:3e:54:2d:24, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:19:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:57 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:19:57 user nova-compute[75066]: DEBUG nova.network.neutron [req-7782a432-b588-4b52-b8c6-af1ab46f74f7 req-ad28c19e-554c-49cc-abd3-3885b3eca04c service nova] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Updated VIF entry in instance network info cache for port 4ab99734-a7a9-43f9-b75e-f02d33a7a50d. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:19:57 user nova-compute[75066]: DEBUG nova.network.neutron [req-7782a432-b588-4b52-b8c6-af1ab46f74f7 req-ad28c19e-554c-49cc-abd3-3885b3eca04c service nova] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Updating instance_info_cache with network_info: [{"id": "4ab99734-a7a9-43f9-b75e-f02d33a7a50d", "address": "fa:16:3e:54:2d:24", "network": {"id": "47c850ae-6dcb-4977-a02a-e32cd3df4749", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-475363603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "943324a514a84cb4947dbab93abc4f6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ab99734-a7", "ovs_interfaceid": "4ab99734-a7a9-43f9-b75e-f02d33a7a50d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:19:57 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-7782a432-b588-4b52-b8c6-af1ab46f74f7 req-ad28c19e-554c-49cc-abd3-3885b3eca04c service nova] Releasing lock "refresh_cache-14de9d20-9e66-4517-b904-2967e0a06a97" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:19:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:58 user nova-compute[75066]: DEBUG nova.compute.manager [req-2027768b-0e73-463d-858c-d2ddf96dcfbe req-cb1157bf-2cfd-45d4-bc3c-9bcec45ed619 service nova] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Received event network-vif-plugged-4850dc75-0d93-4536-abc1-a981dd385d96 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:19:58 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-2027768b-0e73-463d-858c-d2ddf96dcfbe req-cb1157bf-2cfd-45d4-bc3c-9bcec45ed619 service nova] Acquiring lock "d564b128-598b-4ad4-8618-afa4dc8a7347-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:19:58 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-2027768b-0e73-463d-858c-d2ddf96dcfbe req-cb1157bf-2cfd-45d4-bc3c-9bcec45ed619 service nova] Lock "d564b128-598b-4ad4-8618-afa4dc8a7347-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:19:58 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-2027768b-0e73-463d-858c-d2ddf96dcfbe req-cb1157bf-2cfd-45d4-bc3c-9bcec45ed619 service nova] Lock "d564b128-598b-4ad4-8618-afa4dc8a7347-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:19:58 user nova-compute[75066]: DEBUG nova.compute.manager [req-2027768b-0e73-463d-858c-d2ddf96dcfbe req-cb1157bf-2cfd-45d4-bc3c-9bcec45ed619 service nova] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] No waiting events found dispatching network-vif-plugged-4850dc75-0d93-4536-abc1-a981dd385d96 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:19:58 user nova-compute[75066]: WARNING nova.compute.manager [req-2027768b-0e73-463d-858c-d2ddf96dcfbe req-cb1157bf-2cfd-45d4-bc3c-9bcec45ed619 service nova] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Received unexpected event network-vif-plugged-4850dc75-0d93-4536-abc1-a981dd385d96 for instance with vm_state building and task_state spawning.
Dec 01 19:19:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:59 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:59 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:59 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:59 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:59 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:59 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:59 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:19:59 user nova-compute[75066]: DEBUG nova.compute.manager [req-ba308557-d5e3-40ad-b0cd-c4d6a00cba31 req-b71cb04a-784c-45db-85ae-9e5770c7990b service nova] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Received event network-vif-plugged-4ab99734-a7a9-43f9-b75e-f02d33a7a50d {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:19:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-ba308557-d5e3-40ad-b0cd-c4d6a00cba31 req-b71cb04a-784c-45db-85ae-9e5770c7990b service nova] Acquiring lock "14de9d20-9e66-4517-b904-2967e0a06a97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:19:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-ba308557-d5e3-40ad-b0cd-c4d6a00cba31 req-b71cb04a-784c-45db-85ae-9e5770c7990b service nova] Lock "14de9d20-9e66-4517-b904-2967e0a06a97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:19:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-ba308557-d5e3-40ad-b0cd-c4d6a00cba31 req-b71cb04a-784c-45db-85ae-9e5770c7990b service nova] Lock "14de9d20-9e66-4517-b904-2967e0a06a97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:19:59 user nova-compute[75066]: DEBUG nova.compute.manager [req-ba308557-d5e3-40ad-b0cd-c4d6a00cba31 req-b71cb04a-784c-45db-85ae-9e5770c7990b service nova] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] No waiting events found dispatching network-vif-plugged-4ab99734-a7a9-43f9-b75e-f02d33a7a50d {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:19:59 user nova-compute[75066]: WARNING nova.compute.manager [req-ba308557-d5e3-40ad-b0cd-c4d6a00cba31 req-b71cb04a-784c-45db-85ae-9e5770c7990b service nova] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Received unexpected event network-vif-plugged-4ab99734-a7a9-43f9-b75e-f02d33a7a50d for instance with vm_state building and task_state spawning.
Dec 01 19:20:00 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:00 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:20:00 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:20:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:20:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:20:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:20:00 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75066) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 19:20:00 user nova-compute[75066]: DEBUG nova.compute.manager [req-3c5fc446-2eb6-42e5-a0fa-7de486d90949 req-2e284526-d47b-4e77-893c-80f1d532fdde service nova] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Received event network-vif-plugged-4850dc75-0d93-4536-abc1-a981dd385d96 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:20:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-3c5fc446-2eb6-42e5-a0fa-7de486d90949 req-2e284526-d47b-4e77-893c-80f1d532fdde service nova] Acquiring lock "d564b128-598b-4ad4-8618-afa4dc8a7347-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:20:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-3c5fc446-2eb6-42e5-a0fa-7de486d90949 req-2e284526-d47b-4e77-893c-80f1d532fdde service nova] Lock "d564b128-598b-4ad4-8618-afa4dc8a7347-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:20:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-3c5fc446-2eb6-42e5-a0fa-7de486d90949 req-2e284526-d47b-4e77-893c-80f1d532fdde service nova] Lock "d564b128-598b-4ad4-8618-afa4dc8a7347-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:20:00 user nova-compute[75066]: DEBUG nova.compute.manager [req-3c5fc446-2eb6-42e5-a0fa-7de486d90949 req-2e284526-d47b-4e77-893c-80f1d532fdde service nova] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] No waiting events found dispatching network-vif-plugged-4850dc75-0d93-4536-abc1-a981dd385d96 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:20:00 user nova-compute[75066]: WARNING nova.compute.manager [req-3c5fc446-2eb6-42e5-a0fa-7de486d90949 req-2e284526-d47b-4e77-893c-80f1d532fdde service nova] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Received unexpected event network-vif-plugged-4850dc75-0d93-4536-abc1-a981dd385d96 for instance with vm_state building and task_state spawning.
Dec 01 19:20:01 user nova-compute[75066]: DEBUG nova.compute.manager [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Instance event wait completed in 0 seconds for  {{(pid=75066) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 19:20:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Guest created on hypervisor {{(pid=75066) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 19:20:01 user nova-compute[75066]: DEBUG nova.compute.manager [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Instance event wait completed in 0 seconds for  {{(pid=75066) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 19:20:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Guest created on hypervisor {{(pid=75066) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 19:20:01 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Instance spawned successfully.
Dec 01 19:20:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 19:20:01 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Instance spawned successfully.
Dec 01 19:20:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 19:20:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Found default for hw_cdrom_bus of ide {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:20:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Found default for hw_disk_bus of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:20:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Found default for hw_input_bus of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:20:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Found default for hw_pointer_model of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:20:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Found default for hw_video_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:20:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Found default for hw_vif_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:20:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Found default for hw_cdrom_bus of ide {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:20:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Found default for hw_disk_bus of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:20:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Found default for hw_input_bus of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:20:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Found default for hw_pointer_model of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:20:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Found default for hw_video_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:20:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Found default for hw_vif_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:20:01 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:01 user nova-compute[75066]: INFO nova.compute.manager [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Took 8.80 seconds to spawn the instance on the hypervisor.
Dec 01 19:20:01 user nova-compute[75066]: DEBUG nova.compute.manager [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:20:01 user nova-compute[75066]: INFO nova.compute.manager [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Took 7.28 seconds to spawn the instance on the hypervisor.
Dec 01 19:20:01 user nova-compute[75066]: DEBUG nova.compute.manager [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:20:01 user nova-compute[75066]: INFO nova.compute.manager [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Took 9.88 seconds to build instance.
Dec 01 19:20:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:20:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-4b78bac1-aab5-4208-8b78-a12ca318745a tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "d564b128-598b-4ad4-8618-afa4dc8a7347" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.020s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:20:01 user nova-compute[75066]: INFO nova.compute.manager [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Took 8.54 seconds to build instance.
Dec 01 19:20:01 user nova-compute[75066]: DEBUG nova.compute.manager [req-6827aff4-aa4d-4e3f-90cc-52b689f3a72e req-60d8a4b1-f1b3-40f7-bc73-90031acc3557 service nova] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Received event network-vif-plugged-4ab99734-a7a9-43f9-b75e-f02d33a7a50d {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:20:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-6827aff4-aa4d-4e3f-90cc-52b689f3a72e req-60d8a4b1-f1b3-40f7-bc73-90031acc3557 service nova] Acquiring lock "14de9d20-9e66-4517-b904-2967e0a06a97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:20:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-6827aff4-aa4d-4e3f-90cc-52b689f3a72e req-60d8a4b1-f1b3-40f7-bc73-90031acc3557 service nova] Lock "14de9d20-9e66-4517-b904-2967e0a06a97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:20:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-6827aff4-aa4d-4e3f-90cc-52b689f3a72e req-60d8a4b1-f1b3-40f7-bc73-90031acc3557 service nova] Lock "14de9d20-9e66-4517-b904-2967e0a06a97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:20:01 user nova-compute[75066]: DEBUG nova.compute.manager [req-6827aff4-aa4d-4e3f-90cc-52b689f3a72e req-60d8a4b1-f1b3-40f7-bc73-90031acc3557 service nova] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] No waiting events found dispatching network-vif-plugged-4ab99734-a7a9-43f9-b75e-f02d33a7a50d {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:20:01 user nova-compute[75066]: WARNING nova.compute.manager [req-6827aff4-aa4d-4e3f-90cc-52b689f3a72e req-60d8a4b1-f1b3-40f7-bc73-90031acc3557 service nova] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Received unexpected event network-vif-plugged-4ab99734-a7a9-43f9-b75e-f02d33a7a50d for instance with vm_state active and task_state None.
Dec 01 19:20:02 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c8ba91c9-063e-40b2-924e-f8747d191619 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "14de9d20-9e66-4517-b904-2967e0a06a97" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.708s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:20:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:20:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:20:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:20:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:20:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:20:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:20:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:20:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d340166-c58b-4213-b8d3-5036ade48d2d/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:20:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d340166-c58b-4213-b8d3-5036ade48d2d/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:20:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d340166-c58b-4213-b8d3-5036ade48d2d/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:20:03 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d340166-c58b-4213-b8d3-5036ade48d2d/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:20:03 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:20:03 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:03 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:20:03 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:20:03 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:20:03 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67c5dd7c-88aa-4f2f-8f62-a9af0480c38e/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:20:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67c5dd7c-88aa-4f2f-8f62-a9af0480c38e/disk --force-share --output=json" returned: 0 in 0.354s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:20:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67c5dd7c-88aa-4f2f-8f62-a9af0480c38e/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:20:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67c5dd7c-88aa-4f2f-8f62-a9af0480c38e/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:20:04 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:20:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67c5dd7c-88aa-4f2f-8f62-a9af0480c38e/disk.rescue --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:20:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67c5dd7c-88aa-4f2f-8f62-a9af0480c38e/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:20:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67c5dd7c-88aa-4f2f-8f62-a9af0480c38e/disk.rescue --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:20:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67c5dd7c-88aa-4f2f-8f62-a9af0480c38e/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:20:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d86a5a-c62e-41f7-9f33-1a0c61af6a49/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:20:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d86a5a-c62e-41f7-9f33-1a0c61af6a49/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:20:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d86a5a-c62e-41f7-9f33-1a0c61af6a49/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:20:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d86a5a-c62e-41f7-9f33-1a0c61af6a49/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:20:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:20:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:20:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:20:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:20:05 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:20:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:20:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:20:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:20:05 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:20:06 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:20:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:20:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json" returned: 0 in 0.303s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:20:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:20:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:20:06 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:20:06 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:07 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:07 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:20:07 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:20:07 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Hypervisor/Node resource view: name=user free_ram=7486MB free_disk=25.18252944946289GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75066) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 19:20:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:20:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:20:07 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Applying migration context for instance dd546862-fcd5-4b69-8ea3-a8fa4859a489 as it has an incoming, in-progress migration 302310ba-671b-4252-8786-3afb5d194147. Migration status is finished {{(pid=75066) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Dec 01 19:20:07 user nova-compute[75066]: INFO nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Updating resource usage from migration 302310ba-671b-4252-8786-3afb5d194147
Dec 01 19:20:07 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:20:07 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance c223be70-8b9c-46d4-9b5a-3b83dfc05a17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:20:07 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance c3ceeca4-c16c-4cf5-adfd-7d5a2925f435 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:20:07 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 10fc72fa-64a3-4704-ad91-2e3ae88d5424 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:20:07 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 90c49be6-97aa-45f1-bcbe-b9a3875226a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:20:07 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 3d340166-c58b-4213-b8d3-5036ade48d2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:20:07 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Migration 302310ba-671b-4252-8786-3afb5d194147 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Dec 01 19:20:07 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance dd546862-fcd5-4b69-8ea3-a8fa4859a489 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:20:07 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance b7d86a5a-c62e-41f7-9f33-1a0c61af6a49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:20:07 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance d564b128-598b-4ad4-8618-afa4dc8a7347 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:20:07 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 14de9d20-9e66-4517-b904-2967e0a06a97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:20:07 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 19:20:07 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 19:20:07 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:20:07 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:20:07 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Compute_service record updated for user:user {{(pid=75066) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 19:20:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.655s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:20:08 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:20:08 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:20:08 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Starting heal instance info cache {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 19:20:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "refresh_cache-dd546862-fcd5-4b69-8ea3-a8fa4859a489" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:20:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquired lock "refresh_cache-dd546862-fcd5-4b69-8ea3-a8fa4859a489" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:20:09 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Forcefully refreshing network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 19:20:09 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Updating instance_info_cache with network_info: [{"id": "478e7aea-9546-4659-bdac-09213bd9cb82", "address": "fa:16:3e:9a:26:f6", "network": {"id": "d182d3d1-113a-4bf5-b325-f073247f0547", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-325272674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2830de7697db4d5e8b9c358dab7f4368", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap478e7aea-95", "ovs_interfaceid": "478e7aea-9546-4659-bdac-09213bd9cb82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:20:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Releasing lock "refresh_cache-dd546862-fcd5-4b69-8ea3-a8fa4859a489" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:20:09 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Updated the network info_cache for instance {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 19:20:09 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:20:09 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:20:09 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:20:09 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:20:09 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75066) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 19:20:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Acquiring lock "998daa1d-fd6a-4663-8df3-0683a9dbe142" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:20:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Lock "998daa1d-fd6a-4663-8df3-0683a9dbe142" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:20:14 user nova-compute[75066]: DEBUG nova.compute.manager [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Starting instance... {{(pid=75066) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 19:20:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:20:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:20:14 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75066) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 19:20:14 user nova-compute[75066]: INFO nova.compute.claims [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Claim successful on node user
Dec 01 19:20:15 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:20:15 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:20:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.740s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:20:15 user nova-compute[75066]: DEBUG nova.compute.manager [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Start building networks asynchronously for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 19:20:15 user nova-compute[75066]: DEBUG nova.compute.manager [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Allocating IP information in the background. {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 19:20:15 user nova-compute[75066]: DEBUG nova.network.neutron [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] allocate_for_instance() {{(pid=75066) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 19:20:15 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 19:20:15 user nova-compute[75066]: DEBUG nova.compute.manager [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Start building block device mappings for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 19:20:15 user nova-compute[75066]: DEBUG nova.policy [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8ae99d82b8bb499595aae2098059f478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be461a2ee174f25bdbb451e49512e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75066) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 19:20:16 user nova-compute[75066]: DEBUG nova.compute.manager [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Start spawning the instance on the hypervisor. {{(pid=75066) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 19:20:16 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Creating instance directory {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 19:20:16 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Creating image(s)
Dec 01 19:20:16 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Acquiring lock "/opt/stack/data/nova/instances/998daa1d-fd6a-4663-8df3-0683a9dbe142/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:20:16 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Lock "/opt/stack/data/nova/instances/998daa1d-fd6a-4663-8df3-0683a9dbe142/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:20:16 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Lock "/opt/stack/data/nova/instances/998daa1d-fd6a-4663-8df3-0683a9dbe142/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:20:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:20:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.191s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:20:16 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Acquiring lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:20:16 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:20:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:20:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.181s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:20:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/998daa1d-fd6a-4663-8df3-0683a9dbe142/disk 1073741824 {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:20:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/998daa1d-fd6a-4663-8df3-0683a9dbe142/disk 1073741824" returned: 0 in 0.053s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:20:16 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:20:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:20:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.181s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:20:16 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Checking if we can resize image /opt/stack/data/nova/instances/998daa1d-fd6a-4663-8df3-0683a9dbe142/disk. size=1073741824 {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 19:20:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/998daa1d-fd6a-4663-8df3-0683a9dbe142/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:20:17 user nova-compute[75066]: DEBUG nova.network.neutron [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Successfully created port: 2cf25213-8eec-4d19-bad6-b8e2fd905b3c {{(pid=75066) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 19:20:17 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/998daa1d-fd6a-4663-8df3-0683a9dbe142/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:20:17 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Cannot resize image /opt/stack/data/nova/instances/998daa1d-fd6a-4663-8df3-0683a9dbe142/disk to a smaller size. {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 19:20:17 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Created local disks {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 19:20:17 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Ensure instance console log exists: /opt/stack/data/nova/instances/998daa1d-fd6a-4663-8df3-0683a9dbe142/console.log {{(pid=75066) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 19:20:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:20:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:20:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:20:17 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:17 user nova-compute[75066]: DEBUG nova.network.neutron [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Successfully updated port: 2cf25213-8eec-4d19-bad6-b8e2fd905b3c {{(pid=75066) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 19:20:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Acquiring lock "refresh_cache-998daa1d-fd6a-4663-8df3-0683a9dbe142" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:20:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Acquired lock "refresh_cache-998daa1d-fd6a-4663-8df3-0683a9dbe142" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:20:17 user nova-compute[75066]: DEBUG nova.network.neutron [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:20:17 user nova-compute[75066]: DEBUG nova.compute.manager [req-a10c09ed-c848-4c7c-9761-dd166154d1f7 req-1e5a4a56-9f8c-4b05-885b-2f49cdb77f35 service nova] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Received event network-changed-2cf25213-8eec-4d19-bad6-b8e2fd905b3c {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:20:17 user nova-compute[75066]: DEBUG nova.compute.manager [req-a10c09ed-c848-4c7c-9761-dd166154d1f7 req-1e5a4a56-9f8c-4b05-885b-2f49cdb77f35 service nova] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Refreshing instance network info cache due to event network-changed-2cf25213-8eec-4d19-bad6-b8e2fd905b3c. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:20:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a10c09ed-c848-4c7c-9761-dd166154d1f7 req-1e5a4a56-9f8c-4b05-885b-2f49cdb77f35 service nova] Acquiring lock "refresh_cache-998daa1d-fd6a-4663-8df3-0683a9dbe142" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:20:17 user nova-compute[75066]: DEBUG nova.network.neutron [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:20:18 user nova-compute[75066]: DEBUG nova.network.neutron [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Updating instance_info_cache with network_info: [{"id": "2cf25213-8eec-4d19-bad6-b8e2fd905b3c", "address": "fa:16:3e:10:62:79", "network": {"id": "13655709-cc3e-4378-850f-1eb7bc944811", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1907265443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0be461a2ee174f25bdbb451e49512e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf25213-8e", "ovs_interfaceid": "2cf25213-8eec-4d19-bad6-b8e2fd905b3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:20:18 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Releasing lock "refresh_cache-998daa1d-fd6a-4663-8df3-0683a9dbe142" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:20:18 user nova-compute[75066]: DEBUG nova.compute.manager [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Instance network_info: |[{"id": "2cf25213-8eec-4d19-bad6-b8e2fd905b3c", "address": "fa:16:3e:10:62:79", "network": {"id": "13655709-cc3e-4378-850f-1eb7bc944811", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1907265443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0be461a2ee174f25bdbb451e49512e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf25213-8e", "ovs_interfaceid": "2cf25213-8eec-4d19-bad6-b8e2fd905b3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 19:20:18 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a10c09ed-c848-4c7c-9761-dd166154d1f7 req-1e5a4a56-9f8c-4b05-885b-2f49cdb77f35 service nova] Acquired lock "refresh_cache-998daa1d-fd6a-4663-8df3-0683a9dbe142" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:20:18 user nova-compute[75066]: DEBUG nova.network.neutron [req-a10c09ed-c848-4c7c-9761-dd166154d1f7 req-1e5a4a56-9f8c-4b05-885b-2f49cdb77f35 service nova] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Refreshing network info cache for port 2cf25213-8eec-4d19-bad6-b8e2fd905b3c {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:20:18 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Start _get_guest_xml network_info=[{"id": "2cf25213-8eec-4d19-bad6-b8e2fd905b3c", "address": "fa:16:3e:10:62:79", "network": {"id": "13655709-cc3e-4378-850f-1eb7bc944811", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1907265443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0be461a2ee174f25bdbb451e49512e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf25213-8e", "ovs_interfaceid": "2cf25213-8eec-4d19-bad6-b8e2fd905b3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'image_id': '900b237b-e99c-4fdd-a44f-dcb7a08baa86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:20:18 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:20:18 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:20:18 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:20:18 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:20:18 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:20:18 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:20:18 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:20:18 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:20:18 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:20:18 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:20:18 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:20:18 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:20:18 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:20:18 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:20:18 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:20:18 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:20:18 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:20:18 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:20:18 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T19:20:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-431772117',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-431772117',id=17,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDioMIKkD17rbLefUs+CoCe2YAF5MJyWmdGP5njQ+aDOavBc08qUchmFEEnBOz9qWRNoNrJTyhIak33m8ykbjamBmaBpbrxUKAYbxyiEVNdIL8zvksuJtx/Xi7sbDuD1AA==',key_name='tempest-keypair-1571650457',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0be461a2ee174f25bdbb451e49512e75',ramdisk_id='',reservation_id='r-ymwza3b4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-687574292',owner_user_name='tempest-TaggedAttachmentsTest-687574292-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:20:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ae99d82b8bb499595aae2098059f478',uuid=998daa1d-fd6a-4663-8df3-0683a9dbe142,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2cf25213-8eec-4d19-bad6-b8e2fd905b3c", "address": "fa:16:3e:10:62:79", "network": {"id": "13655709-cc3e-4378-850f-1eb7bc944811", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1907265443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0be461a2ee174f25bdbb451e49512e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf25213-8e", "ovs_interfaceid": "2cf25213-8eec-4d19-bad6-b8e2fd905b3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:20:18 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Converting VIF {"id": "2cf25213-8eec-4d19-bad6-b8e2fd905b3c", "address": "fa:16:3e:10:62:79", "network": {"id": "13655709-cc3e-4378-850f-1eb7bc944811", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1907265443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0be461a2ee174f25bdbb451e49512e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf25213-8e", "ovs_interfaceid": "2cf25213-8eec-4d19-bad6-b8e2fd905b3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:20:18 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:62:79,bridge_name='br-int',has_traffic_filtering=True,id=2cf25213-8eec-4d19-bad6-b8e2fd905b3c,network=Network(13655709-cc3e-4378-850f-1eb7bc944811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cf25213-8e') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:20:18 user nova-compute[75066]: DEBUG nova.objects.instance [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Lazy-loading 'pci_devices' on Instance uuid 998daa1d-fd6a-4663-8df3-0683a9dbe142 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:20:18 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:20:18 user nova-compute[75066]:   <uuid>998daa1d-fd6a-4663-8df3-0683a9dbe142</uuid>
Dec 01 19:20:18 user nova-compute[75066]:   <name>instance-00000011</name>
Dec 01 19:20:18 user nova-compute[75066]:   <memory>524288</memory>
Dec 01 19:20:18 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:20:18 user nova-compute[75066]:   <metadata>
Dec 01 19:20:18 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:20:18 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:20:18 user nova-compute[75066]:       <nova:name>tempest-device-tagging-server-431772117</nova:name>
Dec 01 19:20:18 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:20:18</nova:creationTime>
Dec 01 19:20:18 user nova-compute[75066]:       <nova:flavor name="m1.tiny">
Dec 01 19:20:18 user nova-compute[75066]:         <nova:memory>512</nova:memory>
Dec 01 19:20:18 user nova-compute[75066]:         <nova:disk>1</nova:disk>
Dec 01 19:20:18 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:20:18 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:20:18 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:20:18 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:20:18 user nova-compute[75066]:       <nova:owner>
Dec 01 19:20:18 user nova-compute[75066]:         <nova:user uuid="8ae99d82b8bb499595aae2098059f478">tempest-TaggedAttachmentsTest-687574292-project-member</nova:user>
Dec 01 19:20:18 user nova-compute[75066]:         <nova:project uuid="0be461a2ee174f25bdbb451e49512e75">tempest-TaggedAttachmentsTest-687574292</nova:project>
Dec 01 19:20:18 user nova-compute[75066]:       </nova:owner>
Dec 01 19:20:18 user nova-compute[75066]:       <nova:root type="image" uuid="900b237b-e99c-4fdd-a44f-dcb7a08baa86"/>
Dec 01 19:20:18 user nova-compute[75066]:       <nova:ports>
Dec 01 19:20:18 user nova-compute[75066]:         <nova:port uuid="2cf25213-8eec-4d19-bad6-b8e2fd905b3c">
Dec 01 19:20:18 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Dec 01 19:20:18 user nova-compute[75066]:         </nova:port>
Dec 01 19:20:18 user nova-compute[75066]:       </nova:ports>
Dec 01 19:20:18 user nova-compute[75066]:     </nova:instance>
Dec 01 19:20:18 user nova-compute[75066]:   </metadata>
Dec 01 19:20:18 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:20:18 user nova-compute[75066]:     <system>
Dec 01 19:20:18 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:20:18 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:20:18 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:20:18 user nova-compute[75066]:       <entry name="serial">998daa1d-fd6a-4663-8df3-0683a9dbe142</entry>
Dec 01 19:20:18 user nova-compute[75066]:       <entry name="uuid">998daa1d-fd6a-4663-8df3-0683a9dbe142</entry>
Dec 01 19:20:18 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:20:18 user nova-compute[75066]:     </system>
Dec 01 19:20:18 user nova-compute[75066]:   </sysinfo>
Dec 01 19:20:18 user nova-compute[75066]:   <os>
Dec 01 19:20:18 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:20:18 user nova-compute[75066]:     <boot dev="hd"/>
Dec 01 19:20:18 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:20:18 user nova-compute[75066]:   </os>
Dec 01 19:20:18 user nova-compute[75066]:   <features>
Dec 01 19:20:18 user nova-compute[75066]:     <acpi/>
Dec 01 19:20:18 user nova-compute[75066]:     <apic/>
Dec 01 19:20:18 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:20:18 user nova-compute[75066]:   </features>
Dec 01 19:20:18 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:20:18 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:20:18 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:20:18 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:20:18 user nova-compute[75066]:   </clock>
Dec 01 19:20:18 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:20:18 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:20:18 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:20:18 user nova-compute[75066]:   </cpu>
Dec 01 19:20:18 user nova-compute[75066]:   <devices>
Dec 01 19:20:18 user nova-compute[75066]:     <disk type="file" device="disk">
Dec 01 19:20:18 user nova-compute[75066]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 19:20:18 user nova-compute[75066]:       <source file="/opt/stack/data/nova/instances/998daa1d-fd6a-4663-8df3-0683a9dbe142/disk"/>
Dec 01 19:20:18 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:20:18 user nova-compute[75066]:     </disk>
Dec 01 19:20:18 user nova-compute[75066]:     <disk type="file" device="cdrom">
Dec 01 19:20:18 user nova-compute[75066]:       <driver name="qemu" type="raw" cache="none"/>
Dec 01 19:20:18 user nova-compute[75066]:       <source file="/opt/stack/data/nova/instances/998daa1d-fd6a-4663-8df3-0683a9dbe142/disk.config"/>
Dec 01 19:20:18 user nova-compute[75066]:       <target dev="hda" bus="ide"/>
Dec 01 19:20:18 user nova-compute[75066]:     </disk>
Dec 01 19:20:18 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:20:18 user nova-compute[75066]:       <mac address="fa:16:3e:10:62:79"/>
Dec 01 19:20:18 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:20:18 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:20:18 user nova-compute[75066]:       <target dev="tap2cf25213-8e"/>
Dec 01 19:20:18 user nova-compute[75066]:     </interface>
Dec 01 19:20:18 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:20:18 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/998daa1d-fd6a-4663-8df3-0683a9dbe142/console.log" append="off"/>
Dec 01 19:20:18 user nova-compute[75066]:     </serial>
Dec 01 19:20:18 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:20:18 user nova-compute[75066]:     <video>
Dec 01 19:20:18 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:20:18 user nova-compute[75066]:     </video>
Dec 01 19:20:18 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:20:18 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:20:18 user nova-compute[75066]:     </rng>
Dec 01 19:20:18 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:20:18 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:20:18 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:20:18 user nova-compute[75066]:     </memballoon>
Dec 01 19:20:18 user nova-compute[75066]:   </devices>
Dec 01 19:20:18 user nova-compute[75066]: </domain>
Dec 01 19:20:18 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:20:18 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T19:20:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-431772117',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-431772117',id=17,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDioMIKkD17rbLefUs+CoCe2YAF5MJyWmdGP5njQ+aDOavBc08qUchmFEEnBOz9qWRNoNrJTyhIak33m8ykbjamBmaBpbrxUKAYbxyiEVNdIL8zvksuJtx/Xi7sbDuD1AA==',key_name='tempest-keypair-1571650457',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0be461a2ee174f25bdbb451e49512e75',ramdisk_id='',reservation_id='r-ymwza3b4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-687574292',owner_user_name='tempest-TaggedAttachmentsTest-687574292-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:20:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ae99d82b8bb499595aae2098059f478',uuid=998daa1d-fd6a-4663-8df3-0683a9dbe142,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2cf25213-8eec-4d19-bad6-b8e2fd905b3c", "address": "fa:16:3e:10:62:79", "network": {"id": "13655709-cc3e-4378-850f-1eb7bc944811", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1907265443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0be461a2ee174f25bdbb451e49512e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf25213-8e", "ovs_interfaceid": "2cf25213-8eec-4d19-bad6-b8e2fd905b3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:20:18 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Converting VIF {"id": "2cf25213-8eec-4d19-bad6-b8e2fd905b3c", "address": "fa:16:3e:10:62:79", "network": {"id": "13655709-cc3e-4378-850f-1eb7bc944811", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1907265443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0be461a2ee174f25bdbb451e49512e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf25213-8e", "ovs_interfaceid": "2cf25213-8eec-4d19-bad6-b8e2fd905b3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:20:18 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:62:79,bridge_name='br-int',has_traffic_filtering=True,id=2cf25213-8eec-4d19-bad6-b8e2fd905b3c,network=Network(13655709-cc3e-4378-850f-1eb7bc944811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cf25213-8e') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:20:18 user nova-compute[75066]: DEBUG os_vif [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:62:79,bridge_name='br-int',has_traffic_filtering=True,id=2cf25213-8eec-4d19-bad6-b8e2fd905b3c,network=Network(13655709-cc3e-4378-850f-1eb7bc944811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cf25213-8e') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:20:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:20:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:20:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '48b1686b-77bd-55c3-afb9-70273fb94664', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:20:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2cf25213-8e, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:20:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2cf25213-8e, col_values=(('qos', UUID('eabe9044-5a35-4b8d-a43a-590f599f8383')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:20:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2cf25213-8e, col_values=(('external_ids', {'iface-id': '2cf25213-8eec-4d19-bad6-b8e2fd905b3c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:62:79', 'vm-uuid': '998daa1d-fd6a-4663-8df3-0683a9dbe142'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:20:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:20:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:18 user nova-compute[75066]: INFO os_vif [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:62:79,bridge_name='br-int',has_traffic_filtering=True,id=2cf25213-8eec-4d19-bad6-b8e2fd905b3c,network=Network(13655709-cc3e-4378-850f-1eb7bc944811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cf25213-8e')
Dec 01 19:20:18 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:20:18 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] No BDM found with device name hda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:20:18 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] No VIF found with MAC fa:16:3e:10:62:79, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:20:18 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Using config drive
Dec 01 19:20:18 user nova-compute[75066]: DEBUG nova.network.neutron [req-a10c09ed-c848-4c7c-9761-dd166154d1f7 req-1e5a4a56-9f8c-4b05-885b-2f49cdb77f35 service nova] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Updated VIF entry in instance network info cache for port 2cf25213-8eec-4d19-bad6-b8e2fd905b3c. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:20:18 user nova-compute[75066]: DEBUG nova.network.neutron [req-a10c09ed-c848-4c7c-9761-dd166154d1f7 req-1e5a4a56-9f8c-4b05-885b-2f49cdb77f35 service nova] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Updating instance_info_cache with network_info: [{"id": "2cf25213-8eec-4d19-bad6-b8e2fd905b3c", "address": "fa:16:3e:10:62:79", "network": {"id": "13655709-cc3e-4378-850f-1eb7bc944811", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1907265443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0be461a2ee174f25bdbb451e49512e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf25213-8e", "ovs_interfaceid": "2cf25213-8eec-4d19-bad6-b8e2fd905b3c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:20:18 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a10c09ed-c848-4c7c-9761-dd166154d1f7 req-1e5a4a56-9f8c-4b05-885b-2f49cdb77f35 service nova] Releasing lock "refresh_cache-998daa1d-fd6a-4663-8df3-0683a9dbe142" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:20:18 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Creating config drive at /opt/stack/data/nova/instances/998daa1d-fd6a-4663-8df3-0683a9dbe142/disk.config
Dec 01 19:20:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/998daa1d-fd6a-4663-8df3-0683a9dbe142/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpo15385t_ {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:20:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/998daa1d-fd6a-4663-8df3-0683a9dbe142/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpo15385t_" returned: 0 in 0.057s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:20:19 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:19 user nova-compute[75066]: DEBUG nova.compute.manager [None req-99c02dab-c891-49bd-b645-2ff3adf4044d tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:20:19 user nova-compute[75066]: INFO nova.compute.manager [None req-99c02dab-c891-49bd-b645-2ff3adf4044d tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] instance snapshotting
Dec 01 19:20:19 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-99c02dab-c891-49bd-b645-2ff3adf4044d tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Beginning live snapshot process
Dec 01 19:20:19 user nova-compute[75066]: DEBUG nova.compute.manager [req-73261222-7e79-40f5-9f5b-840bec17a078 req-96efbbdc-c7df-4431-add3-5a6795498726 service nova] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Received event network-changed-d51d7391-af1b-4160-b3bb-c77d0507a0e0 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:20:19 user nova-compute[75066]: DEBUG nova.compute.manager [req-73261222-7e79-40f5-9f5b-840bec17a078 req-96efbbdc-c7df-4431-add3-5a6795498726 service nova] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Refreshing instance network info cache due to event network-changed-d51d7391-af1b-4160-b3bb-c77d0507a0e0. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:20:19 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-73261222-7e79-40f5-9f5b-840bec17a078 req-96efbbdc-c7df-4431-add3-5a6795498726 service nova] Acquiring lock "refresh_cache-10fc72fa-64a3-4704-ad91-2e3ae88d5424" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:20:19 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-73261222-7e79-40f5-9f5b-840bec17a078 req-96efbbdc-c7df-4431-add3-5a6795498726 service nova] Acquired lock "refresh_cache-10fc72fa-64a3-4704-ad91-2e3ae88d5424" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:20:19 user nova-compute[75066]: DEBUG nova.network.neutron [req-73261222-7e79-40f5-9f5b-840bec17a078 req-96efbbdc-c7df-4431-add3-5a6795498726 service nova] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Refreshing network info cache for port d51d7391-af1b-4160-b3bb-c77d0507a0e0 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:20:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-99c02dab-c891-49bd-b645-2ff3adf4044d tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json -f qcow2 {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:20:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5100cae8-33c1-46c6-9cef-c32f3425a937 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Acquiring lock "10fc72fa-64a3-4704-ad91-2e3ae88d5424" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:20:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5100cae8-33c1-46c6-9cef-c32f3425a937 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Lock "10fc72fa-64a3-4704-ad91-2e3ae88d5424" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:20:20 user nova-compute[75066]: INFO nova.compute.manager [None req-5100cae8-33c1-46c6-9cef-c32f3425a937 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Shelve offloading
Dec 01 19:20:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-99c02dab-c891-49bd-b645-2ff3adf4044d tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json -f qcow2" returned: 0 in 0.231s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:20:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-99c02dab-c891-49bd-b645-2ff3adf4044d tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json -f qcow2 {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:20:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-99c02dab-c891-49bd-b645-2ff3adf4044d tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json -f qcow2" returned: 0 in 0.200s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:20:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-99c02dab-c891-49bd-b645-2ff3adf4044d tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:20:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:20 user nova-compute[75066]: DEBUG nova.compute.manager [req-e79027fc-8ccc-4cac-bb2a-35c266f46354 req-d7d62285-ec6c-4efe-809a-6e198536be55 service nova] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Received event network-vif-plugged-2cf25213-8eec-4d19-bad6-b8e2fd905b3c {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:20:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-e79027fc-8ccc-4cac-bb2a-35c266f46354 req-d7d62285-ec6c-4efe-809a-6e198536be55 service nova] Acquiring lock "998daa1d-fd6a-4663-8df3-0683a9dbe142-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:20:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-e79027fc-8ccc-4cac-bb2a-35c266f46354 req-d7d62285-ec6c-4efe-809a-6e198536be55 service nova] Lock "998daa1d-fd6a-4663-8df3-0683a9dbe142-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:20:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-e79027fc-8ccc-4cac-bb2a-35c266f46354 req-d7d62285-ec6c-4efe-809a-6e198536be55 service nova] Lock "998daa1d-fd6a-4663-8df3-0683a9dbe142-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:20:20 user nova-compute[75066]: DEBUG nova.compute.manager [req-e79027fc-8ccc-4cac-bb2a-35c266f46354 req-d7d62285-ec6c-4efe-809a-6e198536be55 service nova] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] No waiting events found dispatching network-vif-plugged-2cf25213-8eec-4d19-bad6-b8e2fd905b3c {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:20:20 user nova-compute[75066]: WARNING nova.compute.manager [req-e79027fc-8ccc-4cac-bb2a-35c266f46354 req-d7d62285-ec6c-4efe-809a-6e198536be55 service nova] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Received unexpected event network-vif-plugged-2cf25213-8eec-4d19-bad6-b8e2fd905b3c for instance with vm_state building and task_state spawning.
Dec 01 19:20:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-99c02dab-c891-49bd-b645-2ff3adf4044d tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.220s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:20:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-99c02dab-c891-49bd-b645-2ff3adf4044d tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpbvkix4zj/9dd7421cd4424993b6b81c401f0e9997.delta 1073741824 {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:20:20 user nova-compute[75066]: DEBUG nova.network.neutron [req-73261222-7e79-40f5-9f5b-840bec17a078 req-96efbbdc-c7df-4431-add3-5a6795498726 service nova] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Updated VIF entry in instance network info cache for port d51d7391-af1b-4160-b3bb-c77d0507a0e0. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:20:20 user nova-compute[75066]: DEBUG nova.network.neutron [req-73261222-7e79-40f5-9f5b-840bec17a078 req-96efbbdc-c7df-4431-add3-5a6795498726 service nova] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Updating instance_info_cache with network_info: [{"id": "d51d7391-af1b-4160-b3bb-c77d0507a0e0", "address": "fa:16:3e:e9:da:9e", "network": {"id": "4b17d46f-fdbc-4cd7-991c-ca6981e0f20f", "bridge": "br-int", "label": "tempest-TestShelveInstance-2081974203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5b79591b18f4d35bdd99365c816b55c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd51d7391-af", "ovs_interfaceid": "d51d7391-af1b-4160-b3bb-c77d0507a0e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:20:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-99c02dab-c891-49bd-b645-2ff3adf4044d tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpbvkix4zj/9dd7421cd4424993b6b81c401f0e9997.delta 1073741824" returned: 0 in 0.077s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:20:20 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-99c02dab-c891-49bd-b645-2ff3adf4044d tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Quiescing instance not available: QEMU guest agent is not enabled.
Dec 01 19:20:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-73261222-7e79-40f5-9f5b-840bec17a078 req-96efbbdc-c7df-4431-add3-5a6795498726 service nova] Releasing lock "refresh_cache-10fc72fa-64a3-4704-ad91-2e3ae88d5424" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:20:21 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:21 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:21 user nova-compute[75066]: DEBUG nova.compute.manager [req-afe2e74b-28c0-4f30-9269-da03d3625347 req-3a637d35-462f-4508-98bb-67929538435d service nova] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Received event network-vif-unplugged-d51d7391-af1b-4160-b3bb-c77d0507a0e0 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:20:21 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-afe2e74b-28c0-4f30-9269-da03d3625347 req-3a637d35-462f-4508-98bb-67929538435d service nova] Acquiring lock "10fc72fa-64a3-4704-ad91-2e3ae88d5424-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:20:21 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-afe2e74b-28c0-4f30-9269-da03d3625347 req-3a637d35-462f-4508-98bb-67929538435d service nova] Lock "10fc72fa-64a3-4704-ad91-2e3ae88d5424-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:20:21 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-afe2e74b-28c0-4f30-9269-da03d3625347 req-3a637d35-462f-4508-98bb-67929538435d service nova] Lock "10fc72fa-64a3-4704-ad91-2e3ae88d5424-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:20:21 user nova-compute[75066]: DEBUG nova.compute.manager [req-afe2e74b-28c0-4f30-9269-da03d3625347 req-3a637d35-462f-4508-98bb-67929538435d service nova] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] No waiting events found dispatching network-vif-unplugged-d51d7391-af1b-4160-b3bb-c77d0507a0e0 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:20:21 user nova-compute[75066]: WARNING nova.compute.manager [req-afe2e74b-28c0-4f30-9269-da03d3625347 req-3a637d35-462f-4508-98bb-67929538435d service nova] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Received unexpected event network-vif-unplugged-d51d7391-af1b-4160-b3bb-c77d0507a0e0 for instance with vm_state active and task_state shelving.
Dec 01 19:20:21 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:21 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:21 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:21 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:21 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:22 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Instance destroyed successfully.
Dec 01 19:20:22 user nova-compute[75066]: DEBUG nova.compute.manager [None req-5100cae8-33c1-46c6-9cef-c32f3425a937 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:20:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5100cae8-33c1-46c6-9cef-c32f3425a937 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Acquiring lock "refresh_cache-10fc72fa-64a3-4704-ad91-2e3ae88d5424" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:20:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5100cae8-33c1-46c6-9cef-c32f3425a937 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Acquired lock "refresh_cache-10fc72fa-64a3-4704-ad91-2e3ae88d5424" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:20:22 user nova-compute[75066]: DEBUG nova.network.neutron [None req-5100cae8-33c1-46c6-9cef-c32f3425a937 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:20:22 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-99c02dab-c891-49bd-b645-2ff3adf4044d tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75066) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 19:20:22 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:22 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-99c02dab-c891-49bd-b645-2ff3adf4044d tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] COPY block job progress, current cursor: 27131904 final cursor: 75497472 {{(pid=75066) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 19:20:22 user nova-compute[75066]: DEBUG nova.network.neutron [None req-5100cae8-33c1-46c6-9cef-c32f3425a937 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Updating instance_info_cache with network_info: [{"id": "d51d7391-af1b-4160-b3bb-c77d0507a0e0", "address": "fa:16:3e:e9:da:9e", "network": {"id": "4b17d46f-fdbc-4cd7-991c-ca6981e0f20f", "bridge": "br-int", "label": "tempest-TestShelveInstance-2081974203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5b79591b18f4d35bdd99365c816b55c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd51d7391-af", "ovs_interfaceid": "d51d7391-af1b-4160-b3bb-c77d0507a0e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:20:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5100cae8-33c1-46c6-9cef-c32f3425a937 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Releasing lock "refresh_cache-10fc72fa-64a3-4704-ad91-2e3ae88d5424" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:20:22 user nova-compute[75066]: DEBUG nova.compute.manager [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Instance event wait completed in 0 seconds for  {{(pid=75066) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 19:20:22 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Guest created on hypervisor {{(pid=75066) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 19:20:22 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Instance spawned successfully.
Dec 01 19:20:22 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 19:20:22 user nova-compute[75066]: DEBUG nova.compute.manager [req-5bbace5f-0cb1-4789-8b80-3ef37720c0ae req-bd565d96-ae05-4797-9631-2d5976ca0dd0 service nova] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Received event network-vif-plugged-2cf25213-8eec-4d19-bad6-b8e2fd905b3c {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:20:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-5bbace5f-0cb1-4789-8b80-3ef37720c0ae req-bd565d96-ae05-4797-9631-2d5976ca0dd0 service nova] Acquiring lock "998daa1d-fd6a-4663-8df3-0683a9dbe142-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:20:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-5bbace5f-0cb1-4789-8b80-3ef37720c0ae req-bd565d96-ae05-4797-9631-2d5976ca0dd0 service nova] Lock "998daa1d-fd6a-4663-8df3-0683a9dbe142-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:20:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-5bbace5f-0cb1-4789-8b80-3ef37720c0ae req-bd565d96-ae05-4797-9631-2d5976ca0dd0 service nova] Lock "998daa1d-fd6a-4663-8df3-0683a9dbe142-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:20:22 user nova-compute[75066]: DEBUG nova.compute.manager [req-5bbace5f-0cb1-4789-8b80-3ef37720c0ae req-bd565d96-ae05-4797-9631-2d5976ca0dd0 service nova] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] No waiting events found dispatching network-vif-plugged-2cf25213-8eec-4d19-bad6-b8e2fd905b3c {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:20:22 user nova-compute[75066]: WARNING nova.compute.manager [req-5bbace5f-0cb1-4789-8b80-3ef37720c0ae req-bd565d96-ae05-4797-9631-2d5976ca0dd0 service nova] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Received unexpected event network-vif-plugged-2cf25213-8eec-4d19-bad6-b8e2fd905b3c for instance with vm_state building and task_state spawning.
Dec 01 19:20:22 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Found default for hw_cdrom_bus of ide {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:20:22 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Found default for hw_disk_bus of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:20:22 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Found default for hw_input_bus of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:20:22 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Found default for hw_pointer_model of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:20:22 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Found default for hw_video_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:20:22 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Found default for hw_vif_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:20:23 user nova-compute[75066]: INFO nova.compute.manager [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Took 6.80 seconds to spawn the instance on the hypervisor.
Dec 01 19:20:23 user nova-compute[75066]: DEBUG nova.compute.manager [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:20:23 user nova-compute[75066]: INFO nova.compute.manager [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Took 8.37 seconds to build instance.
Dec 01 19:20:23 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-99c02dab-c891-49bd-b645-2ff3adf4044d tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75066) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 19:20:23 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-99c02dab-c891-49bd-b645-2ff3adf4044d tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Skipping quiescing instance: QEMU guest agent is not enabled.
Dec 01 19:20:23 user nova-compute[75066]: DEBUG nova.compute.manager [req-45895628-691d-476e-90c0-f5085ed88580 req-c673f7e5-3e94-497d-9806-141518157860 service nova] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Received event network-vif-plugged-d51d7391-af1b-4160-b3bb-c77d0507a0e0 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-45895628-691d-476e-90c0-f5085ed88580 req-c673f7e5-3e94-497d-9806-141518157860 service nova] Acquiring lock "10fc72fa-64a3-4704-ad91-2e3ae88d5424-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-45895628-691d-476e-90c0-f5085ed88580 req-c673f7e5-3e94-497d-9806-141518157860 service nova] Lock "10fc72fa-64a3-4704-ad91-2e3ae88d5424-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-45895628-691d-476e-90c0-f5085ed88580 req-c673f7e5-3e94-497d-9806-141518157860 service nova] Lock "10fc72fa-64a3-4704-ad91-2e3ae88d5424-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG nova.compute.manager [req-45895628-691d-476e-90c0-f5085ed88580 req-c673f7e5-3e94-497d-9806-141518157860 service nova] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] No waiting events found dispatching network-vif-plugged-d51d7391-af1b-4160-b3bb-c77d0507a0e0 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:20:23 user nova-compute[75066]: WARNING nova.compute.manager [req-45895628-691d-476e-90c0-f5085ed88580 req-c673f7e5-3e94-497d-9806-141518157860 service nova] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Received unexpected event network-vif-plugged-d51d7391-af1b-4160-b3bb-c77d0507a0e0 for instance with vm_state active and task_state shelving.
Dec 01 19:20:23 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-98783905-057b-4760-8bb3-2fbb8c361523 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Lock "998daa1d-fd6a-4663-8df3-0683a9dbe142" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.483s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG nova.privsep.utils [None req-99c02dab-c891-49bd-b645-2ff3adf4044d tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75066) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-99c02dab-c891-49bd-b645-2ff3adf4044d tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpbvkix4zj/9dd7421cd4424993b6b81c401f0e9997.delta /opt/stack/data/nova/instances/snapshots/tmpbvkix4zj/9dd7421cd4424993b6b81c401f0e9997 {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:20:23 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Instance destroyed successfully.
Dec 01 19:20:23 user nova-compute[75066]: DEBUG nova.objects.instance [None req-5100cae8-33c1-46c6-9cef-c32f3425a937 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Lazy-loading 'resources' on Instance uuid 10fc72fa-64a3-4704-ad91-2e3ae88d5424 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG nova.compute.manager [req-759594dc-af82-4d69-9760-838d99f39676 req-39d2a1cf-744d-489b-962e-2cc85ec4323c service nova] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Received event network-changed-d51d7391-af1b-4160-b3bb-c77d0507a0e0 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG nova.compute.manager [req-759594dc-af82-4d69-9760-838d99f39676 req-39d2a1cf-744d-489b-962e-2cc85ec4323c service nova] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Refreshing instance network info cache due to event network-changed-d51d7391-af1b-4160-b3bb-c77d0507a0e0. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-759594dc-af82-4d69-9760-838d99f39676 req-39d2a1cf-744d-489b-962e-2cc85ec4323c service nova] Acquiring lock "refresh_cache-10fc72fa-64a3-4704-ad91-2e3ae88d5424" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-759594dc-af82-4d69-9760-838d99f39676 req-39d2a1cf-744d-489b-962e-2cc85ec4323c service nova] Acquired lock "refresh_cache-10fc72fa-64a3-4704-ad91-2e3ae88d5424" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG nova.network.neutron [req-759594dc-af82-4d69-9760-838d99f39676 req-39d2a1cf-744d-489b-962e-2cc85ec4323c service nova] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Refreshing network info cache for port d51d7391-af1b-4160-b3bb-c77d0507a0e0 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-5100cae8-33c1-46c6-9cef-c32f3425a937 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:18:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-599780298',display_name='tempest-TestShelveInstance-server-599780298',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-599780298',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOYMosdOMr3YsggFBWlatcebyefVvtCf4/e1UEHGdqfc/vbH6hEB++iXmGS2/+7YSOkIMjPRUBdmwX9FH/UkGY12pJtMicJWhONuHwVC52MSXXi4pg9ytKnzTre4nG3Ezg==',key_name='tempest-TestShelveInstance-1519500384',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:18:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f5b79591b18f4d35bdd99365c816b55c',ramdisk_id='',reservation_id='r-qdcti0kh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1574356427',owner_user_name='tempest-TestShelveInstance-1574356427-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:18:42Z,user_data=None,user_id='f1f8fb37cb13473b84de443c51815b1d',uuid=10fc72fa-64a3-4704-ad91-2e3ae88d5424,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d51d7391-af1b-4160-b3bb-c77d0507a0e0", "address": "fa:16:3e:e9:da:9e", "network": {"id": "4b17d46f-fdbc-4cd7-991c-ca6981e0f20f", "bridge": "br-int", "label": "tempest-TestShelveInstance-2081974203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5b79591b18f4d35bdd99365c816b55c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd51d7391-af", "ovs_interfaceid": "d51d7391-af1b-4160-b3bb-c77d0507a0e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-5100cae8-33c1-46c6-9cef-c32f3425a937 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Converting VIF {"id": "d51d7391-af1b-4160-b3bb-c77d0507a0e0", "address": "fa:16:3e:e9:da:9e", "network": {"id": "4b17d46f-fdbc-4cd7-991c-ca6981e0f20f", "bridge": "br-int", "label": "tempest-TestShelveInstance-2081974203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5b79591b18f4d35bdd99365c816b55c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd51d7391-af", "ovs_interfaceid": "d51d7391-af1b-4160-b3bb-c77d0507a0e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-5100cae8-33c1-46c6-9cef-c32f3425a937 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:da:9e,bridge_name='br-int',has_traffic_filtering=True,id=d51d7391-af1b-4160-b3bb-c77d0507a0e0,network=Network(4b17d46f-fdbc-4cd7-991c-ca6981e0f20f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd51d7391-af') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG os_vif [None req-5100cae8-33c1-46c6-9cef-c32f3425a937 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:da:9e,bridge_name='br-int',has_traffic_filtering=True,id=d51d7391-af1b-4160-b3bb-c77d0507a0e0,network=Network(4b17d46f-fdbc-4cd7-991c-ca6981e0f20f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd51d7391-af') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd51d7391-af, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b29774ee-ca81-4e21-af61-955ec7013301) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:23 user nova-compute[75066]: INFO os_vif [None req-5100cae8-33c1-46c6-9cef-c32f3425a937 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:da:9e,bridge_name='br-int',has_traffic_filtering=True,id=d51d7391-af1b-4160-b3bb-c77d0507a0e0,network=Network(4b17d46f-fdbc-4cd7-991c-ca6981e0f20f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd51d7391-af')
Dec 01 19:20:23 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5100cae8-33c1-46c6-9cef-c32f3425a937 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] calling os-brick to detach iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-5100cae8-33c1-46c6-9cef-c32f3425a937 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, {'target_iqn': 'iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wmuOJlqG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:20:23 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-5100cae8-33c1-46c6-9cef-c32f3425a937 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:20:23 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-5100cae8-33c1-46c6-9cef-c32f3425a937 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-5100cae8-33c1-46c6-9cef-c32f3425a937 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.037s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccfaefc4-73aa-41b9-ac65-9860e127fa8b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-5100cae8-33c1-46c6-9cef-c32f3425a937 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 19:20:23 user nova-compute[75066]: No targets found.
Dec 01 19:20:23 user nova-compute[75066]: iSNS:
Dec 01 19:20:23 user nova-compute[75066]: No targets found.
Dec 01 19:20:23 user nova-compute[75066]: STATIC:
Dec 01 19:20:23 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829
Dec 01 19:20:23 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:20:23 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:20:23 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa
Dec 01 19:20:23 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:20:23 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:20:23 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2
Dec 01 19:20:23 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:20:23 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:20:23 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c
Dec 01 19:20:23 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:20:23 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:20:23 user nova-compute[75066]: FIRMWARE:
Dec 01 19:20:23 user nova-compute[75066]: No targets found.
Dec 01 19:20:23 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-5100cae8-33c1-46c6-9cef-c32f3425a937 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 19:20:23 user nova-compute[75066]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 19:20:23 user nova-compute[75066]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75066) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-5100cae8-33c1-46c6-9cef-c32f3425a937 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c', 0)] {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ad5bad-61e5-49af-829d-af539299baae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f65b8d-0c93-4d80-9ea6-a6105fa16e23]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-5100cae8-33c1-46c6-9cef-c32f3425a937 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)
Dec 01 19:20:23 user nova-compute[75066]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)
Dec 01 19:20:23 user nova-compute[75066]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:20:23 user nova-compute[75066]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)
Dec 01 19:20:23 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-5100cae8-33c1-46c6-9cef-c32f3425a937 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)
Dec 01 19:20:23 user nova-compute[75066]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)
Dec 01 19:20:23 user nova-compute[75066]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:20:23 user nova-compute[75066]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)
Dec 01 19:20:23 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-5100cae8-33c1-46c6-9cef-c32f3425a937 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91901f7ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c'): ({'sdb'}, set())}) {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-5100cae8-33c1-46c6-9cef-c32f3425a937 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Removing single pathed devices sdb {{(pid=75066) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc8720d-a4a8-481f-bd71-c77459883030]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[b44ee83a-d5aa-4467-a662-46aba9180715]: (4, ('ok\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-5100cae8-33c1-46c6-9cef-c32f3425a937 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Flushing IO for device /dev/sdb {{(pid=75066) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.011s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[81fa5a29-1abe-467e-a022-aa56eecb88b2]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-5100cae8-33c1-46c6-9cef-c32f3425a937 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75066) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.089s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d2adac-821f-41e5-b121-c3df4a440b3b]: (4, ('1', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-5100cae8-33c1-46c6-9cef-c32f3425a937 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-5100cae8-33c1-46c6-9cef-c32f3425a937 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] SCSI volumes sdb have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-5100cae8-33c1-46c6-9cef-c32f3425a937 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c')] {{(pid=75066) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[339a17a2-7b20-4fbb-90c0-91d17423b246]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-5100cae8-33c1-46c6-9cef-c32f3425a937 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c -p 172.16.0.220:3260 --logout {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-99c02dab-c891-49bd-b645-2ff3adf4044d tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpbvkix4zj/9dd7421cd4424993b6b81c401f0e9997.delta /opt/stack/data/nova/instances/snapshots/tmpbvkix4zj/9dd7421cd4424993b6b81c401f0e9997" returned: 0 in 0.604s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:20:23 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-99c02dab-c891-49bd-b645-2ff3adf4044d tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Snapshot extracted, beginning image upload
Dec 01 19:20:23 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c -p 172.16.0.220:3260 --logout" returned: 0 in 0.093s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c64497-d74e-4990-9e39-5feabc8c1191]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-5100cae8-33c1-46c6-9cef-c32f3425a937 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c, portal: 172.16.0.220,3260]
Dec 01 19:20:23 user nova-compute[75066]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c, portal: 172.16.0.220,3260] successful.
Dec 01 19:20:23 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c -p 172.16.0.220:3260 --op delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[600e1803-31aa-4b79-b7ea-de36177ed36a]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-5100cae8-33c1-46c6-9cef-c32f3425a937 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-5100cae8-33c1-46c6-9cef-c32f3425a937 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.434s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-5100cae8-33c1-46c6-9cef-c32f3425a937 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] <== disconnect_volume: return (436ms) None {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:20:23 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5100cae8-33c1-46c6-9cef-c32f3425a937 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Disconnected iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 19:20:23 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-5100cae8-33c1-46c6-9cef-c32f3425a937 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Deleting instance files /opt/stack/data/nova/instances/10fc72fa-64a3-4704-ad91-2e3ae88d5424_del
Dec 01 19:20:23 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-5100cae8-33c1-46c6-9cef-c32f3425a937 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Deletion of /opt/stack/data/nova/instances/10fc72fa-64a3-4704-ad91-2e3ae88d5424_del complete
Dec 01 19:20:24 user nova-compute[75066]: DEBUG nova.network.neutron [req-759594dc-af82-4d69-9760-838d99f39676 req-39d2a1cf-744d-489b-962e-2cc85ec4323c service nova] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Updated VIF entry in instance network info cache for port d51d7391-af1b-4160-b3bb-c77d0507a0e0. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:20:24 user nova-compute[75066]: DEBUG nova.network.neutron [req-759594dc-af82-4d69-9760-838d99f39676 req-39d2a1cf-744d-489b-962e-2cc85ec4323c service nova] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Updating instance_info_cache with network_info: [{"id": "d51d7391-af1b-4160-b3bb-c77d0507a0e0", "address": "fa:16:3e:e9:da:9e", "network": {"id": "4b17d46f-fdbc-4cd7-991c-ca6981e0f20f", "bridge": null, "label": "tempest-TestShelveInstance-2081974203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5b79591b18f4d35bdd99365c816b55c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapd51d7391-af", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:20:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-759594dc-af82-4d69-9760-838d99f39676 req-39d2a1cf-744d-489b-962e-2cc85ec4323c service nova] Releasing lock "refresh_cache-10fc72fa-64a3-4704-ad91-2e3ae88d5424" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:20:25 user nova-compute[75066]: INFO nova.scheduler.client.report [None req-5100cae8-33c1-46c6-9cef-c32f3425a937 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Deleted allocations for instance 10fc72fa-64a3-4704-ad91-2e3ae88d5424
Dec 01 19:20:25 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5100cae8-33c1-46c6-9cef-c32f3425a937 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:20:25 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5100cae8-33c1-46c6-9cef-c32f3425a937 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:20:25 user nova-compute[75066]: DEBUG nova.objects.instance [None req-5100cae8-33c1-46c6-9cef-c32f3425a937 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Lazy-loading 'numa_topology' on Instance uuid 10fc72fa-64a3-4704-ad91-2e3ae88d5424 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:20:25 user nova-compute[75066]: DEBUG nova.objects.base [None req-5100cae8-33c1-46c6-9cef-c32f3425a937 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Object Instance<10fc72fa-64a3-4704-ad91-2e3ae88d5424> lazy-loaded attributes: resources,numa_topology {{(pid=75066) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 19:20:26 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-5100cae8-33c1-46c6-9cef-c32f3425a937 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:20:26 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-5100cae8-33c1-46c6-9cef-c32f3425a937 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:20:26 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5100cae8-33c1-46c6-9cef-c32f3425a937 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.858s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:20:26 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5100cae8-33c1-46c6-9cef-c32f3425a937 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Lock "10fc72fa-64a3-4704-ad91-2e3ae88d5424" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 5.794s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:20:26 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Acquiring lock "a553e030-0d69-4725-9f84-6c0c63556ed4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:20:26 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lock "a553e030-0d69-4725-9f84-6c0c63556ed4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:20:26 user nova-compute[75066]: DEBUG nova.compute.manager [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Starting instance... {{(pid=75066) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 19:20:26 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:20:26 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:20:26 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75066) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 19:20:26 user nova-compute[75066]: INFO nova.compute.claims [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Claim successful on node user
Dec 01 19:20:27 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:20:27 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:20:27 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.585s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:20:27 user nova-compute[75066]: DEBUG nova.compute.manager [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Start building networks asynchronously for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 19:20:27 user nova-compute[75066]: DEBUG nova.compute.manager [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Allocating IP information in the background. {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 19:20:27 user nova-compute[75066]: DEBUG nova.network.neutron [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] allocate_for_instance() {{(pid=75066) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 19:20:27 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 19:20:27 user nova-compute[75066]: DEBUG nova.compute.manager [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Start building block device mappings for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 19:20:27 user nova-compute[75066]: DEBUG nova.policy [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7c1a5012f94b43e38161f8c823173f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9caae5967744641b7490e1aa91973c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75066) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 19:20:27 user nova-compute[75066]: DEBUG nova.compute.manager [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Start spawning the instance on the hypervisor. {{(pid=75066) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 19:20:27 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Creating instance directory {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 19:20:27 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Creating image(s)
Dec 01 19:20:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Acquiring lock "/opt/stack/data/nova/instances/a553e030-0d69-4725-9f84-6c0c63556ed4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:20:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lock "/opt/stack/data/nova/instances/a553e030-0d69-4725-9f84-6c0c63556ed4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:20:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lock "/opt/stack/data/nova/instances/a553e030-0d69-4725-9f84-6c0c63556ed4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:20:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:20:27 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-99c02dab-c891-49bd-b645-2ff3adf4044d tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Snapshot image upload complete
Dec 01 19:20:27 user nova-compute[75066]: INFO nova.compute.manager [None req-99c02dab-c891-49bd-b645-2ff3adf4044d tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Took 7.97 seconds to snapshot the instance on the hypervisor.
Dec 01 19:20:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.201s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:20:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Acquiring lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:20:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:20:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:20:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.203s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:20:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/a553e030-0d69-4725-9f84-6c0c63556ed4/disk 1073741824 {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:20:28 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/a553e030-0d69-4725-9f84-6c0c63556ed4/disk 1073741824" returned: 0 in 0.051s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:20:28 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:20:28 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:20:28 user nova-compute[75066]: DEBUG nova.network.neutron [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Successfully created port: 0472fc48-19d0-4e5e-ac11-7c28e1ddd485 {{(pid=75066) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 19:20:28 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.226s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:20:28 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a553e030-0d69-4725-9f84-6c0c63556ed4/disk. size=1073741824 {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 19:20:28 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a553e030-0d69-4725-9f84-6c0c63556ed4/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:20:28 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a553e030-0d69-4725-9f84-6c0c63556ed4/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:20:28 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Cannot resize image /opt/stack/data/nova/instances/a553e030-0d69-4725-9f84-6c0c63556ed4/disk to a smaller size. {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 19:20:28 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Created local disks {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 19:20:28 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Ensure instance console log exists: /opt/stack/data/nova/instances/a553e030-0d69-4725-9f84-6c0c63556ed4/console.log {{(pid=75066) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 19:20:28 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:20:28 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:20:28 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:20:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:28 user nova-compute[75066]: DEBUG nova.network.neutron [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Successfully updated port: 0472fc48-19d0-4e5e-ac11-7c28e1ddd485 {{(pid=75066) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 19:20:28 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Acquiring lock "refresh_cache-a553e030-0d69-4725-9f84-6c0c63556ed4" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:20:28 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Acquired lock "refresh_cache-a553e030-0d69-4725-9f84-6c0c63556ed4" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:20:28 user nova-compute[75066]: DEBUG nova.network.neutron [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:20:28 user nova-compute[75066]: DEBUG nova.compute.manager [req-5af36400-b52e-4b53-9423-8355e8a9488a req-3402a284-e180-4de7-ab61-5487119ecff3 service nova] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Received event network-changed-0472fc48-19d0-4e5e-ac11-7c28e1ddd485 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:20:28 user nova-compute[75066]: DEBUG nova.compute.manager [req-5af36400-b52e-4b53-9423-8355e8a9488a req-3402a284-e180-4de7-ab61-5487119ecff3 service nova] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Refreshing instance network info cache due to event network-changed-0472fc48-19d0-4e5e-ac11-7c28e1ddd485. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:20:28 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-5af36400-b52e-4b53-9423-8355e8a9488a req-3402a284-e180-4de7-ab61-5487119ecff3 service nova] Acquiring lock "refresh_cache-a553e030-0d69-4725-9f84-6c0c63556ed4" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:20:28 user nova-compute[75066]: DEBUG nova.network.neutron [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:20:29 user nova-compute[75066]: DEBUG nova.network.neutron [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Updating instance_info_cache with network_info: [{"id": "0472fc48-19d0-4e5e-ac11-7c28e1ddd485", "address": "fa:16:3e:18:e9:73", "network": {"id": "191f13ce-a864-4c09-8ca5-e8a106e24d37", "bridge": "br-int", "label": "tempest-TestStampPattern-1604601756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9caae5967744641b7490e1aa91973c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0472fc48-19", "ovs_interfaceid": "0472fc48-19d0-4e5e-ac11-7c28e1ddd485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:20:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Releasing lock "refresh_cache-a553e030-0d69-4725-9f84-6c0c63556ed4" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:20:29 user nova-compute[75066]: DEBUG nova.compute.manager [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Instance network_info: |[{"id": "0472fc48-19d0-4e5e-ac11-7c28e1ddd485", "address": "fa:16:3e:18:e9:73", "network": {"id": "191f13ce-a864-4c09-8ca5-e8a106e24d37", "bridge": "br-int", "label": "tempest-TestStampPattern-1604601756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9caae5967744641b7490e1aa91973c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0472fc48-19", "ovs_interfaceid": "0472fc48-19d0-4e5e-ac11-7c28e1ddd485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 19:20:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-5af36400-b52e-4b53-9423-8355e8a9488a req-3402a284-e180-4de7-ab61-5487119ecff3 service nova] Acquired lock "refresh_cache-a553e030-0d69-4725-9f84-6c0c63556ed4" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:20:29 user nova-compute[75066]: DEBUG nova.network.neutron [req-5af36400-b52e-4b53-9423-8355e8a9488a req-3402a284-e180-4de7-ab61-5487119ecff3 service nova] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Refreshing network info cache for port 0472fc48-19d0-4e5e-ac11-7c28e1ddd485 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:20:29 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Start _get_guest_xml network_info=[{"id": "0472fc48-19d0-4e5e-ac11-7c28e1ddd485", "address": "fa:16:3e:18:e9:73", "network": {"id": "191f13ce-a864-4c09-8ca5-e8a106e24d37", "bridge": "br-int", "label": "tempest-TestStampPattern-1604601756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9caae5967744641b7490e1aa91973c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0472fc48-19", "ovs_interfaceid": "0472fc48-19d0-4e5e-ac11-7c28e1ddd485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'image_id': '900b237b-e99c-4fdd-a44f-dcb7a08baa86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:20:29 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:20:29 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:20:29 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:20:29 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:20:29 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:20:29 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:20:29 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:20:29 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:20:29 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:20:29 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:20:29 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:20:29 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:20:29 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:20:29 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:20:29 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:20:29 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:20:29 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:20:29 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:20:29 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:20:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1617344885',display_name='tempest-TestStampPattern-server-1617344885',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1617344885',id=18,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLSWelIBdKpY5tDhTVMPXRfCvQwvHNWZhGDeDhkjt6+GDQnshog1py5tqU+qYJowL71BLCNBO5cYXwkrz8pBEBbdzILknRNr0r/SkH7MZtJef4QVznd62i44CV3XthbMbQ==',key_name='tempest-TestStampPattern-1467755075',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9caae5967744641b7490e1aa91973c0',ramdisk_id='',reservation_id='r-6zps15ix',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-859706400',owner_user_name='tempest-TestStampPattern-859706400-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:20:27Z,user_data=None,user_id='7c1a5012f94b43e38161f8c823173f7f',uuid=a553e030-0d69-4725-9f84-6c0c63556ed4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0472fc48-19d0-4e5e-ac11-7c28e1ddd485", "address": "fa:16:3e:18:e9:73", "network": {"id": "191f13ce-a864-4c09-8ca5-e8a106e24d37", "bridge": "br-int", "label": "tempest-TestStampPattern-1604601756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9caae5967744641b7490e1aa91973c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0472fc48-19", "ovs_interfaceid": "0472fc48-19d0-4e5e-ac11-7c28e1ddd485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:20:29 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Converting VIF {"id": "0472fc48-19d0-4e5e-ac11-7c28e1ddd485", "address": "fa:16:3e:18:e9:73", "network": {"id": "191f13ce-a864-4c09-8ca5-e8a106e24d37", "bridge": "br-int", "label": "tempest-TestStampPattern-1604601756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9caae5967744641b7490e1aa91973c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0472fc48-19", "ovs_interfaceid": "0472fc48-19d0-4e5e-ac11-7c28e1ddd485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:20:29 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:e9:73,bridge_name='br-int',has_traffic_filtering=True,id=0472fc48-19d0-4e5e-ac11-7c28e1ddd485,network=Network(191f13ce-a864-4c09-8ca5-e8a106e24d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0472fc48-19') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:20:29 user nova-compute[75066]: DEBUG nova.objects.instance [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lazy-loading 'pci_devices' on Instance uuid a553e030-0d69-4725-9f84-6c0c63556ed4 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:20:29 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:20:29 user nova-compute[75066]:   <uuid>a553e030-0d69-4725-9f84-6c0c63556ed4</uuid>
Dec 01 19:20:29 user nova-compute[75066]:   <name>instance-00000012</name>
Dec 01 19:20:29 user nova-compute[75066]:   <memory>524288</memory>
Dec 01 19:20:29 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:20:29 user nova-compute[75066]:   <metadata>
Dec 01 19:20:29 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:20:29 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:20:29 user nova-compute[75066]:       <nova:name>tempest-TestStampPattern-server-1617344885</nova:name>
Dec 01 19:20:29 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:20:29</nova:creationTime>
Dec 01 19:20:29 user nova-compute[75066]:       <nova:flavor name="m1.tiny">
Dec 01 19:20:29 user nova-compute[75066]:         <nova:memory>512</nova:memory>
Dec 01 19:20:29 user nova-compute[75066]:         <nova:disk>1</nova:disk>
Dec 01 19:20:29 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:20:29 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:20:29 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:20:29 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:20:29 user nova-compute[75066]:       <nova:owner>
Dec 01 19:20:29 user nova-compute[75066]:         <nova:user uuid="7c1a5012f94b43e38161f8c823173f7f">tempest-TestStampPattern-859706400-project-member</nova:user>
Dec 01 19:20:29 user nova-compute[75066]:         <nova:project uuid="c9caae5967744641b7490e1aa91973c0">tempest-TestStampPattern-859706400</nova:project>
Dec 01 19:20:29 user nova-compute[75066]:       </nova:owner>
Dec 01 19:20:29 user nova-compute[75066]:       <nova:root type="image" uuid="900b237b-e99c-4fdd-a44f-dcb7a08baa86"/>
Dec 01 19:20:29 user nova-compute[75066]:       <nova:ports>
Dec 01 19:20:29 user nova-compute[75066]:         <nova:port uuid="0472fc48-19d0-4e5e-ac11-7c28e1ddd485">
Dec 01 19:20:29 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Dec 01 19:20:29 user nova-compute[75066]:         </nova:port>
Dec 01 19:20:29 user nova-compute[75066]:       </nova:ports>
Dec 01 19:20:29 user nova-compute[75066]:     </nova:instance>
Dec 01 19:20:29 user nova-compute[75066]:   </metadata>
Dec 01 19:20:29 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:20:29 user nova-compute[75066]:     <system>
Dec 01 19:20:29 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:20:29 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:20:29 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:20:29 user nova-compute[75066]:       <entry name="serial">a553e030-0d69-4725-9f84-6c0c63556ed4</entry>
Dec 01 19:20:29 user nova-compute[75066]:       <entry name="uuid">a553e030-0d69-4725-9f84-6c0c63556ed4</entry>
Dec 01 19:20:29 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:20:29 user nova-compute[75066]:     </system>
Dec 01 19:20:29 user nova-compute[75066]:   </sysinfo>
Dec 01 19:20:29 user nova-compute[75066]:   <os>
Dec 01 19:20:29 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:20:29 user nova-compute[75066]:     <boot dev="hd"/>
Dec 01 19:20:29 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:20:29 user nova-compute[75066]:   </os>
Dec 01 19:20:29 user nova-compute[75066]:   <features>
Dec 01 19:20:29 user nova-compute[75066]:     <acpi/>
Dec 01 19:20:29 user nova-compute[75066]:     <apic/>
Dec 01 19:20:29 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:20:29 user nova-compute[75066]:   </features>
Dec 01 19:20:29 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:20:29 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:20:29 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:20:29 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:20:29 user nova-compute[75066]:   </clock>
Dec 01 19:20:29 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:20:29 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:20:29 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:20:29 user nova-compute[75066]:   </cpu>
Dec 01 19:20:29 user nova-compute[75066]:   <devices>
Dec 01 19:20:29 user nova-compute[75066]:     <disk type="file" device="disk">
Dec 01 19:20:29 user nova-compute[75066]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 19:20:29 user nova-compute[75066]:       <source file="/opt/stack/data/nova/instances/a553e030-0d69-4725-9f84-6c0c63556ed4/disk"/>
Dec 01 19:20:29 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:20:29 user nova-compute[75066]:     </disk>
Dec 01 19:20:29 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:20:29 user nova-compute[75066]:       <mac address="fa:16:3e:18:e9:73"/>
Dec 01 19:20:29 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:20:29 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:20:29 user nova-compute[75066]:       <target dev="tap0472fc48-19"/>
Dec 01 19:20:29 user nova-compute[75066]:     </interface>
Dec 01 19:20:29 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:20:29 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/a553e030-0d69-4725-9f84-6c0c63556ed4/console.log" append="off"/>
Dec 01 19:20:29 user nova-compute[75066]:     </serial>
Dec 01 19:20:29 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:20:29 user nova-compute[75066]:     <video>
Dec 01 19:20:29 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:20:29 user nova-compute[75066]:     </video>
Dec 01 19:20:29 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:20:29 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:20:29 user nova-compute[75066]:     </rng>
Dec 01 19:20:29 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:20:29 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:20:29 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:20:29 user nova-compute[75066]:     </memballoon>
Dec 01 19:20:29 user nova-compute[75066]:   </devices>
Dec 01 19:20:29 user nova-compute[75066]: </domain>
Dec 01 19:20:29 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:20:29 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:20:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1617344885',display_name='tempest-TestStampPattern-server-1617344885',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1617344885',id=18,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLSWelIBdKpY5tDhTVMPXRfCvQwvHNWZhGDeDhkjt6+GDQnshog1py5tqU+qYJowL71BLCNBO5cYXwkrz8pBEBbdzILknRNr0r/SkH7MZtJef4QVznd62i44CV3XthbMbQ==',key_name='tempest-TestStampPattern-1467755075',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9caae5967744641b7490e1aa91973c0',ramdisk_id='',reservation_id='r-6zps15ix',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-859706400',owner_user_name='tempest-TestStampPattern-859706400-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:20:27Z,user_data=None,user_id='7c1a5012f94b43e38161f8c823173f7f',uuid=a553e030-0d69-4725-9f84-6c0c63556ed4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0472fc48-19d0-4e5e-ac11-7c28e1ddd485", "address": "fa:16:3e:18:e9:73", "network": {"id": "191f13ce-a864-4c09-8ca5-e8a106e24d37", "bridge": "br-int", "label": "tempest-TestStampPattern-1604601756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9caae5967744641b7490e1aa91973c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0472fc48-19", "ovs_interfaceid": "0472fc48-19d0-4e5e-ac11-7c28e1ddd485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:20:29 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Converting VIF {"id": "0472fc48-19d0-4e5e-ac11-7c28e1ddd485", "address": "fa:16:3e:18:e9:73", "network": {"id": "191f13ce-a864-4c09-8ca5-e8a106e24d37", "bridge": "br-int", "label": "tempest-TestStampPattern-1604601756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9caae5967744641b7490e1aa91973c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0472fc48-19", "ovs_interfaceid": "0472fc48-19d0-4e5e-ac11-7c28e1ddd485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:20:29 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:e9:73,bridge_name='br-int',has_traffic_filtering=True,id=0472fc48-19d0-4e5e-ac11-7c28e1ddd485,network=Network(191f13ce-a864-4c09-8ca5-e8a106e24d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0472fc48-19') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:20:29 user nova-compute[75066]: DEBUG os_vif [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:e9:73,bridge_name='br-int',has_traffic_filtering=True,id=0472fc48-19d0-4e5e-ac11-7c28e1ddd485,network=Network(191f13ce-a864-4c09-8ca5-e8a106e24d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0472fc48-19') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:20:29 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:29 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:20:29 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:20:29 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:29 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f8a01410-f699-50d3-9909-bf1278058b22', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:20:29 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:29 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:20:29 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:29 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0472fc48-19, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:20:29 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0472fc48-19, col_values=(('qos', UUID('9263affa-2c9b-4066-ba37-f1f924b2b58f')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:20:29 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0472fc48-19, col_values=(('external_ids', {'iface-id': '0472fc48-19d0-4e5e-ac11-7c28e1ddd485', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:e9:73', 'vm-uuid': 'a553e030-0d69-4725-9f84-6c0c63556ed4'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:20:29 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:29 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:20:29 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:29 user nova-compute[75066]: INFO os_vif [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:e9:73,bridge_name='br-int',has_traffic_filtering=True,id=0472fc48-19d0-4e5e-ac11-7c28e1ddd485,network=Network(191f13ce-a864-4c09-8ca5-e8a106e24d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0472fc48-19')
Dec 01 19:20:29 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:20:29 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] No VIF found with MAC fa:16:3e:18:e9:73, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:20:29 user nova-compute[75066]: DEBUG nova.network.neutron [req-5af36400-b52e-4b53-9423-8355e8a9488a req-3402a284-e180-4de7-ab61-5487119ecff3 service nova] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Updated VIF entry in instance network info cache for port 0472fc48-19d0-4e5e-ac11-7c28e1ddd485. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:20:29 user nova-compute[75066]: DEBUG nova.network.neutron [req-5af36400-b52e-4b53-9423-8355e8a9488a req-3402a284-e180-4de7-ab61-5487119ecff3 service nova] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Updating instance_info_cache with network_info: [{"id": "0472fc48-19d0-4e5e-ac11-7c28e1ddd485", "address": "fa:16:3e:18:e9:73", "network": {"id": "191f13ce-a864-4c09-8ca5-e8a106e24d37", "bridge": "br-int", "label": "tempest-TestStampPattern-1604601756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9caae5967744641b7490e1aa91973c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0472fc48-19", "ovs_interfaceid": "0472fc48-19d0-4e5e-ac11-7c28e1ddd485", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:20:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-5af36400-b52e-4b53-9423-8355e8a9488a req-3402a284-e180-4de7-ab61-5487119ecff3 service nova] Releasing lock "refresh_cache-a553e030-0d69-4725-9f84-6c0c63556ed4" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:20:31 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:31 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:31 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:31 user nova-compute[75066]: DEBUG nova.compute.manager [req-9770cc4d-4486-479f-b1d4-4ad605f6bc8b req-20a914fe-e85f-417b-ace5-4213de04c225 service nova] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Received event network-vif-plugged-0472fc48-19d0-4e5e-ac11-7c28e1ddd485 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:20:31 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-9770cc4d-4486-479f-b1d4-4ad605f6bc8b req-20a914fe-e85f-417b-ace5-4213de04c225 service nova] Acquiring lock "a553e030-0d69-4725-9f84-6c0c63556ed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:20:31 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-9770cc4d-4486-479f-b1d4-4ad605f6bc8b req-20a914fe-e85f-417b-ace5-4213de04c225 service nova] Lock "a553e030-0d69-4725-9f84-6c0c63556ed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:20:31 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-9770cc4d-4486-479f-b1d4-4ad605f6bc8b req-20a914fe-e85f-417b-ace5-4213de04c225 service nova] Lock "a553e030-0d69-4725-9f84-6c0c63556ed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:20:31 user nova-compute[75066]: DEBUG nova.compute.manager [req-9770cc4d-4486-479f-b1d4-4ad605f6bc8b req-20a914fe-e85f-417b-ace5-4213de04c225 service nova] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] No waiting events found dispatching network-vif-plugged-0472fc48-19d0-4e5e-ac11-7c28e1ddd485 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:20:31 user nova-compute[75066]: WARNING nova.compute.manager [req-9770cc4d-4486-479f-b1d4-4ad605f6bc8b req-20a914fe-e85f-417b-ace5-4213de04c225 service nova] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Received unexpected event network-vif-plugged-0472fc48-19d0-4e5e-ac11-7c28e1ddd485 for instance with vm_state building and task_state spawning.
Dec 01 19:20:32 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:32 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:32 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:32 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:32 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:32 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:33 user nova-compute[75066]: DEBUG nova.compute.manager [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Instance event wait completed in 0 seconds for  {{(pid=75066) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 19:20:33 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Guest created on hypervisor {{(pid=75066) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 19:20:33 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Instance spawned successfully.
Dec 01 19:20:33 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 19:20:33 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Found default for hw_cdrom_bus of ide {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:20:33 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Found default for hw_disk_bus of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:20:33 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Found default for hw_input_bus of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:20:33 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Found default for hw_pointer_model of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:20:33 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Found default for hw_video_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:20:33 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Found default for hw_vif_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:20:33 user nova-compute[75066]: DEBUG nova.compute.manager [req-c320db29-afa5-4ec8-ba1e-10e66518d4f7 req-c2e6fc64-1d3d-4e2a-b88b-13b0f716a1dd service nova] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Received event network-vif-plugged-0472fc48-19d0-4e5e-ac11-7c28e1ddd485 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:20:33 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-c320db29-afa5-4ec8-ba1e-10e66518d4f7 req-c2e6fc64-1d3d-4e2a-b88b-13b0f716a1dd service nova] Acquiring lock "a553e030-0d69-4725-9f84-6c0c63556ed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:20:33 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-c320db29-afa5-4ec8-ba1e-10e66518d4f7 req-c2e6fc64-1d3d-4e2a-b88b-13b0f716a1dd service nova] Lock "a553e030-0d69-4725-9f84-6c0c63556ed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:20:33 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-c320db29-afa5-4ec8-ba1e-10e66518d4f7 req-c2e6fc64-1d3d-4e2a-b88b-13b0f716a1dd service nova] Lock "a553e030-0d69-4725-9f84-6c0c63556ed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:20:33 user nova-compute[75066]: DEBUG nova.compute.manager [req-c320db29-afa5-4ec8-ba1e-10e66518d4f7 req-c2e6fc64-1d3d-4e2a-b88b-13b0f716a1dd service nova] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] No waiting events found dispatching network-vif-plugged-0472fc48-19d0-4e5e-ac11-7c28e1ddd485 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:20:33 user nova-compute[75066]: WARNING nova.compute.manager [req-c320db29-afa5-4ec8-ba1e-10e66518d4f7 req-c2e6fc64-1d3d-4e2a-b88b-13b0f716a1dd service nova] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Received unexpected event network-vif-plugged-0472fc48-19d0-4e5e-ac11-7c28e1ddd485 for instance with vm_state building and task_state spawning.
Dec 01 19:20:33 user nova-compute[75066]: INFO nova.compute.manager [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Took 6.23 seconds to spawn the instance on the hypervisor.
Dec 01 19:20:33 user nova-compute[75066]: DEBUG nova.compute.manager [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:20:33 user nova-compute[75066]: INFO nova.compute.manager [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Took 7.26 seconds to build instance.
Dec 01 19:20:33 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-69f09454-fd6c-43a1-826c-e160e9d36407 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lock "a553e030-0d69-4725-9f84-6c0c63556ed4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.377s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:20:34 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:37 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:39 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:42 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:44 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:46 user nova-compute[75066]: DEBUG nova.compute.manager [req-1bd6140a-6ca9-449c-a723-b5e1f4b2220f req-d6f19d11-bfbe-49ab-ac5a-ca2745fb6d94 service nova] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Received event network-changed-01c08ead-7eed-4e1a-839a-234fce1ba605 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:20:46 user nova-compute[75066]: DEBUG nova.compute.manager [req-1bd6140a-6ca9-449c-a723-b5e1f4b2220f req-d6f19d11-bfbe-49ab-ac5a-ca2745fb6d94 service nova] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Refreshing instance network info cache due to event network-changed-01c08ead-7eed-4e1a-839a-234fce1ba605. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:20:46 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-1bd6140a-6ca9-449c-a723-b5e1f4b2220f req-d6f19d11-bfbe-49ab-ac5a-ca2745fb6d94 service nova] Acquiring lock "refresh_cache-3d340166-c58b-4213-b8d3-5036ade48d2d" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:20:46 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-1bd6140a-6ca9-449c-a723-b5e1f4b2220f req-d6f19d11-bfbe-49ab-ac5a-ca2745fb6d94 service nova] Acquired lock "refresh_cache-3d340166-c58b-4213-b8d3-5036ade48d2d" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:20:46 user nova-compute[75066]: DEBUG nova.network.neutron [req-1bd6140a-6ca9-449c-a723-b5e1f4b2220f req-d6f19d11-bfbe-49ab-ac5a-ca2745fb6d94 service nova] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Refreshing network info cache for port 01c08ead-7eed-4e1a-839a-234fce1ba605 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:20:46 user nova-compute[75066]: DEBUG nova.network.neutron [req-1bd6140a-6ca9-449c-a723-b5e1f4b2220f req-d6f19d11-bfbe-49ab-ac5a-ca2745fb6d94 service nova] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Updated VIF entry in instance network info cache for port 01c08ead-7eed-4e1a-839a-234fce1ba605. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:20:46 user nova-compute[75066]: DEBUG nova.network.neutron [req-1bd6140a-6ca9-449c-a723-b5e1f4b2220f req-d6f19d11-bfbe-49ab-ac5a-ca2745fb6d94 service nova] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Updating instance_info_cache with network_info: [{"id": "01c08ead-7eed-4e1a-839a-234fce1ba605", "address": "fa:16:3e:6e:53:26", "network": {"id": "9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-696310557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0f7516d1db4dd5bc7d77a0bd1d44d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01c08ead-7e", "ovs_interfaceid": "01c08ead-7eed-4e1a-839a-234fce1ba605", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:20:47 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a03d68d5-8e39-4af6-a1c0-4359e7669510 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Acquiring lock "3d340166-c58b-4213-b8d3-5036ade48d2d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:20:47 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a03d68d5-8e39-4af6-a1c0-4359e7669510 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "3d340166-c58b-4213-b8d3-5036ade48d2d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:20:47 user nova-compute[75066]: DEBUG nova.objects.instance [None req-a03d68d5-8e39-4af6-a1c0-4359e7669510 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lazy-loading 'flavor' on Instance uuid 3d340166-c58b-4213-b8d3-5036ade48d2d {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:20:47 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-1bd6140a-6ca9-449c-a723-b5e1f4b2220f req-d6f19d11-bfbe-49ab-ac5a-ca2745fb6d94 service nova] Releasing lock "refresh_cache-3d340166-c58b-4213-b8d3-5036ade48d2d" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:20:47 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a03d68d5-8e39-4af6-a1c0-4359e7669510 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "3d340166-c58b-4213-b8d3-5036ade48d2d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:20:47 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:47 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a03d68d5-8e39-4af6-a1c0-4359e7669510 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Acquiring lock "3d340166-c58b-4213-b8d3-5036ade48d2d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:20:47 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a03d68d5-8e39-4af6-a1c0-4359e7669510 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "3d340166-c58b-4213-b8d3-5036ade48d2d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:20:47 user nova-compute[75066]: INFO nova.compute.manager [None req-a03d68d5-8e39-4af6-a1c0-4359e7669510 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Attaching volume 60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc to /dev/vdb
Dec 01 19:20:47 user nova-compute[75066]: DEBUG os_brick.utils [None req-a03d68d5-8e39-4af6-a1c0-4359e7669510 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:20:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:20:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:20:47 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[955efe90-a852-4ecd-b7fc-264cf2de1a87]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1959854982f\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:20:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:20:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:20:47 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[af54cfda-5353-4bf9-ba7a-a68053276ccc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:20:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:20:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:20:47 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[816d3f8f-98e3-4cc1-8e7c-83ea56d8532d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:20:47 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae97466-ee7e-46a0-8dc5-83d5a7f4454e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:20:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-a03d68d5-8e39-4af6-a1c0-4359e7669510 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Running cmd (subprocess): nvme version {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:20:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-a03d68d5-8e39-4af6-a1c0-4359e7669510 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] 'nvme version' failed. Not Retrying. {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:20:47 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a03d68d5-8e39-4af6-a1c0-4359e7669510 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] nvme not present on system {{(pid=75066) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 19:20:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:20:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:20:47 user nova-compute[75066]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 19:20:47 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[14644a03-cb4e-4de4-a588-7b0055913c99]: (4, '') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:20:47 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-a03d68d5-8e39-4af6-a1c0-4359e7669510 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75066) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 19:20:47 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-a03d68d5-8e39-4af6-a1c0-4359e7669510 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 19:20:47 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-a03d68d5-8e39-4af6-a1c0-4359e7669510 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] LIGHTOS: no hostnqn found. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 19:20:47 user nova-compute[75066]: DEBUG os_brick.utils [None req-a03d68d5-8e39-4af6-a1c0-4359e7669510 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1959854982f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:20:47 user nova-compute[75066]: DEBUG nova.virt.block_device [None req-a03d68d5-8e39-4af6-a1c0-4359e7669510 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Updating existing volume attachment record: cfa8c891-df3e-4738-b1f8-251b8323c50f {{(pid=75066) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 19:20:49 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:53 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:20:54 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:57 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a03d68d5-8e39-4af6-a1c0-4359e7669510 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Calling os-brick to attach iSCSI Volume {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 19:20:57 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-a03d68d5-8e39-4af6-a1c0-4359e7669510 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dkMvfRXG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:20:57 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-a03d68d5-8e39-4af6-a1c0-4359e7669510 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:20:57 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-a03d68d5-8e39-4af6-a1c0-4359e7669510 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:20:57 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-a03d68d5-8e39-4af6-a1c0-4359e7669510 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:20:57 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-a03d68d5-8e39-4af6-a1c0-4359e7669510 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:20:57 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-a03d68d5-8e39-4af6-a1c0-4359e7669510 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:20:57 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-a03d68d5-8e39-4af6-a1c0-4359e7669510 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:20:57 user nova-compute[75066]: INFO os_brick.initiator.connectors.iscsi [None req-a03d68d5-8e39-4af6-a1c0-4359e7669510 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 19:20:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc -p 172.16.0.220:3260 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:20:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:20:57 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[0458cb11-ba8c-42f8-8951-db63dc700526]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:20:57 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-a03d68d5-8e39-4af6-a1c0-4359e7669510 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 19:20:57 user nova-compute[75066]:  {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:20:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc -p 172.16.0.220:3260 --interface default --op new {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:20:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:20:57 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[5107b4e2-7cbe-4b8c-986d-89997b843a8d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc] added\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:20:57 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-a03d68d5-8e39-4af6-a1c0-4359e7669510 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc] added
Dec 01 19:20:57 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:20:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:20:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:20:57 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[4378e672-8d9d-490b-b4bb-8b45045def01]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:20:57 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-a03d68d5-8e39-4af6-a1c0-4359e7669510 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:20:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:20:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:20:57 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf017641-6804-479e-8208-a959c93a538c]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:20:57 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-a03d68d5-8e39-4af6-a1c0-4359e7669510 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:20:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dkMvfRXG {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:20:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dkMvfRXG" returned: 0 in 0.027s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:20:57 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c00c95-8a39-46c2-81dd-5f10caa37c48]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:20:57 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-a03d68d5-8e39-4af6-a1c0-4359e7669510 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dkMvfRXG'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:20:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:20:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:20:57 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a45ea37-244d-475f-87ca-d6f8f55bb188]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:20:57 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-a03d68d5-8e39-4af6-a1c0-4359e7669510 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:20:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:20:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:20:57 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c861182-9e5a-44d3-9150-75aa5c14d76e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:20:57 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-a03d68d5-8e39-4af6-a1c0-4359e7669510 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)
Dec 01 19:20:57 user nova-compute[75066]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:20:57 user nova-compute[75066]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)
Dec 01 19:20:57 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:20:57 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-a03d68d5-8e39-4af6-a1c0-4359e7669510 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)
Dec 01 19:20:57 user nova-compute[75066]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:20:57 user nova-compute[75066]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)
Dec 01 19:20:57 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:20:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc -p 172.16.0.220:3260 --login {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:20:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:20:57 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca36eb94-eee7-460a-ab17-c9f389b97046]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:20:57 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-a03d68d5-8e39-4af6-a1c0-4359e7669510 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc, portal: 172.16.0.220,3260]
Dec 01 19:20:57 user nova-compute[75066]: Login to [iface: default, target: iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc, portal: 172.16.0.220,3260] successful.
Dec 01 19:20:57 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:20:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:20:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:20:57 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[e69de21c-bd8f-4d75-b041-4889a2729b02]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:20:57 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-a03d68d5-8e39-4af6-a1c0-4359e7669510 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:20:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:20:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:20:57 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[580fe0d2-3624-4a2d-b913-090c2950a349]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:20:57 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-a03d68d5-8e39-4af6-a1c0-4359e7669510 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)
Dec 01 19:20:57 user nova-compute[75066]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:20:57 user nova-compute[75066]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)
Dec 01 19:20:57 user nova-compute[75066]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)
Dec 01 19:20:57 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:20:57 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-a03d68d5-8e39-4af6-a1c0-4359e7669510 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)
Dec 01 19:20:57 user nova-compute[75066]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:20:57 user nova-compute[75066]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)
Dec 01 19:20:57 user nova-compute[75066]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)
Dec 01 19:20:57 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:20:57 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-a03d68d5-8e39-4af6-a1c0-4359e7669510 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:20:57 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-a03d68d5-8e39-4af6-a1c0-4359e7669510 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Connected to 172.16.0.220:3260 {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 19:20:57 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-a03d68d5-8e39-4af6-a1c0-4359e7669510 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] HCTL ('33', '-', '-', 0) found on session 17 with lun 0 {{(pid=75066) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 19:20:57 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-a03d68d5-8e39-4af6-a1c0-4359e7669510 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75066) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 19:20:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:20:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:20:57 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c15816-ec18-4a6f-adb2-7208b05ae6f2]: (4, ('- - 0', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:20:57 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-a03d68d5-8e39-4af6-a1c0-4359e7669510 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:20:57 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-a03d68d5-8e39-4af6-a1c0-4359e7669510 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dkMvfRXG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 19:20:57 user nova-compute[75066]: INFO nova.compute.manager [None req-55e3edf4-5cb0-4cb1-a774-8ef3ee5cd479 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Unrescuing
Dec 01 19:20:57 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-55e3edf4-5cb0-4cb1-a774-8ef3ee5cd479 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Acquiring lock "refresh_cache-67c5dd7c-88aa-4f2f-8f62-a9af0480c38e" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:20:57 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-55e3edf4-5cb0-4cb1-a774-8ef3ee5cd479 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Acquired lock "refresh_cache-67c5dd7c-88aa-4f2f-8f62-a9af0480c38e" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:20:57 user nova-compute[75066]: DEBUG nova.network.neutron [None req-55e3edf4-5cb0-4cb1-a774-8ef3ee5cd479 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:20:58 user nova-compute[75066]: DEBUG nova.network.neutron [None req-55e3edf4-5cb0-4cb1-a774-8ef3ee5cd479 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Updating instance_info_cache with network_info: [{"id": "73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2", "address": "fa:16:3e:5a:73:a4", "network": {"id": "fdb3c017-aafb-4c3e-a08c-a73a68be9f70", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1696445417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "306d3049e90647fa9f1c90a104eac0e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bdff9a-3a", "ovs_interfaceid": "73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:20:58 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-55e3edf4-5cb0-4cb1-a774-8ef3ee5cd479 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Releasing lock "refresh_cache-67c5dd7c-88aa-4f2f-8f62-a9af0480c38e" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:20:58 user nova-compute[75066]: DEBUG nova.objects.instance [None req-55e3edf4-5cb0-4cb1-a774-8ef3ee5cd479 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Lazy-loading 'flavor' on Instance uuid 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:20:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:20:58 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:20:58 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:20:58 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-a03d68d5-8e39-4af6-a1c0-4359e7669510 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:20:58 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-a03d68d5-8e39-4af6-a1c0-4359e7669510 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] <== connect_volume: return (1374ms) {'type': 'block', 'scsi_wwn': '23166636337666265', 'path': '/dev/sdb'} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:20:58 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a03d68d5-8e39-4af6-a1c0-4359e7669510 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23166636337666265', 'path': '/dev/sdb'} {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 19:20:58 user nova-compute[75066]: DEBUG nova.objects.instance [None req-a03d68d5-8e39-4af6-a1c0-4359e7669510 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lazy-loading 'flavor' on Instance uuid 3d340166-c58b-4213-b8d3-5036ade48d2d {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:20:58 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-a03d68d5-8e39-4af6-a1c0-4359e7669510 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 19:20:58 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:20:58 user nova-compute[75066]:   <source dev="/dev/sdb"/>
Dec 01 19:20:58 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:20:58 user nova-compute[75066]:   <serial>60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc</serial>
Dec 01 19:20:58 user nova-compute[75066]: </disk>
Dec 01 19:20:58 user nova-compute[75066]:  {{(pid=75066) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 19:20:58 user nova-compute[75066]: DEBUG nova.compute.manager [req-456f1e8a-f1d8-4743-badf-ffae7bff08bf req-9c27e8f5-0038-4f5d-af90-04d817a574ed service nova] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Received event network-vif-unplugged-73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:20:58 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-456f1e8a-f1d8-4743-badf-ffae7bff08bf req-9c27e8f5-0038-4f5d-af90-04d817a574ed service nova] Acquiring lock "67c5dd7c-88aa-4f2f-8f62-a9af0480c38e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:20:58 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-456f1e8a-f1d8-4743-badf-ffae7bff08bf req-9c27e8f5-0038-4f5d-af90-04d817a574ed service nova] Lock "67c5dd7c-88aa-4f2f-8f62-a9af0480c38e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:20:58 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-456f1e8a-f1d8-4743-badf-ffae7bff08bf req-9c27e8f5-0038-4f5d-af90-04d817a574ed service nova] Lock "67c5dd7c-88aa-4f2f-8f62-a9af0480c38e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:20:58 user nova-compute[75066]: DEBUG nova.compute.manager [req-456f1e8a-f1d8-4743-badf-ffae7bff08bf req-9c27e8f5-0038-4f5d-af90-04d817a574ed service nova] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] No waiting events found dispatching network-vif-unplugged-73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:20:58 user nova-compute[75066]: WARNING nova.compute.manager [req-456f1e8a-f1d8-4743-badf-ffae7bff08bf req-9c27e8f5-0038-4f5d-af90-04d817a574ed service nova] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Received unexpected event network-vif-unplugged-73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2 for instance with vm_state rescued and task_state unrescuing.
Dec 01 19:20:59 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Instance destroyed successfully.
Dec 01 19:20:59 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-a03d68d5-8e39-4af6-a1c0-4359e7669510 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:20:59 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-a03d68d5-8e39-4af6-a1c0-4359e7669510 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:20:59 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-a03d68d5-8e39-4af6-a1c0-4359e7669510 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] No VIF found with MAC fa:16:3e:6e:53:26, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:20:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a03d68d5-8e39-4af6-a1c0-4359e7669510 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "3d340166-c58b-4213-b8d3-5036ade48d2d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.126s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:20:59 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:00 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:00 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:21:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:21:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:21:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:21:00 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75066) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 19:21:00 user nova-compute[75066]: DEBUG nova.compute.manager [req-a14899a8-4912-44bf-8c42-cac3614ebccc req-eaad70cf-2297-43f8-8756-e4936c5adf9f service nova] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Received event network-vif-plugged-73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:21:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a14899a8-4912-44bf-8c42-cac3614ebccc req-eaad70cf-2297-43f8-8756-e4936c5adf9f service nova] Acquiring lock "67c5dd7c-88aa-4f2f-8f62-a9af0480c38e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:21:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a14899a8-4912-44bf-8c42-cac3614ebccc req-eaad70cf-2297-43f8-8756-e4936c5adf9f service nova] Lock "67c5dd7c-88aa-4f2f-8f62-a9af0480c38e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:21:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a14899a8-4912-44bf-8c42-cac3614ebccc req-eaad70cf-2297-43f8-8756-e4936c5adf9f service nova] Lock "67c5dd7c-88aa-4f2f-8f62-a9af0480c38e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:21:00 user nova-compute[75066]: DEBUG nova.compute.manager [req-a14899a8-4912-44bf-8c42-cac3614ebccc req-eaad70cf-2297-43f8-8756-e4936c5adf9f service nova] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] No waiting events found dispatching network-vif-plugged-73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:21:00 user nova-compute[75066]: WARNING nova.compute.manager [req-a14899a8-4912-44bf-8c42-cac3614ebccc req-eaad70cf-2297-43f8-8756-e4936c5adf9f service nova] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Received unexpected event network-vif-plugged-73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2 for instance with vm_state rescued and task_state unrescuing.
Dec 01 19:21:00 user nova-compute[75066]: DEBUG nova.compute.manager [req-a14899a8-4912-44bf-8c42-cac3614ebccc req-eaad70cf-2297-43f8-8756-e4936c5adf9f service nova] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Received event network-changed-73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:21:00 user nova-compute[75066]: DEBUG nova.compute.manager [req-a14899a8-4912-44bf-8c42-cac3614ebccc req-eaad70cf-2297-43f8-8756-e4936c5adf9f service nova] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Refreshing instance network info cache due to event network-changed-73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:21:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a14899a8-4912-44bf-8c42-cac3614ebccc req-eaad70cf-2297-43f8-8756-e4936c5adf9f service nova] Acquiring lock "refresh_cache-67c5dd7c-88aa-4f2f-8f62-a9af0480c38e" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:21:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a14899a8-4912-44bf-8c42-cac3614ebccc req-eaad70cf-2297-43f8-8756-e4936c5adf9f service nova] Acquired lock "refresh_cache-67c5dd7c-88aa-4f2f-8f62-a9af0480c38e" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:21:00 user nova-compute[75066]: DEBUG nova.network.neutron [req-a14899a8-4912-44bf-8c42-cac3614ebccc req-eaad70cf-2297-43f8-8756-e4936c5adf9f service nova] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Refreshing network info cache for port 73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:21:00 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:00 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:00 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:01 user nova-compute[75066]: DEBUG nova.network.neutron [req-a14899a8-4912-44bf-8c42-cac3614ebccc req-eaad70cf-2297-43f8-8756-e4936c5adf9f service nova] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Updated VIF entry in instance network info cache for port 73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:21:01 user nova-compute[75066]: DEBUG nova.network.neutron [req-a14899a8-4912-44bf-8c42-cac3614ebccc req-eaad70cf-2297-43f8-8756-e4936c5adf9f service nova] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Updating instance_info_cache with network_info: [{"id": "73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2", "address": "fa:16:3e:5a:73:a4", "network": {"id": "fdb3c017-aafb-4c3e-a08c-a73a68be9f70", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1696445417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "306d3049e90647fa9f1c90a104eac0e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bdff9a-3a", "ovs_interfaceid": "73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:21:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a14899a8-4912-44bf-8c42-cac3614ebccc req-eaad70cf-2297-43f8-8756-e4936c5adf9f service nova] Releasing lock "refresh_cache-67c5dd7c-88aa-4f2f-8f62-a9af0480c38e" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:21:01 user nova-compute[75066]: DEBUG nova.compute.manager [req-a14899a8-4912-44bf-8c42-cac3614ebccc req-eaad70cf-2297-43f8-8756-e4936c5adf9f service nova] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Received event network-changed-73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:21:01 user nova-compute[75066]: DEBUG nova.compute.manager [req-a14899a8-4912-44bf-8c42-cac3614ebccc req-eaad70cf-2297-43f8-8756-e4936c5adf9f service nova] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Refreshing instance network info cache due to event network-changed-73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:21:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a14899a8-4912-44bf-8c42-cac3614ebccc req-eaad70cf-2297-43f8-8756-e4936c5adf9f service nova] Acquiring lock "refresh_cache-67c5dd7c-88aa-4f2f-8f62-a9af0480c38e" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:21:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a14899a8-4912-44bf-8c42-cac3614ebccc req-eaad70cf-2297-43f8-8756-e4936c5adf9f service nova] Acquired lock "refresh_cache-67c5dd7c-88aa-4f2f-8f62-a9af0480c38e" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:21:01 user nova-compute[75066]: DEBUG nova.network.neutron [req-a14899a8-4912-44bf-8c42-cac3614ebccc req-eaad70cf-2297-43f8-8756-e4936c5adf9f service nova] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Refreshing network info cache for port 73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:21:01 user nova-compute[75066]: INFO nova.compute.manager [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Rebuilding instance
Dec 01 19:21:01 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:01 user nova-compute[75066]: DEBUG nova.compute.manager [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:21:01 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:01 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:01 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:01 user nova-compute[75066]: DEBUG nova.compute.manager [req-d0d25faa-807c-4467-8ae9-218c9be2b210 req-322d3cec-a591-4c48-be1c-2e6a519e7e03 service nova] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Received event network-vif-unplugged-01c08ead-7eed-4e1a-839a-234fce1ba605 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:21:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d0d25faa-807c-4467-8ae9-218c9be2b210 req-322d3cec-a591-4c48-be1c-2e6a519e7e03 service nova] Acquiring lock "3d340166-c58b-4213-b8d3-5036ade48d2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:21:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d0d25faa-807c-4467-8ae9-218c9be2b210 req-322d3cec-a591-4c48-be1c-2e6a519e7e03 service nova] Lock "3d340166-c58b-4213-b8d3-5036ade48d2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:21:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d0d25faa-807c-4467-8ae9-218c9be2b210 req-322d3cec-a591-4c48-be1c-2e6a519e7e03 service nova] Lock "3d340166-c58b-4213-b8d3-5036ade48d2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:21:01 user nova-compute[75066]: DEBUG nova.compute.manager [req-d0d25faa-807c-4467-8ae9-218c9be2b210 req-322d3cec-a591-4c48-be1c-2e6a519e7e03 service nova] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] No waiting events found dispatching network-vif-unplugged-01c08ead-7eed-4e1a-839a-234fce1ba605 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:21:01 user nova-compute[75066]: WARNING nova.compute.manager [req-d0d25faa-807c-4467-8ae9-218c9be2b210 req-322d3cec-a591-4c48-be1c-2e6a519e7e03 service nova] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Received unexpected event network-vif-unplugged-01c08ead-7eed-4e1a-839a-234fce1ba605 for instance with vm_state active and task_state rebuilding.
Dec 01 19:21:01 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:01 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG nova.network.neutron [req-a14899a8-4912-44bf-8c42-cac3614ebccc req-eaad70cf-2297-43f8-8756-e4936c5adf9f service nova] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Updated VIF entry in instance network info cache for port 73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG nova.network.neutron [req-a14899a8-4912-44bf-8c42-cac3614ebccc req-eaad70cf-2297-43f8-8756-e4936c5adf9f service nova] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Updating instance_info_cache with network_info: [{"id": "73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2", "address": "fa:16:3e:5a:73:a4", "network": {"id": "fdb3c017-aafb-4c3e-a08c-a73a68be9f70", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1696445417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "306d3049e90647fa9f1c90a104eac0e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bdff9a-3a", "ovs_interfaceid": "73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a14899a8-4912-44bf-8c42-cac3614ebccc req-eaad70cf-2297-43f8-8756-e4936c5adf9f service nova] Releasing lock "refresh_cache-67c5dd7c-88aa-4f2f-8f62-a9af0480c38e" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d340166-c58b-4213-b8d3-5036ade48d2d/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:02 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Instance destroyed successfully.
Dec 01 19:21:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d340166-c58b-4213-b8d3-5036ade48d2d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d340166-c58b-4213-b8d3-5036ade48d2d/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:02 user nova-compute[75066]: INFO nova.compute.manager [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Detaching volume 60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc
Dec 01 19:21:02 user nova-compute[75066]: INFO nova.virt.block_device [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Attempting to driver detach volume 60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc from mountpoint /dev/vdb
Dec 01 19:21:02 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Attempting to detach device vdb from instance 3d340166-c58b-4213-b8d3-5036ade48d2d from the persistent domain config. {{(pid=75066) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 19:21:02 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:21:02 user nova-compute[75066]:   <source dev="/dev/sdb"/>
Dec 01 19:21:02 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:21:02 user nova-compute[75066]:   <serial>60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc</serial>
Dec 01 19:21:02 user nova-compute[75066]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 19:21:02 user nova-compute[75066]: </disk>
Dec 01 19:21:02 user nova-compute[75066]:  {{(pid=75066) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 19:21:02 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Successfully detached device vdb from instance 3d340166-c58b-4213-b8d3-5036ade48d2d from the persistent domain config.
Dec 01 19:21:02 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] calling os-brick to detach iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, {'target_iqn': 'iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dkMvfRXG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:21:02 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 01 19:21:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG nova.compute.manager [req-3f5e145f-7951-4ec3-b260-a29b0ed1d4dc req-9e9a3f8c-df92-49f9-af26-722b3a3a961b service nova] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Received event network-vif-plugged-73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-3f5e145f-7951-4ec3-b260-a29b0ed1d4dc req-9e9a3f8c-df92-49f9-af26-722b3a3a961b service nova] Acquiring lock "67c5dd7c-88aa-4f2f-8f62-a9af0480c38e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-3f5e145f-7951-4ec3-b260-a29b0ed1d4dc req-9e9a3f8c-df92-49f9-af26-722b3a3a961b service nova] Lock "67c5dd7c-88aa-4f2f-8f62-a9af0480c38e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-3f5e145f-7951-4ec3-b260-a29b0ed1d4dc req-9e9a3f8c-df92-49f9-af26-722b3a3a961b service nova] Lock "67c5dd7c-88aa-4f2f-8f62-a9af0480c38e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG nova.compute.manager [req-3f5e145f-7951-4ec3-b260-a29b0ed1d4dc req-9e9a3f8c-df92-49f9-af26-722b3a3a961b service nova] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] No waiting events found dispatching network-vif-plugged-73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:21:02 user nova-compute[75066]: WARNING nova.compute.manager [req-3f5e145f-7951-4ec3-b260-a29b0ed1d4dc req-9e9a3f8c-df92-49f9-af26-722b3a3a961b service nova] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Received unexpected event network-vif-plugged-73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2 for instance with vm_state rescued and task_state unrescuing.
Dec 01 19:21:02 user nova-compute[75066]: DEBUG nova.compute.manager [req-3f5e145f-7951-4ec3-b260-a29b0ed1d4dc req-9e9a3f8c-df92-49f9-af26-722b3a3a961b service nova] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Received event network-vif-plugged-73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-3f5e145f-7951-4ec3-b260-a29b0ed1d4dc req-9e9a3f8c-df92-49f9-af26-722b3a3a961b service nova] Acquiring lock "67c5dd7c-88aa-4f2f-8f62-a9af0480c38e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-3f5e145f-7951-4ec3-b260-a29b0ed1d4dc req-9e9a3f8c-df92-49f9-af26-722b3a3a961b service nova] Lock "67c5dd7c-88aa-4f2f-8f62-a9af0480c38e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-3f5e145f-7951-4ec3-b260-a29b0ed1d4dc req-9e9a3f8c-df92-49f9-af26-722b3a3a961b service nova] Lock "67c5dd7c-88aa-4f2f-8f62-a9af0480c38e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG nova.compute.manager [req-3f5e145f-7951-4ec3-b260-a29b0ed1d4dc req-9e9a3f8c-df92-49f9-af26-722b3a3a961b service nova] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] No waiting events found dispatching network-vif-plugged-73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:21:02 user nova-compute[75066]: WARNING nova.compute.manager [req-3f5e145f-7951-4ec3-b260-a29b0ed1d4dc req-9e9a3f8c-df92-49f9-af26-722b3a3a961b service nova] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Received unexpected event network-vif-plugged-73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2 for instance with vm_state rescued and task_state unrescuing.
Dec 01 19:21:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d104a62-63fa-4628-b6c3-32c2283af08d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 19:21:02 user nova-compute[75066]: No targets found.
Dec 01 19:21:02 user nova-compute[75066]: iSNS:
Dec 01 19:21:02 user nova-compute[75066]: No targets found.
Dec 01 19:21:02 user nova-compute[75066]: STATIC:
Dec 01 19:21:02 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829
Dec 01 19:21:02 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:21:02 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:21:02 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa
Dec 01 19:21:02 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:21:02 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:21:02 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2
Dec 01 19:21:02 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:21:02 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:21:02 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc
Dec 01 19:21:02 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:21:02 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:21:02 user nova-compute[75066]: FIRMWARE:
Dec 01 19:21:02 user nova-compute[75066]: No targets found.
Dec 01 19:21:02 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 19:21:02 user nova-compute[75066]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 19:21:02 user nova-compute[75066]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75066) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc', 0)] {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d340166-c58b-4213-b8d3-5036ade48d2d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf01835-8775-4315-9553-b4fa07c53880]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8678448-6fc0-4862-8b52-f1fa4342ef3c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)
Dec 01 19:21:02 user nova-compute[75066]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:21:02 user nova-compute[75066]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)
Dec 01 19:21:02 user nova-compute[75066]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)
Dec 01 19:21:02 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)
Dec 01 19:21:02 user nova-compute[75066]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:21:02 user nova-compute[75066]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)
Dec 01 19:21:02 user nova-compute[75066]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)
Dec 01 19:21:02 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91901d3880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc'): ({'sdb'}, set())}) {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Removing single pathed devices sdb {{(pid=75066) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8ac4df-2705-48ce-8649-3f0bceb9ada9]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e02d6f-3f43-45e3-a0bf-4579b58714b2]: (4, ('ok\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Flushing IO for device /dev/sdb {{(pid=75066) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[db39acd0-08ea-4417-90ff-725136c3d87a]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75066) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9cc692b-ef51-41de-b1e7-f7383683ebcb]: (4, ('1', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] SCSI volumes sdb have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc')] {{(pid=75066) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ec9e88-aa26-46d9-a625-465e8db1b931]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc -p 172.16.0.220:3260 --logout {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[7751875c-b8cd-4610-9c60-e33f55f520b7]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc, portal: 172.16.0.220,3260]
Dec 01 19:21:02 user nova-compute[75066]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc, portal: 172.16.0.220,3260] successful.
Dec 01 19:21:02 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc -p 172.16.0.220:3260 --op delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ef7954-8fda-4328-a38e-3a1bd2a1f9d8]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.371s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] <== disconnect_volume: return (375ms) None {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:21:02 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Disconnected iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 19:21:03 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:03 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67c5dd7c-88aa-4f2f-8f62-a9af0480c38e/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:03 user nova-compute[75066]: DEBUG nova.compute.manager [None req-55e3edf4-5cb0-4cb1-a774-8ef3ee5cd479 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:21:03 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67c5dd7c-88aa-4f2f-8f62-a9af0480c38e/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:03 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67c5dd7c-88aa-4f2f-8f62-a9af0480c38e/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:03 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:03 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67c5dd7c-88aa-4f2f-8f62-a9af0480c38e/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:03 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:21:03 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d86a5a-c62e-41f7-9f33-1a0c61af6a49/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:03 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d86a5a-c62e-41f7-9f33-1a0c61af6a49/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:03 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d86a5a-c62e-41f7-9f33-1a0c61af6a49/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:03 user nova-compute[75066]: DEBUG nova.compute.manager [req-67841028-6750-479a-a42d-83167dc92ffa req-f63742a8-6769-4882-a8d0-4471084110f2 service nova] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Received event network-vif-plugged-01c08ead-7eed-4e1a-839a-234fce1ba605 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:21:03 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-67841028-6750-479a-a42d-83167dc92ffa req-f63742a8-6769-4882-a8d0-4471084110f2 service nova] Acquiring lock "3d340166-c58b-4213-b8d3-5036ade48d2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:21:03 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-67841028-6750-479a-a42d-83167dc92ffa req-f63742a8-6769-4882-a8d0-4471084110f2 service nova] Lock "3d340166-c58b-4213-b8d3-5036ade48d2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:21:03 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-67841028-6750-479a-a42d-83167dc92ffa req-f63742a8-6769-4882-a8d0-4471084110f2 service nova] Lock "3d340166-c58b-4213-b8d3-5036ade48d2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:21:03 user nova-compute[75066]: DEBUG nova.compute.manager [req-67841028-6750-479a-a42d-83167dc92ffa req-f63742a8-6769-4882-a8d0-4471084110f2 service nova] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] No waiting events found dispatching network-vif-plugged-01c08ead-7eed-4e1a-839a-234fce1ba605 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:21:03 user nova-compute[75066]: WARNING nova.compute.manager [req-67841028-6750-479a-a42d-83167dc92ffa req-f63742a8-6769-4882-a8d0-4471084110f2 service nova] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Received unexpected event network-vif-plugged-01c08ead-7eed-4e1a-839a-234fce1ba605 for instance with vm_state active and task_state rebuilding.
Dec 01 19:21:03 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d86a5a-c62e-41f7-9f33-1a0c61af6a49/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:03 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/998daa1d-fd6a-4663-8df3-0683a9dbe142/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:04 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Instance destroyed successfully.
Dec 01 19:21:04 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:18:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-88799949',display_name='tempest-ServerActionsTestOtherA-server-59047600',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-88799949',id=13,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeOjka3O2yOSG7PgvQxwfceH9ScZixOK/oKEDoZu88X4E6S58dhbFi5q4+c/guiL9cBe6OBGVWUQ58KJXvXMJo6fjs42odNZigfHcTvBLGpR1adq29cPDQW/Rp9UoL0ag==',key_name='tempest-keypair-202509697',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:19:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fb0f7516d1db4dd5bc7d77a0bd1d44d7',ramdisk_id='',reservation_id='r-dyxm9b0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1700253921',owner_user_name='tempest-ServerActionsTestOtherA-1700253921-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:21:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfb3e7b4b0444223af282b16da9bd919',uuid=3d340166-c58b-4213-b8d3-5036ade48d2d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01c08ead-7eed-4e1a-839a-234fce1ba605", "address": "fa:16:3e:6e:53:26", "network": {"id": "9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-696310557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0f7516d1db4dd5bc7d77a0bd1d44d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01c08ead-7e", "ovs_interfaceid": "01c08ead-7eed-4e1a-839a-234fce1ba605", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:21:04 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Converting VIF {"id": "01c08ead-7eed-4e1a-839a-234fce1ba605", "address": "fa:16:3e:6e:53:26", "network": {"id": "9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-696310557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0f7516d1db4dd5bc7d77a0bd1d44d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01c08ead-7e", "ovs_interfaceid": "01c08ead-7eed-4e1a-839a-234fce1ba605", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:21:04 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:53:26,bridge_name='br-int',has_traffic_filtering=True,id=01c08ead-7eed-4e1a-839a-234fce1ba605,network=Network(9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01c08ead-7e') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:21:04 user nova-compute[75066]: DEBUG os_vif [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:53:26,bridge_name='br-int',has_traffic_filtering=True,id=01c08ead-7eed-4e1a-839a-234fce1ba605,network=Network(9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01c08ead-7e') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:21:04 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:04 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap01c08ead-7e, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:21:04 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:04 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:21:04 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:04 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:04 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2e7e3202-6060-4d3a-8928-714e7e406c66) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:21:04 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:04 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:04 user nova-compute[75066]: INFO os_vif [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:53:26,bridge_name='br-int',has_traffic_filtering=True,id=01c08ead-7eed-4e1a-839a-234fce1ba605,network=Network(9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01c08ead-7e')
Dec 01 19:21:04 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] calling os-brick to detach iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 19:21:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, {'target_iqn': 'iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dkMvfRXG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:21:04 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 01 19:21:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:21:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:21:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:04 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8171a8f-ed5b-4b75-9e76-16d58fccd91f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 19:21:04 user nova-compute[75066]: No targets found.
Dec 01 19:21:04 user nova-compute[75066]: iSNS:
Dec 01 19:21:04 user nova-compute[75066]: No targets found.
Dec 01 19:21:04 user nova-compute[75066]: STATIC:
Dec 01 19:21:04 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829
Dec 01 19:21:04 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:21:04 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:21:04 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa
Dec 01 19:21:04 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:21:04 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:21:04 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2
Dec 01 19:21:04 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:21:04 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:21:04 user nova-compute[75066]: FIRMWARE:
Dec 01 19:21:04 user nova-compute[75066]: No targets found.
Dec 01 19:21:04 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:21:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 19:21:04 user nova-compute[75066]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 19:21:04 user nova-compute[75066]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75066) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 19:21:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc', 0)] {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 19:21:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:04 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a55a0b9-0ec1-4a16-b017-5862611f6c49]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:04 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[9541f674-c27e-4815-91d6-33c0a8cdbc48]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)
Dec 01 19:21:04 user nova-compute[75066]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:21:04 user nova-compute[75066]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)
Dec 01 19:21:04 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:21:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)
Dec 01 19:21:04 user nova-compute[75066]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:21:04 user nova-compute[75066]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)
Dec 01 19:21:04 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:21:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91901f51b0>, {}) {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 19:21:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Disconnecting from: [] {{(pid=75066) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 19:21:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.083s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:21:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] <== disconnect_volume: return (85ms) None {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:21:04 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Disconnected iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 19:21:04 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Deleting instance files /opt/stack/data/nova/instances/3d340166-c58b-4213-b8d3-5036ade48d2d_del
Dec 01 19:21:04 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Deletion of /opt/stack/data/nova/instances/3d340166-c58b-4213-b8d3-5036ade48d2d_del complete
Dec 01 19:21:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/998daa1d-fd6a-4663-8df3-0683a9dbe142/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/998daa1d-fd6a-4663-8df3-0683a9dbe142/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:04 user nova-compute[75066]: INFO nova.virt.block_device [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Booting with volume 60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc at /dev/vdb
Dec 01 19:21:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/998daa1d-fd6a-4663-8df3-0683a9dbe142/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:04 user nova-compute[75066]: DEBUG os_brick.utils [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:21:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:04 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bec444c-5492-4058-8cab-e61727f9166e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1959854982f\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:04 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb3c084-7260-421d-8b0b-ab454dccac8d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:04 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[8acffd4f-7785-44af-b383-40ab2812161d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:04 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1f4a11-4b32-4f9b-adcd-591af1bce41e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Running cmd (subprocess): nvme version {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] 'nvme version' failed. Not Retrying. {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:21:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] nvme not present on system {{(pid=75066) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 19:21:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:21:04 user nova-compute[75066]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 19:21:04 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[585635c0-5843-4a59-b920-2a8596858669]: (4, '') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75066) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 19:21:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 19:21:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] LIGHTOS: no hostnqn found. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 19:21:04 user nova-compute[75066]: DEBUG os_brick.utils [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1959854982f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:21:04 user nova-compute[75066]: DEBUG nova.virt.block_device [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Updating existing volume attachment record: 37a8c6b1-a062-4c73-a0e8-ef1d674c29ce {{(pid=75066) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 19:21:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:04 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:21:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-cab2e3b0-5aa1-44e0-a776-e707534ce3bf tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Acquiring lock "c3ceeca4-c16c-4cf5-adfd-7d5a2925f435" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:21:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-cab2e3b0-5aa1-44e0-a776-e707534ce3bf tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "c3ceeca4-c16c-4cf5-adfd-7d5a2925f435" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:21:05 user nova-compute[75066]: INFO nova.compute.manager [None req-cab2e3b0-5aa1-44e0-a776-e707534ce3bf tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Detaching volume f32073d6-c4aa-49cc-a329-e000fd930829
Dec 01 19:21:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:05 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:21:05 user nova-compute[75066]: INFO nova.virt.block_device [None req-cab2e3b0-5aa1-44e0-a776-e707534ce3bf tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Attempting to driver detach volume f32073d6-c4aa-49cc-a329-e000fd930829 from mountpoint /dev/vdb
Dec 01 19:21:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a553e030-0d69-4725-9f84-6c0c63556ed4/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:05 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-cab2e3b0-5aa1-44e0-a776-e707534ce3bf tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Attempting to detach device vdb from instance c3ceeca4-c16c-4cf5-adfd-7d5a2925f435 from the persistent domain config. {{(pid=75066) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 19:21:05 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-cab2e3b0-5aa1-44e0-a776-e707534ce3bf tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 19:21:05 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:21:05 user nova-compute[75066]:   <source dev="/dev/sde"/>
Dec 01 19:21:05 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:21:05 user nova-compute[75066]:   <serial>f32073d6-c4aa-49cc-a329-e000fd930829</serial>
Dec 01 19:21:05 user nova-compute[75066]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 01 19:21:05 user nova-compute[75066]: </disk>
Dec 01 19:21:05 user nova-compute[75066]:  {{(pid=75066) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 19:21:05 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-cab2e3b0-5aa1-44e0-a776-e707534ce3bf tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Successfully detached device vdb from instance c3ceeca4-c16c-4cf5-adfd-7d5a2925f435 from the persistent domain config.
Dec 01 19:21:05 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-cab2e3b0-5aa1-44e0-a776-e707534ce3bf tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c3ceeca4-c16c-4cf5-adfd-7d5a2925f435 from the live domain config. {{(pid=75066) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 19:21:05 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-cab2e3b0-5aa1-44e0-a776-e707534ce3bf tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 19:21:05 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:21:05 user nova-compute[75066]:   <source dev="/dev/sde"/>
Dec 01 19:21:05 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:21:05 user nova-compute[75066]:   <serial>f32073d6-c4aa-49cc-a329-e000fd930829</serial>
Dec 01 19:21:05 user nova-compute[75066]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 01 19:21:05 user nova-compute[75066]: </disk>
Dec 01 19:21:05 user nova-compute[75066]:  {{(pid=75066) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 19:21:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a553e030-0d69-4725-9f84-6c0c63556ed4/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a553e030-0d69-4725-9f84-6c0c63556ed4/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:05 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a553e030-0d69-4725-9f84-6c0c63556ed4/disk --force-share --output=json" returned: 0 in 0.295s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:06 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-cab2e3b0-5aa1-44e0-a776-e707534ce3bf tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c3ceeca4-c16c-4cf5-adfd-7d5a2925f435 {{(pid=75066) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 19:21:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:06 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Port 478e7aea-9546-4659-bdac-09213bd9cb82 binding to destination host user is already ACTIVE {{(pid=75066) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Dec 01 19:21:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Acquiring lock "refresh_cache-dd546862-fcd5-4b69-8ea3-a8fa4859a489" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:21:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Acquired lock "refresh_cache-dd546862-fcd5-4b69-8ea3-a8fa4859a489" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:21:06 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:21:06 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:21:06 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:21:06 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Hypervisor/Node resource view: name=user free_ram=7171MB free_disk=25.004032135009766GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75066) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 19:21:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:21:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:21:06 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Applying migration context for instance dd546862-fcd5-4b69-8ea3-a8fa4859a489 as it has an incoming, in-progress migration 302310ba-671b-4252-8786-3afb5d194147. Migration status is reverting {{(pid=75066) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Dec 01 19:21:06 user nova-compute[75066]: INFO nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Updating resource usage from migration 302310ba-671b-4252-8786-3afb5d194147
Dec 01 19:21:07 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:21:07 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance c223be70-8b9c-46d4-9b5a-3b83dfc05a17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:21:07 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance c3ceeca4-c16c-4cf5-adfd-7d5a2925f435 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:21:07 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 90c49be6-97aa-45f1-bcbe-b9a3875226a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:21:07 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 3d340166-c58b-4213-b8d3-5036ade48d2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:21:07 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Migration 302310ba-671b-4252-8786-3afb5d194147 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Dec 01 19:21:07 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance dd546862-fcd5-4b69-8ea3-a8fa4859a489 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:21:07 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance b7d86a5a-c62e-41f7-9f33-1a0c61af6a49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:21:07 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance d564b128-598b-4ad4-8618-afa4dc8a7347 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:21:07 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 14de9d20-9e66-4517-b904-2967e0a06a97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:21:07 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 998daa1d-fd6a-4663-8df3-0683a9dbe142 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:21:07 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance a553e030-0d69-4725-9f84-6c0c63556ed4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:21:07 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 19:21:07 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=31GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 19:21:07 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Refreshing inventories for resource provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 01 19:21:07 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Updating ProviderTree inventory for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 01 19:21:07 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Updating inventory in ProviderTree for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 01 19:21:07 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Refreshing aggregate associations for resource provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62, aggregates: None {{(pid=75066) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 01 19:21:07 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Updating instance_info_cache with network_info: [{"id": "478e7aea-9546-4659-bdac-09213bd9cb82", "address": "fa:16:3e:9a:26:f6", "network": {"id": "d182d3d1-113a-4bf5-b325-f073247f0547", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-325272674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2830de7697db4d5e8b9c358dab7f4368", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap478e7aea-95", "ovs_interfaceid": "478e7aea-9546-4659-bdac-09213bd9cb82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:21:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Releasing lock "refresh_cache-dd546862-fcd5-4b69-8ea3-a8fa4859a489" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:21:07 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Refreshing trait associations for resource provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62, traits: COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SECURITY_UEFI_SECURE_BOOT {{(pid=75066) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 01 19:21:07 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Creating tmpfile /opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489/tmpixp2kkm9 to verify with other compute node that the instance is on the same shared storage. {{(pid=75066) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Dec 01 19:21:07 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:07 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:07 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:07 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:07 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:07 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:07 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:21:07 user nova-compute[75066]: DEBUG nova.compute.manager [req-f5c37267-0ea1-4e79-b9a3-b4fd78033f70 req-3a2329d6-a302-4cc2-9162-c5a34baee0e7 service nova] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Received event network-vif-unplugged-478e7aea-9546-4659-bdac-09213bd9cb82 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:21:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-f5c37267-0ea1-4e79-b9a3-b4fd78033f70 req-3a2329d6-a302-4cc2-9162-c5a34baee0e7 service nova] Acquiring lock "dd546862-fcd5-4b69-8ea3-a8fa4859a489-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:21:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-f5c37267-0ea1-4e79-b9a3-b4fd78033f70 req-3a2329d6-a302-4cc2-9162-c5a34baee0e7 service nova] Lock "dd546862-fcd5-4b69-8ea3-a8fa4859a489-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:21:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-f5c37267-0ea1-4e79-b9a3-b4fd78033f70 req-3a2329d6-a302-4cc2-9162-c5a34baee0e7 service nova] Lock "dd546862-fcd5-4b69-8ea3-a8fa4859a489-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:21:07 user nova-compute[75066]: DEBUG nova.compute.manager [req-f5c37267-0ea1-4e79-b9a3-b4fd78033f70 req-3a2329d6-a302-4cc2-9162-c5a34baee0e7 service nova] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] No waiting events found dispatching network-vif-unplugged-478e7aea-9546-4659-bdac-09213bd9cb82 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:21:07 user nova-compute[75066]: WARNING nova.compute.manager [req-f5c37267-0ea1-4e79-b9a3-b4fd78033f70 req-3a2329d6-a302-4cc2-9162-c5a34baee0e7 service nova] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Received unexpected event network-vif-unplugged-478e7aea-9546-4659-bdac-09213bd9cb82 for instance with vm_state resized and task_state resize_reverting.
Dec 01 19:21:07 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:21:07 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Compute_service record updated for user:user {{(pid=75066) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 19:21:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.943s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:21:07 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:21:07 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Cleaning up deleted instances {{(pid=75066) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 01 19:21:07 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] There are 0 instances to clean {{(pid=75066) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 01 19:21:07 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:21:07 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75066) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 01 19:21:08 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Instance destroyed successfully.
Dec 01 19:21:08 user nova-compute[75066]: DEBUG nova.objects.instance [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Lazy-loading 'resources' on Instance uuid dd546862-fcd5-4b69-8ea3-a8fa4859a489 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:21:08 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:15:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-360735581',display_name='tempest-ServerActionsTestOtherB-server-360735581',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-360735581',id=5,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOGqD/77ZPXT6+uFjy9YkzZfO6BpJHbV+zzx/mIYY08bckUat50Cdx1l30v4s1jcybtm106xn+eO4W484wI5lg1LoXDJHliGvHVijdeGBF2TMVA7/KP/EGT4mweXKritFQ==',key_name='tempest-keypair-842148615',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:19:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2830de7697db4d5e8b9c358dab7f4368',ramdisk_id='',reservation_id='r-tl7vmif9',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2122210178',owner_user_name='tempest-ServerActionsTestOtherB-2122210178-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:19:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e363b559098f48d4bc5478c657d7de6a',uuid=dd546862-fcd5-4b69-8ea3-a8fa4859a489,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "478e7aea-9546-4659-bdac-09213bd9cb82", "address": "fa:16:3e:9a:26:f6", "network": {"id": "d182d3d1-113a-4bf5-b325-f073247f0547", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-325272674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2830de7697db4d5e8b9c358dab7f4368", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap478e7aea-95", "ovs_interfaceid": "478e7aea-9546-4659-bdac-09213bd9cb82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:21:08 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Converting VIF {"id": "478e7aea-9546-4659-bdac-09213bd9cb82", "address": "fa:16:3e:9a:26:f6", "network": {"id": "d182d3d1-113a-4bf5-b325-f073247f0547", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-325272674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2830de7697db4d5e8b9c358dab7f4368", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap478e7aea-95", "ovs_interfaceid": "478e7aea-9546-4659-bdac-09213bd9cb82", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:21:08 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:26:f6,bridge_name='br-int',has_traffic_filtering=True,id=478e7aea-9546-4659-bdac-09213bd9cb82,network=Network(d182d3d1-113a-4bf5-b325-f073247f0547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap478e7aea-95') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:21:08 user nova-compute[75066]: DEBUG os_vif [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:26:f6,bridge_name='br-int',has_traffic_filtering=True,id=478e7aea-9546-4659-bdac-09213bd9cb82,network=Network(d182d3d1-113a-4bf5-b325-f073247f0547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap478e7aea-95') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:21:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap478e7aea-95, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:21:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:21:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=425ed131-c69b-489d-82d4-2833c65994ef) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:21:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:21:08 user nova-compute[75066]: INFO os_vif [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:26:f6,bridge_name='br-int',has_traffic_filtering=True,id=478e7aea-9546-4659-bdac-09213bd9cb82,network=Network(d182d3d1-113a-4bf5-b325-f073247f0547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap478e7aea-95')
Dec 01 19:21:08 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] calling os-brick to detach iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 19:21:08 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, {'target_iqn': 'iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gUkyhEaX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:21:08 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:21:08 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:21:08 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:21:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:08 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[4814518c-ed06-4f0e-bc09-4e92f98f9a5e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:08 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 19:21:08 user nova-compute[75066]: No targets found.
Dec 01 19:21:08 user nova-compute[75066]: iSNS:
Dec 01 19:21:08 user nova-compute[75066]: No targets found.
Dec 01 19:21:08 user nova-compute[75066]: STATIC:
Dec 01 19:21:08 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829
Dec 01 19:21:08 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:21:08 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:21:08 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa
Dec 01 19:21:08 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:21:08 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:21:08 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2
Dec 01 19:21:08 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:21:08 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:21:08 user nova-compute[75066]: FIRMWARE:
Dec 01 19:21:08 user nova-compute[75066]: No targets found.
Dec 01 19:21:08 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:21:08 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 19:21:08 user nova-compute[75066]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 19:21:08 user nova-compute[75066]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75066) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 19:21:08 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2', 0)] {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 19:21:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:08 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[53876b6d-538d-433a-86a7-85e004b21cdf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:08 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73e7efb-3c18-4499-b613-f9614f8f69e2]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:08 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)
Dec 01 19:21:08 user nova-compute[75066]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:21:08 user nova-compute[75066]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)
Dec 01 19:21:08 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:21:08 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)
Dec 01 19:21:08 user nova-compute[75066]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:21:08 user nova-compute[75066]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)
Dec 01 19:21:08 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:21:08 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f919017e320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2'): ({'sdd'}, set())}) {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 19:21:08 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Removing single pathed devices sdd {{(pid=75066) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 19:21:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:08 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb502856-50b5-4377-8d6b-50127bd2c440]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:08 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96ee23d-a8d8-4231-a1bc-ca26659ee919]: (4, ('ok\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:08 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Flushing IO for device /dev/sdd {{(pid=75066) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 19:21:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:08 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e564045-36d0-4b13-9f8a-f7bc3c5c47f0]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:08 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75066) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 19:21:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.036s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:08 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d334211-035e-4e57-83ed-fcc33e4aba5e]: (4, ('1', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:08 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 19:21:08 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] SCSI volumes sdd have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 19:21:08 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2')] {{(pid=75066) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 19:21:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:08 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a91ebe5-cf1d-45d4-9b4f-fd89a5eacabe]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:08 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:21:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 -p 172.16.0.220:3260 --logout {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:08 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[85389acf-9f82-4c78-b2e6-d8d48b6e305c]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:08 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2, portal: 172.16.0.220,3260]
Dec 01 19:21:08 user nova-compute[75066]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2, portal: 172.16.0.220,3260] successful.
Dec 01 19:21:08 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:21:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 -p 172.16.0.220:3260 --op delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:08 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4a68ec-51fa-4219-90a1-77bc1c4fd7b0]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:08 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:21:08 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:21:08 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] <== disconnect_volume: return (308ms) None {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:21:08 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Disconnected iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 19:21:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:21:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:21:09 user nova-compute[75066]: DEBUG nova.objects.instance [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Lazy-loading 'migration_context' on Instance uuid dd546862-fcd5-4b69-8ea3-a8fa4859a489 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:21:09 user nova-compute[75066]: DEBUG nova.objects.base [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Object Instance<dd546862-fcd5-4b69-8ea3-a8fa4859a489> lazy-loaded attributes: resources,migration_context {{(pid=75066) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 19:21:09 user nova-compute[75066]: DEBUG nova.compute.manager [req-1b46d0de-9e20-4f2a-a0a7-efcfad904ea0 req-cf0369e9-58ef-4461-8817-c61a982bc02b service nova] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Received event network-vif-plugged-478e7aea-9546-4659-bdac-09213bd9cb82 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:21:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-1b46d0de-9e20-4f2a-a0a7-efcfad904ea0 req-cf0369e9-58ef-4461-8817-c61a982bc02b service nova] Acquiring lock "dd546862-fcd5-4b69-8ea3-a8fa4859a489-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:21:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-1b46d0de-9e20-4f2a-a0a7-efcfad904ea0 req-cf0369e9-58ef-4461-8817-c61a982bc02b service nova] Lock "dd546862-fcd5-4b69-8ea3-a8fa4859a489-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:21:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-1b46d0de-9e20-4f2a-a0a7-efcfad904ea0 req-cf0369e9-58ef-4461-8817-c61a982bc02b service nova] Lock "dd546862-fcd5-4b69-8ea3-a8fa4859a489-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:21:09 user nova-compute[75066]: DEBUG nova.compute.manager [req-1b46d0de-9e20-4f2a-a0a7-efcfad904ea0 req-cf0369e9-58ef-4461-8817-c61a982bc02b service nova] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] No waiting events found dispatching network-vif-plugged-478e7aea-9546-4659-bdac-09213bd9cb82 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:21:09 user nova-compute[75066]: WARNING nova.compute.manager [req-1b46d0de-9e20-4f2a-a0a7-efcfad904ea0 req-cf0369e9-58ef-4461-8817-c61a982bc02b service nova] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Received unexpected event network-vif-plugged-478e7aea-9546-4659-bdac-09213bd9cb82 for instance with vm_state resized and task_state resize_reverting.
Dec 01 19:21:09 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:21:09 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:21:09 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Starting heal instance info cache {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 19:21:09 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:21:09 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:21:09 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Didn't find any instances for network info cache update. {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 01 19:21:09 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:21:09 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:21:09 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:21:09 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:21:09 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:21:09 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75066) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 19:21:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.518s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:21:10 user nova-compute[75066]: INFO nova.compute.manager [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Swapping old allocation on dict_keys(['8f57eb82-1921-43e1-b4a8-f85f2894ae62']) held by migration 302310ba-671b-4252-8786-3afb5d194147 for instance
Dec 01 19:21:10 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Overwriting current allocation {'allocations': {'8f57eb82-1921-43e1-b4a8-f85f2894ae62': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 22}}, 'project_id': '2830de7697db4d5e8b9c358dab7f4368', 'user_id': 'e363b559098f48d4bc5478c657d7de6a', 'consumer_generation': 1} on consumer dd546862-fcd5-4b69-8ea3-a8fa4859a489 {{(pid=75066) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Dec 01 19:21:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Acquiring lock "refresh_cache-dd546862-fcd5-4b69-8ea3-a8fa4859a489" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:21:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Acquired lock "refresh_cache-dd546862-fcd5-4b69-8ea3-a8fa4859a489" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:21:10 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:21:11 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Updating instance_info_cache with network_info: [{"id": "478e7aea-9546-4659-bdac-09213bd9cb82", "address": "fa:16:3e:9a:26:f6", "network": {"id": "d182d3d1-113a-4bf5-b325-f073247f0547", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-325272674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2830de7697db4d5e8b9c358dab7f4368", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap478e7aea-95", "ovs_interfaceid": "478e7aea-9546-4659-bdac-09213bd9cb82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:21:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Releasing lock "refresh_cache-dd546862-fcd5-4b69-8ea3-a8fa4859a489" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:21:11 user nova-compute[75066]: DEBUG os_brick.utils [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:21:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:11 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f3935a-2300-436a-a1bb-d6f8d3c7293c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1959854982f\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.042s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:11 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1aecf30-035a-4a71-8b05-df2f2cbf1415]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:11 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4cfa6a-2bc4-43a1-9067-870b05ffed71]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:11 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16aee39-bcf1-4712-8440-ef7e42bdc3ed]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Running cmd (subprocess): nvme version {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] 'nvme version' failed. Not Retrying. {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:21:11 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] nvme not present on system {{(pid=75066) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 19:21:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:21:11 user nova-compute[75066]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 19:21:11 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d7c21d-1f9d-4ec5-9a74-94ec66e59616]: (4, '') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:11 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75066) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 19:21:11 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 19:21:11 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] LIGHTOS: no hostnqn found. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 19:21:11 user nova-compute[75066]: DEBUG os_brick.utils [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] <== get_connector_properties: return (356ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1959854982f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:21:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:14 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Creating instance directory {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 19:21:14 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Creating image(s)
Dec 01 19:21:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Acquiring lock "/opt/stack/data/nova/instances/3d340166-c58b-4213-b8d3-5036ade48d2d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:21:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "/opt/stack/data/nova/instances/3d340166-c58b-4213-b8d3-5036ade48d2d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:21:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "/opt/stack/data/nova/instances/3d340166-c58b-4213-b8d3-5036ade48d2d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:21:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.169s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Acquiring lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.168s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/3d340166-c58b-4213-b8d3-5036ade48d2d/disk 1073741824 {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/3d340166-c58b-4213-b8d3-5036ade48d2d/disk 1073741824" returned: 0 in 0.050s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.169s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3d340166-c58b-4213-b8d3-5036ade48d2d/disk. size=1073741824 {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d340166-c58b-4213-b8d3-5036ade48d2d/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d340166-c58b-4213-b8d3-5036ade48d2d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Cannot resize image /opt/stack/data/nova/instances/3d340166-c58b-4213-b8d3-5036ade48d2d/disk to a smaller size. {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Created local disks {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Ensure instance console log exists: /opt/stack/data/nova/instances/3d340166-c58b-4213-b8d3-5036ade48d2d/console.log {{(pid=75066) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Start _get_guest_xml network_info=[{"id": "01c08ead-7eed-4e1a-839a-234fce1ba605", "address": "fa:16:3e:6e:53:26", "network": {"id": "9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-696310557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0f7516d1db4dd5bc7d77a0bd1d44d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01c08ead-7e", "ovs_interfaceid": "01c08ead-7eed-4e1a-839a-234fce1ba605", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'image_id': '900b237b-e99c-4fdd-a44f-dcb7a08baa86'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'mount_device': '/dev/vdb', 'guest_format': None, 'delete_on_termination': False, 'attachment_id': '37a8c6b1-a062-4c73-a0e8-ef1d674c29ce', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dkMvfRXG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3d340166-c58b-4213-b8d3-5036ade48d2d', 'attached_at': '', 'detached_at': '', 'volume_id': '60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc', 'serial': '60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:21:15 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Dec 01 19:21:15 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Dec 01 19:21:15 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG nova.objects.instance [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3d340166-c58b-4213-b8d3-5036ade48d2d {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Calling os-brick to attach iSCSI Volume {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dkMvfRXG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:21:15 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 01 19:21:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:21:15 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 01 19:21:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:21:15 user nova-compute[75066]: INFO os_brick.initiator.connectors.iscsi [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 19:21:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc -p 172.16.0.220:3260 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[69feb1bc-85bb-42b5-9d8a-1eb32f6b80d0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 19:21:15 user nova-compute[75066]:  {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc -p 172.16.0.220:3260 --interface default --op new {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a2c7e4-038b-4007-b6b2-7b5bbf6d91fa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc] added\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc] added
Dec 01 19:21:15 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d2dfa2-48f6-40c9-8e1c-703f36c2a140]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[b58685a8-0079-4593-a24a-f38111809f8f]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dkMvfRXG {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dkMvfRXG" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0023c1-485b-4130-87f6-adbb0780f6ac]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dkMvfRXG'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83b4bec-2115-43e9-8ab0-3642e6ec7fef]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72b9eb4-16c0-4e72-942b-1df2860e974e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)
Dec 01 19:21:15 user nova-compute[75066]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:21:15 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)
Dec 01 19:21:15 user nova-compute[75066]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:21:15 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:21:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc -p 172.16.0.220:3260 --login {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:16 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d49313-85c3-4b9e-b894-15c6a45bf9dc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:16 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc, portal: 172.16.0.220,3260]
Dec 01 19:21:16 user nova-compute[75066]: Login to [iface: default, target: iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc, portal: 172.16.0.220,3260] successful.
Dec 01 19:21:16 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:21:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:16 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[1114595a-0ce0-4ac7-8c31-443e0b743cab]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:16 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:21:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:16 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ed0be0-e783-41e6-8424-80bb30b95b4e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:16 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)
Dec 01 19:21:16 user nova-compute[75066]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:21:16 user nova-compute[75066]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)
Dec 01 19:21:16 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:21:16 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)
Dec 01 19:21:16 user nova-compute[75066]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:21:16 user nova-compute[75066]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)
Dec 01 19:21:16 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:21:16 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.287s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:21:16 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Connected to 172.16.0.220:3260 {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 19:21:16 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] HCTL ('33', '-', '-', 0) found on session 18 with lun 0 {{(pid=75066) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 19:21:16 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75066) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 19:21:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:16 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[63afbcea-ad74-492e-bdd1-d99c6f7de1c6]: (4, ('- - 0', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:16 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Searching for a device in session 18 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:21:16 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dkMvfRXG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 19:21:17 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:21:17 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23166636337666265', 'path': '/dev/sdb'} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:21:17 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23166636337666265', 'path': '/dev/sdb'} {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 19:21:17 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-01T19:18:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-88799949',display_name='tempest-ServerActionsTestOtherA-server-59047600',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-88799949',id=13,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeOjka3O2yOSG7PgvQxwfceH9ScZixOK/oKEDoZu88X4E6S58dhbFi5q4+c/guiL9cBe6OBGVWUQ58KJXvXMJo6fjs42odNZigfHcTvBLGpR1adq29cPDQW/Rp9UoL0ag==',key_name='tempest-keypair-202509697',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:19:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fb0f7516d1db4dd5bc7d77a0bd1d44d7',ramdisk_id='',reservation_id='r-dyxm9b0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1700253921',owner_user_name='tempest-ServerActionsTestOtherA-1700253921-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:21:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfb3e7b4b0444223af282b16da9bd919',uuid=3d340166-c58b-4213-b8d3-5036ade48d2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01c08ead-7eed-4e1a-839a-234fce1ba605", "address": "fa:16:3e:6e:53:26", "network": {"id": "9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-696310557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0f7516d1db4dd5bc7d77a0bd1d44d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01c08ead-7e", "ovs_interfaceid": "01c08ead-7eed-4e1a-839a-234fce1ba605", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:21:17 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Converting VIF {"id": "01c08ead-7eed-4e1a-839a-234fce1ba605", "address": "fa:16:3e:6e:53:26", "network": {"id": "9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-696310557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0f7516d1db4dd5bc7d77a0bd1d44d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01c08ead-7e", "ovs_interfaceid": "01c08ead-7eed-4e1a-839a-234fce1ba605", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:21:17 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:53:26,bridge_name='br-int',has_traffic_filtering=True,id=01c08ead-7eed-4e1a-839a-234fce1ba605,network=Network(9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01c08ead-7e') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:21:17 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:21:17 user nova-compute[75066]:   <uuid>3d340166-c58b-4213-b8d3-5036ade48d2d</uuid>
Dec 01 19:21:17 user nova-compute[75066]:   <name>instance-0000000d</name>
Dec 01 19:21:17 user nova-compute[75066]:   <memory>524288</memory>
Dec 01 19:21:17 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:21:17 user nova-compute[75066]:   <metadata>
Dec 01 19:21:17 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:21:17 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:21:17 user nova-compute[75066]:       <nova:name>tempest-ServerActionsTestOtherA-server-59047600</nova:name>
Dec 01 19:21:17 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:21:15</nova:creationTime>
Dec 01 19:21:17 user nova-compute[75066]:       <nova:flavor name="m1.tiny">
Dec 01 19:21:17 user nova-compute[75066]:         <nova:memory>512</nova:memory>
Dec 01 19:21:17 user nova-compute[75066]:         <nova:disk>1</nova:disk>
Dec 01 19:21:17 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:21:17 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:21:17 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:21:17 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:21:17 user nova-compute[75066]:       <nova:owner>
Dec 01 19:21:17 user nova-compute[75066]:         <nova:user uuid="cfb3e7b4b0444223af282b16da9bd919">tempest-ServerActionsTestOtherA-1700253921-project-member</nova:user>
Dec 01 19:21:17 user nova-compute[75066]:         <nova:project uuid="fb0f7516d1db4dd5bc7d77a0bd1d44d7">tempest-ServerActionsTestOtherA-1700253921</nova:project>
Dec 01 19:21:17 user nova-compute[75066]:       </nova:owner>
Dec 01 19:21:17 user nova-compute[75066]:       <nova:root type="image" uuid="900b237b-e99c-4fdd-a44f-dcb7a08baa86"/>
Dec 01 19:21:17 user nova-compute[75066]:       <nova:ports>
Dec 01 19:21:17 user nova-compute[75066]:         <nova:port uuid="01c08ead-7eed-4e1a-839a-234fce1ba605">
Dec 01 19:21:17 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 01 19:21:17 user nova-compute[75066]:         </nova:port>
Dec 01 19:21:17 user nova-compute[75066]:       </nova:ports>
Dec 01 19:21:17 user nova-compute[75066]:     </nova:instance>
Dec 01 19:21:17 user nova-compute[75066]:   </metadata>
Dec 01 19:21:17 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:21:17 user nova-compute[75066]:     <system>
Dec 01 19:21:17 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:21:17 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:21:17 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:21:17 user nova-compute[75066]:       <entry name="serial">3d340166-c58b-4213-b8d3-5036ade48d2d</entry>
Dec 01 19:21:17 user nova-compute[75066]:       <entry name="uuid">3d340166-c58b-4213-b8d3-5036ade48d2d</entry>
Dec 01 19:21:17 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:21:17 user nova-compute[75066]:     </system>
Dec 01 19:21:17 user nova-compute[75066]:   </sysinfo>
Dec 01 19:21:17 user nova-compute[75066]:   <os>
Dec 01 19:21:17 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:21:17 user nova-compute[75066]:     <boot dev="hd"/>
Dec 01 19:21:17 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:21:17 user nova-compute[75066]:   </os>
Dec 01 19:21:17 user nova-compute[75066]:   <features>
Dec 01 19:21:17 user nova-compute[75066]:     <acpi/>
Dec 01 19:21:17 user nova-compute[75066]:     <apic/>
Dec 01 19:21:17 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:21:17 user nova-compute[75066]:   </features>
Dec 01 19:21:17 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:21:17 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:21:17 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:21:17 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:21:17 user nova-compute[75066]:   </clock>
Dec 01 19:21:17 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:21:17 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:21:17 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:21:17 user nova-compute[75066]:   </cpu>
Dec 01 19:21:17 user nova-compute[75066]:   <devices>
Dec 01 19:21:17 user nova-compute[75066]:     <disk type="file" device="disk">
Dec 01 19:21:17 user nova-compute[75066]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 19:21:17 user nova-compute[75066]:       <source file="/opt/stack/data/nova/instances/3d340166-c58b-4213-b8d3-5036ade48d2d/disk"/>
Dec 01 19:21:17 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:21:17 user nova-compute[75066]:     </disk>
Dec 01 19:21:17 user nova-compute[75066]:     <disk type="block" device="disk">
Dec 01 19:21:17 user nova-compute[75066]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:21:17 user nova-compute[75066]:       <source dev="/dev/sdb"/>
Dec 01 19:21:17 user nova-compute[75066]:       <target dev="vdb" bus="virtio"/>
Dec 01 19:21:17 user nova-compute[75066]:       <serial>60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc</serial>
Dec 01 19:21:17 user nova-compute[75066]:     </disk>
Dec 01 19:21:17 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:21:17 user nova-compute[75066]:       <mac address="fa:16:3e:6e:53:26"/>
Dec 01 19:21:17 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:21:17 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:21:17 user nova-compute[75066]:       <target dev="tap01c08ead-7e"/>
Dec 01 19:21:17 user nova-compute[75066]:     </interface>
Dec 01 19:21:17 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:21:17 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/3d340166-c58b-4213-b8d3-5036ade48d2d/console.log" append="off"/>
Dec 01 19:21:17 user nova-compute[75066]:     </serial>
Dec 01 19:21:17 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:21:17 user nova-compute[75066]:     <video>
Dec 01 19:21:17 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:21:17 user nova-compute[75066]:     </video>
Dec 01 19:21:17 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:21:17 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:21:17 user nova-compute[75066]:     </rng>
Dec 01 19:21:17 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:21:17 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:21:17 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:21:17 user nova-compute[75066]:     </memballoon>
Dec 01 19:21:17 user nova-compute[75066]:   </devices>
Dec 01 19:21:17 user nova-compute[75066]: </domain>
Dec 01 19:21:17 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:21:17 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-01T19:18:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-88799949',display_name='tempest-ServerActionsTestOtherA-server-59047600',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-88799949',id=13,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeOjka3O2yOSG7PgvQxwfceH9ScZixOK/oKEDoZu88X4E6S58dhbFi5q4+c/guiL9cBe6OBGVWUQ58KJXvXMJo6fjs42odNZigfHcTvBLGpR1adq29cPDQW/Rp9UoL0ag==',key_name='tempest-keypair-202509697',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:19:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fb0f7516d1db4dd5bc7d77a0bd1d44d7',ramdisk_id='',reservation_id='r-dyxm9b0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1700253921',owner_user_name='tempest-ServerActionsTestOtherA-1700253921-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:21:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfb3e7b4b0444223af282b16da9bd919',uuid=3d340166-c58b-4213-b8d3-5036ade48d2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01c08ead-7eed-4e1a-839a-234fce1ba605", "address": "fa:16:3e:6e:53:26", "network": {"id": "9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-696310557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0f7516d1db4dd5bc7d77a0bd1d44d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01c08ead-7e", "ovs_interfaceid": "01c08ead-7eed-4e1a-839a-234fce1ba605", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:21:17 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Converting VIF {"id": "01c08ead-7eed-4e1a-839a-234fce1ba605", "address": "fa:16:3e:6e:53:26", "network": {"id": "9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-696310557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0f7516d1db4dd5bc7d77a0bd1d44d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01c08ead-7e", "ovs_interfaceid": "01c08ead-7eed-4e1a-839a-234fce1ba605", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:21:17 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:53:26,bridge_name='br-int',has_traffic_filtering=True,id=01c08ead-7eed-4e1a-839a-234fce1ba605,network=Network(9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01c08ead-7e') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:21:17 user nova-compute[75066]: DEBUG os_vif [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:53:26,bridge_name='br-int',has_traffic_filtering=True,id=01c08ead-7eed-4e1a-839a-234fce1ba605,network=Network(9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01c08ead-7e') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:21:17 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:17 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:21:17 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:21:17 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:17 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ec4a5a22-8006-57be-8116-33fcd9ca118a', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:21:17 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:17 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:21:17 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:17 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap01c08ead-7e, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:21:17 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap01c08ead-7e, col_values=(('qos', UUID('b80767b5-6dea-4949-8760-f71ab4205b52')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:21:17 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap01c08ead-7e, col_values=(('external_ids', {'iface-id': '01c08ead-7eed-4e1a-839a-234fce1ba605', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:53:26', 'vm-uuid': '3d340166-c58b-4213-b8d3-5036ade48d2d'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:21:17 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:17 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:21:17 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:17 user nova-compute[75066]: INFO os_vif [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:53:26,bridge_name='br-int',has_traffic_filtering=True,id=01c08ead-7eed-4e1a-839a-234fce1ba605,network=Network(9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01c08ead-7e')
Dec 01 19:21:17 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:21:17 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:21:17 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] No VIF found with MAC fa:16:3e:6e:53:26, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:21:17 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:18 user nova-compute[75066]: DEBUG nova.compute.manager [req-cd624f62-0228-4c74-9c9f-2ccd18bade9c req-530cfbb4-2c52-4194-bbec-8bb90efe8cf8 service nova] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Received event network-vif-plugged-01c08ead-7eed-4e1a-839a-234fce1ba605 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:21:18 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-cd624f62-0228-4c74-9c9f-2ccd18bade9c req-530cfbb4-2c52-4194-bbec-8bb90efe8cf8 service nova] Acquiring lock "3d340166-c58b-4213-b8d3-5036ade48d2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:21:18 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-cd624f62-0228-4c74-9c9f-2ccd18bade9c req-530cfbb4-2c52-4194-bbec-8bb90efe8cf8 service nova] Lock "3d340166-c58b-4213-b8d3-5036ade48d2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:21:18 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-cd624f62-0228-4c74-9c9f-2ccd18bade9c req-530cfbb4-2c52-4194-bbec-8bb90efe8cf8 service nova] Lock "3d340166-c58b-4213-b8d3-5036ade48d2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:21:18 user nova-compute[75066]: DEBUG nova.compute.manager [req-cd624f62-0228-4c74-9c9f-2ccd18bade9c req-530cfbb4-2c52-4194-bbec-8bb90efe8cf8 service nova] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] No waiting events found dispatching network-vif-plugged-01c08ead-7eed-4e1a-839a-234fce1ba605 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:21:18 user nova-compute[75066]: WARNING nova.compute.manager [req-cd624f62-0228-4c74-9c9f-2ccd18bade9c req-530cfbb4-2c52-4194-bbec-8bb90efe8cf8 service nova] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Received unexpected event network-vif-plugged-01c08ead-7eed-4e1a-839a-234fce1ba605 for instance with vm_state active and task_state rebuild_spawning.
Dec 01 19:21:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:19 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Acquiring lock "933210b1-5c5e-421a-9b63-4595fc5f5f25" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:21:19 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lock "933210b1-5c5e-421a-9b63-4595fc5f5f25" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:21:19 user nova-compute[75066]: DEBUG nova.compute.manager [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Starting instance... {{(pid=75066) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 19:21:19 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:21:19 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:21:19 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75066) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 19:21:19 user nova-compute[75066]: INFO nova.compute.claims [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Claim successful on node user
Dec 01 19:21:20 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:21:20 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:21:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.523s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:21:20 user nova-compute[75066]: DEBUG nova.compute.manager [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Start building networks asynchronously for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 19:21:20 user nova-compute[75066]: DEBUG nova.compute.manager [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Allocating IP information in the background. {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 19:21:20 user nova-compute[75066]: DEBUG nova.network.neutron [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] allocate_for_instance() {{(pid=75066) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 19:21:20 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 19:21:20 user nova-compute[75066]: DEBUG nova.compute.manager [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Start building block device mappings for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 19:21:20 user nova-compute[75066]: DEBUG nova.policy [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a0be767f43744d73a35ed6b7a45c8b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb5b77e2da142499315e0a96f86d959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75066) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 19:21:20 user nova-compute[75066]: DEBUG nova.compute.manager [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Start spawning the instance on the hypervisor. {{(pid=75066) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 19:21:20 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Creating instance directory {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 19:21:20 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Creating image(s)
Dec 01 19:21:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Acquiring lock "/opt/stack/data/nova/instances/933210b1-5c5e-421a-9b63-4595fc5f5f25/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:21:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lock "/opt/stack/data/nova/instances/933210b1-5c5e-421a-9b63-4595fc5f5f25/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:21:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lock "/opt/stack/data/nova/instances/933210b1-5c5e-421a-9b63-4595fc5f5f25/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:21:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.171s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Acquiring lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:21:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:21:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.196s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/933210b1-5c5e-421a-9b63-4595fc5f5f25/disk 1073741824 {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/933210b1-5c5e-421a-9b63-4595fc5f5f25/disk 1073741824" returned: 0 in 0.047s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:21:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:20 user nova-compute[75066]: DEBUG nova.compute.manager [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Instance event wait completed in 0 seconds for  {{(pid=75066) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 19:21:20 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Guest created on hypervisor {{(pid=75066) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 19:21:20 user nova-compute[75066]: DEBUG nova.compute.manager [req-b1fafb00-6772-4b38-87dc-de7851cca389 req-b8af27d8-c472-4a25-8a16-c3063b5e3296 service nova] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Received event network-vif-plugged-01c08ead-7eed-4e1a-839a-234fce1ba605 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:21:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-b1fafb00-6772-4b38-87dc-de7851cca389 req-b8af27d8-c472-4a25-8a16-c3063b5e3296 service nova] Acquiring lock "3d340166-c58b-4213-b8d3-5036ade48d2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:21:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-b1fafb00-6772-4b38-87dc-de7851cca389 req-b8af27d8-c472-4a25-8a16-c3063b5e3296 service nova] Lock "3d340166-c58b-4213-b8d3-5036ade48d2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:21:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-b1fafb00-6772-4b38-87dc-de7851cca389 req-b8af27d8-c472-4a25-8a16-c3063b5e3296 service nova] Lock "3d340166-c58b-4213-b8d3-5036ade48d2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:21:20 user nova-compute[75066]: DEBUG nova.compute.manager [req-b1fafb00-6772-4b38-87dc-de7851cca389 req-b8af27d8-c472-4a25-8a16-c3063b5e3296 service nova] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] No waiting events found dispatching network-vif-plugged-01c08ead-7eed-4e1a-839a-234fce1ba605 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:21:20 user nova-compute[75066]: WARNING nova.compute.manager [req-b1fafb00-6772-4b38-87dc-de7851cca389 req-b8af27d8-c472-4a25-8a16-c3063b5e3296 service nova] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Received unexpected event network-vif-plugged-01c08ead-7eed-4e1a-839a-234fce1ba605 for instance with vm_state active and task_state rebuild_spawning.
Dec 01 19:21:20 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Instance spawned successfully.
Dec 01 19:21:20 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 19:21:20 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Found default for hw_cdrom_bus of ide {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:21:20 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Found default for hw_disk_bus of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:21:20 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Found default for hw_input_bus of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:21:20 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Found default for hw_pointer_model of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:21:20 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Found default for hw_video_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:21:20 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Found default for hw_vif_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:21:20 user nova-compute[75066]: DEBUG nova.network.neutron [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Successfully created port: 171473a9-1228-4e96-b10f-c3d9a58b91eb {{(pid=75066) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 19:21:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.196s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:20 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Checking if we can resize image /opt/stack/data/nova/instances/933210b1-5c5e-421a-9b63-4595fc5f5f25/disk. size=1073741824 {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 19:21:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/933210b1-5c5e-421a-9b63-4595fc5f5f25/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG nova.compute.manager [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG nova.objects.instance [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75066) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/933210b1-5c5e-421a-9b63-4595fc5f5f25/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Cannot resize image /opt/stack/data/nova/instances/933210b1-5c5e-421a-9b63-4595fc5f5f25/disk to a smaller size. {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Created local disks {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Ensure instance console log exists: /opt/stack/data/nova/instances/933210b1-5c5e-421a-9b63-4595fc5f5f25/console.log {{(pid=75066) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-3c37a6f8-1062-4640-ab51-47948a84cecf tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.083s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Starting finish_revert_migration {{(pid=75066) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11813}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Start _get_guest_xml network_info=[{"id": "478e7aea-9546-4659-bdac-09213bd9cb82", "address": "fa:16:3e:9a:26:f6", "network": {"id": "d182d3d1-113a-4bf5-b325-f073247f0547", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-325272674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2830de7697db4d5e8b9c358dab7f4368", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap478e7aea-95", "ovs_interfaceid": "478e7aea-9546-4659-bdac-09213bd9cb82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'image_id': '900b237b-e99c-4fdd-a44f-dcb7a08baa86'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'mount_device': '/dev/vdb', 'guest_format': None, 'delete_on_termination': False, 'attachment_id': 'c3790fe8-d116-442c-a048-3d05a508face', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gUkyhEaX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'dd546862-fcd5-4b69-8ea3-a8fa4859a489', 'attached_at': '2023-12-01T19:21:21.000000', 'detached_at': '', 'volume_id': 'b6e9e54d-57f4-4413-9c76-50da506906d2', 'serial': 'b6e9e54d-57f4-4413-9c76-50da506906d2'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:21:21 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:21:21 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:21:21 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG nova.objects.instance [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Lazy-loading 'vcpu_model' on Instance uuid dd546862-fcd5-4b69-8ea3-a8fa4859a489 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Calling os-brick to attach iSCSI Volume {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gUkyhEaX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:21:21 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:21:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:21:21 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:21:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:21:21 user nova-compute[75066]: INFO os_brick.initiator.connectors.iscsi [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 19:21:21 user nova-compute[75066]: DEBUG nova.network.neutron [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Successfully updated port: 171473a9-1228-4e96-b10f-c3d9a58b91eb {{(pid=75066) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 -p 172.16.0.220:3260 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Acquiring lock "refresh_cache-933210b1-5c5e-421a-9b63-4595fc5f5f25" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Acquired lock "refresh_cache-933210b1-5c5e-421a-9b63-4595fc5f5f25" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG nova.network.neutron [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[2983cca2-28d3-43e5-aac4-87072ce6f5a0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 19:21:21 user nova-compute[75066]:  {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[daeaa90c-a7c4-4c16-8386-4171cde72df4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2] added\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2] added
Dec 01 19:21:21 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[32737b86-96a1-4bbe-b536-b2d7d84cf651]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11da6b2-0872-45ac-b9ab-818d06982998]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG nova.network.neutron [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gUkyhEaX {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gUkyhEaX" returned: 0 in 0.027s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ba3aa25-2ae3-4463-be2b-7552903274f6]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gUkyhEaX'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[93040905-7962-441d-b3ef-ce8b7e1b3c04]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[916a868f-b552-4cf2-841e-97529f3fb8cf]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)
Dec 01 19:21:21 user nova-compute[75066]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:21:21 user nova-compute[75066]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)
Dec 01 19:21:21 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)
Dec 01 19:21:21 user nova-compute[75066]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:21:21 user nova-compute[75066]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)
Dec 01 19:21:21 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:21:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 -p 172.16.0.220:3260 --login {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[74bf796d-f53c-4639-b674-0f1c552851ca]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2, portal: 172.16.0.220,3260]
Dec 01 19:21:22 user nova-compute[75066]: Login to [iface: default, target: iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2, portal: 172.16.0.220,3260] successful.
Dec 01 19:21:22 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd4a7c9-ceb0-4ac2-87a5-6096adba8d06]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0dabe18-b3ce-4d09-9d6e-3ac14013fc5e]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)
Dec 01 19:21:22 user nova-compute[75066]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:21:22 user nova-compute[75066]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)
Dec 01 19:21:22 user nova-compute[75066]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)
Dec 01 19:21:22 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)
Dec 01 19:21:22 user nova-compute[75066]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:21:22 user nova-compute[75066]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)
Dec 01 19:21:22 user nova-compute[75066]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)
Dec 01 19:21:22 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Connected to 172.16.0.220:3260 {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] HCTL ('35', '-', '-', 0) found on session 19 with lun 0 {{(pid=75066) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75066) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b6c627d-c5dd-4542-90eb-b29d33a6c64a]: (4, ('- - 0', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Searching for a device in session 19 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gUkyhEaX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG nova.network.neutron [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Updating instance_info_cache with network_info: [{"id": "171473a9-1228-4e96-b10f-c3d9a58b91eb", "address": "fa:16:3e:09:a8:0f", "network": {"id": "195edf10-5722-4eef-b117-7a450e973afa", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2017280124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fb5b77e2da142499315e0a96f86d959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap171473a9-12", "ovs_interfaceid": "171473a9-1228-4e96-b10f-c3d9a58b91eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Releasing lock "refresh_cache-933210b1-5c5e-421a-9b63-4595fc5f5f25" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG nova.compute.manager [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Instance network_info: |[{"id": "171473a9-1228-4e96-b10f-c3d9a58b91eb", "address": "fa:16:3e:09:a8:0f", "network": {"id": "195edf10-5722-4eef-b117-7a450e973afa", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2017280124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fb5b77e2da142499315e0a96f86d959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap171473a9-12", "ovs_interfaceid": "171473a9-1228-4e96-b10f-c3d9a58b91eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Start _get_guest_xml network_info=[{"id": "171473a9-1228-4e96-b10f-c3d9a58b91eb", "address": "fa:16:3e:09:a8:0f", "network": {"id": "195edf10-5722-4eef-b117-7a450e973afa", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2017280124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fb5b77e2da142499315e0a96f86d959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap171473a9-12", "ovs_interfaceid": "171473a9-1228-4e96-b10f-c3d9a58b91eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'image_id': '900b237b-e99c-4fdd-a44f-dcb7a08baa86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:21:22 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:21:22 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:21:22 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:21:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-300985667',display_name='tempest-VolumesSnapshotTestJSON-instance-300985667',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-300985667',id=19,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQyCV1/xA765wlFyfrxcdfpjke/xdY+6QVDuYMiSGnqchoHcqlYGTVApz5dBkMx3FH/27lGkGmhnsZfvpusJhg1qzRgF/6fqz3MrJlw84RcijakUYX9319IAJqAP2euig==',key_name='tempest-keypair-773295022',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6fb5b77e2da142499315e0a96f86d959',ramdisk_id='',reservation_id='r-pxf0e5tl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1069530394',owner_user_name='tempest-VolumesSnapshotTestJSON-1069530394-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:21:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0be767f43744d73a35ed6b7a45c8b95',uuid=933210b1-5c5e-421a-9b63-4595fc5f5f25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "171473a9-1228-4e96-b10f-c3d9a58b91eb", "address": "fa:16:3e:09:a8:0f", "network": {"id": "195edf10-5722-4eef-b117-7a450e973afa", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2017280124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fb5b77e2da142499315e0a96f86d959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap171473a9-12", "ovs_interfaceid": "171473a9-1228-4e96-b10f-c3d9a58b91eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Converting VIF {"id": "171473a9-1228-4e96-b10f-c3d9a58b91eb", "address": "fa:16:3e:09:a8:0f", "network": {"id": "195edf10-5722-4eef-b117-7a450e973afa", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2017280124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fb5b77e2da142499315e0a96f86d959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap171473a9-12", "ovs_interfaceid": "171473a9-1228-4e96-b10f-c3d9a58b91eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:a8:0f,bridge_name='br-int',has_traffic_filtering=True,id=171473a9-1228-4e96-b10f-c3d9a58b91eb,network=Network(195edf10-5722-4eef-b117-7a450e973afa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap171473a9-12') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG nova.objects.instance [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lazy-loading 'pci_devices' on Instance uuid 933210b1-5c5e-421a-9b63-4595fc5f5f25 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:21:22 user nova-compute[75066]:   <uuid>933210b1-5c5e-421a-9b63-4595fc5f5f25</uuid>
Dec 01 19:21:22 user nova-compute[75066]:   <name>instance-00000013</name>
Dec 01 19:21:22 user nova-compute[75066]:   <memory>524288</memory>
Dec 01 19:21:22 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:21:22 user nova-compute[75066]:   <metadata>
Dec 01 19:21:22 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:21:22 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:21:22 user nova-compute[75066]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-300985667</nova:name>
Dec 01 19:21:22 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:21:22</nova:creationTime>
Dec 01 19:21:22 user nova-compute[75066]:       <nova:flavor name="m1.tiny">
Dec 01 19:21:22 user nova-compute[75066]:         <nova:memory>512</nova:memory>
Dec 01 19:21:22 user nova-compute[75066]:         <nova:disk>1</nova:disk>
Dec 01 19:21:22 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:21:22 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:21:22 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:21:22 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:21:22 user nova-compute[75066]:       <nova:owner>
Dec 01 19:21:22 user nova-compute[75066]:         <nova:user uuid="a0be767f43744d73a35ed6b7a45c8b95">tempest-VolumesSnapshotTestJSON-1069530394-project-member</nova:user>
Dec 01 19:21:22 user nova-compute[75066]:         <nova:project uuid="6fb5b77e2da142499315e0a96f86d959">tempest-VolumesSnapshotTestJSON-1069530394</nova:project>
Dec 01 19:21:22 user nova-compute[75066]:       </nova:owner>
Dec 01 19:21:22 user nova-compute[75066]:       <nova:root type="image" uuid="900b237b-e99c-4fdd-a44f-dcb7a08baa86"/>
Dec 01 19:21:22 user nova-compute[75066]:       <nova:ports>
Dec 01 19:21:22 user nova-compute[75066]:         <nova:port uuid="171473a9-1228-4e96-b10f-c3d9a58b91eb">
Dec 01 19:21:22 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 01 19:21:22 user nova-compute[75066]:         </nova:port>
Dec 01 19:21:22 user nova-compute[75066]:       </nova:ports>
Dec 01 19:21:22 user nova-compute[75066]:     </nova:instance>
Dec 01 19:21:22 user nova-compute[75066]:   </metadata>
Dec 01 19:21:22 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:21:22 user nova-compute[75066]:     <system>
Dec 01 19:21:22 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:21:22 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:21:22 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:21:22 user nova-compute[75066]:       <entry name="serial">933210b1-5c5e-421a-9b63-4595fc5f5f25</entry>
Dec 01 19:21:22 user nova-compute[75066]:       <entry name="uuid">933210b1-5c5e-421a-9b63-4595fc5f5f25</entry>
Dec 01 19:21:22 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:21:22 user nova-compute[75066]:     </system>
Dec 01 19:21:22 user nova-compute[75066]:   </sysinfo>
Dec 01 19:21:22 user nova-compute[75066]:   <os>
Dec 01 19:21:22 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:21:22 user nova-compute[75066]:     <boot dev="hd"/>
Dec 01 19:21:22 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:21:22 user nova-compute[75066]:   </os>
Dec 01 19:21:22 user nova-compute[75066]:   <features>
Dec 01 19:21:22 user nova-compute[75066]:     <acpi/>
Dec 01 19:21:22 user nova-compute[75066]:     <apic/>
Dec 01 19:21:22 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:21:22 user nova-compute[75066]:   </features>
Dec 01 19:21:22 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:21:22 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:21:22 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:21:22 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:21:22 user nova-compute[75066]:   </clock>
Dec 01 19:21:22 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:21:22 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:21:22 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:21:22 user nova-compute[75066]:   </cpu>
Dec 01 19:21:22 user nova-compute[75066]:   <devices>
Dec 01 19:21:22 user nova-compute[75066]:     <disk type="file" device="disk">
Dec 01 19:21:22 user nova-compute[75066]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 19:21:22 user nova-compute[75066]:       <source file="/opt/stack/data/nova/instances/933210b1-5c5e-421a-9b63-4595fc5f5f25/disk"/>
Dec 01 19:21:22 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:21:22 user nova-compute[75066]:     </disk>
Dec 01 19:21:22 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:21:22 user nova-compute[75066]:       <mac address="fa:16:3e:09:a8:0f"/>
Dec 01 19:21:22 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:21:22 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:21:22 user nova-compute[75066]:       <target dev="tap171473a9-12"/>
Dec 01 19:21:22 user nova-compute[75066]:     </interface>
Dec 01 19:21:22 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:21:22 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/933210b1-5c5e-421a-9b63-4595fc5f5f25/console.log" append="off"/>
Dec 01 19:21:22 user nova-compute[75066]:     </serial>
Dec 01 19:21:22 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:21:22 user nova-compute[75066]:     <video>
Dec 01 19:21:22 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:21:22 user nova-compute[75066]:     </video>
Dec 01 19:21:22 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:21:22 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:21:22 user nova-compute[75066]:     </rng>
Dec 01 19:21:22 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:21:22 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:21:22 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:21:22 user nova-compute[75066]:     </memballoon>
Dec 01 19:21:22 user nova-compute[75066]:   </devices>
Dec 01 19:21:22 user nova-compute[75066]: </domain>
Dec 01 19:21:22 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:21:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-300985667',display_name='tempest-VolumesSnapshotTestJSON-instance-300985667',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-300985667',id=19,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQyCV1/xA765wlFyfrxcdfpjke/xdY+6QVDuYMiSGnqchoHcqlYGTVApz5dBkMx3FH/27lGkGmhnsZfvpusJhg1qzRgF/6fqz3MrJlw84RcijakUYX9319IAJqAP2euig==',key_name='tempest-keypair-773295022',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6fb5b77e2da142499315e0a96f86d959',ramdisk_id='',reservation_id='r-pxf0e5tl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1069530394',owner_user_name='tempest-VolumesSnapshotTestJSON-1069530394-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:21:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0be767f43744d73a35ed6b7a45c8b95',uuid=933210b1-5c5e-421a-9b63-4595fc5f5f25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "171473a9-1228-4e96-b10f-c3d9a58b91eb", "address": "fa:16:3e:09:a8:0f", "network": {"id": "195edf10-5722-4eef-b117-7a450e973afa", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2017280124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fb5b77e2da142499315e0a96f86d959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap171473a9-12", "ovs_interfaceid": "171473a9-1228-4e96-b10f-c3d9a58b91eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Converting VIF {"id": "171473a9-1228-4e96-b10f-c3d9a58b91eb", "address": "fa:16:3e:09:a8:0f", "network": {"id": "195edf10-5722-4eef-b117-7a450e973afa", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2017280124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fb5b77e2da142499315e0a96f86d959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap171473a9-12", "ovs_interfaceid": "171473a9-1228-4e96-b10f-c3d9a58b91eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:a8:0f,bridge_name='br-int',has_traffic_filtering=True,id=171473a9-1228-4e96-b10f-c3d9a58b91eb,network=Network(195edf10-5722-4eef-b117-7a450e973afa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap171473a9-12') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG os_vif [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:a8:0f,bridge_name='br-int',has_traffic_filtering=True,id=171473a9-1228-4e96-b10f-c3d9a58b91eb,network=Network(195edf10-5722-4eef-b117-7a450e973afa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap171473a9-12') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a4374038-7bd2-507a-b042-86c3e549abfb', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap171473a9-12, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap171473a9-12, col_values=(('qos', UUID('8aa0299e-ff3b-436f-b28f-45b221ee5629')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap171473a9-12, col_values=(('external_ids', {'iface-id': '171473a9-1228-4e96-b10f-c3d9a58b91eb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:a8:0f', 'vm-uuid': '933210b1-5c5e-421a-9b63-4595fc5f5f25'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:22 user nova-compute[75066]: INFO os_vif [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:a8:0f,bridge_name='br-int',has_traffic_filtering=True,id=171473a9-1228-4e96-b10f-c3d9a58b91eb,network=Network(195edf10-5722-4eef-b117-7a450e973afa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap171473a9-12')
Dec 01 19:21:22 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] No VIF found with MAC fa:16:3e:09:a8:0f, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG nova.compute.manager [req-b7d76d1e-6a9b-4c8d-bb30-9d15d0eee1c0 req-51e5d37e-5534-4db4-93b7-ce8e6c2be35b service nova] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Received event network-changed-171473a9-1228-4e96-b10f-c3d9a58b91eb {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG nova.compute.manager [req-b7d76d1e-6a9b-4c8d-bb30-9d15d0eee1c0 req-51e5d37e-5534-4db4-93b7-ce8e6c2be35b service nova] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Refreshing instance network info cache due to event network-changed-171473a9-1228-4e96-b10f-c3d9a58b91eb. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-b7d76d1e-6a9b-4c8d-bb30-9d15d0eee1c0 req-51e5d37e-5534-4db4-93b7-ce8e6c2be35b service nova] Acquiring lock "refresh_cache-933210b1-5c5e-421a-9b63-4595fc5f5f25" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-b7d76d1e-6a9b-4c8d-bb30-9d15d0eee1c0 req-51e5d37e-5534-4db4-93b7-ce8e6c2be35b service nova] Acquired lock "refresh_cache-933210b1-5c5e-421a-9b63-4595fc5f5f25" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:21:22 user nova-compute[75066]: DEBUG nova.network.neutron [req-b7d76d1e-6a9b-4c8d-bb30-9d15d0eee1c0 req-51e5d37e-5534-4db4-93b7-ce8e6c2be35b service nova] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Refreshing network info cache for port 171473a9-1228-4e96-b10f-c3d9a58b91eb {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:21:23 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:21:23 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '23132323935306161', 'path': '/dev/sdd'} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:21:23 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23132323935306161', 'path': '/dev/sdd'} {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 19:21:23 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:15:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-360735581',display_name='tempest-ServerActionsTestOtherB-server-360735581',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-360735581',id=5,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOGqD/77ZPXT6+uFjy9YkzZfO6BpJHbV+zzx/mIYY08bckUat50Cdx1l30v4s1jcybtm106xn+eO4W484wI5lg1LoXDJHliGvHVijdeGBF2TMVA7/KP/EGT4mweXKritFQ==',key_name='tempest-keypair-842148615',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:19:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2830de7697db4d5e8b9c358dab7f4368',ramdisk_id='',reservation_id='r-tl7vmif9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2122210178',owner_user_name='tempest-ServerActionsTestOtherB-2122210178-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:21:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e363b559098f48d4bc5478c657d7de6a',uuid=dd546862-fcd5-4b69-8ea3-a8fa4859a489,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "478e7aea-9546-4659-bdac-09213bd9cb82", "address": "fa:16:3e:9a:26:f6", "network": {"id": "d182d3d1-113a-4bf5-b325-f073247f0547", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-325272674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2830de7697db4d5e8b9c358dab7f4368", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap478e7aea-95", "ovs_interfaceid": "478e7aea-9546-4659-bdac-09213bd9cb82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:21:23 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Converting VIF {"id": "478e7aea-9546-4659-bdac-09213bd9cb82", "address": "fa:16:3e:9a:26:f6", "network": {"id": "d182d3d1-113a-4bf5-b325-f073247f0547", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-325272674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2830de7697db4d5e8b9c358dab7f4368", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap478e7aea-95", "ovs_interfaceid": "478e7aea-9546-4659-bdac-09213bd9cb82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:21:23 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:26:f6,bridge_name='br-int',has_traffic_filtering=True,id=478e7aea-9546-4659-bdac-09213bd9cb82,network=Network(d182d3d1-113a-4bf5-b325-f073247f0547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap478e7aea-95') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:21:23 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:21:23 user nova-compute[75066]:   <uuid>dd546862-fcd5-4b69-8ea3-a8fa4859a489</uuid>
Dec 01 19:21:23 user nova-compute[75066]:   <name>instance-00000005</name>
Dec 01 19:21:23 user nova-compute[75066]:   <memory>524288</memory>
Dec 01 19:21:23 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:21:23 user nova-compute[75066]:   <metadata>
Dec 01 19:21:23 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:21:23 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:21:23 user nova-compute[75066]:       <nova:name>tempest-ServerActionsTestOtherB-server-360735581</nova:name>
Dec 01 19:21:23 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:21:21</nova:creationTime>
Dec 01 19:21:23 user nova-compute[75066]:       <nova:flavor name="m1.tiny">
Dec 01 19:21:23 user nova-compute[75066]:         <nova:memory>512</nova:memory>
Dec 01 19:21:23 user nova-compute[75066]:         <nova:disk>1</nova:disk>
Dec 01 19:21:23 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:21:23 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:21:23 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:21:23 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:21:23 user nova-compute[75066]:       <nova:owner>
Dec 01 19:21:23 user nova-compute[75066]:         <nova:user uuid="e363b559098f48d4bc5478c657d7de6a">tempest-ServerActionsTestOtherB-2122210178-project-member</nova:user>
Dec 01 19:21:23 user nova-compute[75066]:         <nova:project uuid="2830de7697db4d5e8b9c358dab7f4368">tempest-ServerActionsTestOtherB-2122210178</nova:project>
Dec 01 19:21:23 user nova-compute[75066]:       </nova:owner>
Dec 01 19:21:23 user nova-compute[75066]:       <nova:root type="image" uuid="900b237b-e99c-4fdd-a44f-dcb7a08baa86"/>
Dec 01 19:21:23 user nova-compute[75066]:       <nova:ports>
Dec 01 19:21:23 user nova-compute[75066]:         <nova:port uuid="478e7aea-9546-4659-bdac-09213bd9cb82">
Dec 01 19:21:23 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 01 19:21:23 user nova-compute[75066]:         </nova:port>
Dec 01 19:21:23 user nova-compute[75066]:       </nova:ports>
Dec 01 19:21:23 user nova-compute[75066]:     </nova:instance>
Dec 01 19:21:23 user nova-compute[75066]:   </metadata>
Dec 01 19:21:23 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:21:23 user nova-compute[75066]:     <system>
Dec 01 19:21:23 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:21:23 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:21:23 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:21:23 user nova-compute[75066]:       <entry name="serial">dd546862-fcd5-4b69-8ea3-a8fa4859a489</entry>
Dec 01 19:21:23 user nova-compute[75066]:       <entry name="uuid">dd546862-fcd5-4b69-8ea3-a8fa4859a489</entry>
Dec 01 19:21:23 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:21:23 user nova-compute[75066]:     </system>
Dec 01 19:21:23 user nova-compute[75066]:   </sysinfo>
Dec 01 19:21:23 user nova-compute[75066]:   <os>
Dec 01 19:21:23 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:21:23 user nova-compute[75066]:     <boot dev="hd"/>
Dec 01 19:21:23 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:21:23 user nova-compute[75066]:   </os>
Dec 01 19:21:23 user nova-compute[75066]:   <features>
Dec 01 19:21:23 user nova-compute[75066]:     <acpi/>
Dec 01 19:21:23 user nova-compute[75066]:     <apic/>
Dec 01 19:21:23 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:21:23 user nova-compute[75066]:   </features>
Dec 01 19:21:23 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:21:23 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:21:23 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:21:23 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:21:23 user nova-compute[75066]:   </clock>
Dec 01 19:21:23 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:21:23 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:21:23 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:21:23 user nova-compute[75066]:   </cpu>
Dec 01 19:21:23 user nova-compute[75066]:   <devices>
Dec 01 19:21:23 user nova-compute[75066]:     <disk type="file" device="disk">
Dec 01 19:21:23 user nova-compute[75066]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 19:21:23 user nova-compute[75066]:       <source file="/opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489/disk"/>
Dec 01 19:21:23 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:21:23 user nova-compute[75066]:     </disk>
Dec 01 19:21:23 user nova-compute[75066]:     <disk type="block" device="disk">
Dec 01 19:21:23 user nova-compute[75066]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:21:23 user nova-compute[75066]:       <source dev="/dev/sdd"/>
Dec 01 19:21:23 user nova-compute[75066]:       <target dev="vdb" bus="virtio"/>
Dec 01 19:21:23 user nova-compute[75066]:       <serial>b6e9e54d-57f4-4413-9c76-50da506906d2</serial>
Dec 01 19:21:23 user nova-compute[75066]:     </disk>
Dec 01 19:21:23 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:21:23 user nova-compute[75066]:       <mac address="fa:16:3e:9a:26:f6"/>
Dec 01 19:21:23 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:21:23 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:21:23 user nova-compute[75066]:       <target dev="tap478e7aea-95"/>
Dec 01 19:21:23 user nova-compute[75066]:     </interface>
Dec 01 19:21:23 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:21:23 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489/console.log" append="off"/>
Dec 01 19:21:23 user nova-compute[75066]:     </serial>
Dec 01 19:21:23 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:21:23 user nova-compute[75066]:     <video>
Dec 01 19:21:23 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:21:23 user nova-compute[75066]:     </video>
Dec 01 19:21:23 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:21:23 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:21:23 user nova-compute[75066]:     </rng>
Dec 01 19:21:23 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:21:23 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:21:23 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:21:23 user nova-compute[75066]:     </memballoon>
Dec 01 19:21:23 user nova-compute[75066]:   </devices>
Dec 01 19:21:23 user nova-compute[75066]: </domain>
Dec 01 19:21:23 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:21:23 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:15:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-360735581',display_name='tempest-ServerActionsTestOtherB-server-360735581',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-360735581',id=5,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOGqD/77ZPXT6+uFjy9YkzZfO6BpJHbV+zzx/mIYY08bckUat50Cdx1l30v4s1jcybtm106xn+eO4W484wI5lg1LoXDJHliGvHVijdeGBF2TMVA7/KP/EGT4mweXKritFQ==',key_name='tempest-keypair-842148615',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:19:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='2830de7697db4d5e8b9c358dab7f4368',ramdisk_id='',reservation_id='r-tl7vmif9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-2122210178',owner_user_name='tempest-ServerActionsTestOtherB-2122210178-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:21:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e363b559098f48d4bc5478c657d7de6a',uuid=dd546862-fcd5-4b69-8ea3-a8fa4859a489,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "478e7aea-9546-4659-bdac-09213bd9cb82", "address": "fa:16:3e:9a:26:f6", "network": {"id": "d182d3d1-113a-4bf5-b325-f073247f0547", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-325272674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2830de7697db4d5e8b9c358dab7f4368", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap478e7aea-95", "ovs_interfaceid": "478e7aea-9546-4659-bdac-09213bd9cb82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:21:23 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Converting VIF {"id": "478e7aea-9546-4659-bdac-09213bd9cb82", "address": "fa:16:3e:9a:26:f6", "network": {"id": "d182d3d1-113a-4bf5-b325-f073247f0547", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-325272674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2830de7697db4d5e8b9c358dab7f4368", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap478e7aea-95", "ovs_interfaceid": "478e7aea-9546-4659-bdac-09213bd9cb82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:21:23 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:26:f6,bridge_name='br-int',has_traffic_filtering=True,id=478e7aea-9546-4659-bdac-09213bd9cb82,network=Network(d182d3d1-113a-4bf5-b325-f073247f0547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap478e7aea-95') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:21:23 user nova-compute[75066]: DEBUG os_vif [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:26:f6,bridge_name='br-int',has_traffic_filtering=True,id=478e7aea-9546-4659-bdac-09213bd9cb82,network=Network(d182d3d1-113a-4bf5-b325-f073247f0547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap478e7aea-95') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:21:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:21:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:21:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8df8152a-87d1-5502-b08a-0d94887ddb2c', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:21:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:21:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap478e7aea-95, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:21:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap478e7aea-95, col_values=(('qos', UUID('b94b9379-6a1e-40b6-bf78-df2a0171d5d5')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:21:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap478e7aea-95, col_values=(('external_ids', {'iface-id': '478e7aea-9546-4659-bdac-09213bd9cb82', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:26:f6', 'vm-uuid': 'dd546862-fcd5-4b69-8ea3-a8fa4859a489'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:21:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:21:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:23 user nova-compute[75066]: INFO os_vif [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:26:f6,bridge_name='br-int',has_traffic_filtering=True,id=478e7aea-9546-4659-bdac-09213bd9cb82,network=Network(d182d3d1-113a-4bf5-b325-f073247f0547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap478e7aea-95')
Dec 01 19:21:23 user nova-compute[75066]: DEBUG nova.network.neutron [req-b7d76d1e-6a9b-4c8d-bb30-9d15d0eee1c0 req-51e5d37e-5534-4db4-93b7-ce8e6c2be35b service nova] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Updated VIF entry in instance network info cache for port 171473a9-1228-4e96-b10f-c3d9a58b91eb. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:21:23 user nova-compute[75066]: DEBUG nova.network.neutron [req-b7d76d1e-6a9b-4c8d-bb30-9d15d0eee1c0 req-51e5d37e-5534-4db4-93b7-ce8e6c2be35b service nova] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Updating instance_info_cache with network_info: [{"id": "171473a9-1228-4e96-b10f-c3d9a58b91eb", "address": "fa:16:3e:09:a8:0f", "network": {"id": "195edf10-5722-4eef-b117-7a450e973afa", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2017280124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fb5b77e2da142499315e0a96f86d959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap171473a9-12", "ovs_interfaceid": "171473a9-1228-4e96-b10f-c3d9a58b91eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:21:23 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-b7d76d1e-6a9b-4c8d-bb30-9d15d0eee1c0 req-51e5d37e-5534-4db4-93b7-ce8e6c2be35b service nova] Releasing lock "refresh_cache-933210b1-5c5e-421a-9b63-4595fc5f5f25" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:21:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:24 user nova-compute[75066]: DEBUG nova.compute.manager [req-b7200617-64af-4f54-a7aa-076e0c6daa67 req-20a0aace-b4e4-452e-8028-fe02da97e9c6 service nova] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Received event network-vif-plugged-171473a9-1228-4e96-b10f-c3d9a58b91eb {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:21:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-b7200617-64af-4f54-a7aa-076e0c6daa67 req-20a0aace-b4e4-452e-8028-fe02da97e9c6 service nova] Acquiring lock "933210b1-5c5e-421a-9b63-4595fc5f5f25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:21:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-b7200617-64af-4f54-a7aa-076e0c6daa67 req-20a0aace-b4e4-452e-8028-fe02da97e9c6 service nova] Lock "933210b1-5c5e-421a-9b63-4595fc5f5f25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:21:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-b7200617-64af-4f54-a7aa-076e0c6daa67 req-20a0aace-b4e4-452e-8028-fe02da97e9c6 service nova] Lock "933210b1-5c5e-421a-9b63-4595fc5f5f25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:21:24 user nova-compute[75066]: DEBUG nova.compute.manager [req-b7200617-64af-4f54-a7aa-076e0c6daa67 req-20a0aace-b4e4-452e-8028-fe02da97e9c6 service nova] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] No waiting events found dispatching network-vif-plugged-171473a9-1228-4e96-b10f-c3d9a58b91eb {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:21:24 user nova-compute[75066]: WARNING nova.compute.manager [req-b7200617-64af-4f54-a7aa-076e0c6daa67 req-20a0aace-b4e4-452e-8028-fe02da97e9c6 service nova] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Received unexpected event network-vif-plugged-171473a9-1228-4e96-b10f-c3d9a58b91eb for instance with vm_state building and task_state spawning.
Dec 01 19:21:24 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:24 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:24 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:24 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:24 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:25 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:25 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:25 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:25 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:25 user nova-compute[75066]: DEBUG nova.compute.manager [req-f25a794d-913f-432e-8176-caab45b8135b req-96d2a2d7-5d7e-445f-a24e-805f860f305d service nova] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] Received event network-changed-6c3db9c1-34b1-4671-9553-c3d71eeacb3d {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:21:25 user nova-compute[75066]: DEBUG nova.compute.manager [req-f25a794d-913f-432e-8176-caab45b8135b req-96d2a2d7-5d7e-445f-a24e-805f860f305d service nova] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] Refreshing instance network info cache due to event network-changed-6c3db9c1-34b1-4671-9553-c3d71eeacb3d. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:21:25 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-f25a794d-913f-432e-8176-caab45b8135b req-96d2a2d7-5d7e-445f-a24e-805f860f305d service nova] Acquiring lock "refresh_cache-b7d86a5a-c62e-41f7-9f33-1a0c61af6a49" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:21:25 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-f25a794d-913f-432e-8176-caab45b8135b req-96d2a2d7-5d7e-445f-a24e-805f860f305d service nova] Acquired lock "refresh_cache-b7d86a5a-c62e-41f7-9f33-1a0c61af6a49" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:21:25 user nova-compute[75066]: DEBUG nova.network.neutron [req-f25a794d-913f-432e-8176-caab45b8135b req-96d2a2d7-5d7e-445f-a24e-805f860f305d service nova] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] Refreshing network info cache for port 6c3db9c1-34b1-4671-9553-c3d71eeacb3d {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:21:25 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:25 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:25 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:26 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-cab2e3b0-5aa1-44e0-a776-e707534ce3bf tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c3ceeca4-c16c-4cf5-adfd-7d5a2925f435 is timed out.
Dec 01 19:21:26 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-cab2e3b0-5aa1-44e0-a776-e707534ce3bf tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Successfully detached device vdb from instance c3ceeca4-c16c-4cf5-adfd-7d5a2925f435 from the live domain config.
Dec 01 19:21:26 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cab2e3b0-5aa1-44e0-a776-e707534ce3bf tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] calling os-brick to detach iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 19:21:26 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab2e3b0-5aa1-44e0-a776-e707534ce3bf tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, {'target_iqn': 'iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qYPJGAzg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:21:26 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-cab2e3b0-5aa1-44e0-a776-e707534ce3bf tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:21:26 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-cab2e3b0-5aa1-44e0-a776-e707534ce3bf tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:21:26 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-cab2e3b0-5aa1-44e0-a776-e707534ce3bf tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:21:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:26 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:26 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[8176d233-22a6-4b6c-9e14-4a72ed4dbd55]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:26 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab2e3b0-5aa1-44e0-a776-e707534ce3bf tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 19:21:26 user nova-compute[75066]: No targets found.
Dec 01 19:21:26 user nova-compute[75066]: iSNS:
Dec 01 19:21:26 user nova-compute[75066]: No targets found.
Dec 01 19:21:26 user nova-compute[75066]: STATIC:
Dec 01 19:21:26 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829
Dec 01 19:21:26 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:21:26 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:21:26 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa
Dec 01 19:21:26 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:21:26 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:21:26 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2
Dec 01 19:21:26 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:21:26 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:21:26 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc
Dec 01 19:21:26 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:21:26 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:21:26 user nova-compute[75066]: FIRMWARE:
Dec 01 19:21:26 user nova-compute[75066]: No targets found.
Dec 01 19:21:26 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:21:26 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab2e3b0-5aa1-44e0-a776-e707534ce3bf tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 19:21:26 user nova-compute[75066]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 19:21:26 user nova-compute[75066]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75066) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 19:21:26 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab2e3b0-5aa1-44e0-a776-e707534ce3bf tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829', 0)] {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 19:21:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:26 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c85e81-882f-47c0-a148-72ab606aae3f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:26 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c7be01-9d74-447f-ba97-1d1283376d4f]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:26 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab2e3b0-5aa1-44e0-a776-e707534ce3bf tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)
Dec 01 19:21:26 user nova-compute[75066]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:21:26 user nova-compute[75066]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)
Dec 01 19:21:26 user nova-compute[75066]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)
Dec 01 19:21:26 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:21:26 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab2e3b0-5aa1-44e0-a776-e707534ce3bf tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)
Dec 01 19:21:26 user nova-compute[75066]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 (non-flash)
Dec 01 19:21:26 user nova-compute[75066]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)
Dec 01 19:21:26 user nova-compute[75066]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)
Dec 01 19:21:26 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:21:26 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab2e3b0-5aa1-44e0-a776-e707534ce3bf tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f917074e8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829'): ({'sde'}, set())}) {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 19:21:26 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-cab2e3b0-5aa1-44e0-a776-e707534ce3bf tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Removing single pathed devices sde {{(pid=75066) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 19:21:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:26 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e27ed0-6c7b-4d4b-ba10-18c7dc199d9d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:26 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[87cc4247-0d7e-4ff8-a92a-e5d33b479543]: (4, ('ok\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:26 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-cab2e3b0-5aa1-44e0-a776-e707534ce3bf tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Flushing IO for device /dev/sde {{(pid=75066) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 19:21:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:26 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77c8d56-2f91-4050-9b0f-361b674ca5cf]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:26 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-cab2e3b0-5aa1-44e0-a776-e707534ce3bf tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75066) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 19:21:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.052s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:26 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a85a95-6b37-4e58-82ba-91dae5a7fd8b]: (4, ('1', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:26 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-cab2e3b0-5aa1-44e0-a776-e707534ce3bf tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 19:21:26 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-cab2e3b0-5aa1-44e0-a776-e707534ce3bf tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] SCSI volumes sde have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 19:21:26 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab2e3b0-5aa1-44e0-a776-e707534ce3bf tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829')] {{(pid=75066) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 19:21:26 user nova-compute[75066]: DEBUG nova.compute.manager [req-00648ef4-60dc-49b6-80e2-7f5ed2c88fff req-a1c9e518-bbc1-40a1-a168-1819982a30a1 service nova] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Received event network-vif-plugged-171473a9-1228-4e96-b10f-c3d9a58b91eb {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:21:26 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-00648ef4-60dc-49b6-80e2-7f5ed2c88fff req-a1c9e518-bbc1-40a1-a168-1819982a30a1 service nova] Acquiring lock "933210b1-5c5e-421a-9b63-4595fc5f5f25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:21:26 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-00648ef4-60dc-49b6-80e2-7f5ed2c88fff req-a1c9e518-bbc1-40a1-a168-1819982a30a1 service nova] Lock "933210b1-5c5e-421a-9b63-4595fc5f5f25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:21:26 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-00648ef4-60dc-49b6-80e2-7f5ed2c88fff req-a1c9e518-bbc1-40a1-a168-1819982a30a1 service nova] Lock "933210b1-5c5e-421a-9b63-4595fc5f5f25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:21:26 user nova-compute[75066]: DEBUG nova.compute.manager [req-00648ef4-60dc-49b6-80e2-7f5ed2c88fff req-a1c9e518-bbc1-40a1-a168-1819982a30a1 service nova] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] No waiting events found dispatching network-vif-plugged-171473a9-1228-4e96-b10f-c3d9a58b91eb {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:21:26 user nova-compute[75066]: WARNING nova.compute.manager [req-00648ef4-60dc-49b6-80e2-7f5ed2c88fff req-a1c9e518-bbc1-40a1-a168-1819982a30a1 service nova] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Received unexpected event network-vif-plugged-171473a9-1228-4e96-b10f-c3d9a58b91eb for instance with vm_state building and task_state spawning.
Dec 01 19:21:26 user nova-compute[75066]: DEBUG nova.compute.manager [req-00648ef4-60dc-49b6-80e2-7f5ed2c88fff req-a1c9e518-bbc1-40a1-a168-1819982a30a1 service nova] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Received event network-vif-plugged-478e7aea-9546-4659-bdac-09213bd9cb82 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:21:26 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-00648ef4-60dc-49b6-80e2-7f5ed2c88fff req-a1c9e518-bbc1-40a1-a168-1819982a30a1 service nova] Acquiring lock "dd546862-fcd5-4b69-8ea3-a8fa4859a489-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:21:26 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-00648ef4-60dc-49b6-80e2-7f5ed2c88fff req-a1c9e518-bbc1-40a1-a168-1819982a30a1 service nova] Lock "dd546862-fcd5-4b69-8ea3-a8fa4859a489-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:21:26 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-00648ef4-60dc-49b6-80e2-7f5ed2c88fff req-a1c9e518-bbc1-40a1-a168-1819982a30a1 service nova] Lock "dd546862-fcd5-4b69-8ea3-a8fa4859a489-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:21:26 user nova-compute[75066]: DEBUG nova.compute.manager [req-00648ef4-60dc-49b6-80e2-7f5ed2c88fff req-a1c9e518-bbc1-40a1-a168-1819982a30a1 service nova] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] No waiting events found dispatching network-vif-plugged-478e7aea-9546-4659-bdac-09213bd9cb82 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:21:26 user nova-compute[75066]: WARNING nova.compute.manager [req-00648ef4-60dc-49b6-80e2-7f5ed2c88fff req-a1c9e518-bbc1-40a1-a168-1819982a30a1 service nova] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Received unexpected event network-vif-plugged-478e7aea-9546-4659-bdac-09213bd9cb82 for instance with vm_state resized and task_state resize_reverting.
Dec 01 19:21:26 user nova-compute[75066]: DEBUG nova.compute.manager [req-00648ef4-60dc-49b6-80e2-7f5ed2c88fff req-a1c9e518-bbc1-40a1-a168-1819982a30a1 service nova] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Received event network-vif-plugged-478e7aea-9546-4659-bdac-09213bd9cb82 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:21:26 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-00648ef4-60dc-49b6-80e2-7f5ed2c88fff req-a1c9e518-bbc1-40a1-a168-1819982a30a1 service nova] Acquiring lock "dd546862-fcd5-4b69-8ea3-a8fa4859a489-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:21:26 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-00648ef4-60dc-49b6-80e2-7f5ed2c88fff req-a1c9e518-bbc1-40a1-a168-1819982a30a1 service nova] Lock "dd546862-fcd5-4b69-8ea3-a8fa4859a489-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:21:26 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-00648ef4-60dc-49b6-80e2-7f5ed2c88fff req-a1c9e518-bbc1-40a1-a168-1819982a30a1 service nova] Lock "dd546862-fcd5-4b69-8ea3-a8fa4859a489-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:21:26 user nova-compute[75066]: DEBUG nova.compute.manager [req-00648ef4-60dc-49b6-80e2-7f5ed2c88fff req-a1c9e518-bbc1-40a1-a168-1819982a30a1 service nova] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] No waiting events found dispatching network-vif-plugged-478e7aea-9546-4659-bdac-09213bd9cb82 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:21:26 user nova-compute[75066]: WARNING nova.compute.manager [req-00648ef4-60dc-49b6-80e2-7f5ed2c88fff req-a1c9e518-bbc1-40a1-a168-1819982a30a1 service nova] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Received unexpected event network-vif-plugged-478e7aea-9546-4659-bdac-09213bd9cb82 for instance with vm_state resized and task_state resize_reverting.
Dec 01 19:21:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:26 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e73331-f3b9-498e-917b-7783e653db46]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:26 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab2e3b0-5aa1-44e0-a776-e707534ce3bf tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:21:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 -p 172.16.0.220:3260 --logout {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 -p 172.16.0.220:3260 --logout" returned: 0 in 0.094s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:26 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[e48241c1-981e-4d91-920c-e287a2d3e069]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:26 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab2e3b0-5aa1-44e0-a776-e707534ce3bf tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829, portal: 172.16.0.220,3260]
Dec 01 19:21:26 user nova-compute[75066]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829, portal: 172.16.0.220,3260] successful.
Dec 01 19:21:26 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:21:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 -p 172.16.0.220:3260 --op delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f32073d6-c4aa-49cc-a329-e000fd930829 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:26 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[1551bfdd-0fdd-4f64-a6bc-801a5d498ff3]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:26 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab2e3b0-5aa1-44e0-a776-e707534ce3bf tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:21:26 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-cab2e3b0-5aa1-44e0-a776-e707534ce3bf tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.392s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:21:26 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-cab2e3b0-5aa1-44e0-a776-e707534ce3bf tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] <== disconnect_volume: return (394ms) None {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:21:26 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cab2e3b0-5aa1-44e0-a776-e707534ce3bf tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Disconnected iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 19:21:26 user nova-compute[75066]: DEBUG nova.network.neutron [req-f25a794d-913f-432e-8176-caab45b8135b req-96d2a2d7-5d7e-445f-a24e-805f860f305d service nova] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] Updated VIF entry in instance network info cache for port 6c3db9c1-34b1-4671-9553-c3d71eeacb3d. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:21:26 user nova-compute[75066]: DEBUG nova.network.neutron [req-f25a794d-913f-432e-8176-caab45b8135b req-96d2a2d7-5d7e-445f-a24e-805f860f305d service nova] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] Updating instance_info_cache with network_info: [{"id": "6c3db9c1-34b1-4671-9553-c3d71eeacb3d", "address": "fa:16:3e:14:52:b4", "network": {"id": "5380ccc0-6aee-42e3-a3e7-b2219a2eb53a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-952289001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ec09f9e9cee4b46a5adda7a2811e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c3db9c1-34", "ovs_interfaceid": "6c3db9c1-34b1-4671-9553-c3d71eeacb3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:21:26 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-f25a794d-913f-432e-8176-caab45b8135b req-96d2a2d7-5d7e-445f-a24e-805f860f305d service nova] Releasing lock "refresh_cache-b7d86a5a-c62e-41f7-9f33-1a0c61af6a49" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:21:27 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:27 user nova-compute[75066]: DEBUG nova.objects.instance [None req-cab2e3b0-5aa1-44e0-a776-e707534ce3bf tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lazy-loading 'flavor' on Instance uuid c3ceeca4-c16c-4cf5-adfd-7d5a2925f435 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:21:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-cab2e3b0-5aa1-44e0-a776-e707534ce3bf tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "c3ceeca4-c16c-4cf5-adfd-7d5a2925f435" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.242s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:21:27 user nova-compute[75066]: DEBUG nova.compute.manager [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Instance event wait completed in 0 seconds for  {{(pid=75066) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 19:21:27 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Guest created on hypervisor {{(pid=75066) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 19:21:27 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Instance spawned successfully.
Dec 01 19:21:27 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 19:21:27 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Found default for hw_cdrom_bus of ide {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:21:27 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Found default for hw_disk_bus of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:21:27 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Found default for hw_input_bus of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:21:27 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Found default for hw_pointer_model of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:21:27 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Found default for hw_video_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:21:27 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Found default for hw_vif_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:21:27 user nova-compute[75066]: INFO nova.compute.manager [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Took 7.56 seconds to spawn the instance on the hypervisor.
Dec 01 19:21:27 user nova-compute[75066]: DEBUG nova.compute.manager [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:21:27 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Instance event wait completed in 0 seconds for  {{(pid=75066) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 19:21:27 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Instance running successfully.
Dec 01 19:21:27 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] finish_revert_migration finished successfully. {{(pid=75066) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11857}}
Dec 01 19:21:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dc9967cf-966d-4b23-a5cd-8264f48de8a4 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Acquiring lock "c3ceeca4-c16c-4cf5-adfd-7d5a2925f435" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:21:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dc9967cf-966d-4b23-a5cd-8264f48de8a4 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "c3ceeca4-c16c-4cf5-adfd-7d5a2925f435" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:21:27 user nova-compute[75066]: DEBUG nova.compute.manager [None req-dc9967cf-966d-4b23-a5cd-8264f48de8a4 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:21:27 user nova-compute[75066]: INFO nova.compute.manager [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Took 8.44 seconds to build instance.
Dec 01 19:21:27 user nova-compute[75066]: DEBUG nova.compute.manager [None req-dc9967cf-966d-4b23-a5cd-8264f48de8a4 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75066) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Dec 01 19:21:27 user nova-compute[75066]: DEBUG nova.objects.instance [None req-dc9967cf-966d-4b23-a5cd-8264f48de8a4 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lazy-loading 'flavor' on Instance uuid c3ceeca4-c16c-4cf5-adfd-7d5a2925f435 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:21:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-9f7b710f-b6b8-4e55-ad18-34ce2aa199ac tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lock "933210b1-5c5e-421a-9b63-4595fc5f5f25" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.533s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:21:28 user nova-compute[75066]: INFO nova.compute.manager [None req-ad421e70-80e8-47bb-b830-fdf03b69ab2b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Updating instance to original state: 'active'
Dec 01 19:21:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:28 user nova-compute[75066]: DEBUG nova.compute.manager [req-f0dd8d87-1685-4c76-8d14-219bd76103a8 req-23e90857-5f72-4400-9bab-4294017407dc service nova] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Received event network-vif-unplugged-c9353199-d4a3-488f-857d-b0ebdb31a68f {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:21:28 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-f0dd8d87-1685-4c76-8d14-219bd76103a8 req-23e90857-5f72-4400-9bab-4294017407dc service nova] Acquiring lock "c3ceeca4-c16c-4cf5-adfd-7d5a2925f435-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:21:28 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-f0dd8d87-1685-4c76-8d14-219bd76103a8 req-23e90857-5f72-4400-9bab-4294017407dc service nova] Lock "c3ceeca4-c16c-4cf5-adfd-7d5a2925f435-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:21:28 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-f0dd8d87-1685-4c76-8d14-219bd76103a8 req-23e90857-5f72-4400-9bab-4294017407dc service nova] Lock "c3ceeca4-c16c-4cf5-adfd-7d5a2925f435-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:21:28 user nova-compute[75066]: DEBUG nova.compute.manager [req-f0dd8d87-1685-4c76-8d14-219bd76103a8 req-23e90857-5f72-4400-9bab-4294017407dc service nova] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] No waiting events found dispatching network-vif-unplugged-c9353199-d4a3-488f-857d-b0ebdb31a68f {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:21:28 user nova-compute[75066]: WARNING nova.compute.manager [req-f0dd8d87-1685-4c76-8d14-219bd76103a8 req-23e90857-5f72-4400-9bab-4294017407dc service nova] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Received unexpected event network-vif-unplugged-c9353199-d4a3-488f-857d-b0ebdb31a68f for instance with vm_state active and task_state powering-off.
Dec 01 19:21:28 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Instance destroyed successfully.
Dec 01 19:21:28 user nova-compute[75066]: DEBUG nova.compute.manager [None req-dc9967cf-966d-4b23-a5cd-8264f48de8a4 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:21:28 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dc9967cf-966d-4b23-a5cd-8264f48de8a4 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "c3ceeca4-c16c-4cf5-adfd-7d5a2925f435" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.977s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:21:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-866ba3f7-875e-4602-b8a0-3a48ac2af139 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Acquiring lock "b7d86a5a-c62e-41f7-9f33-1a0c61af6a49" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:21:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-866ba3f7-875e-4602-b8a0-3a48ac2af139 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Lock "b7d86a5a-c62e-41f7-9f33-1a0c61af6a49" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:21:29 user nova-compute[75066]: DEBUG nova.objects.instance [None req-866ba3f7-875e-4602-b8a0-3a48ac2af139 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Lazy-loading 'flavor' on Instance uuid b7d86a5a-c62e-41f7-9f33-1a0c61af6a49 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:21:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-866ba3f7-875e-4602-b8a0-3a48ac2af139 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Lock "b7d86a5a-c62e-41f7-9f33-1a0c61af6a49" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.087s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:21:30 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-866ba3f7-875e-4602-b8a0-3a48ac2af139 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Acquiring lock "b7d86a5a-c62e-41f7-9f33-1a0c61af6a49" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:21:30 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-866ba3f7-875e-4602-b8a0-3a48ac2af139 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Lock "b7d86a5a-c62e-41f7-9f33-1a0c61af6a49" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:21:30 user nova-compute[75066]: INFO nova.compute.manager [None req-866ba3f7-875e-4602-b8a0-3a48ac2af139 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] Attaching volume 1f533a4a-ce47-4388-8555-7d87faf20d3b to /dev/vdb
Dec 01 19:21:30 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Acquiring lock "905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:21:30 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:21:30 user nova-compute[75066]: DEBUG nova.compute.manager [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Starting instance... {{(pid=75066) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 19:21:30 user nova-compute[75066]: DEBUG os_brick.utils [None req-866ba3f7-875e-4602-b8a0-3a48ac2af139 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:21:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:30 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1f1d0e-1a49-442c-b2b2-87e865867527]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1959854982f\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:30 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[43cd2e67-51fd-468c-9151-9d2406bf92fc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:30 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca2aa6b-82a3-4f7f-bb01-9dd2b0ac4040]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:30 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2bac70-f646-463b-b72a-116ac93f2da4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-866ba3f7-875e-4602-b8a0-3a48ac2af139 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Running cmd (subprocess): nvme version {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-866ba3f7-875e-4602-b8a0-3a48ac2af139 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] 'nvme version' failed. Not Retrying. {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:21:30 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:21:30 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:21:30 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.nvmeof [None req-866ba3f7-875e-4602-b8a0-3a48ac2af139 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] nvme not present on system {{(pid=75066) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 19:21:30 user nova-compute[75066]: DEBUG nova.compute.manager [req-d20452d0-ce6c-42af-81a1-058d8c1a57bf req-698506ff-13d3-4941-974c-bdc7eaeaedc1 service nova] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Received event network-vif-plugged-c9353199-d4a3-488f-857d-b0ebdb31a68f {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:21:30 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d20452d0-ce6c-42af-81a1-058d8c1a57bf req-698506ff-13d3-4941-974c-bdc7eaeaedc1 service nova] Acquiring lock "c3ceeca4-c16c-4cf5-adfd-7d5a2925f435-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:21:30 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d20452d0-ce6c-42af-81a1-058d8c1a57bf req-698506ff-13d3-4941-974c-bdc7eaeaedc1 service nova] Lock "c3ceeca4-c16c-4cf5-adfd-7d5a2925f435-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:21:30 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d20452d0-ce6c-42af-81a1-058d8c1a57bf req-698506ff-13d3-4941-974c-bdc7eaeaedc1 service nova] Lock "c3ceeca4-c16c-4cf5-adfd-7d5a2925f435-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:21:30 user nova-compute[75066]: DEBUG nova.compute.manager [req-d20452d0-ce6c-42af-81a1-058d8c1a57bf req-698506ff-13d3-4941-974c-bdc7eaeaedc1 service nova] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] No waiting events found dispatching network-vif-plugged-c9353199-d4a3-488f-857d-b0ebdb31a68f {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:21:30 user nova-compute[75066]: WARNING nova.compute.manager [req-d20452d0-ce6c-42af-81a1-058d8c1a57bf req-698506ff-13d3-4941-974c-bdc7eaeaedc1 service nova] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Received unexpected event network-vif-plugged-c9353199-d4a3-488f-857d-b0ebdb31a68f for instance with vm_state stopped and task_state None.
Dec 01 19:21:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:30 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75066) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 19:21:30 user nova-compute[75066]: INFO nova.compute.claims [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Claim successful on node user
Dec 01 19:21:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:21:30 user nova-compute[75066]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 19:21:30 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4414ed-154b-4a28-97a4-b1aa65cf5239]: (4, '') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:30 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-866ba3f7-875e-4602-b8a0-3a48ac2af139 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75066) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 19:21:30 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-866ba3f7-875e-4602-b8a0-3a48ac2af139 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 19:21:30 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-866ba3f7-875e-4602-b8a0-3a48ac2af139 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] LIGHTOS: no hostnqn found. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 19:21:30 user nova-compute[75066]: DEBUG os_brick.utils [None req-866ba3f7-875e-4602-b8a0-3a48ac2af139 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] <== get_connector_properties: return (461ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1959854982f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:21:30 user nova-compute[75066]: DEBUG nova.virt.block_device [None req-866ba3f7-875e-4602-b8a0-3a48ac2af139 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] Updating existing volume attachment record: e6e4f908-a91c-4ce2-be23-55d278dcdbac {{(pid=75066) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 19:21:31 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:21:31 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:21:31 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:21:31 user nova-compute[75066]: DEBUG nova.compute.manager [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Start building networks asynchronously for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 19:21:31 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a7aa68c0-2a9c-4c59-894d-f79115f6286b tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Acquiring lock "67c5dd7c-88aa-4f2f-8f62-a9af0480c38e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:21:31 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a7aa68c0-2a9c-4c59-894d-f79115f6286b tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Lock "67c5dd7c-88aa-4f2f-8f62-a9af0480c38e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:21:31 user nova-compute[75066]: INFO nova.compute.manager [None req-a7aa68c0-2a9c-4c59-894d-f79115f6286b tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Detaching volume 40dba61d-f444-45f9-b949-2138807215fa
Dec 01 19:21:31 user nova-compute[75066]: DEBUG nova.compute.manager [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Allocating IP information in the background. {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 19:21:31 user nova-compute[75066]: DEBUG nova.network.neutron [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] allocate_for_instance() {{(pid=75066) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 19:21:31 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 19:21:31 user nova-compute[75066]: DEBUG nova.compute.manager [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Start building block device mappings for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 19:21:31 user nova-compute[75066]: INFO nova.virt.block_device [None req-a7aa68c0-2a9c-4c59-894d-f79115f6286b tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Attempting to driver detach volume 40dba61d-f444-45f9-b949-2138807215fa from mountpoint /dev/vdb
Dec 01 19:21:31 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-a7aa68c0-2a9c-4c59-894d-f79115f6286b tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Attempting to detach device vdb from instance 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e from the persistent domain config. {{(pid=75066) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 19:21:31 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-a7aa68c0-2a9c-4c59-894d-f79115f6286b tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 19:21:31 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:21:31 user nova-compute[75066]:   <source dev="/dev/sdc"/>
Dec 01 19:21:31 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:21:31 user nova-compute[75066]:   <serial>40dba61d-f444-45f9-b949-2138807215fa</serial>
Dec 01 19:21:31 user nova-compute[75066]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 19:21:31 user nova-compute[75066]: </disk>
Dec 01 19:21:31 user nova-compute[75066]:  {{(pid=75066) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 19:21:31 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-a7aa68c0-2a9c-4c59-894d-f79115f6286b tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Successfully detached device vdb from instance 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e from the persistent domain config.
Dec 01 19:21:31 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-a7aa68c0-2a9c-4c59-894d-f79115f6286b tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e from the live domain config. {{(pid=75066) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 19:21:31 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-a7aa68c0-2a9c-4c59-894d-f79115f6286b tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 19:21:31 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:21:31 user nova-compute[75066]:   <source dev="/dev/sdc"/>
Dec 01 19:21:31 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:21:31 user nova-compute[75066]:   <serial>40dba61d-f444-45f9-b949-2138807215fa</serial>
Dec 01 19:21:31 user nova-compute[75066]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 19:21:31 user nova-compute[75066]: </disk>
Dec 01 19:21:31 user nova-compute[75066]:  {{(pid=75066) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 19:21:31 user nova-compute[75066]: INFO nova.virt.block_device [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Booting with blank volume at /dev/vda
Dec 01 19:21:31 user nova-compute[75066]: DEBUG nova.policy [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '964c1681ca8745d0b3879266d24f507e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e000d89bca44cd8acba504256d8d1f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75066) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 19:21:31 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-a7aa68c0-2a9c-4c59-894d-f79115f6286b tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e {{(pid=75066) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 19:21:32 user nova-compute[75066]: DEBUG nova.network.neutron [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Successfully created port: 6c41fc1e-7ed5-490d-a375-0db34c7ae40b {{(pid=75066) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 19:21:32 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:32 user nova-compute[75066]: DEBUG nova.network.neutron [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Successfully updated port: 6c41fc1e-7ed5-490d-a375-0db34c7ae40b {{(pid=75066) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 19:21:32 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Acquiring lock "refresh_cache-905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:21:32 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Acquired lock "refresh_cache-905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:21:32 user nova-compute[75066]: DEBUG nova.network.neutron [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:21:32 user nova-compute[75066]: DEBUG nova.compute.manager [req-ad56c1d3-2bd4-4eb0-b93c-969292f5049b req-0c2d4e4c-a6c4-4c08-96a8-865db856f448 service nova] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Received event network-changed-6c41fc1e-7ed5-490d-a375-0db34c7ae40b {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:21:32 user nova-compute[75066]: DEBUG nova.compute.manager [req-ad56c1d3-2bd4-4eb0-b93c-969292f5049b req-0c2d4e4c-a6c4-4c08-96a8-865db856f448 service nova] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Refreshing instance network info cache due to event network-changed-6c41fc1e-7ed5-490d-a375-0db34c7ae40b. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:21:32 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-ad56c1d3-2bd4-4eb0-b93c-969292f5049b req-0c2d4e4c-a6c4-4c08-96a8-865db856f448 service nova] Acquiring lock "refresh_cache-905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:21:32 user nova-compute[75066]: DEBUG nova.network.neutron [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:21:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:33 user nova-compute[75066]: DEBUG nova.network.neutron [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Updating instance_info_cache with network_info: [{"id": "6c41fc1e-7ed5-490d-a375-0db34c7ae40b", "address": "fa:16:3e:ed:e9:7c", "network": {"id": "6b0f48b7-3db2-49b2-a238-8fd811b52d62", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1688127634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e000d89bca44cd8acba504256d8d1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c41fc1e-7e", "ovs_interfaceid": "6c41fc1e-7ed5-490d-a375-0db34c7ae40b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:21:33 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Releasing lock "refresh_cache-905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:21:33 user nova-compute[75066]: DEBUG nova.compute.manager [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Instance network_info: |[{"id": "6c41fc1e-7ed5-490d-a375-0db34c7ae40b", "address": "fa:16:3e:ed:e9:7c", "network": {"id": "6b0f48b7-3db2-49b2-a238-8fd811b52d62", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1688127634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e000d89bca44cd8acba504256d8d1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c41fc1e-7e", "ovs_interfaceid": "6c41fc1e-7ed5-490d-a375-0db34c7ae40b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 19:21:33 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-ad56c1d3-2bd4-4eb0-b93c-969292f5049b req-0c2d4e4c-a6c4-4c08-96a8-865db856f448 service nova] Acquired lock "refresh_cache-905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:21:33 user nova-compute[75066]: DEBUG nova.network.neutron [req-ad56c1d3-2bd4-4eb0-b93c-969292f5049b req-0c2d4e4c-a6c4-4c08-96a8-865db856f448 service nova] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Refreshing network info cache for port 6c41fc1e-7ed5-490d-a375-0db34c7ae40b {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:21:33 user nova-compute[75066]: DEBUG nova.network.neutron [req-ad56c1d3-2bd4-4eb0-b93c-969292f5049b req-0c2d4e4c-a6c4-4c08-96a8-865db856f448 service nova] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Updated VIF entry in instance network info cache for port 6c41fc1e-7ed5-490d-a375-0db34c7ae40b. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:21:33 user nova-compute[75066]: DEBUG nova.network.neutron [req-ad56c1d3-2bd4-4eb0-b93c-969292f5049b req-0c2d4e4c-a6c4-4c08-96a8-865db856f448 service nova] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Updating instance_info_cache with network_info: [{"id": "6c41fc1e-7ed5-490d-a375-0db34c7ae40b", "address": "fa:16:3e:ed:e9:7c", "network": {"id": "6b0f48b7-3db2-49b2-a238-8fd811b52d62", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1688127634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e000d89bca44cd8acba504256d8d1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c41fc1e-7e", "ovs_interfaceid": "6c41fc1e-7ed5-490d-a375-0db34c7ae40b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:21:33 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-ad56c1d3-2bd4-4eb0-b93c-969292f5049b req-0c2d4e4c-a6c4-4c08-96a8-865db856f448 service nova] Releasing lock "refresh_cache-905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:21:37 user nova-compute[75066]: DEBUG os_brick.utils [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:21:37 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:37 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:37 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad489753-8fa9-48ef-977e-a1c7448ffe74]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1959854982f\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:37 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:37 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:37 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c5b63f-71af-499c-8718-29f76a9e7c6e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:37 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:37 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:37 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebcbfd3c-9145-4af8-8c92-fb90f85f28da]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:37 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c238f2-baed-49fc-8642-bc3eb7256ab9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:37 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Running cmd (subprocess): nvme version {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:37 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] 'nvme version' failed. Not Retrying. {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:21:37 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.nvmeof [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] nvme not present on system {{(pid=75066) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 19:21:37 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:37 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:21:37 user nova-compute[75066]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 19:21:37 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e561faa-9f14-49cf-9d82-c236cfa9d5ab]: (4, '') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:37 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75066) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 19:21:37 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 19:21:37 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] LIGHTOS: no hostnqn found. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 19:21:37 user nova-compute[75066]: DEBUG os_brick.utils [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1959854982f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:21:37 user nova-compute[75066]: DEBUG nova.virt.block_device [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Updating existing volume attachment record: e0c109bf-cc94-4073-b781-f3cc8ec19c2b {{(pid=75066) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 19:21:37 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:40 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-866ba3f7-875e-4602-b8a0-3a48ac2af139 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] Calling os-brick to attach iSCSI Volume {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 19:21:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-866ba3f7-875e-4602-b8a0-3a48ac2af139 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1f533a4a-ce47-4388-8555-7d87faf20d3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EXdLgujq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:21:40 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-866ba3f7-875e-4602-b8a0-3a48ac2af139 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:21:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-866ba3f7-875e-4602-b8a0-3a48ac2af139 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:21:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-866ba3f7-875e-4602-b8a0-3a48ac2af139 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:21:40 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-866ba3f7-875e-4602-b8a0-3a48ac2af139 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:21:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-866ba3f7-875e-4602-b8a0-3a48ac2af139 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f533a4a-ce47-4388-8555-7d87faf20d3b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:21:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-866ba3f7-875e-4602-b8a0-3a48ac2af139 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f533a4a-ce47-4388-8555-7d87faf20d3b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:21:40 user nova-compute[75066]: INFO os_brick.initiator.connectors.iscsi [None req-866ba3f7-875e-4602-b8a0-3a48ac2af139 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 19:21:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f533a4a-ce47-4388-8555-7d87faf20d3b -p 172.16.0.220:3260 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f533a4a-ce47-4388-8555-7d87faf20d3b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:40 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2665b0-e303-4498-87a5-517f686b97c2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-866ba3f7-875e-4602-b8a0-3a48ac2af139 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 19:21:40 user nova-compute[75066]:  {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:21:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f533a4a-ce47-4388-8555-7d87faf20d3b -p 172.16.0.220:3260 --interface default --op new {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f533a4a-ce47-4388-8555-7d87faf20d3b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:40 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2a9a3b-3124-4b34-b967-c9a7f06605b1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f533a4a-ce47-4388-8555-7d87faf20d3b] added\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-866ba3f7-875e-4602-b8a0-3a48ac2af139 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f533a4a-ce47-4388-8555-7d87faf20d3b] added
Dec 01 19:21:40 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:21:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f533a4a-ce47-4388-8555-7d87faf20d3b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f533a4a-ce47-4388-8555-7d87faf20d3b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:40 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[415ddac7-01d7-476b-89ff-4e8f9c2dfeb7]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-866ba3f7-875e-4602-b8a0-3a48ac2af139 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:21:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f533a4a-ce47-4388-8555-7d87faf20d3b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f533a4a-ce47-4388-8555-7d87faf20d3b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:40 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d31657c-8043-4185-9318-5d520485af3a]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-866ba3f7-875e-4602-b8a0-3a48ac2af139 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:21:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f533a4a-ce47-4388-8555-7d87faf20d3b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EXdLgujq {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f533a4a-ce47-4388-8555-7d87faf20d3b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EXdLgujq" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:40 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b36591-abf4-495d-80d9-573002ccf740]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-866ba3f7-875e-4602-b8a0-3a48ac2af139 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EXdLgujq'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:21:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f533a4a-ce47-4388-8555-7d87faf20d3b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f533a4a-ce47-4388-8555-7d87faf20d3b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:40 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5c0aff-8566-43b5-985c-ff94fd533558]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-866ba3f7-875e-4602-b8a0-3a48ac2af139 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:21:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:40 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[23256fe2-fff8-4d4e-b07a-9998ab55979c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-866ba3f7-875e-4602-b8a0-3a48ac2af139 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)
Dec 01 19:21:40 user nova-compute[75066]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)
Dec 01 19:21:40 user nova-compute[75066]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)
Dec 01 19:21:40 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:21:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-866ba3f7-875e-4602-b8a0-3a48ac2af139 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)
Dec 01 19:21:40 user nova-compute[75066]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)
Dec 01 19:21:40 user nova-compute[75066]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)
Dec 01 19:21:40 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:21:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f533a4a-ce47-4388-8555-7d87faf20d3b -p 172.16.0.220:3260 --login {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f533a4a-ce47-4388-8555-7d87faf20d3b -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:40 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe72a232-f2b5-4555-8b3e-62c53aa46b38]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f533a4a-ce47-4388-8555-7d87faf20d3b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1f533a4a-ce47-4388-8555-7d87faf20d3b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-866ba3f7-875e-4602-b8a0-3a48ac2af139 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f533a4a-ce47-4388-8555-7d87faf20d3b, portal: 172.16.0.220,3260]
Dec 01 19:21:40 user nova-compute[75066]: Login to [iface: default, target: iqn.2010-10.org.openstack:1f533a4a-ce47-4388-8555-7d87faf20d3b, portal: 172.16.0.220,3260] successful.
Dec 01 19:21:40 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:21:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f533a4a-ce47-4388-8555-7d87faf20d3b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f533a4a-ce47-4388-8555-7d87faf20d3b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:40 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a21a4a-dd00-4717-b429-6ee2e4b62083]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-866ba3f7-875e-4602-b8a0-3a48ac2af139 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:21:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:40 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8b6cfc-f808-49a7-950a-73668f3957b2]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f533a4a-ce47-4388-8555-7d87faf20d3b (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-866ba3f7-875e-4602-b8a0-3a48ac2af139 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)
Dec 01 19:21:40 user nova-compute[75066]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)
Dec 01 19:21:40 user nova-compute[75066]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)
Dec 01 19:21:40 user nova-compute[75066]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f533a4a-ce47-4388-8555-7d87faf20d3b (non-flash)
Dec 01 19:21:40 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:21:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-866ba3f7-875e-4602-b8a0-3a48ac2af139 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)
Dec 01 19:21:40 user nova-compute[75066]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)
Dec 01 19:21:40 user nova-compute[75066]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)
Dec 01 19:21:40 user nova-compute[75066]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f533a4a-ce47-4388-8555-7d87faf20d3b (non-flash)
Dec 01 19:21:40 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:21:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-866ba3f7-875e-4602-b8a0-3a48ac2af139 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f533a4a-ce47-4388-8555-7d87faf20d3b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:21:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-866ba3f7-875e-4602-b8a0-3a48ac2af139 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Connected to 172.16.0.220:3260 {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 19:21:40 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-866ba3f7-875e-4602-b8a0-3a48ac2af139 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] HCTL ('36', '-', '-', 0) found on session 20 with lun 0 {{(pid=75066) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 19:21:40 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-866ba3f7-875e-4602-b8a0-3a48ac2af139 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75066) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 19:21:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:40 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2589f92-2069-49df-9cc8-cb9c8147c44d]: (4, ('- - 0', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:40 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-866ba3f7-875e-4602-b8a0-3a48ac2af139 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Searching for a device in session 20 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:21:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-866ba3f7-875e-4602-b8a0-3a48ac2af139 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:1f533a4a-ce47-4388-8555-7d87faf20d3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EXdLgujq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 19:21:41 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-866ba3f7-875e-4602-b8a0-3a48ac2af139 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:21:41 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-866ba3f7-875e-4602-b8a0-3a48ac2af139 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23430386632643365', 'path': '/dev/sde'} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:21:41 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-866ba3f7-875e-4602-b8a0-3a48ac2af139 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23430386632643365', 'path': '/dev/sde'} {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 19:21:41 user nova-compute[75066]: DEBUG nova.objects.instance [None req-866ba3f7-875e-4602-b8a0-3a48ac2af139 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Lazy-loading 'flavor' on Instance uuid b7d86a5a-c62e-41f7-9f33-1a0c61af6a49 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:21:41 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-866ba3f7-875e-4602-b8a0-3a48ac2af139 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 19:21:41 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:21:41 user nova-compute[75066]:   <source dev="/dev/sde"/>
Dec 01 19:21:41 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:21:41 user nova-compute[75066]:   <serial>1f533a4a-ce47-4388-8555-7d87faf20d3b</serial>
Dec 01 19:21:41 user nova-compute[75066]: </disk>
Dec 01 19:21:41 user nova-compute[75066]:  {{(pid=75066) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 19:21:42 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-866ba3f7-875e-4602-b8a0-3a48ac2af139 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:21:42 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-866ba3f7-875e-4602-b8a0-3a48ac2af139 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:21:42 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-866ba3f7-875e-4602-b8a0-3a48ac2af139 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] No VIF found with MAC fa:16:3e:14:52:b4, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:21:42 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:42 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-866ba3f7-875e-4602-b8a0-3a48ac2af139 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Lock "b7d86a5a-c62e-41f7-9f33-1a0c61af6a49" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.458s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:21:43 user nova-compute[75066]: INFO nova.compute.manager [None req-136a8c6c-b1b5-4d6e-944b-2034e03ecb20 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Rescuing
Dec 01 19:21:43 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-136a8c6c-b1b5-4d6e-944b-2034e03ecb20 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Acquiring lock "refresh_cache-14de9d20-9e66-4517-b904-2967e0a06a97" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:21:43 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-136a8c6c-b1b5-4d6e-944b-2034e03ecb20 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Acquired lock "refresh_cache-14de9d20-9e66-4517-b904-2967e0a06a97" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:21:43 user nova-compute[75066]: DEBUG nova.network.neutron [None req-136a8c6c-b1b5-4d6e-944b-2034e03ecb20 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:21:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:43 user nova-compute[75066]: DEBUG nova.network.neutron [None req-136a8c6c-b1b5-4d6e-944b-2034e03ecb20 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Updating instance_info_cache with network_info: [{"id": "4ab99734-a7a9-43f9-b75e-f02d33a7a50d", "address": "fa:16:3e:54:2d:24", "network": {"id": "47c850ae-6dcb-4977-a02a-e32cd3df4749", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-475363603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "943324a514a84cb4947dbab93abc4f6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ab99734-a7", "ovs_interfaceid": "4ab99734-a7a9-43f9-b75e-f02d33a7a50d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:21:43 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-136a8c6c-b1b5-4d6e-944b-2034e03ecb20 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Releasing lock "refresh_cache-14de9d20-9e66-4517-b904-2967e0a06a97" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:21:43 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b110e378-1397-4ed5-996f-13aaf8730492 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Acquiring lock "b7d86a5a-c62e-41f7-9f33-1a0c61af6a49" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:21:43 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b110e378-1397-4ed5-996f-13aaf8730492 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Lock "b7d86a5a-c62e-41f7-9f33-1a0c61af6a49" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:21:43 user nova-compute[75066]: INFO nova.compute.manager [None req-b110e378-1397-4ed5-996f-13aaf8730492 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] Detaching volume 1f533a4a-ce47-4388-8555-7d87faf20d3b
Dec 01 19:21:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:43 user nova-compute[75066]: INFO nova.virt.block_device [None req-b110e378-1397-4ed5-996f-13aaf8730492 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] Attempting to driver detach volume 1f533a4a-ce47-4388-8555-7d87faf20d3b from mountpoint /dev/vdb
Dec 01 19:21:43 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b110e378-1397-4ed5-996f-13aaf8730492 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Attempting to detach device vdb from instance b7d86a5a-c62e-41f7-9f33-1a0c61af6a49 from the persistent domain config. {{(pid=75066) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 19:21:43 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-b110e378-1397-4ed5-996f-13aaf8730492 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 19:21:43 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:21:43 user nova-compute[75066]:   <source dev="/dev/sde"/>
Dec 01 19:21:43 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:21:43 user nova-compute[75066]:   <serial>1f533a4a-ce47-4388-8555-7d87faf20d3b</serial>
Dec 01 19:21:43 user nova-compute[75066]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 19:21:43 user nova-compute[75066]: </disk>
Dec 01 19:21:43 user nova-compute[75066]:  {{(pid=75066) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 19:21:43 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-b110e378-1397-4ed5-996f-13aaf8730492 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Successfully detached device vdb from instance b7d86a5a-c62e-41f7-9f33-1a0c61af6a49 from the persistent domain config.
Dec 01 19:21:43 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b110e378-1397-4ed5-996f-13aaf8730492 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b7d86a5a-c62e-41f7-9f33-1a0c61af6a49 from the live domain config. {{(pid=75066) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 19:21:43 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-b110e378-1397-4ed5-996f-13aaf8730492 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 19:21:43 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:21:43 user nova-compute[75066]:   <source dev="/dev/sde"/>
Dec 01 19:21:43 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:21:43 user nova-compute[75066]:   <serial>1f533a4a-ce47-4388-8555-7d87faf20d3b</serial>
Dec 01 19:21:43 user nova-compute[75066]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 19:21:43 user nova-compute[75066]: </disk>
Dec 01 19:21:43 user nova-compute[75066]:  {{(pid=75066) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 19:21:43 user nova-compute[75066]: DEBUG nova.compute.manager [req-40aedf56-c378-4705-aaf3-7b9b18227f63 req-506dd074-6dc7-4a72-9508-e05a0d518d79 service nova] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Received event network-vif-unplugged-4ab99734-a7a9-43f9-b75e-f02d33a7a50d {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:21:43 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-40aedf56-c378-4705-aaf3-7b9b18227f63 req-506dd074-6dc7-4a72-9508-e05a0d518d79 service nova] Acquiring lock "14de9d20-9e66-4517-b904-2967e0a06a97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:21:43 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-40aedf56-c378-4705-aaf3-7b9b18227f63 req-506dd074-6dc7-4a72-9508-e05a0d518d79 service nova] Lock "14de9d20-9e66-4517-b904-2967e0a06a97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:21:43 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-40aedf56-c378-4705-aaf3-7b9b18227f63 req-506dd074-6dc7-4a72-9508-e05a0d518d79 service nova] Lock "14de9d20-9e66-4517-b904-2967e0a06a97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:21:43 user nova-compute[75066]: DEBUG nova.compute.manager [req-40aedf56-c378-4705-aaf3-7b9b18227f63 req-506dd074-6dc7-4a72-9508-e05a0d518d79 service nova] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] No waiting events found dispatching network-vif-unplugged-4ab99734-a7a9-43f9-b75e-f02d33a7a50d {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:21:43 user nova-compute[75066]: WARNING nova.compute.manager [req-40aedf56-c378-4705-aaf3-7b9b18227f63 req-506dd074-6dc7-4a72-9508-e05a0d518d79 service nova] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Received unexpected event network-vif-unplugged-4ab99734-a7a9-43f9-b75e-f02d33a7a50d for instance with vm_state active and task_state rescuing.
Dec 01 19:21:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:44 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:44 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:44 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:44 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:44 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:44 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:44 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b110e378-1397-4ed5-996f-13aaf8730492 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b7d86a5a-c62e-41f7-9f33-1a0c61af6a49 {{(pid=75066) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 19:21:44 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Instance destroyed successfully.
Dec 01 19:21:44 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-136a8c6c-b1b5-4d6e-944b-2034e03ecb20 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Attempting rescue
Dec 01 19:21:44 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-136a8c6c-b1b5-4d6e-944b-2034e03ecb20 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75066) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4314}}
Dec 01 19:21:44 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-136a8c6c-b1b5-4d6e-944b-2034e03ecb20 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Instance directory exists: not creating {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4719}}
Dec 01 19:21:44 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-136a8c6c-b1b5-4d6e-944b-2034e03ecb20 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Creating image(s)
Dec 01 19:21:44 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-136a8c6c-b1b5-4d6e-944b-2034e03ecb20 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Acquiring lock "/opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:21:44 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-136a8c6c-b1b5-4d6e-944b-2034e03ecb20 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "/opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:21:44 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-136a8c6c-b1b5-4d6e-944b-2034e03ecb20 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "/opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:21:44 user nova-compute[75066]: DEBUG nova.objects.instance [None req-136a8c6c-b1b5-4d6e-944b-2034e03ecb20 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lazy-loading 'trusted_certs' on Instance uuid 14de9d20-9e66-4517-b904-2967e0a06a97 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:21:44 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-136a8c6c-b1b5-4d6e-944b-2034e03ecb20 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Acquiring lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:21:44 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-136a8c6c-b1b5-4d6e-944b-2034e03ecb20 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:21:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-136a8c6c-b1b5-4d6e-944b-2034e03ecb20 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:44 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:44 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-136a8c6c-b1b5-4d6e-944b-2034e03ecb20 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.214s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-136a8c6c-b1b5-4d6e-944b-2034e03ecb20 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk.rescue {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-136a8c6c-b1b5-4d6e-944b-2034e03ecb20 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk.rescue" returned: 0 in 0.050s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:44 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-136a8c6c-b1b5-4d6e-944b-2034e03ecb20 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:21:44 user nova-compute[75066]: DEBUG nova.objects.instance [None req-136a8c6c-b1b5-4d6e-944b-2034e03ecb20 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lazy-loading 'migration_context' on Instance uuid 14de9d20-9e66-4517-b904-2967e0a06a97 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:21:44 user nova-compute[75066]: DEBUG nova.objects.base [None req-136a8c6c-b1b5-4d6e-944b-2034e03ecb20 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Object Instance<14de9d20-9e66-4517-b904-2967e0a06a97> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75066) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 19:21:44 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-136a8c6c-b1b5-4d6e-944b-2034e03ecb20 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Created local disks {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 19:21:44 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-136a8c6c-b1b5-4d6e-944b-2034e03ecb20 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Start _get_guest_xml network_info=[{"id": "4ab99734-a7a9-43f9-b75e-f02d33a7a50d", "address": "fa:16:3e:54:2d:24", "network": {"id": "47c850ae-6dcb-4977-a02a-e32cd3df4749", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-475363603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-475363603-network", "vif_mac": "fa:16:3e:54:2d:24"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "943324a514a84cb4947dbab93abc4f6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ab99734-a7", "ovs_interfaceid": "4ab99734-a7a9-43f9-b75e-f02d33a7a50d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '900b237b-e99c-4fdd-a44f-dcb7a08baa86', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:21:44 user nova-compute[75066]: DEBUG nova.objects.instance [None req-136a8c6c-b1b5-4d6e-944b-2034e03ecb20 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lazy-loading 'resources' on Instance uuid 14de9d20-9e66-4517-b904-2967e0a06a97 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:21:44 user nova-compute[75066]: DEBUG nova.objects.base [None req-136a8c6c-b1b5-4d6e-944b-2034e03ecb20 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Object Instance<14de9d20-9e66-4517-b904-2967e0a06a97> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75066) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 19:21:44 user nova-compute[75066]: DEBUG nova.objects.instance [None req-136a8c6c-b1b5-4d6e-944b-2034e03ecb20 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lazy-loading 'numa_topology' on Instance uuid 14de9d20-9e66-4517-b904-2967e0a06a97 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:21:44 user nova-compute[75066]: DEBUG nova.objects.base [None req-136a8c6c-b1b5-4d6e-944b-2034e03ecb20 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Object Instance<14de9d20-9e66-4517-b904-2967e0a06a97> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75066) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 19:21:44 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-136a8c6c-b1b5-4d6e-944b-2034e03ecb20 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:21:44 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-136a8c6c-b1b5-4d6e-944b-2034e03ecb20 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:21:44 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-136a8c6c-b1b5-4d6e-944b-2034e03ecb20 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:21:44 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-136a8c6c-b1b5-4d6e-944b-2034e03ecb20 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:21:44 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-136a8c6c-b1b5-4d6e-944b-2034e03ecb20 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:21:44 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-136a8c6c-b1b5-4d6e-944b-2034e03ecb20 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:21:44 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-136a8c6c-b1b5-4d6e-944b-2034e03ecb20 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:21:44 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-136a8c6c-b1b5-4d6e-944b-2034e03ecb20 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:21:44 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-136a8c6c-b1b5-4d6e-944b-2034e03ecb20 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:21:44 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-136a8c6c-b1b5-4d6e-944b-2034e03ecb20 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:21:44 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-136a8c6c-b1b5-4d6e-944b-2034e03ecb20 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:21:44 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-136a8c6c-b1b5-4d6e-944b-2034e03ecb20 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:21:44 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-136a8c6c-b1b5-4d6e-944b-2034e03ecb20 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:21:44 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-136a8c6c-b1b5-4d6e-944b-2034e03ecb20 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:21:44 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-136a8c6c-b1b5-4d6e-944b-2034e03ecb20 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:21:44 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-136a8c6c-b1b5-4d6e-944b-2034e03ecb20 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:21:44 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-136a8c6c-b1b5-4d6e-944b-2034e03ecb20 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:21:44 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-136a8c6c-b1b5-4d6e-944b-2034e03ecb20 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:21:44 user nova-compute[75066]: DEBUG nova.objects.instance [None req-136a8c6c-b1b5-4d6e-944b-2034e03ecb20 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lazy-loading 'vcpu_model' on Instance uuid 14de9d20-9e66-4517-b904-2967e0a06a97 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:21:44 user nova-compute[75066]: DEBUG nova.objects.base [None req-136a8c6c-b1b5-4d6e-944b-2034e03ecb20 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Object Instance<14de9d20-9e66-4517-b904-2967e0a06a97> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75066) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 19:21:44 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-136a8c6c-b1b5-4d6e-944b-2034e03ecb20 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:19:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-186779241',display_name='tempest-ServerRescueNegativeTestJSON-server-186779241',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-186779241',id=16,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:20:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='943324a514a84cb4947dbab93abc4f6c',ramdisk_id='',reservation_id='r-z616xe6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-146516797',owner_user_name='tempest-ServerRescueNegativeTestJSON-146516797-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:20:02Z,user_data=None,user_id='e6ee9ed4a8d8418082a59be8db20cf2e',uuid=14de9d20-9e66-4517-b904-2967e0a06a97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ab99734-a7a9-43f9-b75e-f02d33a7a50d", "address": "fa:16:3e:54:2d:24", "network": {"id": "47c850ae-6dcb-4977-a02a-e32cd3df4749", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-475363603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-475363603-network", "vif_mac": "fa:16:3e:54:2d:24"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "943324a514a84cb4947dbab93abc4f6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ab99734-a7", "ovs_interfaceid": "4ab99734-a7a9-43f9-b75e-f02d33a7a50d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:21:44 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-136a8c6c-b1b5-4d6e-944b-2034e03ecb20 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Converting VIF {"id": "4ab99734-a7a9-43f9-b75e-f02d33a7a50d", "address": "fa:16:3e:54:2d:24", "network": {"id": "47c850ae-6dcb-4977-a02a-e32cd3df4749", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-475363603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-475363603-network", "vif_mac": "fa:16:3e:54:2d:24"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "943324a514a84cb4947dbab93abc4f6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ab99734-a7", "ovs_interfaceid": "4ab99734-a7a9-43f9-b75e-f02d33a7a50d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:21:44 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-136a8c6c-b1b5-4d6e-944b-2034e03ecb20 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:2d:24,bridge_name='br-int',has_traffic_filtering=True,id=4ab99734-a7a9-43f9-b75e-f02d33a7a50d,network=Network(47c850ae-6dcb-4977-a02a-e32cd3df4749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ab99734-a7') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:21:44 user nova-compute[75066]: DEBUG nova.objects.instance [None req-136a8c6c-b1b5-4d6e-944b-2034e03ecb20 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lazy-loading 'pci_devices' on Instance uuid 14de9d20-9e66-4517-b904-2967e0a06a97 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:21:44 user nova-compute[75066]: DEBUG nova.objects.base [None req-136a8c6c-b1b5-4d6e-944b-2034e03ecb20 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Object Instance<14de9d20-9e66-4517-b904-2967e0a06a97> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75066) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 19:21:44 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-136a8c6c-b1b5-4d6e-944b-2034e03ecb20 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:21:44 user nova-compute[75066]:   <uuid>14de9d20-9e66-4517-b904-2967e0a06a97</uuid>
Dec 01 19:21:44 user nova-compute[75066]:   <name>instance-00000010</name>
Dec 01 19:21:44 user nova-compute[75066]:   <memory>524288</memory>
Dec 01 19:21:44 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:21:44 user nova-compute[75066]:   <metadata>
Dec 01 19:21:44 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:21:44 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:21:44 user nova-compute[75066]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-186779241</nova:name>
Dec 01 19:21:44 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:21:44</nova:creationTime>
Dec 01 19:21:44 user nova-compute[75066]:       <nova:flavor name="m1.tiny">
Dec 01 19:21:44 user nova-compute[75066]:         <nova:memory>512</nova:memory>
Dec 01 19:21:44 user nova-compute[75066]:         <nova:disk>1</nova:disk>
Dec 01 19:21:44 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:21:44 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:21:44 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:21:44 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:21:44 user nova-compute[75066]:       <nova:owner>
Dec 01 19:21:44 user nova-compute[75066]:         <nova:user uuid="e6ee9ed4a8d8418082a59be8db20cf2e">tempest-ServerRescueNegativeTestJSON-146516797-project-member</nova:user>
Dec 01 19:21:44 user nova-compute[75066]:         <nova:project uuid="943324a514a84cb4947dbab93abc4f6c">tempest-ServerRescueNegativeTestJSON-146516797</nova:project>
Dec 01 19:21:44 user nova-compute[75066]:       </nova:owner>
Dec 01 19:21:44 user nova-compute[75066]:       <nova:root type="image" uuid="900b237b-e99c-4fdd-a44f-dcb7a08baa86"/>
Dec 01 19:21:44 user nova-compute[75066]:       <nova:ports>
Dec 01 19:21:44 user nova-compute[75066]:         <nova:port uuid="4ab99734-a7a9-43f9-b75e-f02d33a7a50d">
Dec 01 19:21:44 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Dec 01 19:21:44 user nova-compute[75066]:         </nova:port>
Dec 01 19:21:44 user nova-compute[75066]:       </nova:ports>
Dec 01 19:21:44 user nova-compute[75066]:     </nova:instance>
Dec 01 19:21:44 user nova-compute[75066]:   </metadata>
Dec 01 19:21:44 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:21:44 user nova-compute[75066]:     <system>
Dec 01 19:21:44 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:21:44 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:21:44 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:21:44 user nova-compute[75066]:       <entry name="serial">14de9d20-9e66-4517-b904-2967e0a06a97</entry>
Dec 01 19:21:44 user nova-compute[75066]:       <entry name="uuid">14de9d20-9e66-4517-b904-2967e0a06a97</entry>
Dec 01 19:21:44 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:21:44 user nova-compute[75066]:     </system>
Dec 01 19:21:44 user nova-compute[75066]:   </sysinfo>
Dec 01 19:21:44 user nova-compute[75066]:   <os>
Dec 01 19:21:44 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:21:44 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:21:44 user nova-compute[75066]:   </os>
Dec 01 19:21:44 user nova-compute[75066]:   <features>
Dec 01 19:21:44 user nova-compute[75066]:     <acpi/>
Dec 01 19:21:44 user nova-compute[75066]:     <apic/>
Dec 01 19:21:44 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:21:44 user nova-compute[75066]:   </features>
Dec 01 19:21:44 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:21:44 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:21:44 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:21:44 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:21:44 user nova-compute[75066]:   </clock>
Dec 01 19:21:44 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:21:44 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:21:44 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:21:44 user nova-compute[75066]:   </cpu>
Dec 01 19:21:44 user nova-compute[75066]:   <devices>
Dec 01 19:21:44 user nova-compute[75066]:     <disk type="file" device="disk">
Dec 01 19:21:44 user nova-compute[75066]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 19:21:44 user nova-compute[75066]:       <source file="/opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk.rescue"/>
Dec 01 19:21:44 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:21:44 user nova-compute[75066]:     </disk>
Dec 01 19:21:44 user nova-compute[75066]:     <disk type="file" device="disk">
Dec 01 19:21:44 user nova-compute[75066]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 19:21:44 user nova-compute[75066]:       <source file="/opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk"/>
Dec 01 19:21:44 user nova-compute[75066]:       <target dev="vdb" bus="virtio"/>
Dec 01 19:21:44 user nova-compute[75066]:     </disk>
Dec 01 19:21:44 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:21:44 user nova-compute[75066]:       <mac address="fa:16:3e:54:2d:24"/>
Dec 01 19:21:44 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:21:44 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:21:44 user nova-compute[75066]:       <target dev="tap4ab99734-a7"/>
Dec 01 19:21:44 user nova-compute[75066]:     </interface>
Dec 01 19:21:44 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:21:44 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/console.log" append="off"/>
Dec 01 19:21:44 user nova-compute[75066]:     </serial>
Dec 01 19:21:44 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:21:44 user nova-compute[75066]:     <video>
Dec 01 19:21:44 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:21:44 user nova-compute[75066]:     </video>
Dec 01 19:21:44 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:21:44 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:21:44 user nova-compute[75066]:     </rng>
Dec 01 19:21:44 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:21:44 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:21:44 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:21:44 user nova-compute[75066]:     </memballoon>
Dec 01 19:21:44 user nova-compute[75066]:   </devices>
Dec 01 19:21:44 user nova-compute[75066]: </domain>
Dec 01 19:21:44 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:21:44 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Instance destroyed successfully.
Dec 01 19:21:45 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-136a8c6c-b1b5-4d6e-944b-2034e03ecb20 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:21:45 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-136a8c6c-b1b5-4d6e-944b-2034e03ecb20 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:21:45 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-136a8c6c-b1b5-4d6e-944b-2034e03ecb20 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] No VIF found with MAC fa:16:3e:54:2d:24, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:21:46 user nova-compute[75066]: DEBUG nova.compute.manager [req-56ab0967-cc7a-4d7a-9370-c29cbba7f92a req-73cb17f1-3ae2-4015-9a66-11b22559a6cb service nova] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Received event network-vif-plugged-4ab99734-a7a9-43f9-b75e-f02d33a7a50d {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:21:46 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-56ab0967-cc7a-4d7a-9370-c29cbba7f92a req-73cb17f1-3ae2-4015-9a66-11b22559a6cb service nova] Acquiring lock "14de9d20-9e66-4517-b904-2967e0a06a97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:21:46 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-56ab0967-cc7a-4d7a-9370-c29cbba7f92a req-73cb17f1-3ae2-4015-9a66-11b22559a6cb service nova] Lock "14de9d20-9e66-4517-b904-2967e0a06a97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:21:46 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-56ab0967-cc7a-4d7a-9370-c29cbba7f92a req-73cb17f1-3ae2-4015-9a66-11b22559a6cb service nova] Lock "14de9d20-9e66-4517-b904-2967e0a06a97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:21:46 user nova-compute[75066]: DEBUG nova.compute.manager [req-56ab0967-cc7a-4d7a-9370-c29cbba7f92a req-73cb17f1-3ae2-4015-9a66-11b22559a6cb service nova] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] No waiting events found dispatching network-vif-plugged-4ab99734-a7a9-43f9-b75e-f02d33a7a50d {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:21:46 user nova-compute[75066]: WARNING nova.compute.manager [req-56ab0967-cc7a-4d7a-9370-c29cbba7f92a req-73cb17f1-3ae2-4015-9a66-11b22559a6cb service nova] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Received unexpected event network-vif-plugged-4ab99734-a7a9-43f9-b75e-f02d33a7a50d for instance with vm_state active and task_state rescuing.
Dec 01 19:21:46 user nova-compute[75066]: DEBUG nova.compute.manager [req-56ab0967-cc7a-4d7a-9370-c29cbba7f92a req-73cb17f1-3ae2-4015-9a66-11b22559a6cb service nova] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Received event network-vif-plugged-4ab99734-a7a9-43f9-b75e-f02d33a7a50d {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:21:46 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-56ab0967-cc7a-4d7a-9370-c29cbba7f92a req-73cb17f1-3ae2-4015-9a66-11b22559a6cb service nova] Acquiring lock "14de9d20-9e66-4517-b904-2967e0a06a97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:21:46 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-56ab0967-cc7a-4d7a-9370-c29cbba7f92a req-73cb17f1-3ae2-4015-9a66-11b22559a6cb service nova] Lock "14de9d20-9e66-4517-b904-2967e0a06a97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:21:46 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-56ab0967-cc7a-4d7a-9370-c29cbba7f92a req-73cb17f1-3ae2-4015-9a66-11b22559a6cb service nova] Lock "14de9d20-9e66-4517-b904-2967e0a06a97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:21:46 user nova-compute[75066]: DEBUG nova.compute.manager [req-56ab0967-cc7a-4d7a-9370-c29cbba7f92a req-73cb17f1-3ae2-4015-9a66-11b22559a6cb service nova] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] No waiting events found dispatching network-vif-plugged-4ab99734-a7a9-43f9-b75e-f02d33a7a50d {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:21:46 user nova-compute[75066]: WARNING nova.compute.manager [req-56ab0967-cc7a-4d7a-9370-c29cbba7f92a req-73cb17f1-3ae2-4015-9a66-11b22559a6cb service nova] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Received unexpected event network-vif-plugged-4ab99734-a7a9-43f9-b75e-f02d33a7a50d for instance with vm_state active and task_state rescuing.
Dec 01 19:21:46 user nova-compute[75066]: DEBUG nova.compute.manager [req-56ab0967-cc7a-4d7a-9370-c29cbba7f92a req-73cb17f1-3ae2-4015-9a66-11b22559a6cb service nova] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Received event network-vif-plugged-4ab99734-a7a9-43f9-b75e-f02d33a7a50d {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:21:46 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-56ab0967-cc7a-4d7a-9370-c29cbba7f92a req-73cb17f1-3ae2-4015-9a66-11b22559a6cb service nova] Acquiring lock "14de9d20-9e66-4517-b904-2967e0a06a97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:21:46 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-56ab0967-cc7a-4d7a-9370-c29cbba7f92a req-73cb17f1-3ae2-4015-9a66-11b22559a6cb service nova] Lock "14de9d20-9e66-4517-b904-2967e0a06a97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:21:46 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-56ab0967-cc7a-4d7a-9370-c29cbba7f92a req-73cb17f1-3ae2-4015-9a66-11b22559a6cb service nova] Lock "14de9d20-9e66-4517-b904-2967e0a06a97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:21:46 user nova-compute[75066]: DEBUG nova.compute.manager [req-56ab0967-cc7a-4d7a-9370-c29cbba7f92a req-73cb17f1-3ae2-4015-9a66-11b22559a6cb service nova] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] No waiting events found dispatching network-vif-plugged-4ab99734-a7a9-43f9-b75e-f02d33a7a50d {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:21:46 user nova-compute[75066]: WARNING nova.compute.manager [req-56ab0967-cc7a-4d7a-9370-c29cbba7f92a req-73cb17f1-3ae2-4015-9a66-11b22559a6cb service nova] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Received unexpected event network-vif-plugged-4ab99734-a7a9-43f9-b75e-f02d33a7a50d for instance with vm_state active and task_state rescuing.
Dec 01 19:21:46 user nova-compute[75066]: DEBUG nova.compute.manager [req-56ab0967-cc7a-4d7a-9370-c29cbba7f92a req-73cb17f1-3ae2-4015-9a66-11b22559a6cb service nova] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Received event network-vif-unplugged-4ab99734-a7a9-43f9-b75e-f02d33a7a50d {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:21:46 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-56ab0967-cc7a-4d7a-9370-c29cbba7f92a req-73cb17f1-3ae2-4015-9a66-11b22559a6cb service nova] Acquiring lock "14de9d20-9e66-4517-b904-2967e0a06a97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:21:46 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-56ab0967-cc7a-4d7a-9370-c29cbba7f92a req-73cb17f1-3ae2-4015-9a66-11b22559a6cb service nova] Lock "14de9d20-9e66-4517-b904-2967e0a06a97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:21:46 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-56ab0967-cc7a-4d7a-9370-c29cbba7f92a req-73cb17f1-3ae2-4015-9a66-11b22559a6cb service nova] Lock "14de9d20-9e66-4517-b904-2967e0a06a97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:21:46 user nova-compute[75066]: DEBUG nova.compute.manager [req-56ab0967-cc7a-4d7a-9370-c29cbba7f92a req-73cb17f1-3ae2-4015-9a66-11b22559a6cb service nova] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] No waiting events found dispatching network-vif-unplugged-4ab99734-a7a9-43f9-b75e-f02d33a7a50d {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:21:46 user nova-compute[75066]: WARNING nova.compute.manager [req-56ab0967-cc7a-4d7a-9370-c29cbba7f92a req-73cb17f1-3ae2-4015-9a66-11b22559a6cb service nova] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Received unexpected event network-vif-unplugged-4ab99734-a7a9-43f9-b75e-f02d33a7a50d for instance with vm_state active and task_state rescuing.
Dec 01 19:21:46 user nova-compute[75066]: DEBUG nova.compute.manager [req-56ab0967-cc7a-4d7a-9370-c29cbba7f92a req-73cb17f1-3ae2-4015-9a66-11b22559a6cb service nova] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Received event network-vif-plugged-4ab99734-a7a9-43f9-b75e-f02d33a7a50d {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:21:46 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-56ab0967-cc7a-4d7a-9370-c29cbba7f92a req-73cb17f1-3ae2-4015-9a66-11b22559a6cb service nova] Acquiring lock "14de9d20-9e66-4517-b904-2967e0a06a97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:21:46 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-56ab0967-cc7a-4d7a-9370-c29cbba7f92a req-73cb17f1-3ae2-4015-9a66-11b22559a6cb service nova] Lock "14de9d20-9e66-4517-b904-2967e0a06a97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:21:46 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-56ab0967-cc7a-4d7a-9370-c29cbba7f92a req-73cb17f1-3ae2-4015-9a66-11b22559a6cb service nova] Lock "14de9d20-9e66-4517-b904-2967e0a06a97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:21:46 user nova-compute[75066]: DEBUG nova.compute.manager [req-56ab0967-cc7a-4d7a-9370-c29cbba7f92a req-73cb17f1-3ae2-4015-9a66-11b22559a6cb service nova] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] No waiting events found dispatching network-vif-plugged-4ab99734-a7a9-43f9-b75e-f02d33a7a50d {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:21:46 user nova-compute[75066]: WARNING nova.compute.manager [req-56ab0967-cc7a-4d7a-9370-c29cbba7f92a req-73cb17f1-3ae2-4015-9a66-11b22559a6cb service nova] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Received unexpected event network-vif-plugged-4ab99734-a7a9-43f9-b75e-f02d33a7a50d for instance with vm_state active and task_state rescuing.
Dec 01 19:21:46 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:46 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:46 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:46 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:46 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:46 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:47 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:47 user nova-compute[75066]: DEBUG nova.compute.manager [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Start spawning the instance on the hypervisor. {{(pid=75066) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 19:21:47 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Creating instance directory {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 19:21:47 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Creating image(s)
Dec 01 19:21:47 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Did not create local disks {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Dec 01 19:21:47 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Ensure instance console log exists: /opt/stack/data/nova/instances/905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436/console.log {{(pid=75066) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 19:21:47 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:21:47 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:21:47 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:21:47 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Start _get_guest_xml network_info=[{"id": "6c41fc1e-7ed5-490d-a375-0db34c7ae40b", "address": "fa:16:3e:ed:e9:7c", "network": {"id": "6b0f48b7-3db2-49b2-a238-8fd811b52d62", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1688127634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e000d89bca44cd8acba504256d8d1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c41fc1e-7e", "ovs_interfaceid": "6c41fc1e-7ed5-490d-a375-0db34c7ae40b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': False, 'attachment_id': 'e0c109bf-cc94-4073-b781-f3cc8ec19c2b', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fQZgCqOJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436', 'attached_at': '', 'detached_at': '', 'volume_id': '1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb', 'serial': '1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:21:47 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:21:47 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:21:47 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:21:47 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:21:47 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:21:47 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:21:47 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:21:47 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:21:47 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:21:47 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:21:47 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:21:47 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:21:47 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:21:47 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:21:47 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:21:47 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:21:47 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:21:47 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:21:47 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Calling os-brick to attach iSCSI Volume {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 19:21:47 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fQZgCqOJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:21:47 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:21:47 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:21:47 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:21:47 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:21:47 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:21:47 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:21:47 user nova-compute[75066]: INFO os_brick.initiator.connectors.iscsi [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 19:21:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb -p 172.16.0.220:3260 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:47 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[46791676-6fdc-42d9-aa58-89f2bd363350]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:47 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 19:21:47 user nova-compute[75066]:  {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:21:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb -p 172.16.0.220:3260 --interface default --op new {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:47 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[71260487-804e-4ba8-910a-a289a6be33a8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb] added\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:47 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb] added
Dec 01 19:21:47 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:21:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:47 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f70bdd-28c3-4305-bd89-799f1d544b34]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:47 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:21:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:47 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3646979-014e-4414-9060-af5899db39ad]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:47 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:21:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fQZgCqOJ {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fQZgCqOJ" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:47 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[281d23f2-90bb-4837-8a5b-7d65ab19373b]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:47 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fQZgCqOJ'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:21:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:47 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[9addbee5-0b4a-4fa7-80c3-125bf3d2ea8c]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:47 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:21:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:47 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87b567a-338e-48ff-a2e9-e5e5ad9561e6]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f533a4a-ce47-4388-8555-7d87faf20d3b (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:47 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)
Dec 01 19:21:47 user nova-compute[75066]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)
Dec 01 19:21:47 user nova-compute[75066]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)
Dec 01 19:21:47 user nova-compute[75066]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f533a4a-ce47-4388-8555-7d87faf20d3b (non-flash)
Dec 01 19:21:47 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:21:47 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)
Dec 01 19:21:47 user nova-compute[75066]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)
Dec 01 19:21:47 user nova-compute[75066]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)
Dec 01 19:21:47 user nova-compute[75066]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f533a4a-ce47-4388-8555-7d87faf20d3b (non-flash)
Dec 01 19:21:47 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:21:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb -p 172.16.0.220:3260 --login {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:48 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:48 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb73045-e2cd-4ca3-9261-963eccd481bd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:48 user nova-compute[75066]: DEBUG nova.compute.manager [req-8bd9579e-c0c0-490f-aeba-fbe89a48fb89 req-fae30930-d215-493b-a0c1-a15ac3408005 service nova] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Received event network-vif-plugged-4ab99734-a7a9-43f9-b75e-f02d33a7a50d {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:21:48 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-8bd9579e-c0c0-490f-aeba-fbe89a48fb89 req-fae30930-d215-493b-a0c1-a15ac3408005 service nova] Acquiring lock "14de9d20-9e66-4517-b904-2967e0a06a97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:21:48 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-8bd9579e-c0c0-490f-aeba-fbe89a48fb89 req-fae30930-d215-493b-a0c1-a15ac3408005 service nova] Lock "14de9d20-9e66-4517-b904-2967e0a06a97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:21:48 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-8bd9579e-c0c0-490f-aeba-fbe89a48fb89 req-fae30930-d215-493b-a0c1-a15ac3408005 service nova] Lock "14de9d20-9e66-4517-b904-2967e0a06a97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:21:48 user nova-compute[75066]: DEBUG nova.compute.manager [req-8bd9579e-c0c0-490f-aeba-fbe89a48fb89 req-fae30930-d215-493b-a0c1-a15ac3408005 service nova] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] No waiting events found dispatching network-vif-plugged-4ab99734-a7a9-43f9-b75e-f02d33a7a50d {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:21:48 user nova-compute[75066]: WARNING nova.compute.manager [req-8bd9579e-c0c0-490f-aeba-fbe89a48fb89 req-fae30930-d215-493b-a0c1-a15ac3408005 service nova] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Received unexpected event network-vif-plugged-4ab99734-a7a9-43f9-b75e-f02d33a7a50d for instance with vm_state active and task_state rescuing.
Dec 01 19:21:48 user nova-compute[75066]: DEBUG nova.compute.manager [req-8bd9579e-c0c0-490f-aeba-fbe89a48fb89 req-fae30930-d215-493b-a0c1-a15ac3408005 service nova] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Received event network-vif-plugged-4ab99734-a7a9-43f9-b75e-f02d33a7a50d {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:21:48 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-8bd9579e-c0c0-490f-aeba-fbe89a48fb89 req-fae30930-d215-493b-a0c1-a15ac3408005 service nova] Acquiring lock "14de9d20-9e66-4517-b904-2967e0a06a97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:21:48 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-8bd9579e-c0c0-490f-aeba-fbe89a48fb89 req-fae30930-d215-493b-a0c1-a15ac3408005 service nova] Lock "14de9d20-9e66-4517-b904-2967e0a06a97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:21:48 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-8bd9579e-c0c0-490f-aeba-fbe89a48fb89 req-fae30930-d215-493b-a0c1-a15ac3408005 service nova] Lock "14de9d20-9e66-4517-b904-2967e0a06a97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:21:48 user nova-compute[75066]: DEBUG nova.compute.manager [req-8bd9579e-c0c0-490f-aeba-fbe89a48fb89 req-fae30930-d215-493b-a0c1-a15ac3408005 service nova] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] No waiting events found dispatching network-vif-plugged-4ab99734-a7a9-43f9-b75e-f02d33a7a50d {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:21:48 user nova-compute[75066]: WARNING nova.compute.manager [req-8bd9579e-c0c0-490f-aeba-fbe89a48fb89 req-fae30930-d215-493b-a0c1-a15ac3408005 service nova] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Received unexpected event network-vif-plugged-4ab99734-a7a9-43f9-b75e-f02d33a7a50d for instance with vm_state active and task_state rescuing.
Dec 01 19:21:48 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb, portal: 172.16.0.220,3260]
Dec 01 19:21:48 user nova-compute[75066]: Login to [iface: default, target: iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb, portal: 172.16.0.220,3260] successful.
Dec 01 19:21:48 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:21:48 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:48 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:48 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[4370ce25-f12e-429a-b35c-43a3bb8a8700]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:48 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:21:48 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:48 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:48 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df18bfa-3b8e-484e-a65c-6f855c13bf4c]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f533a4a-ce47-4388-8555-7d87faf20d3b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:48 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)
Dec 01 19:21:48 user nova-compute[75066]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)
Dec 01 19:21:48 user nova-compute[75066]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)
Dec 01 19:21:48 user nova-compute[75066]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f533a4a-ce47-4388-8555-7d87faf20d3b (non-flash)
Dec 01 19:21:48 user nova-compute[75066]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:21:48 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:21:48 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)
Dec 01 19:21:48 user nova-compute[75066]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)
Dec 01 19:21:48 user nova-compute[75066]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)
Dec 01 19:21:48 user nova-compute[75066]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f533a4a-ce47-4388-8555-7d87faf20d3b (non-flash)
Dec 01 19:21:48 user nova-compute[75066]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:21:48 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:21:48 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:21:48 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Connected to 172.16.0.220:3260 {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 19:21:48 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] HCTL ('37', '-', '-', 0) found on session 21 with lun 0 {{(pid=75066) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 19:21:48 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75066) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 19:21:48 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:48 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:48 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b39c19a-5813-49d8-81f3-f4693214fb50]: (4, ('- - 0', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:48 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Searching for a device in session 21 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:21:48 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fQZgCqOJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 19:21:48 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:48 user nova-compute[75066]: DEBUG nova.compute.manager [None req-136a8c6c-b1b5-4d6e-944b-2034e03ecb20 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:21:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:21:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23333656132396164', 'path': '/dev/sdf'} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:21:49 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333656132396164', 'path': '/dev/sdf'} {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 19:21:49 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:21:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1711948720',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1711948720',id=20,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e000d89bca44cd8acba504256d8d1f1',ramdisk_id='',reservation_id='r-dxnjcyj0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-454493649',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:21:31Z,user_data=None,user_id='964c1681ca8745d0b3879266d24f507e',uuid=905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c41fc1e-7ed5-490d-a375-0db34c7ae40b", "address": "fa:16:3e:ed:e9:7c", "network": {"id": "6b0f48b7-3db2-49b2-a238-8fd811b52d62", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1688127634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e000d89bca44cd8acba504256d8d1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c41fc1e-7e", "ovs_interfaceid": "6c41fc1e-7ed5-490d-a375-0db34c7ae40b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:21:49 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Converting VIF {"id": "6c41fc1e-7ed5-490d-a375-0db34c7ae40b", "address": "fa:16:3e:ed:e9:7c", "network": {"id": "6b0f48b7-3db2-49b2-a238-8fd811b52d62", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1688127634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e000d89bca44cd8acba504256d8d1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c41fc1e-7e", "ovs_interfaceid": "6c41fc1e-7ed5-490d-a375-0db34c7ae40b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:21:49 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:e9:7c,bridge_name='br-int',has_traffic_filtering=True,id=6c41fc1e-7ed5-490d-a375-0db34c7ae40b,network=Network(6b0f48b7-3db2-49b2-a238-8fd811b52d62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c41fc1e-7e') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:21:49 user nova-compute[75066]: DEBUG nova.objects.instance [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lazy-loading 'pci_devices' on Instance uuid 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:21:49 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:21:49 user nova-compute[75066]:   <uuid>905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436</uuid>
Dec 01 19:21:49 user nova-compute[75066]:   <name>instance-00000014</name>
Dec 01 19:21:49 user nova-compute[75066]:   <memory>524288</memory>
Dec 01 19:21:49 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:21:49 user nova-compute[75066]:   <metadata>
Dec 01 19:21:49 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:21:49 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:21:49 user nova-compute[75066]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1711948720</nova:name>
Dec 01 19:21:49 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:21:47</nova:creationTime>
Dec 01 19:21:49 user nova-compute[75066]:       <nova:flavor name="m1.tiny">
Dec 01 19:21:49 user nova-compute[75066]:         <nova:memory>512</nova:memory>
Dec 01 19:21:49 user nova-compute[75066]:         <nova:disk>1</nova:disk>
Dec 01 19:21:49 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:21:49 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:21:49 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:21:49 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:21:49 user nova-compute[75066]:       <nova:owner>
Dec 01 19:21:49 user nova-compute[75066]:         <nova:user uuid="964c1681ca8745d0b3879266d24f507e">tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member</nova:user>
Dec 01 19:21:49 user nova-compute[75066]:         <nova:project uuid="2e000d89bca44cd8acba504256d8d1f1">tempest-ServerBootFromVolumeStableRescueTest-454493649</nova:project>
Dec 01 19:21:49 user nova-compute[75066]:       </nova:owner>
Dec 01 19:21:49 user nova-compute[75066]:       <nova:root type="image" uuid="900b237b-e99c-4fdd-a44f-dcb7a08baa86"/>
Dec 01 19:21:49 user nova-compute[75066]:       <nova:ports>
Dec 01 19:21:49 user nova-compute[75066]:         <nova:port uuid="6c41fc1e-7ed5-490d-a375-0db34c7ae40b">
Dec 01 19:21:49 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Dec 01 19:21:49 user nova-compute[75066]:         </nova:port>
Dec 01 19:21:49 user nova-compute[75066]:       </nova:ports>
Dec 01 19:21:49 user nova-compute[75066]:     </nova:instance>
Dec 01 19:21:49 user nova-compute[75066]:   </metadata>
Dec 01 19:21:49 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:21:49 user nova-compute[75066]:     <system>
Dec 01 19:21:49 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:21:49 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:21:49 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:21:49 user nova-compute[75066]:       <entry name="serial">905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436</entry>
Dec 01 19:21:49 user nova-compute[75066]:       <entry name="uuid">905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436</entry>
Dec 01 19:21:49 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:21:49 user nova-compute[75066]:     </system>
Dec 01 19:21:49 user nova-compute[75066]:   </sysinfo>
Dec 01 19:21:49 user nova-compute[75066]:   <os>
Dec 01 19:21:49 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:21:49 user nova-compute[75066]:     <boot dev="hd"/>
Dec 01 19:21:49 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:21:49 user nova-compute[75066]:   </os>
Dec 01 19:21:49 user nova-compute[75066]:   <features>
Dec 01 19:21:49 user nova-compute[75066]:     <acpi/>
Dec 01 19:21:49 user nova-compute[75066]:     <apic/>
Dec 01 19:21:49 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:21:49 user nova-compute[75066]:   </features>
Dec 01 19:21:49 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:21:49 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:21:49 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:21:49 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:21:49 user nova-compute[75066]:   </clock>
Dec 01 19:21:49 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:21:49 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:21:49 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:21:49 user nova-compute[75066]:   </cpu>
Dec 01 19:21:49 user nova-compute[75066]:   <devices>
Dec 01 19:21:49 user nova-compute[75066]:     <disk type="block" device="disk">
Dec 01 19:21:49 user nova-compute[75066]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:21:49 user nova-compute[75066]:       <source dev="/dev/sdf"/>
Dec 01 19:21:49 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:21:49 user nova-compute[75066]:       <serial>1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb</serial>
Dec 01 19:21:49 user nova-compute[75066]:     </disk>
Dec 01 19:21:49 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:21:49 user nova-compute[75066]:       <mac address="fa:16:3e:ed:e9:7c"/>
Dec 01 19:21:49 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:21:49 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:21:49 user nova-compute[75066]:       <target dev="tap6c41fc1e-7e"/>
Dec 01 19:21:49 user nova-compute[75066]:     </interface>
Dec 01 19:21:49 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:21:49 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436/console.log" append="off"/>
Dec 01 19:21:49 user nova-compute[75066]:     </serial>
Dec 01 19:21:49 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:21:49 user nova-compute[75066]:     <video>
Dec 01 19:21:49 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:21:49 user nova-compute[75066]:     </video>
Dec 01 19:21:49 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:21:49 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:21:49 user nova-compute[75066]:     </rng>
Dec 01 19:21:49 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:21:49 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:21:49 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:21:49 user nova-compute[75066]:     </memballoon>
Dec 01 19:21:49 user nova-compute[75066]:   </devices>
Dec 01 19:21:49 user nova-compute[75066]: </domain>
Dec 01 19:21:49 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:21:49 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:21:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1711948720',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1711948720',id=20,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e000d89bca44cd8acba504256d8d1f1',ramdisk_id='',reservation_id='r-dxnjcyj0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-454493649',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:21:31Z,user_data=None,user_id='964c1681ca8745d0b3879266d24f507e',uuid=905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c41fc1e-7ed5-490d-a375-0db34c7ae40b", "address": "fa:16:3e:ed:e9:7c", "network": {"id": "6b0f48b7-3db2-49b2-a238-8fd811b52d62", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1688127634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e000d89bca44cd8acba504256d8d1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c41fc1e-7e", "ovs_interfaceid": "6c41fc1e-7ed5-490d-a375-0db34c7ae40b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:21:49 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Converting VIF {"id": "6c41fc1e-7ed5-490d-a375-0db34c7ae40b", "address": "fa:16:3e:ed:e9:7c", "network": {"id": "6b0f48b7-3db2-49b2-a238-8fd811b52d62", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1688127634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e000d89bca44cd8acba504256d8d1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c41fc1e-7e", "ovs_interfaceid": "6c41fc1e-7ed5-490d-a375-0db34c7ae40b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:21:49 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:e9:7c,bridge_name='br-int',has_traffic_filtering=True,id=6c41fc1e-7ed5-490d-a375-0db34c7ae40b,network=Network(6b0f48b7-3db2-49b2-a238-8fd811b52d62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c41fc1e-7e') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:21:49 user nova-compute[75066]: DEBUG os_vif [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:e9:7c,bridge_name='br-int',has_traffic_filtering=True,id=6c41fc1e-7ed5-490d-a375-0db34c7ae40b,network=Network(6b0f48b7-3db2-49b2-a238-8fd811b52d62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c41fc1e-7e') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:21:49 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:49 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:21:49 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:21:49 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:49 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fc62eccc-66ff-52f1-ad7e-285c5a35ac9a', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:21:49 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:49 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:21:49 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:49 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:49 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6c41fc1e-7e, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:21:49 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6c41fc1e-7e, col_values=(('qos', UUID('dfdb1775-0f49-40d9-8633-b00dcc91116d')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:21:49 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6c41fc1e-7e, col_values=(('external_ids', {'iface-id': '6c41fc1e-7ed5-490d-a375-0db34c7ae40b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:e9:7c', 'vm-uuid': '905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:21:49 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:49 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:21:49 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:49 user nova-compute[75066]: INFO os_vif [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:e9:7c,bridge_name='br-int',has_traffic_filtering=True,id=6c41fc1e-7ed5-490d-a375-0db34c7ae40b,network=Network(6b0f48b7-3db2-49b2-a238-8fd811b52d62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c41fc1e-7e')
Dec 01 19:21:49 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:21:49 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] No VIF found with MAC fa:16:3e:ed:e9:7c, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:21:50 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:50 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:50 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:50 user nova-compute[75066]: DEBUG nova.compute.manager [req-c46a2fac-7bbc-4df9-adc6-dd4d0e1c3564 req-0b694fff-bc1a-405e-af65-9241145aff36 service nova] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Received event network-vif-plugged-6c41fc1e-7ed5-490d-a375-0db34c7ae40b {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:21:50 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-c46a2fac-7bbc-4df9-adc6-dd4d0e1c3564 req-0b694fff-bc1a-405e-af65-9241145aff36 service nova] Acquiring lock "905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:21:50 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-c46a2fac-7bbc-4df9-adc6-dd4d0e1c3564 req-0b694fff-bc1a-405e-af65-9241145aff36 service nova] Lock "905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:21:50 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-c46a2fac-7bbc-4df9-adc6-dd4d0e1c3564 req-0b694fff-bc1a-405e-af65-9241145aff36 service nova] Lock "905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:21:50 user nova-compute[75066]: DEBUG nova.compute.manager [req-c46a2fac-7bbc-4df9-adc6-dd4d0e1c3564 req-0b694fff-bc1a-405e-af65-9241145aff36 service nova] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] No waiting events found dispatching network-vif-plugged-6c41fc1e-7ed5-490d-a375-0db34c7ae40b {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:21:50 user nova-compute[75066]: WARNING nova.compute.manager [req-c46a2fac-7bbc-4df9-adc6-dd4d0e1c3564 req-0b694fff-bc1a-405e-af65-9241145aff36 service nova] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Received unexpected event network-vif-plugged-6c41fc1e-7ed5-490d-a375-0db34c7ae40b for instance with vm_state building and task_state spawning.
Dec 01 19:21:50 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:50 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:51 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-a7aa68c0-2a9c-4c59-894d-f79115f6286b tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e is timed out.
Dec 01 19:21:51 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-a7aa68c0-2a9c-4c59-894d-f79115f6286b tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Successfully detached device vdb from instance 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e from the live domain config.
Dec 01 19:21:51 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7aa68c0-2a9c-4c59-894d-f79115f6286b tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] calling os-brick to detach iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 19:21:51 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7aa68c0-2a9c-4c59-894d-f79115f6286b tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, {'target_iqn': 'iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'desDpvUl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:21:51 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-a7aa68c0-2a9c-4c59-894d-f79115f6286b tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:21:51 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-a7aa68c0-2a9c-4c59-894d-f79115f6286b tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:21:51 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-a7aa68c0-2a9c-4c59-894d-f79115f6286b tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:21:51 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:51 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:51 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03047c2-b445-4c1b-8cf6-35dd9a2b12ba]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1f533a4a-ce47-4388-8555-7d87faf20d3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:51 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7aa68c0-2a9c-4c59-894d-f79115f6286b tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 19:21:51 user nova-compute[75066]: No targets found.
Dec 01 19:21:51 user nova-compute[75066]: iSNS:
Dec 01 19:21:51 user nova-compute[75066]: No targets found.
Dec 01 19:21:51 user nova-compute[75066]: STATIC:
Dec 01 19:21:51 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa
Dec 01 19:21:51 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:21:51 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:21:51 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2
Dec 01 19:21:51 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:21:51 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:21:51 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:1f533a4a-ce47-4388-8555-7d87faf20d3b
Dec 01 19:21:51 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:21:51 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:21:51 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc
Dec 01 19:21:51 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:21:51 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:21:51 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb
Dec 01 19:21:51 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:21:51 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:21:51 user nova-compute[75066]: FIRMWARE:
Dec 01 19:21:51 user nova-compute[75066]: No targets found.
Dec 01 19:21:51 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:21:51 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7aa68c0-2a9c-4c59-894d-f79115f6286b tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 19:21:51 user nova-compute[75066]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 19:21:51 user nova-compute[75066]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75066) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 19:21:51 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7aa68c0-2a9c-4c59-894d-f79115f6286b tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa', 0)] {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 19:21:51 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:51 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:51 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff9c7d1-a459-44c5-bbda-a5cd91d10d2e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f533a4a-ce47-4388-8555-7d87faf20d3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:51 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:52 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:52 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f45541-0e93-40ca-a9a4-644015c3a676]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f533a4a-ce47-4388-8555-7d87faf20d3b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:52 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7aa68c0-2a9c-4c59-894d-f79115f6286b tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)
Dec 01 19:21:52 user nova-compute[75066]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)
Dec 01 19:21:52 user nova-compute[75066]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)
Dec 01 19:21:52 user nova-compute[75066]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f533a4a-ce47-4388-8555-7d87faf20d3b (non-flash)
Dec 01 19:21:52 user nova-compute[75066]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:21:52 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:21:52 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7aa68c0-2a9c-4c59-894d-f79115f6286b tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa (non-flash)
Dec 01 19:21:52 user nova-compute[75066]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)
Dec 01 19:21:52 user nova-compute[75066]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)
Dec 01 19:21:52 user nova-compute[75066]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f533a4a-ce47-4388-8555-7d87faf20d3b (non-flash)
Dec 01 19:21:52 user nova-compute[75066]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:21:52 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:21:52 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7aa68c0-2a9c-4c59-894d-f79115f6286b tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91901ad090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa'): ({'sdc'}, set())}) {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 19:21:52 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-a7aa68c0-2a9c-4c59-894d-f79115f6286b tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Removing single pathed devices sdc {{(pid=75066) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 19:21:52 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:52 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:52 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd77df38-5cd8-4e68-9e7c-896224b52260]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:52 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:52 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:52 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf607531-052f-421b-af08-08c742bfa0ce]: (4, ('ok\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:52 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-a7aa68c0-2a9c-4c59-894d-f79115f6286b tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Flushing IO for device /dev/sdc {{(pid=75066) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 19:21:52 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:52 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:52 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f04522-433b-436e-b062-d2731cbc7943]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:52 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-a7aa68c0-2a9c-4c59-894d-f79115f6286b tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75066) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 19:21:52 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:52 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:52 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[7532e0bc-adf1-4c41-bcc3-d111cd85beac]: (4, ('1', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:52 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-a7aa68c0-2a9c-4c59-894d-f79115f6286b tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 19:21:52 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-a7aa68c0-2a9c-4c59-894d-f79115f6286b tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] SCSI volumes sdc have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 19:21:52 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7aa68c0-2a9c-4c59-894d-f79115f6286b tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa')] {{(pid=75066) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 19:21:52 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:52 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:52 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa14a6d-63ba-46cf-b1f9-80583a107f6b]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:52 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7aa68c0-2a9c-4c59-894d-f79115f6286b tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:21:52 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa -p 172.16.0.220:3260 --logout {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:52 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:52 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c73bd3-0757-4526-b587-9375277eb6d0]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:52 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7aa68c0-2a9c-4c59-894d-f79115f6286b tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa, portal: 172.16.0.220,3260]
Dec 01 19:21:52 user nova-compute[75066]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa, portal: 172.16.0.220,3260] successful.
Dec 01 19:21:52 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:21:52 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa -p 172.16.0.220:3260 --op delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:21:52 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40dba61d-f444-45f9-b949-2138807215fa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:21:52 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[db73ed60-e4b3-4295-a3ea-6b9656d4614b]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:21:52 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7aa68c0-2a9c-4c59-894d-f79115f6286b tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:21:52 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-a7aa68c0-2a9c-4c59-894d-f79115f6286b tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:21:52 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7aa68c0-2a9c-4c59-894d-f79115f6286b tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] <== disconnect_volume: return (312ms) None {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:21:52 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7aa68c0-2a9c-4c59-894d-f79115f6286b tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Disconnected iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 19:21:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:52 user nova-compute[75066]: DEBUG nova.compute.manager [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Instance event wait completed in 0 seconds for  {{(pid=75066) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 19:21:52 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Guest created on hypervisor {{(pid=75066) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 19:21:52 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Instance spawned successfully.
Dec 01 19:21:52 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 19:21:52 user nova-compute[75066]: DEBUG nova.compute.manager [req-aade1320-6c80-4d46-8348-59c022be6ad8 req-ddc15329-83e0-41fa-b63d-a3956dff7ff2 service nova] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Received event network-vif-plugged-6c41fc1e-7ed5-490d-a375-0db34c7ae40b {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:21:52 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-aade1320-6c80-4d46-8348-59c022be6ad8 req-ddc15329-83e0-41fa-b63d-a3956dff7ff2 service nova] Acquiring lock "905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:21:52 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-aade1320-6c80-4d46-8348-59c022be6ad8 req-ddc15329-83e0-41fa-b63d-a3956dff7ff2 service nova] Lock "905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:21:52 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-aade1320-6c80-4d46-8348-59c022be6ad8 req-ddc15329-83e0-41fa-b63d-a3956dff7ff2 service nova] Lock "905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:21:52 user nova-compute[75066]: DEBUG nova.compute.manager [req-aade1320-6c80-4d46-8348-59c022be6ad8 req-ddc15329-83e0-41fa-b63d-a3956dff7ff2 service nova] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] No waiting events found dispatching network-vif-plugged-6c41fc1e-7ed5-490d-a375-0db34c7ae40b {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:21:52 user nova-compute[75066]: WARNING nova.compute.manager [req-aade1320-6c80-4d46-8348-59c022be6ad8 req-ddc15329-83e0-41fa-b63d-a3956dff7ff2 service nova] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Received unexpected event network-vif-plugged-6c41fc1e-7ed5-490d-a375-0db34c7ae40b for instance with vm_state building and task_state spawning.
Dec 01 19:21:52 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Found default for hw_cdrom_bus of ide {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:21:52 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Found default for hw_disk_bus of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:21:52 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Found default for hw_input_bus of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:21:52 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Found default for hw_pointer_model of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:21:52 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Found default for hw_video_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:21:52 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Found default for hw_vif_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:21:53 user nova-compute[75066]: INFO nova.compute.manager [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Took 5.22 seconds to spawn the instance on the hypervisor.
Dec 01 19:21:53 user nova-compute[75066]: DEBUG nova.compute.manager [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:21:53 user nova-compute[75066]: INFO nova.compute.manager [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Took 22.88 seconds to build instance.
Dec 01 19:21:53 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-aea05e26-f58e-4e4d-b177-f0f66fd440fe tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.003s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:21:53 user nova-compute[75066]: DEBUG nova.objects.instance [None req-a7aa68c0-2a9c-4c59-894d-f79115f6286b tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Lazy-loading 'flavor' on Instance uuid 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:21:53 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a7aa68c0-2a9c-4c59-894d-f79115f6286b tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Lock "67c5dd7c-88aa-4f2f-8f62-a9af0480c38e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.084s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:21:54 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:54 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:21:54 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Triggering sync for uuid 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e {{(pid=75066) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 19:21:54 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Triggering sync for uuid c223be70-8b9c-46d4-9b5a-3b83dfc05a17 {{(pid=75066) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 19:21:54 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Triggering sync for uuid c3ceeca4-c16c-4cf5-adfd-7d5a2925f435 {{(pid=75066) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 19:21:54 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Triggering sync for uuid dd546862-fcd5-4b69-8ea3-a8fa4859a489 {{(pid=75066) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 19:21:54 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Triggering sync for uuid 90c49be6-97aa-45f1-bcbe-b9a3875226a7 {{(pid=75066) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 19:21:54 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Triggering sync for uuid b7d86a5a-c62e-41f7-9f33-1a0c61af6a49 {{(pid=75066) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 19:21:54 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Triggering sync for uuid d564b128-598b-4ad4-8618-afa4dc8a7347 {{(pid=75066) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 19:21:54 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Triggering sync for uuid 14de9d20-9e66-4517-b904-2967e0a06a97 {{(pid=75066) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 19:21:54 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Triggering sync for uuid 998daa1d-fd6a-4663-8df3-0683a9dbe142 {{(pid=75066) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 19:21:54 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Triggering sync for uuid a553e030-0d69-4725-9f84-6c0c63556ed4 {{(pid=75066) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 19:21:54 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Triggering sync for uuid 933210b1-5c5e-421a-9b63-4595fc5f5f25 {{(pid=75066) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 19:21:54 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Triggering sync for uuid 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436 {{(pid=75066) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 19:21:54 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Triggering sync for uuid 3d340166-c58b-4213-b8d3-5036ade48d2d {{(pid=75066) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 19:21:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "67c5dd7c-88aa-4f2f-8f62-a9af0480c38e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:21:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "67c5dd7c-88aa-4f2f-8f62-a9af0480c38e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:21:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "c223be70-8b9c-46d4-9b5a-3b83dfc05a17" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:21:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "c223be70-8b9c-46d4-9b5a-3b83dfc05a17" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:21:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "c3ceeca4-c16c-4cf5-adfd-7d5a2925f435" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:21:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "c3ceeca4-c16c-4cf5-adfd-7d5a2925f435" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:21:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "dd546862-fcd5-4b69-8ea3-a8fa4859a489" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:21:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "dd546862-fcd5-4b69-8ea3-a8fa4859a489" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:21:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "90c49be6-97aa-45f1-bcbe-b9a3875226a7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:21:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "90c49be6-97aa-45f1-bcbe-b9a3875226a7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:21:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "b7d86a5a-c62e-41f7-9f33-1a0c61af6a49" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:21:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "d564b128-598b-4ad4-8618-afa4dc8a7347" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:21:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "d564b128-598b-4ad4-8618-afa4dc8a7347" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:21:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "14de9d20-9e66-4517-b904-2967e0a06a97" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:21:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "14de9d20-9e66-4517-b904-2967e0a06a97" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:21:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "998daa1d-fd6a-4663-8df3-0683a9dbe142" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:21:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "998daa1d-fd6a-4663-8df3-0683a9dbe142" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:21:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "a553e030-0d69-4725-9f84-6c0c63556ed4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:21:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "a553e030-0d69-4725-9f84-6c0c63556ed4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:21:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "933210b1-5c5e-421a-9b63-4595fc5f5f25" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:21:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "933210b1-5c5e-421a-9b63-4595fc5f5f25" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:21:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:21:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:21:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "3d340166-c58b-4213-b8d3-5036ade48d2d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:21:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "3d340166-c58b-4213-b8d3-5036ade48d2d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:21:54 user nova-compute[75066]: WARNING oslo_messaging._drivers.amqpdriver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20
Dec 01 19:21:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "c3ceeca4-c16c-4cf5-adfd-7d5a2925f435" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:21:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "67c5dd7c-88aa-4f2f-8f62-a9af0480c38e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:21:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "c223be70-8b9c-46d4-9b5a-3b83dfc05a17" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:21:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "dd546862-fcd5-4b69-8ea3-a8fa4859a489" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:21:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "d564b128-598b-4ad4-8618-afa4dc8a7347" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.088s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:21:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "933210b1-5c5e-421a-9b63-4595fc5f5f25" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.093s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:21:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.093s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:21:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "3d340166-c58b-4213-b8d3-5036ade48d2d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.097s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:21:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "90c49be6-97aa-45f1-bcbe-b9a3875226a7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.106s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:21:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "14de9d20-9e66-4517-b904-2967e0a06a97" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.108s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:21:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "998daa1d-fd6a-4663-8df3-0683a9dbe142" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.109s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:21:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "a553e030-0d69-4725-9f84-6c0c63556ed4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.111s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:21:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:59 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:21:59 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:22:01 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:22:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:22:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:22:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:22:01 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75066) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 19:22:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/933210b1-5c5e-421a-9b63-4595fc5f5f25/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/933210b1-5c5e-421a-9b63-4595fc5f5f25/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/933210b1-5c5e-421a-9b63-4595fc5f5f25/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/933210b1-5c5e-421a-9b63-4595fc5f5f25/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a553e030-0d69-4725-9f84-6c0c63556ed4/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a553e030-0d69-4725-9f84-6c0c63556ed4/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a553e030-0d69-4725-9f84-6c0c63556ed4/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a553e030-0d69-4725-9f84-6c0c63556ed4/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:02 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:22:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:03 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:03 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:03 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:03 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:03 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:03 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:03 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:03 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:03 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:03 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:04 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:22:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk.rescue --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:04 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:22:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk.rescue --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:04 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-b110e378-1397-4ed5-996f-13aaf8730492 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b7d86a5a-c62e-41f7-9f33-1a0c61af6a49 is timed out.
Dec 01 19:22:04 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-b110e378-1397-4ed5-996f-13aaf8730492 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Successfully detached device vdb from instance b7d86a5a-c62e-41f7-9f33-1a0c61af6a49 from the live domain config.
Dec 01 19:22:04 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b110e378-1397-4ed5-996f-13aaf8730492 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] calling os-brick to detach iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 19:22:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b110e378-1397-4ed5-996f-13aaf8730492 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, {'target_iqn': 'iqn.2010-10.org.openstack:1f533a4a-ce47-4388-8555-7d87faf20d3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EXdLgujq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:22:04 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-b110e378-1397-4ed5-996f-13aaf8730492 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:22:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-b110e378-1397-4ed5-996f-13aaf8730492 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:22:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-b110e378-1397-4ed5-996f-13aaf8730492 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:22:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:04 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[77028a70-1322-464b-a95c-74033227b0c4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1f533a4a-ce47-4388-8555-7d87faf20d3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b110e378-1397-4ed5-996f-13aaf8730492 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 19:22:04 user nova-compute[75066]: No targets found.
Dec 01 19:22:04 user nova-compute[75066]: iSNS:
Dec 01 19:22:04 user nova-compute[75066]: No targets found.
Dec 01 19:22:04 user nova-compute[75066]: STATIC:
Dec 01 19:22:04 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2
Dec 01 19:22:04 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:22:04 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:22:04 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:1f533a4a-ce47-4388-8555-7d87faf20d3b
Dec 01 19:22:04 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:22:04 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:22:04 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc
Dec 01 19:22:04 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:22:04 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:22:04 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb
Dec 01 19:22:04 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:22:04 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:22:04 user nova-compute[75066]: FIRMWARE:
Dec 01 19:22:04 user nova-compute[75066]: No targets found.
Dec 01 19:22:04 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:22:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b110e378-1397-4ed5-996f-13aaf8730492 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 19:22:04 user nova-compute[75066]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 19:22:04 user nova-compute[75066]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75066) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 19:22:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b110e378-1397-4ed5-996f-13aaf8730492 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f533a4a-ce47-4388-8555-7d87faf20d3b', 0)] {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 19:22:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:04 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f052ea-8b55-47bf-9502-ea5b3d1d8e2c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f533a4a-ce47-4388-8555-7d87faf20d3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:04 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca42d174-6838-4c3a-af78-458d38f41f63]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f533a4a-ce47-4388-8555-7d87faf20d3b (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b110e378-1397-4ed5-996f-13aaf8730492 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)
Dec 01 19:22:04 user nova-compute[75066]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)
Dec 01 19:22:04 user nova-compute[75066]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f533a4a-ce47-4388-8555-7d87faf20d3b (non-flash)
Dec 01 19:22:04 user nova-compute[75066]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:22:04 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:22:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b110e378-1397-4ed5-996f-13aaf8730492 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)
Dec 01 19:22:04 user nova-compute[75066]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)
Dec 01 19:22:04 user nova-compute[75066]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f533a4a-ce47-4388-8555-7d87faf20d3b (non-flash)
Dec 01 19:22:04 user nova-compute[75066]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:22:04 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:22:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b110e378-1397-4ed5-996f-13aaf8730492 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f917066a0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f533a4a-ce47-4388-8555-7d87faf20d3b'): ({'sde'}, set())}) {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 19:22:04 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-b110e378-1397-4ed5-996f-13aaf8730492 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Removing single pathed devices sde {{(pid=75066) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 19:22:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:04 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[1037133f-1795-465d-a59f-50e27818f772]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:04 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1417a23-057f-4ac9-9a86-eb9d6df2a539]: (4, ('ok\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:04 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-b110e378-1397-4ed5-996f-13aaf8730492 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Flushing IO for device /dev/sde {{(pid=75066) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 19:22:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:04 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fcf6913-01be-40da-8ed4-a4eb49d77949]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:04 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-b110e378-1397-4ed5-996f-13aaf8730492 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75066) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 19:22:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:04 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[de908b2c-9559-4e19-be96-5a4e4b308afd]: (4, ('1', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:04 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-b110e378-1397-4ed5-996f-13aaf8730492 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 19:22:04 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-b110e378-1397-4ed5-996f-13aaf8730492 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] SCSI volumes sde have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 19:22:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b110e378-1397-4ed5-996f-13aaf8730492 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f533a4a-ce47-4388-8555-7d87faf20d3b')] {{(pid=75066) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 19:22:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f533a4a-ce47-4388-8555-7d87faf20d3b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f533a4a-ce47-4388-8555-7d87faf20d3b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:04 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[c24326c2-fbeb-44ea-9488-5f69b66dd1e4]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b110e378-1397-4ed5-996f-13aaf8730492 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:22:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f533a4a-ce47-4388-8555-7d87faf20d3b -p 172.16.0.220:3260 --logout {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f533a4a-ce47-4388-8555-7d87faf20d3b -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:04 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[404fd4c0-1a32-4141-a3ee-7859dff0613a]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:1f533a4a-ce47-4388-8555-7d87faf20d3b, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:1f533a4a-ce47-4388-8555-7d87faf20d3b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b110e378-1397-4ed5-996f-13aaf8730492 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:1f533a4a-ce47-4388-8555-7d87faf20d3b, portal: 172.16.0.220,3260]
Dec 01 19:22:04 user nova-compute[75066]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:1f533a4a-ce47-4388-8555-7d87faf20d3b, portal: 172.16.0.220,3260] successful.
Dec 01 19:22:04 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:22:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f533a4a-ce47-4388-8555-7d87faf20d3b -p 172.16.0.220:3260 --op delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f533a4a-ce47-4388-8555-7d87faf20d3b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:04 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[4081b806-f879-40af-99ee-61fb5773799f]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b110e378-1397-4ed5-996f-13aaf8730492 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:22:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-b110e378-1397-4ed5-996f-13aaf8730492 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:22:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b110e378-1397-4ed5-996f-13aaf8730492 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] <== disconnect_volume: return (365ms) None {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:22:04 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b110e378-1397-4ed5-996f-13aaf8730492 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] Disconnected iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 19:22:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d86a5a-c62e-41f7-9f33-1a0c61af6a49/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d86a5a-c62e-41f7-9f33-1a0c61af6a49/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d86a5a-c62e-41f7-9f33-1a0c61af6a49/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d86a5a-c62e-41f7-9f33-1a0c61af6a49/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67c5dd7c-88aa-4f2f-8f62-a9af0480c38e/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67c5dd7c-88aa-4f2f-8f62-a9af0480c38e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67c5dd7c-88aa-4f2f-8f62-a9af0480c38e/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:05 user nova-compute[75066]: DEBUG nova.compute.manager [req-d4a7892b-0c4a-429e-923e-b9cb0d765000 req-8cf3e7ca-1d7e-4264-9d67-1d98272007bb service nova] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Received event network-changed-2cf25213-8eec-4d19-bad6-b8e2fd905b3c {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:22:05 user nova-compute[75066]: DEBUG nova.compute.manager [req-d4a7892b-0c4a-429e-923e-b9cb0d765000 req-8cf3e7ca-1d7e-4264-9d67-1d98272007bb service nova] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Refreshing instance network info cache due to event network-changed-2cf25213-8eec-4d19-bad6-b8e2fd905b3c. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:22:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d4a7892b-0c4a-429e-923e-b9cb0d765000 req-8cf3e7ca-1d7e-4264-9d67-1d98272007bb service nova] Acquiring lock "refresh_cache-998daa1d-fd6a-4663-8df3-0683a9dbe142" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:22:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d4a7892b-0c4a-429e-923e-b9cb0d765000 req-8cf3e7ca-1d7e-4264-9d67-1d98272007bb service nova] Acquired lock "refresh_cache-998daa1d-fd6a-4663-8df3-0683a9dbe142" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:22:05 user nova-compute[75066]: DEBUG nova.network.neutron [req-d4a7892b-0c4a-429e-923e-b9cb0d765000 req-8cf3e7ca-1d7e-4264-9d67-1d98272007bb service nova] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Refreshing network info cache for port 2cf25213-8eec-4d19-bad6-b8e2fd905b3c {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:22:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67c5dd7c-88aa-4f2f-8f62-a9af0480c38e/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/998daa1d-fd6a-4663-8df3-0683a9dbe142/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:05 user nova-compute[75066]: DEBUG nova.objects.instance [None req-b110e378-1397-4ed5-996f-13aaf8730492 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Lazy-loading 'flavor' on Instance uuid b7d86a5a-c62e-41f7-9f33-1a0c61af6a49 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:22:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b110e378-1397-4ed5-996f-13aaf8730492 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Lock "b7d86a5a-c62e-41f7-9f33-1a0c61af6a49" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.068s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:22:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "b7d86a5a-c62e-41f7-9f33-1a0c61af6a49" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 11.003s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:22:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "b7d86a5a-c62e-41f7-9f33-1a0c61af6a49" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.033s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:22:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/998daa1d-fd6a-4663-8df3-0683a9dbe142/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/998daa1d-fd6a-4663-8df3-0683a9dbe142/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-6d3ea883-b783-48b3-83c0-e28173123953 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Acquiring lock "interface-998daa1d-fd6a-4663-8df3-0683a9dbe142-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:22:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-6d3ea883-b783-48b3-83c0-e28173123953 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Lock "interface-998daa1d-fd6a-4663-8df3-0683a9dbe142-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:22:05 user nova-compute[75066]: DEBUG nova.objects.instance [None req-6d3ea883-b783-48b3-83c0-e28173123953 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Lazy-loading 'flavor' on Instance uuid 998daa1d-fd6a-4663-8df3-0683a9dbe142 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:22:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/998daa1d-fd6a-4663-8df3-0683a9dbe142/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d340166-c58b-4213-b8d3-5036ade48d2d/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:06 user nova-compute[75066]: DEBUG nova.objects.instance [None req-6d3ea883-b783-48b3-83c0-e28173123953 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Lazy-loading 'pci_requests' on Instance uuid 998daa1d-fd6a-4663-8df3-0683a9dbe142 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:22:06 user nova-compute[75066]: DEBUG nova.network.neutron [req-d4a7892b-0c4a-429e-923e-b9cb0d765000 req-8cf3e7ca-1d7e-4264-9d67-1d98272007bb service nova] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Updated VIF entry in instance network info cache for port 2cf25213-8eec-4d19-bad6-b8e2fd905b3c. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:22:06 user nova-compute[75066]: DEBUG nova.network.neutron [req-d4a7892b-0c4a-429e-923e-b9cb0d765000 req-8cf3e7ca-1d7e-4264-9d67-1d98272007bb service nova] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Updating instance_info_cache with network_info: [{"id": "2cf25213-8eec-4d19-bad6-b8e2fd905b3c", "address": "fa:16:3e:10:62:79", "network": {"id": "13655709-cc3e-4378-850f-1eb7bc944811", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1907265443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0be461a2ee174f25bdbb451e49512e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf25213-8e", "ovs_interfaceid": "2cf25213-8eec-4d19-bad6-b8e2fd905b3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:22:06 user nova-compute[75066]: DEBUG nova.objects.base [None req-6d3ea883-b783-48b3-83c0-e28173123953 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Object Instance<998daa1d-fd6a-4663-8df3-0683a9dbe142> lazy-loaded attributes: flavor,pci_requests {{(pid=75066) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 19:22:06 user nova-compute[75066]: DEBUG nova.network.neutron [None req-6d3ea883-b783-48b3-83c0-e28173123953 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] allocate_for_instance() {{(pid=75066) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 19:22:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d4a7892b-0c4a-429e-923e-b9cb0d765000 req-8cf3e7ca-1d7e-4264-9d67-1d98272007bb service nova] Releasing lock "refresh_cache-998daa1d-fd6a-4663-8df3-0683a9dbe142" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:22:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d340166-c58b-4213-b8d3-5036ade48d2d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d340166-c58b-4213-b8d3-5036ade48d2d/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:06 user nova-compute[75066]: DEBUG nova.policy [None req-6d3ea883-b783-48b3-83c0-e28173123953 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8ae99d82b8bb499595aae2098059f478', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0be461a2ee174f25bdbb451e49512e75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75066) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 19:22:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d340166-c58b-4213-b8d3-5036ade48d2d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:06 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:22:06 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:22:06 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:22:06 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Hypervisor/Node resource view: name=user free_ram=7149MB free_disk=24.974082946777344GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75066) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 19:22:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:22:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:22:06 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:22:06 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance c223be70-8b9c-46d4-9b5a-3b83dfc05a17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:22:06 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance c3ceeca4-c16c-4cf5-adfd-7d5a2925f435 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:22:06 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 90c49be6-97aa-45f1-bcbe-b9a3875226a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:22:06 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 3d340166-c58b-4213-b8d3-5036ade48d2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:22:06 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance dd546862-fcd5-4b69-8ea3-a8fa4859a489 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:22:06 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance b7d86a5a-c62e-41f7-9f33-1a0c61af6a49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:22:06 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance d564b128-598b-4ad4-8618-afa4dc8a7347 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:22:06 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 14de9d20-9e66-4517-b904-2967e0a06a97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:22:06 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 998daa1d-fd6a-4663-8df3-0683a9dbe142 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:22:06 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance a553e030-0d69-4725-9f84-6c0c63556ed4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:22:06 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 933210b1-5c5e-421a-9b63-4595fc5f5f25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:22:06 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:22:06 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 19:22:06 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 19:22:07 user nova-compute[75066]: DEBUG nova.network.neutron [None req-6d3ea883-b783-48b3-83c0-e28173123953 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Successfully created port: ecbe6e20-8532-4496-8a4c-1151c3770cdc {{(pid=75066) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 19:22:07 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:22:07 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:22:07 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Compute_service record updated for user:user {{(pid=75066) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 19:22:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.519s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:22:07 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:07 user nova-compute[75066]: DEBUG nova.network.neutron [None req-6d3ea883-b783-48b3-83c0-e28173123953 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Successfully updated port: ecbe6e20-8532-4496-8a4c-1151c3770cdc {{(pid=75066) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 19:22:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-6d3ea883-b783-48b3-83c0-e28173123953 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Acquiring lock "refresh_cache-998daa1d-fd6a-4663-8df3-0683a9dbe142" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:22:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-6d3ea883-b783-48b3-83c0-e28173123953 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Acquired lock "refresh_cache-998daa1d-fd6a-4663-8df3-0683a9dbe142" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:22:07 user nova-compute[75066]: DEBUG nova.network.neutron [None req-6d3ea883-b783-48b3-83c0-e28173123953 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:22:07 user nova-compute[75066]: DEBUG nova.compute.manager [req-a3bce5cb-a7da-4b7f-85e7-67aa43401921 req-91b0a3d1-7344-44e2-97fc-3d228fc6fbcf service nova] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Received event network-changed-ecbe6e20-8532-4496-8a4c-1151c3770cdc {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:22:07 user nova-compute[75066]: DEBUG nova.compute.manager [req-a3bce5cb-a7da-4b7f-85e7-67aa43401921 req-91b0a3d1-7344-44e2-97fc-3d228fc6fbcf service nova] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Refreshing instance network info cache due to event network-changed-ecbe6e20-8532-4496-8a4c-1151c3770cdc. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:22:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a3bce5cb-a7da-4b7f-85e7-67aa43401921 req-91b0a3d1-7344-44e2-97fc-3d228fc6fbcf service nova] Acquiring lock "refresh_cache-998daa1d-fd6a-4663-8df3-0683a9dbe142" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:22:08 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:22:08 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:22:08 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Starting heal instance info cache {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 19:22:08 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Rebuilding the list of instances to heal {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 19:22:08 user nova-compute[75066]: DEBUG nova.network.neutron [None req-6d3ea883-b783-48b3-83c0-e28173123953 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Updating instance_info_cache with network_info: [{"id": "2cf25213-8eec-4d19-bad6-b8e2fd905b3c", "address": "fa:16:3e:10:62:79", "network": {"id": "13655709-cc3e-4378-850f-1eb7bc944811", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1907265443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0be461a2ee174f25bdbb451e49512e75", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf25213-8e", "ovs_interfaceid": "2cf25213-8eec-4d19-bad6-b8e2fd905b3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ecbe6e20-8532-4496-8a4c-1151c3770cdc", "address": "fa:16:3e:ce:51:6a", "network": {"id": "cbb49fd2-4044-4aa7-b04c-c67d5521b682", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-188466014", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0be461a2ee174f25bdbb451e49512e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecbe6e20-85", "ovs_interfaceid": "ecbe6e20-8532-4496-8a4c-1151c3770cdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:22:08 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-6d3ea883-b783-48b3-83c0-e28173123953 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Releasing lock "refresh_cache-998daa1d-fd6a-4663-8df3-0683a9dbe142" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:22:08 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a3bce5cb-a7da-4b7f-85e7-67aa43401921 req-91b0a3d1-7344-44e2-97fc-3d228fc6fbcf service nova] Acquired lock "refresh_cache-998daa1d-fd6a-4663-8df3-0683a9dbe142" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:22:08 user nova-compute[75066]: DEBUG nova.network.neutron [req-a3bce5cb-a7da-4b7f-85e7-67aa43401921 req-91b0a3d1-7344-44e2-97fc-3d228fc6fbcf service nova] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Refreshing network info cache for port ecbe6e20-8532-4496-8a4c-1151c3770cdc {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:22:08 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-6d3ea883-b783-48b3-83c0-e28173123953 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T19:20:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-431772117',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-431772117',id=17,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDioMIKkD17rbLefUs+CoCe2YAF5MJyWmdGP5njQ+aDOavBc08qUchmFEEnBOz9qWRNoNrJTyhIak33m8ykbjamBmaBpbrxUKAYbxyiEVNdIL8zvksuJtx/Xi7sbDuD1AA==',key_name='tempest-keypair-1571650457',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:20:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0be461a2ee174f25bdbb451e49512e75',ramdisk_id='',reservation_id='r-ymwza3b4',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-687574292',owner_user_name='tempest-TaggedAttachmentsTest-687574292-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:20:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ae99d82b8bb499595aae2098059f478',uuid=998daa1d-fd6a-4663-8df3-0683a9dbe142,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ecbe6e20-8532-4496-8a4c-1151c3770cdc", "address": "fa:16:3e:ce:51:6a", "network": {"id": "cbb49fd2-4044-4aa7-b04c-c67d5521b682", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-188466014", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0be461a2ee174f25bdbb451e49512e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecbe6e20-85", "ovs_interfaceid": "ecbe6e20-8532-4496-8a4c-1151c3770cdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:22:08 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-6d3ea883-b783-48b3-83c0-e28173123953 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Converting VIF {"id": "ecbe6e20-8532-4496-8a4c-1151c3770cdc", "address": "fa:16:3e:ce:51:6a", "network": {"id": "cbb49fd2-4044-4aa7-b04c-c67d5521b682", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-188466014", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0be461a2ee174f25bdbb451e49512e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecbe6e20-85", "ovs_interfaceid": "ecbe6e20-8532-4496-8a4c-1151c3770cdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:22:08 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-6d3ea883-b783-48b3-83c0-e28173123953 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:51:6a,bridge_name='br-int',has_traffic_filtering=True,id=ecbe6e20-8532-4496-8a4c-1151c3770cdc,network=Network(cbb49fd2-4044-4aa7-b04c-c67d5521b682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecbe6e20-85') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:22:08 user nova-compute[75066]: DEBUG os_vif [None req-6d3ea883-b783-48b3-83c0-e28173123953 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:51:6a,bridge_name='br-int',has_traffic_filtering=True,id=ecbe6e20-8532-4496-8a4c-1151c3770cdc,network=Network(cbb49fd2-4044-4aa7-b04c-c67d5521b682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecbe6e20-85') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:22:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:22:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:22:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e8a2865a-df43-5b56-8eb9-8f56bff223d1', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:22:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:08 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "refresh_cache-67c5dd7c-88aa-4f2f-8f62-a9af0480c38e" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:22:08 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquired lock "refresh_cache-67c5dd7c-88aa-4f2f-8f62-a9af0480c38e" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:22:08 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Forcefully refreshing network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 19:22:08 user nova-compute[75066]: DEBUG nova.objects.instance [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lazy-loading 'info_cache' on Instance uuid 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:22:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:22:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapecbe6e20-85, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:22:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapecbe6e20-85, col_values=(('qos', UUID('74e51940-0df0-42a8-aa17-ec0a6f764804')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:22:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapecbe6e20-85, col_values=(('external_ids', {'iface-id': 'ecbe6e20-8532-4496-8a4c-1151c3770cdc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:51:6a', 'vm-uuid': '998daa1d-fd6a-4663-8df3-0683a9dbe142'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:22:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:22:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:08 user nova-compute[75066]: INFO os_vif [None req-6d3ea883-b783-48b3-83c0-e28173123953 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:51:6a,bridge_name='br-int',has_traffic_filtering=True,id=ecbe6e20-8532-4496-8a4c-1151c3770cdc,network=Network(cbb49fd2-4044-4aa7-b04c-c67d5521b682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecbe6e20-85')
Dec 01 19:22:08 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-6d3ea883-b783-48b3-83c0-e28173123953 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T19:20:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-431772117',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-431772117',id=17,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDioMIKkD17rbLefUs+CoCe2YAF5MJyWmdGP5njQ+aDOavBc08qUchmFEEnBOz9qWRNoNrJTyhIak33m8ykbjamBmaBpbrxUKAYbxyiEVNdIL8zvksuJtx/Xi7sbDuD1AA==',key_name='tempest-keypair-1571650457',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:20:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0be461a2ee174f25bdbb451e49512e75',ramdisk_id='',reservation_id='r-ymwza3b4',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-687574292',owner_user_name='tempest-TaggedAttachmentsTest-687574292-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:20:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ae99d82b8bb499595aae2098059f478',uuid=998daa1d-fd6a-4663-8df3-0683a9dbe142,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ecbe6e20-8532-4496-8a4c-1151c3770cdc", "address": "fa:16:3e:ce:51:6a", "network": {"id": "cbb49fd2-4044-4aa7-b04c-c67d5521b682", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-188466014", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0be461a2ee174f25bdbb451e49512e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecbe6e20-85", "ovs_interfaceid": "ecbe6e20-8532-4496-8a4c-1151c3770cdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:22:08 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-6d3ea883-b783-48b3-83c0-e28173123953 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Converting VIF {"id": "ecbe6e20-8532-4496-8a4c-1151c3770cdc", "address": "fa:16:3e:ce:51:6a", "network": {"id": "cbb49fd2-4044-4aa7-b04c-c67d5521b682", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-188466014", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0be461a2ee174f25bdbb451e49512e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecbe6e20-85", "ovs_interfaceid": "ecbe6e20-8532-4496-8a4c-1151c3770cdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:22:08 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-6d3ea883-b783-48b3-83c0-e28173123953 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:51:6a,bridge_name='br-int',has_traffic_filtering=True,id=ecbe6e20-8532-4496-8a4c-1151c3770cdc,network=Network(cbb49fd2-4044-4aa7-b04c-c67d5521b682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecbe6e20-85') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:22:08 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-6d3ea883-b783-48b3-83c0-e28173123953 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] attach device xml: <interface type="ethernet">
Dec 01 19:22:08 user nova-compute[75066]:   <mac address="fa:16:3e:ce:51:6a"/>
Dec 01 19:22:08 user nova-compute[75066]:   <model type="virtio"/>
Dec 01 19:22:08 user nova-compute[75066]:   <mtu size="1442"/>
Dec 01 19:22:08 user nova-compute[75066]:   <target dev="tapecbe6e20-85"/>
Dec 01 19:22:08 user nova-compute[75066]: </interface>
Dec 01 19:22:08 user nova-compute[75066]:  {{(pid=75066) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 19:22:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:08 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-6d3ea883-b783-48b3-83c0-e28173123953 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:22:08 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-6d3ea883-b783-48b3-83c0-e28173123953 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] No BDM found with device name hda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:22:08 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-6d3ea883-b783-48b3-83c0-e28173123953 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] No VIF found with MAC fa:16:3e:10:62:79, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:22:08 user nova-compute[75066]: DEBUG nova.network.neutron [req-a3bce5cb-a7da-4b7f-85e7-67aa43401921 req-91b0a3d1-7344-44e2-97fc-3d228fc6fbcf service nova] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Updated VIF entry in instance network info cache for port ecbe6e20-8532-4496-8a4c-1151c3770cdc. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:22:08 user nova-compute[75066]: DEBUG nova.network.neutron [req-a3bce5cb-a7da-4b7f-85e7-67aa43401921 req-91b0a3d1-7344-44e2-97fc-3d228fc6fbcf service nova] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Updating instance_info_cache with network_info: [{"id": "2cf25213-8eec-4d19-bad6-b8e2fd905b3c", "address": "fa:16:3e:10:62:79", "network": {"id": "13655709-cc3e-4378-850f-1eb7bc944811", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1907265443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0be461a2ee174f25bdbb451e49512e75", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf25213-8e", "ovs_interfaceid": "2cf25213-8eec-4d19-bad6-b8e2fd905b3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ecbe6e20-8532-4496-8a4c-1151c3770cdc", "address": "fa:16:3e:ce:51:6a", "network": {"id": "cbb49fd2-4044-4aa7-b04c-c67d5521b682", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-188466014", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0be461a2ee174f25bdbb451e49512e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecbe6e20-85", "ovs_interfaceid": "ecbe6e20-8532-4496-8a4c-1151c3770cdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:22:08 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-6d3ea883-b783-48b3-83c0-e28173123953 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:22:08 user nova-compute[75066]:   <nova:package version="0.0.0"/>
Dec 01 19:22:08 user nova-compute[75066]:   <nova:name>tempest-device-tagging-server-431772117</nova:name>
Dec 01 19:22:08 user nova-compute[75066]:   <nova:creationTime>2023-12-01 19:22:08</nova:creationTime>
Dec 01 19:22:08 user nova-compute[75066]:   <nova:flavor name="m1.tiny">
Dec 01 19:22:08 user nova-compute[75066]:     <nova:memory>512</nova:memory>
Dec 01 19:22:08 user nova-compute[75066]:     <nova:disk>1</nova:disk>
Dec 01 19:22:08 user nova-compute[75066]:     <nova:swap>0</nova:swap>
Dec 01 19:22:08 user nova-compute[75066]:     <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:22:08 user nova-compute[75066]:     <nova:vcpus>1</nova:vcpus>
Dec 01 19:22:08 user nova-compute[75066]:   </nova:flavor>
Dec 01 19:22:08 user nova-compute[75066]:   <nova:owner>
Dec 01 19:22:08 user nova-compute[75066]:     <nova:user uuid="8ae99d82b8bb499595aae2098059f478">tempest-TaggedAttachmentsTest-687574292-project-member</nova:user>
Dec 01 19:22:08 user nova-compute[75066]:     <nova:project uuid="0be461a2ee174f25bdbb451e49512e75">tempest-TaggedAttachmentsTest-687574292</nova:project>
Dec 01 19:22:08 user nova-compute[75066]:   </nova:owner>
Dec 01 19:22:08 user nova-compute[75066]:   <nova:root type="image" uuid="900b237b-e99c-4fdd-a44f-dcb7a08baa86"/>
Dec 01 19:22:08 user nova-compute[75066]:   <nova:ports>
Dec 01 19:22:08 user nova-compute[75066]:     <nova:port uuid="2cf25213-8eec-4d19-bad6-b8e2fd905b3c">
Dec 01 19:22:08 user nova-compute[75066]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Dec 01 19:22:08 user nova-compute[75066]:     </nova:port>
Dec 01 19:22:08 user nova-compute[75066]:     <nova:port uuid="ecbe6e20-8532-4496-8a4c-1151c3770cdc">
Dec 01 19:22:08 user nova-compute[75066]:       <nova:ip type="fixed" address="10.10.10.51" ipVersion="4"/>
Dec 01 19:22:08 user nova-compute[75066]:     </nova:port>
Dec 01 19:22:08 user nova-compute[75066]:   </nova:ports>
Dec 01 19:22:08 user nova-compute[75066]: </nova:instance>
Dec 01 19:22:08 user nova-compute[75066]:  {{(pid=75066) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Dec 01 19:22:08 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a3bce5cb-a7da-4b7f-85e7-67aa43401921 req-91b0a3d1-7344-44e2-97fc-3d228fc6fbcf service nova] Releasing lock "refresh_cache-998daa1d-fd6a-4663-8df3-0683a9dbe142" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:22:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-6d3ea883-b783-48b3-83c0-e28173123953 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Lock "interface-998daa1d-fd6a-4663-8df3-0683a9dbe142-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.072s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:22:09 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:09 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:09 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:09 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:09 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:09 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Updating instance_info_cache with network_info: [{"id": "73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2", "address": "fa:16:3e:5a:73:a4", "network": {"id": "fdb3c017-aafb-4c3e-a08c-a73a68be9f70", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1696445417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "306d3049e90647fa9f1c90a104eac0e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bdff9a-3a", "ovs_interfaceid": "73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:22:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Releasing lock "refresh_cache-67c5dd7c-88aa-4f2f-8f62-a9af0480c38e" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:22:09 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Updated the network info_cache for instance {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 19:22:09 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:22:09 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:22:09 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:22:09 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:22:09 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75066) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 19:22:09 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:22:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-4b2955ef-d374-4454-ab0b-705500ce831e tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Acquiring lock "998daa1d-fd6a-4663-8df3-0683a9dbe142" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:22:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-4b2955ef-d374-4454-ab0b-705500ce831e tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Lock "998daa1d-fd6a-4663-8df3-0683a9dbe142" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:22:09 user nova-compute[75066]: DEBUG nova.objects.instance [None req-4b2955ef-d374-4454-ab0b-705500ce831e tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Lazy-loading 'flavor' on Instance uuid 998daa1d-fd6a-4663-8df3-0683a9dbe142 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:22:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-4b2955ef-d374-4454-ab0b-705500ce831e tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Lock "998daa1d-fd6a-4663-8df3-0683a9dbe142" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:22:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-4b2955ef-d374-4454-ab0b-705500ce831e tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Acquiring lock "998daa1d-fd6a-4663-8df3-0683a9dbe142" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:22:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-4b2955ef-d374-4454-ab0b-705500ce831e tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Lock "998daa1d-fd6a-4663-8df3-0683a9dbe142" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:22:09 user nova-compute[75066]: INFO nova.compute.manager [None req-4b2955ef-d374-4454-ab0b-705500ce831e tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Attaching volume 6986eb1c-5a0a-4839-900b-7af58180eb89 to /dev/vdb
Dec 01 19:22:09 user nova-compute[75066]: DEBUG os_brick.utils [None req-4b2955ef-d374-4454-ab0b-705500ce831e tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:22:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:09 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d62329-9148-4eb0-a5c9-fd2f6b10bd4b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1959854982f\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:09 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d7e14c-8df8-4691-bb3e-f55b184442ee]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:09 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f0d988-07ed-4aa8-9aef-ee3422ce6ca9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:09 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61dbecc-16eb-47d0-adf5-f57188d0059f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-4b2955ef-d374-4454-ab0b-705500ce831e tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Running cmd (subprocess): nvme version {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-4b2955ef-d374-4454-ab0b-705500ce831e tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] 'nvme version' failed. Not Retrying. {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:22:09 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4b2955ef-d374-4454-ab0b-705500ce831e tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] nvme not present on system {{(pid=75066) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 19:22:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:22:09 user nova-compute[75066]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 19:22:09 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab37ca81-68d0-4a95-9c8f-d6f98f26af2d]: (4, '') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:09 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-4b2955ef-d374-4454-ab0b-705500ce831e tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75066) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 19:22:09 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-4b2955ef-d374-4454-ab0b-705500ce831e tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 19:22:09 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-4b2955ef-d374-4454-ab0b-705500ce831e tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] LIGHTOS: no hostnqn found. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 19:22:09 user nova-compute[75066]: DEBUG os_brick.utils [None req-4b2955ef-d374-4454-ab0b-705500ce831e tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1959854982f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:22:09 user nova-compute[75066]: DEBUG nova.virt.block_device [None req-4b2955ef-d374-4454-ab0b-705500ce831e tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Updating existing volume attachment record: 08c5a0bc-56c4-4490-9995-a3a03f380279 {{(pid=75066) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 19:22:09 user nova-compute[75066]: DEBUG nova.compute.manager [req-cfc19f1e-347b-4fe5-9f84-636d82475e48 req-7edcbf6a-ff97-440c-9dde-14a9986884b1 service nova] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Received event network-vif-plugged-ecbe6e20-8532-4496-8a4c-1151c3770cdc {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:22:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-cfc19f1e-347b-4fe5-9f84-636d82475e48 req-7edcbf6a-ff97-440c-9dde-14a9986884b1 service nova] Acquiring lock "998daa1d-fd6a-4663-8df3-0683a9dbe142-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:22:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-cfc19f1e-347b-4fe5-9f84-636d82475e48 req-7edcbf6a-ff97-440c-9dde-14a9986884b1 service nova] Lock "998daa1d-fd6a-4663-8df3-0683a9dbe142-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:22:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-cfc19f1e-347b-4fe5-9f84-636d82475e48 req-7edcbf6a-ff97-440c-9dde-14a9986884b1 service nova] Lock "998daa1d-fd6a-4663-8df3-0683a9dbe142-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:22:09 user nova-compute[75066]: DEBUG nova.compute.manager [req-cfc19f1e-347b-4fe5-9f84-636d82475e48 req-7edcbf6a-ff97-440c-9dde-14a9986884b1 service nova] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] No waiting events found dispatching network-vif-plugged-ecbe6e20-8532-4496-8a4c-1151c3770cdc {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:22:09 user nova-compute[75066]: WARNING nova.compute.manager [req-cfc19f1e-347b-4fe5-9f84-636d82475e48 req-7edcbf6a-ff97-440c-9dde-14a9986884b1 service nova] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Received unexpected event network-vif-plugged-ecbe6e20-8532-4496-8a4c-1151c3770cdc for instance with vm_state active and task_state None.
Dec 01 19:22:09 user nova-compute[75066]: DEBUG nova.compute.manager [req-cfc19f1e-347b-4fe5-9f84-636d82475e48 req-7edcbf6a-ff97-440c-9dde-14a9986884b1 service nova] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Received event network-vif-plugged-ecbe6e20-8532-4496-8a4c-1151c3770cdc {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:22:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-cfc19f1e-347b-4fe5-9f84-636d82475e48 req-7edcbf6a-ff97-440c-9dde-14a9986884b1 service nova] Acquiring lock "998daa1d-fd6a-4663-8df3-0683a9dbe142-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:22:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-cfc19f1e-347b-4fe5-9f84-636d82475e48 req-7edcbf6a-ff97-440c-9dde-14a9986884b1 service nova] Lock "998daa1d-fd6a-4663-8df3-0683a9dbe142-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:22:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-cfc19f1e-347b-4fe5-9f84-636d82475e48 req-7edcbf6a-ff97-440c-9dde-14a9986884b1 service nova] Lock "998daa1d-fd6a-4663-8df3-0683a9dbe142-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:22:09 user nova-compute[75066]: DEBUG nova.compute.manager [req-cfc19f1e-347b-4fe5-9f84-636d82475e48 req-7edcbf6a-ff97-440c-9dde-14a9986884b1 service nova] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] No waiting events found dispatching network-vif-plugged-ecbe6e20-8532-4496-8a4c-1151c3770cdc {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:22:09 user nova-compute[75066]: WARNING nova.compute.manager [req-cfc19f1e-347b-4fe5-9f84-636d82475e48 req-7edcbf6a-ff97-440c-9dde-14a9986884b1 service nova] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Received unexpected event network-vif-plugged-ecbe6e20-8532-4496-8a4c-1151c3770cdc for instance with vm_state active and task_state None.
Dec 01 19:22:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Acquiring lock "10fc72fa-64a3-4704-ad91-2e3ae88d5424" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:22:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Lock "10fc72fa-64a3-4704-ad91-2e3ae88d5424" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:22:12 user nova-compute[75066]: INFO nova.compute.manager [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Unshelving
Dec 01 19:22:12 user nova-compute[75066]: INFO nova.virt.block_device [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Booting with volume a0f565ac-cb88-4957-a726-5589e85dfd5c at /dev/vda
Dec 01 19:22:12 user nova-compute[75066]: DEBUG os_brick.utils [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:22:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:12 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[7428c0bf-1b14-41de-9e01-0221cf30acdc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1959854982f\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:12 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa4657cb-d231-4774-bb51-50c8de392892]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:12 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[14549aad-0c12-4014-9d20-f4cd140ef248]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:12 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[e675feb0-6619-442b-b965-29115c377740]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Running cmd (subprocess): nvme version {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] 'nvme version' failed. Not Retrying. {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:22:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] nvme not present on system {{(pid=75066) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 19:22:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:22:12 user nova-compute[75066]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 19:22:12 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c015c6-457e-418b-ad00-1ddd84bce964]: (4, '') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75066) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 19:22:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 19:22:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] LIGHTOS: no hostnqn found. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 19:22:12 user nova-compute[75066]: DEBUG os_brick.utils [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1959854982f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:22:12 user nova-compute[75066]: DEBUG nova.virt.block_device [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Updating existing volume attachment record: 49f94344-8a26-49a0-b029-df14c02f54a2 {{(pid=75066) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 19:22:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:17 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:17 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:18 user nova-compute[75066]: DEBUG nova.compute.manager [req-98d3bd1a-e86b-4a1f-a78e-f45f080a2463 req-616fafd5-5a4c-4295-947d-08ffec2f418c service nova] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Received event network-changed-0472fc48-19d0-4e5e-ac11-7c28e1ddd485 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:22:18 user nova-compute[75066]: DEBUG nova.compute.manager [req-98d3bd1a-e86b-4a1f-a78e-f45f080a2463 req-616fafd5-5a4c-4295-947d-08ffec2f418c service nova] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Refreshing instance network info cache due to event network-changed-0472fc48-19d0-4e5e-ac11-7c28e1ddd485. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:22:18 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-98d3bd1a-e86b-4a1f-a78e-f45f080a2463 req-616fafd5-5a4c-4295-947d-08ffec2f418c service nova] Acquiring lock "refresh_cache-a553e030-0d69-4725-9f84-6c0c63556ed4" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:22:18 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-98d3bd1a-e86b-4a1f-a78e-f45f080a2463 req-616fafd5-5a4c-4295-947d-08ffec2f418c service nova] Acquired lock "refresh_cache-a553e030-0d69-4725-9f84-6c0c63556ed4" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:22:18 user nova-compute[75066]: DEBUG nova.network.neutron [req-98d3bd1a-e86b-4a1f-a78e-f45f080a2463 req-616fafd5-5a4c-4295-947d-08ffec2f418c service nova] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Refreshing network info cache for port 0472fc48-19d0-4e5e-ac11-7c28e1ddd485 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:22:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:18 user nova-compute[75066]: DEBUG nova.network.neutron [req-98d3bd1a-e86b-4a1f-a78e-f45f080a2463 req-616fafd5-5a4c-4295-947d-08ffec2f418c service nova] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Updated VIF entry in instance network info cache for port 0472fc48-19d0-4e5e-ac11-7c28e1ddd485. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:22:18 user nova-compute[75066]: DEBUG nova.network.neutron [req-98d3bd1a-e86b-4a1f-a78e-f45f080a2463 req-616fafd5-5a4c-4295-947d-08ffec2f418c service nova] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Updating instance_info_cache with network_info: [{"id": "0472fc48-19d0-4e5e-ac11-7c28e1ddd485", "address": "fa:16:3e:18:e9:73", "network": {"id": "191f13ce-a864-4c09-8ca5-e8a106e24d37", "bridge": "br-int", "label": "tempest-TestStampPattern-1604601756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9caae5967744641b7490e1aa91973c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0472fc48-19", "ovs_interfaceid": "0472fc48-19d0-4e5e-ac11-7c28e1ddd485", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:22:18 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-98d3bd1a-e86b-4a1f-a78e-f45f080a2463 req-616fafd5-5a4c-4295-947d-08ffec2f418c service nova] Releasing lock "refresh_cache-a553e030-0d69-4725-9f84-6c0c63556ed4" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:22:18 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-cdfc24d7-06fc-44a4-b255-4f86a2e235aa tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Acquiring lock "a553e030-0d69-4725-9f84-6c0c63556ed4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:22:18 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-cdfc24d7-06fc-44a4-b255-4f86a2e235aa tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lock "a553e030-0d69-4725-9f84-6c0c63556ed4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:22:18 user nova-compute[75066]: DEBUG nova.objects.instance [None req-cdfc24d7-06fc-44a4-b255-4f86a2e235aa tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lazy-loading 'flavor' on Instance uuid a553e030-0d69-4725-9f84-6c0c63556ed4 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:22:18 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-cdfc24d7-06fc-44a4-b255-4f86a2e235aa tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lock "a553e030-0d69-4725-9f84-6c0c63556ed4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:22:18 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b2955ef-d374-4454-ab0b-705500ce831e tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Calling os-brick to attach iSCSI Volume {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 19:22:18 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2955ef-d374-4454-ab0b-705500ce831e tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6986eb1c-5a0a-4839-900b-7af58180eb89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JVgCSEut', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:22:18 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-4b2955ef-d374-4454-ab0b-705500ce831e tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:22:18 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-4b2955ef-d374-4454-ab0b-705500ce831e tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:22:18 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-4b2955ef-d374-4454-ab0b-705500ce831e tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:22:18 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-4b2955ef-d374-4454-ab0b-705500ce831e tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:22:18 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-4b2955ef-d374-4454-ab0b-705500ce831e tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6986eb1c-5a0a-4839-900b-7af58180eb89" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:22:18 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-4b2955ef-d374-4454-ab0b-705500ce831e tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6986eb1c-5a0a-4839-900b-7af58180eb89" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:22:18 user nova-compute[75066]: INFO os_brick.initiator.connectors.iscsi [None req-4b2955ef-d374-4454-ab0b-705500ce831e tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 19:22:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6986eb1c-5a0a-4839-900b-7af58180eb89 -p 172.16.0.220:3260 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6986eb1c-5a0a-4839-900b-7af58180eb89 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:18 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[23044420-0542-42de-8d15-d0aeec30f145]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:18 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2955ef-d374-4454-ab0b-705500ce831e tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 19:22:18 user nova-compute[75066]:  {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:22:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6986eb1c-5a0a-4839-900b-7af58180eb89 -p 172.16.0.220:3260 --interface default --op new {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:18 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-cdfc24d7-06fc-44a4-b255-4f86a2e235aa tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Acquiring lock "a553e030-0d69-4725-9f84-6c0c63556ed4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:22:18 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-cdfc24d7-06fc-44a4-b255-4f86a2e235aa tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lock "a553e030-0d69-4725-9f84-6c0c63556ed4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:22:18 user nova-compute[75066]: INFO nova.compute.manager [None req-cdfc24d7-06fc-44a4-b255-4f86a2e235aa tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Attaching volume 0974d418-ea5d-4b7c-82d8-a6e2909589bb to /dev/vdb
Dec 01 19:22:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6986eb1c-5a0a-4839-900b-7af58180eb89 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:19 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[746016c6-321a-4e45-82db-fd974ce158ec]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6986eb1c-5a0a-4839-900b-7af58180eb89] added\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:19 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2955ef-d374-4454-ab0b-705500ce831e tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6986eb1c-5a0a-4839-900b-7af58180eb89] added
Dec 01 19:22:19 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:22:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6986eb1c-5a0a-4839-900b-7af58180eb89 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6986eb1c-5a0a-4839-900b-7af58180eb89 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:19 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0d0be5-638b-43bf-aed7-130ea2d0a285]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:19 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2955ef-d374-4454-ab0b-705500ce831e tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:22:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6986eb1c-5a0a-4839-900b-7af58180eb89 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6986eb1c-5a0a-4839-900b-7af58180eb89 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:19 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4dffa2e-8080-4e9d-9112-435790022dd3]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:19 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2955ef-d374-4454-ab0b-705500ce831e tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:22:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6986eb1c-5a0a-4839-900b-7af58180eb89 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JVgCSEut {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:19 user nova-compute[75066]: DEBUG os_brick.utils [None req-cdfc24d7-06fc-44a4-b255-4f86a2e235aa tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:22:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6986eb1c-5a0a-4839-900b-7af58180eb89 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JVgCSEut" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:19 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[000d2e4f-c76b-4836-a922-fffd2e17f5f5]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:19 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2955ef-d374-4454-ab0b-705500ce831e tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JVgCSEut'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:22:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6986eb1c-5a0a-4839-900b-7af58180eb89 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:19 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[358815cb-0c66-4604-b35f-08fe5dcda7f3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1959854982f\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6986eb1c-5a0a-4839-900b-7af58180eb89 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:19 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[5010de3e-7c06-401e-b60d-9fa556a4295f]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:19 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2955ef-d374-4454-ab0b-705500ce831e tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:22:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:19 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c312a2-686f-4a90-9f09-1d48956e0aef]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:19 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a3b2ce-43e5-46e7-8ff8-4c0801d608fb]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:19 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2955ef-d374-4454-ab0b-705500ce831e tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)
Dec 01 19:22:19 user nova-compute[75066]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)
Dec 01 19:22:19 user nova-compute[75066]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:22:19 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:22:19 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2955ef-d374-4454-ab0b-705500ce831e tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)
Dec 01 19:22:19 user nova-compute[75066]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)
Dec 01 19:22:19 user nova-compute[75066]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:22:19 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:22:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6986eb1c-5a0a-4839-900b-7af58180eb89 -p 172.16.0.220:3260 --login {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:19 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1337231-c37a-4064-a25a-13aa8464e523]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:19 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[e789287e-5b4e-4b53-8f90-2c818efc7397]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-cdfc24d7-06fc-44a4-b255-4f86a2e235aa tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Running cmd (subprocess): nvme version {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-cdfc24d7-06fc-44a4-b255-4f86a2e235aa tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] 'nvme version' failed. Not Retrying. {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:22:19 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cdfc24d7-06fc-44a4-b255-4f86a2e235aa tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] nvme not present on system {{(pid=75066) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 19:22:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6986eb1c-5a0a-4839-900b-7af58180eb89 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:19 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[227ec860-539a-4b72-90ef-e58b8129470f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6986eb1c-5a0a-4839-900b-7af58180eb89, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6986eb1c-5a0a-4839-900b-7af58180eb89, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:19 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2955ef-d374-4454-ab0b-705500ce831e tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6986eb1c-5a0a-4839-900b-7af58180eb89, portal: 172.16.0.220,3260]
Dec 01 19:22:19 user nova-compute[75066]: Login to [iface: default, target: iqn.2010-10.org.openstack:6986eb1c-5a0a-4839-900b-7af58180eb89, portal: 172.16.0.220,3260] successful.
Dec 01 19:22:19 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:22:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:22:19 user nova-compute[75066]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 19:22:19 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[168512aa-8f7f-4f32-a36c-a80c0f188364]: (4, '') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6986eb1c-5a0a-4839-900b-7af58180eb89 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:19 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-cdfc24d7-06fc-44a4-b255-4f86a2e235aa tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75066) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 19:22:19 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-cdfc24d7-06fc-44a4-b255-4f86a2e235aa tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 19:22:19 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-cdfc24d7-06fc-44a4-b255-4f86a2e235aa tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] LIGHTOS: no hostnqn found. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 19:22:19 user nova-compute[75066]: DEBUG os_brick.utils [None req-cdfc24d7-06fc-44a4-b255-4f86a2e235aa tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1959854982f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:22:19 user nova-compute[75066]: DEBUG nova.virt.block_device [None req-cdfc24d7-06fc-44a4-b255-4f86a2e235aa tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Updating existing volume attachment record: 3f15c1f8-8a9d-4b7d-8cbc-d9504f36b59f {{(pid=75066) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 19:22:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6986eb1c-5a0a-4839-900b-7af58180eb89 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:19 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[cccabd88-eaae-4f4b-91f7-85bd70c79d6d]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:19 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2955ef-d374-4454-ab0b-705500ce831e tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:22:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:19 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d57a3d-ea43-43da-a4fa-81c7f9bef828]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6986eb1c-5a0a-4839-900b-7af58180eb89 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:19 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2955ef-d374-4454-ab0b-705500ce831e tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)
Dec 01 19:22:19 user nova-compute[75066]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)
Dec 01 19:22:19 user nova-compute[75066]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:22:19 user nova-compute[75066]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6986eb1c-5a0a-4839-900b-7af58180eb89 (non-flash)
Dec 01 19:22:19 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:22:19 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2955ef-d374-4454-ab0b-705500ce831e tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)
Dec 01 19:22:19 user nova-compute[75066]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)
Dec 01 19:22:19 user nova-compute[75066]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:22:19 user nova-compute[75066]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6986eb1c-5a0a-4839-900b-7af58180eb89 (non-flash)
Dec 01 19:22:19 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:22:19 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-4b2955ef-d374-4454-ab0b-705500ce831e tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6986eb1c-5a0a-4839-900b-7af58180eb89" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:22:19 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2955ef-d374-4454-ab0b-705500ce831e tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Connected to 172.16.0.220:3260 {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 19:22:19 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-4b2955ef-d374-4454-ab0b-705500ce831e tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] HCTL ('34', '-', '-', 0) found on session 22 with lun 0 {{(pid=75066) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 19:22:19 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-4b2955ef-d374-4454-ab0b-705500ce831e tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75066) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 19:22:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:19 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37c44c0-83ed-4c86-91d2-a33f9471e88b]: (4, ('- - 0', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:19 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-4b2955ef-d374-4454-ab0b-705500ce831e tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: None {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:22:20 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-4b2955ef-d374-4454-ab0b-705500ce831e tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:22:20 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2955ef-d374-4454-ab0b-705500ce831e tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6986eb1c-5a0a-4839-900b-7af58180eb89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JVgCSEut', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 19:22:20 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-4b2955ef-d374-4454-ab0b-705500ce831e tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:22:20 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-4b2955ef-d374-4454-ab0b-705500ce831e tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '23833653939626136', 'path': '/dev/sdc'} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:22:20 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4b2955ef-d374-4454-ab0b-705500ce831e tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833653939626136', 'path': '/dev/sdc'} {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 19:22:20 user nova-compute[75066]: DEBUG nova.objects.instance [None req-4b2955ef-d374-4454-ab0b-705500ce831e tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Lazy-loading 'flavor' on Instance uuid 998daa1d-fd6a-4663-8df3-0683a9dbe142 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:22:20 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-4b2955ef-d374-4454-ab0b-705500ce831e tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 19:22:20 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:22:20 user nova-compute[75066]:   <source dev="/dev/sdc"/>
Dec 01 19:22:20 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:22:20 user nova-compute[75066]:   <serial>6986eb1c-5a0a-4839-900b-7af58180eb89</serial>
Dec 01 19:22:20 user nova-compute[75066]: </disk>
Dec 01 19:22:20 user nova-compute[75066]:  {{(pid=75066) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 19:22:20 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-4b2955ef-d374-4454-ab0b-705500ce831e tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:22:20 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-4b2955ef-d374-4454-ab0b-705500ce831e tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] No BDM found with device name hda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:22:20 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-4b2955ef-d374-4454-ab0b-705500ce831e tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] No VIF found with MAC fa:16:3e:10:62:79, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:22:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-4b2955ef-d374-4454-ab0b-705500ce831e tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Lock "998daa1d-fd6a-4663-8df3-0683a9dbe142" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.319s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:22:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a5260209-c99f-405f-ba27-9b0e9438a2e6 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Acquiring lock "67c5dd7c-88aa-4f2f-8f62-a9af0480c38e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:22:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a5260209-c99f-405f-ba27-9b0e9438a2e6 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Lock "67c5dd7c-88aa-4f2f-8f62-a9af0480c38e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:22:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a5260209-c99f-405f-ba27-9b0e9438a2e6 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Acquiring lock "67c5dd7c-88aa-4f2f-8f62-a9af0480c38e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:22:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a5260209-c99f-405f-ba27-9b0e9438a2e6 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Lock "67c5dd7c-88aa-4f2f-8f62-a9af0480c38e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:22:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a5260209-c99f-405f-ba27-9b0e9438a2e6 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Lock "67c5dd7c-88aa-4f2f-8f62-a9af0480c38e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:22:22 user nova-compute[75066]: INFO nova.compute.manager [None req-a5260209-c99f-405f-ba27-9b0e9438a2e6 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Terminating instance
Dec 01 19:22:22 user nova-compute[75066]: DEBUG nova.compute.manager [None req-a5260209-c99f-405f-ba27-9b0e9438a2e6 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Start destroying the instance on the hypervisor. {{(pid=75066) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 19:22:22 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:22 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:22 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ce6c601f-6b1f-4881-bdca-a87740ef70d4 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Acquiring lock "998daa1d-fd6a-4663-8df3-0683a9dbe142" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:22:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ce6c601f-6b1f-4881-bdca-a87740ef70d4 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Lock "998daa1d-fd6a-4663-8df3-0683a9dbe142" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:22:22 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:22 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:22 user nova-compute[75066]: INFO nova.compute.manager [None req-ce6c601f-6b1f-4881-bdca-a87740ef70d4 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Detaching volume 6986eb1c-5a0a-4839-900b-7af58180eb89
Dec 01 19:22:22 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:22 user nova-compute[75066]: INFO nova.virt.block_device [None req-ce6c601f-6b1f-4881-bdca-a87740ef70d4 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Attempting to driver detach volume 6986eb1c-5a0a-4839-900b-7af58180eb89 from mountpoint /dev/vdb
Dec 01 19:22:22 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ce6c601f-6b1f-4881-bdca-a87740ef70d4 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Attempting to detach device vdb from instance 998daa1d-fd6a-4663-8df3-0683a9dbe142 from the persistent domain config. {{(pid=75066) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 19:22:22 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-ce6c601f-6b1f-4881-bdca-a87740ef70d4 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 19:22:22 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:22:22 user nova-compute[75066]:   <source dev="/dev/sdc"/>
Dec 01 19:22:22 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:22:22 user nova-compute[75066]:   <serial>6986eb1c-5a0a-4839-900b-7af58180eb89</serial>
Dec 01 19:22:22 user nova-compute[75066]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Dec 01 19:22:22 user nova-compute[75066]: </disk>
Dec 01 19:22:22 user nova-compute[75066]:  {{(pid=75066) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 19:22:22 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-ce6c601f-6b1f-4881-bdca-a87740ef70d4 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Successfully detached device vdb from instance 998daa1d-fd6a-4663-8df3-0683a9dbe142 from the persistent domain config.
Dec 01 19:22:22 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ce6c601f-6b1f-4881-bdca-a87740ef70d4 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 998daa1d-fd6a-4663-8df3-0683a9dbe142 from the live domain config. {{(pid=75066) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 19:22:22 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-ce6c601f-6b1f-4881-bdca-a87740ef70d4 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 19:22:22 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:22:22 user nova-compute[75066]:   <source dev="/dev/sdc"/>
Dec 01 19:22:22 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:22:22 user nova-compute[75066]:   <serial>6986eb1c-5a0a-4839-900b-7af58180eb89</serial>
Dec 01 19:22:22 user nova-compute[75066]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Dec 01 19:22:22 user nova-compute[75066]: </disk>
Dec 01 19:22:22 user nova-compute[75066]:  {{(pid=75066) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 19:22:22 user nova-compute[75066]: DEBUG nova.compute.manager [req-42e1fd9b-e9a7-4911-bf7d-15e37c70f27a req-d699edbd-c2f0-404f-9920-4c5ac5f8663e service nova] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Received event network-vif-unplugged-73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:22:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-42e1fd9b-e9a7-4911-bf7d-15e37c70f27a req-d699edbd-c2f0-404f-9920-4c5ac5f8663e service nova] Acquiring lock "67c5dd7c-88aa-4f2f-8f62-a9af0480c38e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:22:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-42e1fd9b-e9a7-4911-bf7d-15e37c70f27a req-d699edbd-c2f0-404f-9920-4c5ac5f8663e service nova] Lock "67c5dd7c-88aa-4f2f-8f62-a9af0480c38e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:22:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-42e1fd9b-e9a7-4911-bf7d-15e37c70f27a req-d699edbd-c2f0-404f-9920-4c5ac5f8663e service nova] Lock "67c5dd7c-88aa-4f2f-8f62-a9af0480c38e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:22:22 user nova-compute[75066]: DEBUG nova.compute.manager [req-42e1fd9b-e9a7-4911-bf7d-15e37c70f27a req-d699edbd-c2f0-404f-9920-4c5ac5f8663e service nova] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] No waiting events found dispatching network-vif-unplugged-73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:22:22 user nova-compute[75066]: DEBUG nova.compute.manager [req-42e1fd9b-e9a7-4911-bf7d-15e37c70f27a req-d699edbd-c2f0-404f-9920-4c5ac5f8663e service nova] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Received event network-vif-unplugged-73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2 for instance with task_state deleting. {{(pid=75066) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 19:22:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:22:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:22:22 user nova-compute[75066]: DEBUG nova.objects.instance [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Lazy-loading 'pci_requests' on Instance uuid 10fc72fa-64a3-4704-ad91-2e3ae88d5424 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:22:22 user nova-compute[75066]: DEBUG nova.objects.instance [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Lazy-loading 'numa_topology' on Instance uuid 10fc72fa-64a3-4704-ad91-2e3ae88d5424 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:22:22 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75066) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 19:22:22 user nova-compute[75066]: INFO nova.compute.claims [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Claim successful on node user
Dec 01 19:22:23 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ce6c601f-6b1f-4881-bdca-a87740ef70d4 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 998daa1d-fd6a-4663-8df3-0683a9dbe142 {{(pid=75066) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 19:22:23 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Instance destroyed successfully.
Dec 01 19:22:23 user nova-compute[75066]: DEBUG nova.objects.instance [None req-a5260209-c99f-405f-ba27-9b0e9438a2e6 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Lazy-loading 'resources' on Instance uuid 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:22:23 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-a5260209-c99f-405f-ba27-9b0e9438a2e6 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:15:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-116335834',display_name='tempest-ServerStableDeviceRescueTest-server-116335834',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-116335834',id=1,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNNwUw2DY7Q5YGZ9SklK7Yt6zDNAMAKbqWf0bjfGOIr+Bf73P/Vb8HVUq1DDGOQfShaQxirLaBE1zWK7StLIdvMV/O9laZqIqcEwHqJJUVd7PEVzmYYja/8XpEumf+mt5Q==',key_name='tempest-keypair-572874473',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:19:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='306d3049e90647fa9f1c90a104eac0e7',ramdisk_id='',reservation_id='r-vlwek4pb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1936445064',owner_user_name='tempest-ServerStableDeviceRescueTest-1936445064-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:21:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1fbd6bed08164f359471592ccc78a43d',uuid=67c5dd7c-88aa-4f2f-8f62-a9af0480c38e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2", "address": "fa:16:3e:5a:73:a4", "network": {"id": "fdb3c017-aafb-4c3e-a08c-a73a68be9f70", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1696445417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "306d3049e90647fa9f1c90a104eac0e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bdff9a-3a", "ovs_interfaceid": "73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:22:23 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-a5260209-c99f-405f-ba27-9b0e9438a2e6 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Converting VIF {"id": "73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2", "address": "fa:16:3e:5a:73:a4", "network": {"id": "fdb3c017-aafb-4c3e-a08c-a73a68be9f70", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1696445417-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.231", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "306d3049e90647fa9f1c90a104eac0e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73bdff9a-3a", "ovs_interfaceid": "73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:22:23 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-a5260209-c99f-405f-ba27-9b0e9438a2e6 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5a:73:a4,bridge_name='br-int',has_traffic_filtering=True,id=73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2,network=Network(fdb3c017-aafb-4c3e-a08c-a73a68be9f70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73bdff9a-3a') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:22:23 user nova-compute[75066]: DEBUG os_vif [None req-a5260209-c99f-405f-ba27-9b0e9438a2e6 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:73:a4,bridge_name='br-int',has_traffic_filtering=True,id=73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2,network=Network(fdb3c017-aafb-4c3e-a08c-a73a68be9f70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73bdff9a-3a') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:22:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap73bdff9a-3a, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:22:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:22:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=56c9896f-4f04-4ebe-a87b-a5142661d271) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:22:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:22:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:23 user nova-compute[75066]: INFO os_vif [None req-a5260209-c99f-405f-ba27-9b0e9438a2e6 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:73:a4,bridge_name='br-int',has_traffic_filtering=True,id=73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2,network=Network(fdb3c017-aafb-4c3e-a08c-a73a68be9f70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73bdff9a-3a')
Dec 01 19:22:23 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-a5260209-c99f-405f-ba27-9b0e9438a2e6 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Deleting instance files /opt/stack/data/nova/instances/67c5dd7c-88aa-4f2f-8f62-a9af0480c38e_del
Dec 01 19:22:23 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-a5260209-c99f-405f-ba27-9b0e9438a2e6 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Deletion of /opt/stack/data/nova/instances/67c5dd7c-88aa-4f2f-8f62-a9af0480c38e_del complete
Dec 01 19:22:23 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:22:23 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:22:23 user nova-compute[75066]: INFO nova.compute.manager [None req-a5260209-c99f-405f-ba27-9b0e9438a2e6 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Took 1.20 seconds to destroy the instance on the hypervisor.
Dec 01 19:22:23 user nova-compute[75066]: DEBUG oslo.service.loopingcall [None req-a5260209-c99f-405f-ba27-9b0e9438a2e6 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75066) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 19:22:23 user nova-compute[75066]: DEBUG nova.compute.manager [-] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Deallocating network for instance {{(pid=75066) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 19:22:23 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] deallocate_for_instance() {{(pid=75066) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 19:22:23 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.614s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:22:23 user nova-compute[75066]: INFO nova.network.neutron [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Updating port d51d7391-af1b-4160-b3bb-c77d0507a0e0 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Dec 01 19:22:24 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:22:24 user nova-compute[75066]: INFO nova.compute.manager [-] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Took 0.69 seconds to deallocate network for instance.
Dec 01 19:22:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a5260209-c99f-405f-ba27-9b0e9438a2e6 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:22:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a5260209-c99f-405f-ba27-9b0e9438a2e6 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:22:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Acquiring lock "refresh_cache-10fc72fa-64a3-4704-ad91-2e3ae88d5424" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:22:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Acquired lock "refresh_cache-10fc72fa-64a3-4704-ad91-2e3ae88d5424" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:22:24 user nova-compute[75066]: DEBUG nova.network.neutron [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:22:24 user nova-compute[75066]: DEBUG nova.compute.manager [req-96093403-a93c-49b6-8eac-ffa33c6d942a req-9f82f218-d402-4fc2-bc79-c4dce8468f89 service nova] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Received event network-changed-d51d7391-af1b-4160-b3bb-c77d0507a0e0 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:22:24 user nova-compute[75066]: DEBUG nova.compute.manager [req-96093403-a93c-49b6-8eac-ffa33c6d942a req-9f82f218-d402-4fc2-bc79-c4dce8468f89 service nova] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Refreshing instance network info cache due to event network-changed-d51d7391-af1b-4160-b3bb-c77d0507a0e0. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:22:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-96093403-a93c-49b6-8eac-ffa33c6d942a req-9f82f218-d402-4fc2-bc79-c4dce8468f89 service nova] Acquiring lock "refresh_cache-10fc72fa-64a3-4704-ad91-2e3ae88d5424" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:22:24 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-a5260209-c99f-405f-ba27-9b0e9438a2e6 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:22:24 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-a5260209-c99f-405f-ba27-9b0e9438a2e6 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:22:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a5260209-c99f-405f-ba27-9b0e9438a2e6 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.446s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:22:24 user nova-compute[75066]: INFO nova.scheduler.client.report [None req-a5260209-c99f-405f-ba27-9b0e9438a2e6 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Deleted allocations for instance 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e
Dec 01 19:22:24 user nova-compute[75066]: DEBUG nova.compute.manager [req-0696164c-7852-4767-b205-4e9f71c23151 req-867143f8-b038-4580-b6bd-abc75af5ca14 service nova] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Received event network-vif-plugged-73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:22:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-0696164c-7852-4767-b205-4e9f71c23151 req-867143f8-b038-4580-b6bd-abc75af5ca14 service nova] Acquiring lock "67c5dd7c-88aa-4f2f-8f62-a9af0480c38e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:22:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-0696164c-7852-4767-b205-4e9f71c23151 req-867143f8-b038-4580-b6bd-abc75af5ca14 service nova] Lock "67c5dd7c-88aa-4f2f-8f62-a9af0480c38e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:22:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-0696164c-7852-4767-b205-4e9f71c23151 req-867143f8-b038-4580-b6bd-abc75af5ca14 service nova] Lock "67c5dd7c-88aa-4f2f-8f62-a9af0480c38e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:22:24 user nova-compute[75066]: DEBUG nova.compute.manager [req-0696164c-7852-4767-b205-4e9f71c23151 req-867143f8-b038-4580-b6bd-abc75af5ca14 service nova] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] No waiting events found dispatching network-vif-plugged-73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:22:24 user nova-compute[75066]: WARNING nova.compute.manager [req-0696164c-7852-4767-b205-4e9f71c23151 req-867143f8-b038-4580-b6bd-abc75af5ca14 service nova] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Received unexpected event network-vif-plugged-73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2 for instance with vm_state deleted and task_state None.
Dec 01 19:22:24 user nova-compute[75066]: DEBUG nova.compute.manager [req-0696164c-7852-4767-b205-4e9f71c23151 req-867143f8-b038-4580-b6bd-abc75af5ca14 service nova] [instance: 67c5dd7c-88aa-4f2f-8f62-a9af0480c38e] Received event network-vif-deleted-73bdff9a-3ac7-4c28-9ac5-e4e0f39b92a2 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:22:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a5260209-c99f-405f-ba27-9b0e9438a2e6 tempest-ServerStableDeviceRescueTest-1936445064 tempest-ServerStableDeviceRescueTest-1936445064-project-member] Lock "67c5dd7c-88aa-4f2f-8f62-a9af0480c38e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.548s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:22:24 user nova-compute[75066]: DEBUG nova.network.neutron [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Updating instance_info_cache with network_info: [{"id": "d51d7391-af1b-4160-b3bb-c77d0507a0e0", "address": "fa:16:3e:e9:da:9e", "network": {"id": "4b17d46f-fdbc-4cd7-991c-ca6981e0f20f", "bridge": "br-int", "label": "tempest-TestShelveInstance-2081974203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5b79591b18f4d35bdd99365c816b55c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd51d7391-af", "ovs_interfaceid": "d51d7391-af1b-4160-b3bb-c77d0507a0e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:22:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Releasing lock "refresh_cache-10fc72fa-64a3-4704-ad91-2e3ae88d5424" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:22:24 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Creating instance directory {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 19:22:24 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Creating image(s)
Dec 01 19:22:24 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Did not create local disks {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Dec 01 19:22:24 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Ensure instance console log exists: /opt/stack/data/nova/instances/10fc72fa-64a3-4704-ad91-2e3ae88d5424/console.log {{(pid=75066) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 19:22:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:22:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:22:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:22:24 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Start _get_guest_xml network_info=[{"id": "d51d7391-af1b-4160-b3bb-c77d0507a0e0", "address": "fa:16:3e:e9:da:9e", "network": {"id": "4b17d46f-fdbc-4cd7-991c-ca6981e0f20f", "bridge": "br-int", "label": "tempest-TestShelveInstance-2081974203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5b79591b18f4d35bdd99365c816b55c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd51d7391-af", "ovs_interfaceid": "d51d7391-af1b-4160-b3bb-c77d0507a0e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': True, 'attachment_id': '49f94344-8a26-49a0-b029-df14c02f54a2', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wmuOJlqG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '10fc72fa-64a3-4704-ad91-2e3ae88d5424', 'attached_at': '', 'detached_at': '', 'volume_id': 'a0f565ac-cb88-4957-a726-5589e85dfd5c', 'serial': 'a0f565ac-cb88-4957-a726-5589e85dfd5c'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:22:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-96093403-a93c-49b6-8eac-ffa33c6d942a req-9f82f218-d402-4fc2-bc79-c4dce8468f89 service nova] Acquired lock "refresh_cache-10fc72fa-64a3-4704-ad91-2e3ae88d5424" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:22:24 user nova-compute[75066]: DEBUG nova.network.neutron [req-96093403-a93c-49b6-8eac-ffa33c6d942a req-9f82f218-d402-4fc2-bc79-c4dce8468f89 service nova] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Refreshing network info cache for port d51d7391-af1b-4160-b3bb-c77d0507a0e0 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:22:24 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:22:24 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:22:24 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:22:24 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:22:24 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:22:24 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:22:24 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:22:24 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:22:24 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:22:24 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:22:24 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:22:24 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:22:24 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:22:24 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:22:24 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:22:24 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:22:24 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:22:24 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:22:24 user nova-compute[75066]: DEBUG nova.objects.instance [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Lazy-loading 'vcpu_model' on Instance uuid 10fc72fa-64a3-4704-ad91-2e3ae88d5424 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:22:24 user nova-compute[75066]: DEBUG nova.objects.base [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Object Instance<10fc72fa-64a3-4704-ad91-2e3ae88d5424> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75066) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 19:22:24 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Calling os-brick to attach iSCSI Volume {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 19:22:24 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wmuOJlqG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:22:24 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:22:24 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:22:24 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:22:24 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:22:24 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:22:24 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:22:24 user nova-compute[75066]: INFO os_brick.initiator.connectors.iscsi [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 19:22:24 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c -p 172.16.0.220:3260 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:24 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:24 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7682e6b-b49c-44d9-b5aa-9b55984d407e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:24 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 19:22:24 user nova-compute[75066]:  {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:22:24 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c -p 172.16.0.220:3260 --interface default --op new {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:24 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:24 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8eb73e-aab9-4c1f-ad05-a2cc18450083]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c] added\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:24 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c] added
Dec 01 19:22:24 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:22:24 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:24 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:24 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc4e278-345c-41fd-9e8d-3e254dae7d63]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:24 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:22:24 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:24 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:24 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91f8748-d606-4ed9-8a9d-df6077d24e05]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:24 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:22:24 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wmuOJlqG {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:25 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wmuOJlqG" returned: 0 in 0.021s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:25 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[f540dc9b-5bb2-44fd-8ab8-b4fe734d59b4]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:25 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wmuOJlqG'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:22:25 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:25 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:25 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[03634756-b0ca-4b95-9da2-18b94f8f53dd]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:25 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:22:25 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:25 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:25 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[42187e1e-c3bb-4a41-82b8-d1dbe443595c]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6986eb1c-5a0a-4839-900b-7af58180eb89 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:25 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)
Dec 01 19:22:25 user nova-compute[75066]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)
Dec 01 19:22:25 user nova-compute[75066]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:22:25 user nova-compute[75066]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6986eb1c-5a0a-4839-900b-7af58180eb89 (non-flash)
Dec 01 19:22:25 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:22:25 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)
Dec 01 19:22:25 user nova-compute[75066]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)
Dec 01 19:22:25 user nova-compute[75066]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:22:25 user nova-compute[75066]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6986eb1c-5a0a-4839-900b-7af58180eb89 (non-flash)
Dec 01 19:22:25 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:22:25 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c -p 172.16.0.220:3260 --login {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:25 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:25 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ac901b-1fa5-4603-86a4-475149466fee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:25 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c, portal: 172.16.0.220,3260]
Dec 01 19:22:25 user nova-compute[75066]: Login to [iface: default, target: iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c, portal: 172.16.0.220,3260] successful.
Dec 01 19:22:25 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:22:25 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:25 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:25 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[7100bc24-db5e-499a-adb5-45419ffe29a3]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:25 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:22:25 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:25 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:25 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c28235c-2830-47d1-85ed-29f6eb091ae6]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6986eb1c-5a0a-4839-900b-7af58180eb89 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:25 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)
Dec 01 19:22:25 user nova-compute[75066]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)
Dec 01 19:22:25 user nova-compute[75066]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:22:25 user nova-compute[75066]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6986eb1c-5a0a-4839-900b-7af58180eb89 (non-flash)
Dec 01 19:22:25 user nova-compute[75066]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)
Dec 01 19:22:25 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:22:25 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)
Dec 01 19:22:25 user nova-compute[75066]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)
Dec 01 19:22:25 user nova-compute[75066]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:22:25 user nova-compute[75066]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6986eb1c-5a0a-4839-900b-7af58180eb89 (non-flash)
Dec 01 19:22:25 user nova-compute[75066]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)
Dec 01 19:22:25 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:22:25 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:22:25 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Connected to 172.16.0.220:3260 {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 19:22:25 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] HCTL ('36', '-', '-', 0) found on session 23 with lun 0 {{(pid=75066) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 19:22:25 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75066) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 19:22:25 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:25 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:25 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[b32817c2-101e-4922-8a94-ebb633d10c56]: (4, ('- - 0', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:25 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Searching for a device in session 23 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:22:25 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wmuOJlqG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 19:22:25 user nova-compute[75066]: DEBUG nova.network.neutron [req-96093403-a93c-49b6-8eac-ffa33c6d942a req-9f82f218-d402-4fc2-bc79-c4dce8468f89 service nova] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Updated VIF entry in instance network info cache for port d51d7391-af1b-4160-b3bb-c77d0507a0e0. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:22:25 user nova-compute[75066]: DEBUG nova.network.neutron [req-96093403-a93c-49b6-8eac-ffa33c6d942a req-9f82f218-d402-4fc2-bc79-c4dce8468f89 service nova] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Updating instance_info_cache with network_info: [{"id": "d51d7391-af1b-4160-b3bb-c77d0507a0e0", "address": "fa:16:3e:e9:da:9e", "network": {"id": "4b17d46f-fdbc-4cd7-991c-ca6981e0f20f", "bridge": "br-int", "label": "tempest-TestShelveInstance-2081974203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5b79591b18f4d35bdd99365c816b55c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd51d7391-af", "ovs_interfaceid": "d51d7391-af1b-4160-b3bb-c77d0507a0e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:22:25 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-96093403-a93c-49b6-8eac-ffa33c6d942a req-9f82f218-d402-4fc2-bc79-c4dce8468f89 service nova] Releasing lock "refresh_cache-10fc72fa-64a3-4704-ad91-2e3ae88d5424" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:22:26 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:22:26 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] <== connect_volume: return (1358ms) {'type': 'block', 'scsi_wwn': '23566316565613133', 'path': '/dev/sde'} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:22:26 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23566316565613133', 'path': '/dev/sde'} {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 19:22:26 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-01T19:18:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-599780298',display_name='tempest-TestShelveInstance-server-599780298',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-599780298',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1519500384',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:18:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f5b79591b18f4d35bdd99365c816b55c',ramdisk_id='',reservation_id='r-qdcti0kh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1574356427',owner_user_name='tempest-TestShelveInstance-1574356427-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:22:13Z,user_data=None,user_id='f1f8fb37cb13473b84de443c51815b1d',uuid=10fc72fa-64a3-4704-ad91-2e3ae88d5424,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d51d7391-af1b-4160-b3bb-c77d0507a0e0", "address": "fa:16:3e:e9:da:9e", "network": {"id": "4b17d46f-fdbc-4cd7-991c-ca6981e0f20f", "bridge": "br-int", "label": "tempest-TestShelveInstance-2081974203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5b79591b18f4d35bdd99365c816b55c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd51d7391-af", "ovs_interfaceid": "d51d7391-af1b-4160-b3bb-c77d0507a0e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:22:26 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Converting VIF {"id": "d51d7391-af1b-4160-b3bb-c77d0507a0e0", "address": "fa:16:3e:e9:da:9e", "network": {"id": "4b17d46f-fdbc-4cd7-991c-ca6981e0f20f", "bridge": "br-int", "label": "tempest-TestShelveInstance-2081974203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5b79591b18f4d35bdd99365c816b55c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd51d7391-af", "ovs_interfaceid": "d51d7391-af1b-4160-b3bb-c77d0507a0e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:22:26 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:da:9e,bridge_name='br-int',has_traffic_filtering=True,id=d51d7391-af1b-4160-b3bb-c77d0507a0e0,network=Network(4b17d46f-fdbc-4cd7-991c-ca6981e0f20f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd51d7391-af') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:22:26 user nova-compute[75066]: DEBUG nova.objects.instance [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Lazy-loading 'pci_devices' on Instance uuid 10fc72fa-64a3-4704-ad91-2e3ae88d5424 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:22:26 user nova-compute[75066]: DEBUG nova.objects.base [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Object Instance<10fc72fa-64a3-4704-ad91-2e3ae88d5424> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75066) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 19:22:26 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:22:26 user nova-compute[75066]:   <uuid>10fc72fa-64a3-4704-ad91-2e3ae88d5424</uuid>
Dec 01 19:22:26 user nova-compute[75066]:   <name>instance-0000000b</name>
Dec 01 19:22:26 user nova-compute[75066]:   <memory>524288</memory>
Dec 01 19:22:26 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:22:26 user nova-compute[75066]:   <metadata>
Dec 01 19:22:26 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:22:26 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:22:26 user nova-compute[75066]:       <nova:name>tempest-TestShelveInstance-server-599780298</nova:name>
Dec 01 19:22:26 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:22:24</nova:creationTime>
Dec 01 19:22:26 user nova-compute[75066]:       <nova:flavor name="m1.tiny">
Dec 01 19:22:26 user nova-compute[75066]:         <nova:memory>512</nova:memory>
Dec 01 19:22:26 user nova-compute[75066]:         <nova:disk>1</nova:disk>
Dec 01 19:22:26 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:22:26 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:22:26 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:22:26 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:22:26 user nova-compute[75066]:       <nova:owner>
Dec 01 19:22:26 user nova-compute[75066]:         <nova:user uuid="f1f8fb37cb13473b84de443c51815b1d">tempest-TestShelveInstance-1574356427-project-member</nova:user>
Dec 01 19:22:26 user nova-compute[75066]:         <nova:project uuid="f5b79591b18f4d35bdd99365c816b55c">tempest-TestShelveInstance-1574356427</nova:project>
Dec 01 19:22:26 user nova-compute[75066]:       </nova:owner>
Dec 01 19:22:26 user nova-compute[75066]:       <nova:ports>
Dec 01 19:22:26 user nova-compute[75066]:         <nova:port uuid="d51d7391-af1b-4160-b3bb-c77d0507a0e0">
Dec 01 19:22:26 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Dec 01 19:22:26 user nova-compute[75066]:         </nova:port>
Dec 01 19:22:26 user nova-compute[75066]:       </nova:ports>
Dec 01 19:22:26 user nova-compute[75066]:     </nova:instance>
Dec 01 19:22:26 user nova-compute[75066]:   </metadata>
Dec 01 19:22:26 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:22:26 user nova-compute[75066]:     <system>
Dec 01 19:22:26 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:22:26 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:22:26 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:22:26 user nova-compute[75066]:       <entry name="serial">10fc72fa-64a3-4704-ad91-2e3ae88d5424</entry>
Dec 01 19:22:26 user nova-compute[75066]:       <entry name="uuid">10fc72fa-64a3-4704-ad91-2e3ae88d5424</entry>
Dec 01 19:22:26 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:22:26 user nova-compute[75066]:     </system>
Dec 01 19:22:26 user nova-compute[75066]:   </sysinfo>
Dec 01 19:22:26 user nova-compute[75066]:   <os>
Dec 01 19:22:26 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:22:26 user nova-compute[75066]:     <boot dev="hd"/>
Dec 01 19:22:26 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:22:26 user nova-compute[75066]:   </os>
Dec 01 19:22:26 user nova-compute[75066]:   <features>
Dec 01 19:22:26 user nova-compute[75066]:     <acpi/>
Dec 01 19:22:26 user nova-compute[75066]:     <apic/>
Dec 01 19:22:26 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:22:26 user nova-compute[75066]:   </features>
Dec 01 19:22:26 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:22:26 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:22:26 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:22:26 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:22:26 user nova-compute[75066]:   </clock>
Dec 01 19:22:26 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:22:26 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:22:26 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:22:26 user nova-compute[75066]:   </cpu>
Dec 01 19:22:26 user nova-compute[75066]:   <devices>
Dec 01 19:22:26 user nova-compute[75066]:     <disk type="block" device="disk">
Dec 01 19:22:26 user nova-compute[75066]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:22:26 user nova-compute[75066]:       <source dev="/dev/sde"/>
Dec 01 19:22:26 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:22:26 user nova-compute[75066]:       <serial>a0f565ac-cb88-4957-a726-5589e85dfd5c</serial>
Dec 01 19:22:26 user nova-compute[75066]:     </disk>
Dec 01 19:22:26 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:22:26 user nova-compute[75066]:       <mac address="fa:16:3e:e9:da:9e"/>
Dec 01 19:22:26 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:22:26 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:22:26 user nova-compute[75066]:       <target dev="tapd51d7391-af"/>
Dec 01 19:22:26 user nova-compute[75066]:     </interface>
Dec 01 19:22:26 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:22:26 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/10fc72fa-64a3-4704-ad91-2e3ae88d5424/console.log" append="off"/>
Dec 01 19:22:26 user nova-compute[75066]:     </serial>
Dec 01 19:22:26 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:22:26 user nova-compute[75066]:     <video>
Dec 01 19:22:26 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:22:26 user nova-compute[75066]:     </video>
Dec 01 19:22:26 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:22:26 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:22:26 user nova-compute[75066]:     </rng>
Dec 01 19:22:26 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:22:26 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:22:26 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:22:26 user nova-compute[75066]:     </memballoon>
Dec 01 19:22:26 user nova-compute[75066]:   </devices>
Dec 01 19:22:26 user nova-compute[75066]: </domain>
Dec 01 19:22:26 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:22:26 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-01T19:18:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-599780298',display_name='tempest-TestShelveInstance-server-599780298',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-599780298',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1519500384',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:18:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='f5b79591b18f4d35bdd99365c816b55c',ramdisk_id='',reservation_id='r-qdcti0kh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1574356427',owner_user_name='tempest-TestShelveInstance-1574356427-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:22:13Z,user_data=None,user_id='f1f8fb37cb13473b84de443c51815b1d',uuid=10fc72fa-64a3-4704-ad91-2e3ae88d5424,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d51d7391-af1b-4160-b3bb-c77d0507a0e0", "address": "fa:16:3e:e9:da:9e", "network": {"id": "4b17d46f-fdbc-4cd7-991c-ca6981e0f20f", "bridge": "br-int", "label": "tempest-TestShelveInstance-2081974203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5b79591b18f4d35bdd99365c816b55c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd51d7391-af", "ovs_interfaceid": "d51d7391-af1b-4160-b3bb-c77d0507a0e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:22:26 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Converting VIF {"id": "d51d7391-af1b-4160-b3bb-c77d0507a0e0", "address": "fa:16:3e:e9:da:9e", "network": {"id": "4b17d46f-fdbc-4cd7-991c-ca6981e0f20f", "bridge": "br-int", "label": "tempest-TestShelveInstance-2081974203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5b79591b18f4d35bdd99365c816b55c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd51d7391-af", "ovs_interfaceid": "d51d7391-af1b-4160-b3bb-c77d0507a0e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:22:26 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:da:9e,bridge_name='br-int',has_traffic_filtering=True,id=d51d7391-af1b-4160-b3bb-c77d0507a0e0,network=Network(4b17d46f-fdbc-4cd7-991c-ca6981e0f20f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd51d7391-af') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:22:26 user nova-compute[75066]: DEBUG os_vif [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:da:9e,bridge_name='br-int',has_traffic_filtering=True,id=d51d7391-af1b-4160-b3bb-c77d0507a0e0,network=Network(4b17d46f-fdbc-4cd7-991c-ca6981e0f20f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd51d7391-af') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:22:26 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:26 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:22:26 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:22:26 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:26 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5090397c-a1be-5c7f-ba44-8e789b2fa442', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:22:26 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:26 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:22:26 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:26 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:26 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd51d7391-af, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:22:26 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd51d7391-af, col_values=(('qos', UUID('0e4647dc-d763-4e95-b07c-6b7cd96b7494')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:22:26 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd51d7391-af, col_values=(('external_ids', {'iface-id': 'd51d7391-af1b-4160-b3bb-c77d0507a0e0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:da:9e', 'vm-uuid': '10fc72fa-64a3-4704-ad91-2e3ae88d5424'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:22:26 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:26 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:22:26 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:26 user nova-compute[75066]: INFO os_vif [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:da:9e,bridge_name='br-int',has_traffic_filtering=True,id=d51d7391-af1b-4160-b3bb-c77d0507a0e0,network=Network(4b17d46f-fdbc-4cd7-991c-ca6981e0f20f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd51d7391-af')
Dec 01 19:22:26 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:22:26 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] No VIF found with MAC fa:16:3e:e9:da:9e, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:22:27 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:27 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:27 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:27 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:27 user nova-compute[75066]: DEBUG nova.compute.manager [req-89db7708-67b4-4e0d-bef0-bd7fdec414c3 req-4f491d0f-1b63-49fd-abc1-247a5316a5de service nova] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Received event network-vif-plugged-d51d7391-af1b-4160-b3bb-c77d0507a0e0 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:22:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-89db7708-67b4-4e0d-bef0-bd7fdec414c3 req-4f491d0f-1b63-49fd-abc1-247a5316a5de service nova] Acquiring lock "10fc72fa-64a3-4704-ad91-2e3ae88d5424-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:22:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-89db7708-67b4-4e0d-bef0-bd7fdec414c3 req-4f491d0f-1b63-49fd-abc1-247a5316a5de service nova] Lock "10fc72fa-64a3-4704-ad91-2e3ae88d5424-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:22:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-89db7708-67b4-4e0d-bef0-bd7fdec414c3 req-4f491d0f-1b63-49fd-abc1-247a5316a5de service nova] Lock "10fc72fa-64a3-4704-ad91-2e3ae88d5424-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:22:27 user nova-compute[75066]: DEBUG nova.compute.manager [req-89db7708-67b4-4e0d-bef0-bd7fdec414c3 req-4f491d0f-1b63-49fd-abc1-247a5316a5de service nova] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] No waiting events found dispatching network-vif-plugged-d51d7391-af1b-4160-b3bb-c77d0507a0e0 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:22:27 user nova-compute[75066]: WARNING nova.compute.manager [req-89db7708-67b4-4e0d-bef0-bd7fdec414c3 req-4f491d0f-1b63-49fd-abc1-247a5316a5de service nova] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Received unexpected event network-vif-plugged-d51d7391-af1b-4160-b3bb-c77d0507a0e0 for instance with vm_state shelved_offloaded and task_state spawning.
Dec 01 19:22:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:29 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cdfc24d7-06fc-44a4-b255-4f86a2e235aa tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Calling os-brick to attach iSCSI Volume {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 19:22:29 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfc24d7-06fc-44a4-b255-4f86a2e235aa tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0974d418-ea5d-4b7c-82d8-a6e2909589bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AoaCduYI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:22:29 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-cdfc24d7-06fc-44a4-b255-4f86a2e235aa tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:22:29 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-cdfc24d7-06fc-44a4-b255-4f86a2e235aa tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:22:29 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-cdfc24d7-06fc-44a4-b255-4f86a2e235aa tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:22:29 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-cdfc24d7-06fc-44a4-b255-4f86a2e235aa tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:22:29 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-cdfc24d7-06fc-44a4-b255-4f86a2e235aa tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0974d418-ea5d-4b7c-82d8-a6e2909589bb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:22:29 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-cdfc24d7-06fc-44a4-b255-4f86a2e235aa tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0974d418-ea5d-4b7c-82d8-a6e2909589bb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:22:29 user nova-compute[75066]: INFO os_brick.initiator.connectors.iscsi [None req-cdfc24d7-06fc-44a4-b255-4f86a2e235aa tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 19:22:29 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0974d418-ea5d-4b7c-82d8-a6e2909589bb -p 172.16.0.220:3260 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:29 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0974d418-ea5d-4b7c-82d8-a6e2909589bb -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:29 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82ec2f4-37fd-4ec0-9e93-d32f120adfd6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:29 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfc24d7-06fc-44a4-b255-4f86a2e235aa tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 19:22:29 user nova-compute[75066]:  {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:22:29 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0974d418-ea5d-4b7c-82d8-a6e2909589bb -p 172.16.0.220:3260 --interface default --op new {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:29 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0974d418-ea5d-4b7c-82d8-a6e2909589bb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:29 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[635d66bb-119c-44fc-a026-fa9ba99b9594]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0974d418-ea5d-4b7c-82d8-a6e2909589bb] added\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:29 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfc24d7-06fc-44a4-b255-4f86a2e235aa tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0974d418-ea5d-4b7c-82d8-a6e2909589bb] added
Dec 01 19:22:29 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:22:29 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0974d418-ea5d-4b7c-82d8-a6e2909589bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:29 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0974d418-ea5d-4b7c-82d8-a6e2909589bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:29 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[849c60f0-26f8-4103-a9ad-fa11c6d4b3b2]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:29 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfc24d7-06fc-44a4-b255-4f86a2e235aa tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:22:29 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0974d418-ea5d-4b7c-82d8-a6e2909589bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:29 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0974d418-ea5d-4b7c-82d8-a6e2909589bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:29 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[81bf7d22-67ce-4a81-86cf-0e26b886efcc]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:29 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfc24d7-06fc-44a4-b255-4f86a2e235aa tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:22:29 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0974d418-ea5d-4b7c-82d8-a6e2909589bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AoaCduYI {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:29 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0974d418-ea5d-4b7c-82d8-a6e2909589bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AoaCduYI" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:29 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73c2491-60dd-485e-b401-0ff8d7f7bbc3]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:29 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfc24d7-06fc-44a4-b255-4f86a2e235aa tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AoaCduYI'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:22:29 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0974d418-ea5d-4b7c-82d8-a6e2909589bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:29 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0974d418-ea5d-4b7c-82d8-a6e2909589bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:29 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[6918428d-d247-4794-83d0-053c7e602948]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:29 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfc24d7-06fc-44a4-b255-4f86a2e235aa tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:22:29 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:29 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:29 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db498b1-fa09-43cc-bfce-ca76a48d03f6]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6986eb1c-5a0a-4839-900b-7af58180eb89 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:29 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfc24d7-06fc-44a4-b255-4f86a2e235aa tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)
Dec 01 19:22:29 user nova-compute[75066]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)
Dec 01 19:22:29 user nova-compute[75066]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:22:29 user nova-compute[75066]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6986eb1c-5a0a-4839-900b-7af58180eb89 (non-flash)
Dec 01 19:22:29 user nova-compute[75066]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)
Dec 01 19:22:29 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:22:29 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfc24d7-06fc-44a4-b255-4f86a2e235aa tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)
Dec 01 19:22:29 user nova-compute[75066]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)
Dec 01 19:22:29 user nova-compute[75066]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:22:29 user nova-compute[75066]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6986eb1c-5a0a-4839-900b-7af58180eb89 (non-flash)
Dec 01 19:22:29 user nova-compute[75066]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)
Dec 01 19:22:29 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:22:29 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0974d418-ea5d-4b7c-82d8-a6e2909589bb -p 172.16.0.220:3260 --login {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:29 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0974d418-ea5d-4b7c-82d8-a6e2909589bb -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:29 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[77cdd9b1-fc58-483a-b66b-606e6166590b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0974d418-ea5d-4b7c-82d8-a6e2909589bb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0974d418-ea5d-4b7c-82d8-a6e2909589bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:29 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfc24d7-06fc-44a4-b255-4f86a2e235aa tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0974d418-ea5d-4b7c-82d8-a6e2909589bb, portal: 172.16.0.220,3260]
Dec 01 19:22:29 user nova-compute[75066]: Login to [iface: default, target: iqn.2010-10.org.openstack:0974d418-ea5d-4b7c-82d8-a6e2909589bb, portal: 172.16.0.220,3260] successful.
Dec 01 19:22:29 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:22:29 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0974d418-ea5d-4b7c-82d8-a6e2909589bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:29 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0974d418-ea5d-4b7c-82d8-a6e2909589bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:29 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf7508e-bb70-4d67-a456-9fa0765b4c97]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:29 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfc24d7-06fc-44a4-b255-4f86a2e235aa tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:22:29 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:29 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:29 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a1464e-11f1-4d8e-b3ca-5ae15684d79f]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6986eb1c-5a0a-4839-900b-7af58180eb89 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0974d418-ea5d-4b7c-82d8-a6e2909589bb (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:29 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfc24d7-06fc-44a4-b255-4f86a2e235aa tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)
Dec 01 19:22:29 user nova-compute[75066]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)
Dec 01 19:22:29 user nova-compute[75066]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:22:29 user nova-compute[75066]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6986eb1c-5a0a-4839-900b-7af58180eb89 (non-flash)
Dec 01 19:22:29 user nova-compute[75066]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)
Dec 01 19:22:29 user nova-compute[75066]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0974d418-ea5d-4b7c-82d8-a6e2909589bb (non-flash)
Dec 01 19:22:29 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:22:29 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfc24d7-06fc-44a4-b255-4f86a2e235aa tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)
Dec 01 19:22:29 user nova-compute[75066]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)
Dec 01 19:22:29 user nova-compute[75066]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:22:29 user nova-compute[75066]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6986eb1c-5a0a-4839-900b-7af58180eb89 (non-flash)
Dec 01 19:22:29 user nova-compute[75066]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)
Dec 01 19:22:29 user nova-compute[75066]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0974d418-ea5d-4b7c-82d8-a6e2909589bb (non-flash)
Dec 01 19:22:29 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:22:29 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-cdfc24d7-06fc-44a4-b255-4f86a2e235aa tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0974d418-ea5d-4b7c-82d8-a6e2909589bb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:22:29 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfc24d7-06fc-44a4-b255-4f86a2e235aa tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Connected to 172.16.0.220:3260 {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 19:22:29 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-cdfc24d7-06fc-44a4-b255-4f86a2e235aa tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] HCTL ('38', '-', '-', 0) found on session 24 with lun 0 {{(pid=75066) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 19:22:29 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-cdfc24d7-06fc-44a4-b255-4f86a2e235aa tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75066) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 19:22:29 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:29 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:29 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57edf74-dcdc-4f00-a158-fed49dbe8852]: (4, ('- - 0', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:29 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-cdfc24d7-06fc-44a4-b255-4f86a2e235aa tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Searching for a device in session 24 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:22:29 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfc24d7-06fc-44a4-b255-4f86a2e235aa tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:0974d418-ea5d-4b7c-82d8-a6e2909589bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AoaCduYI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 19:22:29 user nova-compute[75066]: DEBUG nova.compute.manager [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Instance event wait completed in 0 seconds for  {{(pid=75066) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 19:22:29 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Guest created on hypervisor {{(pid=75066) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 19:22:29 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Instance spawned successfully.
Dec 01 19:22:29 user nova-compute[75066]: DEBUG nova.compute.manager [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:22:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dd3f5d91-26d6-4721-ac40-6ea66cdd9933 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Lock "10fc72fa-64a3-4704-ad91-2e3ae88d5424" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 17.358s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:22:29 user nova-compute[75066]: DEBUG nova.compute.manager [req-b88777da-56e3-4056-ae6e-a995543b889b req-ba5ca3ce-a78d-4b0f-b118-1af5dc5f1246 service nova] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Received event network-vif-plugged-d51d7391-af1b-4160-b3bb-c77d0507a0e0 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:22:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-b88777da-56e3-4056-ae6e-a995543b889b req-ba5ca3ce-a78d-4b0f-b118-1af5dc5f1246 service nova] Acquiring lock "10fc72fa-64a3-4704-ad91-2e3ae88d5424-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:22:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-b88777da-56e3-4056-ae6e-a995543b889b req-ba5ca3ce-a78d-4b0f-b118-1af5dc5f1246 service nova] Lock "10fc72fa-64a3-4704-ad91-2e3ae88d5424-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:22:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-b88777da-56e3-4056-ae6e-a995543b889b req-ba5ca3ce-a78d-4b0f-b118-1af5dc5f1246 service nova] Lock "10fc72fa-64a3-4704-ad91-2e3ae88d5424-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:22:29 user nova-compute[75066]: DEBUG nova.compute.manager [req-b88777da-56e3-4056-ae6e-a995543b889b req-ba5ca3ce-a78d-4b0f-b118-1af5dc5f1246 service nova] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] No waiting events found dispatching network-vif-plugged-d51d7391-af1b-4160-b3bb-c77d0507a0e0 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:22:29 user nova-compute[75066]: WARNING nova.compute.manager [req-b88777da-56e3-4056-ae6e-a995543b889b req-ba5ca3ce-a78d-4b0f-b118-1af5dc5f1246 service nova] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Received unexpected event network-vif-plugged-d51d7391-af1b-4160-b3bb-c77d0507a0e0 for instance with vm_state active and task_state None.
Dec 01 19:22:30 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-cdfc24d7-06fc-44a4-b255-4f86a2e235aa tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:22:30 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdfc24d7-06fc-44a4-b255-4f86a2e235aa tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '23165656438386632', 'path': '/dev/sdg'} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:22:30 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cdfc24d7-06fc-44a4-b255-4f86a2e235aa tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23165656438386632', 'path': '/dev/sdg'} {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 19:22:30 user nova-compute[75066]: DEBUG nova.objects.instance [None req-cdfc24d7-06fc-44a4-b255-4f86a2e235aa tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lazy-loading 'flavor' on Instance uuid a553e030-0d69-4725-9f84-6c0c63556ed4 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:22:30 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-cdfc24d7-06fc-44a4-b255-4f86a2e235aa tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 19:22:30 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:22:30 user nova-compute[75066]:   <source dev="/dev/sdg"/>
Dec 01 19:22:30 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:22:30 user nova-compute[75066]:   <serial>0974d418-ea5d-4b7c-82d8-a6e2909589bb</serial>
Dec 01 19:22:30 user nova-compute[75066]: </disk>
Dec 01 19:22:30 user nova-compute[75066]:  {{(pid=75066) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 19:22:31 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-cdfc24d7-06fc-44a4-b255-4f86a2e235aa tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:22:31 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-cdfc24d7-06fc-44a4-b255-4f86a2e235aa tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:22:31 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-cdfc24d7-06fc-44a4-b255-4f86a2e235aa tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] No VIF found with MAC fa:16:3e:18:e9:73, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:22:31 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:31 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-cdfc24d7-06fc-44a4-b255-4f86a2e235aa tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lock "a553e030-0d69-4725-9f84-6c0c63556ed4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.424s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:22:32 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:33 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ec1e147e-1f7b-45f1-8d77-a531a16fa038 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Acquiring lock "a553e030-0d69-4725-9f84-6c0c63556ed4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:22:33 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ec1e147e-1f7b-45f1-8d77-a531a16fa038 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lock "a553e030-0d69-4725-9f84-6c0c63556ed4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:22:33 user nova-compute[75066]: INFO nova.compute.manager [None req-ec1e147e-1f7b-45f1-8d77-a531a16fa038 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Detaching volume 0974d418-ea5d-4b7c-82d8-a6e2909589bb
Dec 01 19:22:33 user nova-compute[75066]: INFO nova.virt.block_device [None req-ec1e147e-1f7b-45f1-8d77-a531a16fa038 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Attempting to driver detach volume 0974d418-ea5d-4b7c-82d8-a6e2909589bb from mountpoint /dev/vdb
Dec 01 19:22:33 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ec1e147e-1f7b-45f1-8d77-a531a16fa038 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Attempting to detach device vdb from instance a553e030-0d69-4725-9f84-6c0c63556ed4 from the persistent domain config. {{(pid=75066) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 19:22:33 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-ec1e147e-1f7b-45f1-8d77-a531a16fa038 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 19:22:33 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:22:33 user nova-compute[75066]:   <source dev="/dev/sdg"/>
Dec 01 19:22:33 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:22:33 user nova-compute[75066]:   <serial>0974d418-ea5d-4b7c-82d8-a6e2909589bb</serial>
Dec 01 19:22:33 user nova-compute[75066]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 19:22:33 user nova-compute[75066]: </disk>
Dec 01 19:22:33 user nova-compute[75066]:  {{(pid=75066) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 19:22:33 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-ec1e147e-1f7b-45f1-8d77-a531a16fa038 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Successfully detached device vdb from instance a553e030-0d69-4725-9f84-6c0c63556ed4 from the persistent domain config.
Dec 01 19:22:33 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ec1e147e-1f7b-45f1-8d77-a531a16fa038 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a553e030-0d69-4725-9f84-6c0c63556ed4 from the live domain config. {{(pid=75066) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 19:22:33 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-ec1e147e-1f7b-45f1-8d77-a531a16fa038 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 19:22:33 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:22:33 user nova-compute[75066]:   <source dev="/dev/sdg"/>
Dec 01 19:22:33 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:22:33 user nova-compute[75066]:   <serial>0974d418-ea5d-4b7c-82d8-a6e2909589bb</serial>
Dec 01 19:22:33 user nova-compute[75066]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 19:22:33 user nova-compute[75066]: </disk>
Dec 01 19:22:33 user nova-compute[75066]:  {{(pid=75066) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 19:22:34 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ec1e147e-1f7b-45f1-8d77-a531a16fa038 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a553e030-0d69-4725-9f84-6c0c63556ed4 {{(pid=75066) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 19:22:34 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Acquiring lock "08a362a4-9353-4139-afd4-1a24fcfa65a0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:22:34 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Lock "08a362a4-9353-4139-afd4-1a24fcfa65a0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:22:34 user nova-compute[75066]: DEBUG nova.compute.manager [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: 08a362a4-9353-4139-afd4-1a24fcfa65a0] Starting instance... {{(pid=75066) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 19:22:35 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:22:35 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:22:35 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75066) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 19:22:35 user nova-compute[75066]: INFO nova.compute.claims [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: 08a362a4-9353-4139-afd4-1a24fcfa65a0] Claim successful on node user
Dec 01 19:22:35 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:22:35 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:22:35 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.497s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:22:35 user nova-compute[75066]: DEBUG nova.compute.manager [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: 08a362a4-9353-4139-afd4-1a24fcfa65a0] Start building networks asynchronously for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 19:22:35 user nova-compute[75066]: DEBUG nova.compute.manager [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: 08a362a4-9353-4139-afd4-1a24fcfa65a0] Allocating IP information in the background. {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 19:22:35 user nova-compute[75066]: DEBUG nova.network.neutron [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: 08a362a4-9353-4139-afd4-1a24fcfa65a0] allocate_for_instance() {{(pid=75066) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 19:22:35 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: 08a362a4-9353-4139-afd4-1a24fcfa65a0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 19:22:35 user nova-compute[75066]: DEBUG nova.compute.manager [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: 08a362a4-9353-4139-afd4-1a24fcfa65a0] Start building block device mappings for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 19:22:35 user nova-compute[75066]: DEBUG nova.policy [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8f807bcec6a5479cb3a97c85d7110afe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec09f9e9cee4b46a5adda7a2811e991', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75066) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 19:22:35 user nova-compute[75066]: DEBUG nova.compute.manager [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: 08a362a4-9353-4139-afd4-1a24fcfa65a0] Start spawning the instance on the hypervisor. {{(pid=75066) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 19:22:35 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: 08a362a4-9353-4139-afd4-1a24fcfa65a0] Creating instance directory {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 19:22:35 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: 08a362a4-9353-4139-afd4-1a24fcfa65a0] Creating image(s)
Dec 01 19:22:35 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Acquiring lock "/opt/stack/data/nova/instances/08a362a4-9353-4139-afd4-1a24fcfa65a0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:22:35 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Lock "/opt/stack/data/nova/instances/08a362a4-9353-4139-afd4-1a24fcfa65a0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:22:35 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Lock "/opt/stack/data/nova/instances/08a362a4-9353-4139-afd4-1a24fcfa65a0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:22:35 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.173s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Acquiring lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:22:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:22:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.232s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/08a362a4-9353-4139-afd4-1a24fcfa65a0/disk 1073741824 {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:36 user nova-compute[75066]: DEBUG nova.network.neutron [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: 08a362a4-9353-4139-afd4-1a24fcfa65a0] Successfully created port: e828e2c4-e88f-4494-815b-854289833466 {{(pid=75066) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 19:22:36 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/08a362a4-9353-4139-afd4-1a24fcfa65a0/disk 1073741824" returned: 0 in 0.055s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.292s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:22:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.174s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:36 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Checking if we can resize image /opt/stack/data/nova/instances/08a362a4-9353-4139-afd4-1a24fcfa65a0/disk. size=1073741824 {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 19:22:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08a362a4-9353-4139-afd4-1a24fcfa65a0/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08a362a4-9353-4139-afd4-1a24fcfa65a0/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:36 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Cannot resize image /opt/stack/data/nova/instances/08a362a4-9353-4139-afd4-1a24fcfa65a0/disk to a smaller size. {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 19:22:36 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: 08a362a4-9353-4139-afd4-1a24fcfa65a0] Created local disks {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 19:22:36 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: 08a362a4-9353-4139-afd4-1a24fcfa65a0] Ensure instance console log exists: /opt/stack/data/nova/instances/08a362a4-9353-4139-afd4-1a24fcfa65a0/console.log {{(pid=75066) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 19:22:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:22:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:22:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:22:36 user nova-compute[75066]: DEBUG nova.network.neutron [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: 08a362a4-9353-4139-afd4-1a24fcfa65a0] Successfully updated port: e828e2c4-e88f-4494-815b-854289833466 {{(pid=75066) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 19:22:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Acquiring lock "refresh_cache-08a362a4-9353-4139-afd4-1a24fcfa65a0" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:22:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Acquired lock "refresh_cache-08a362a4-9353-4139-afd4-1a24fcfa65a0" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:22:36 user nova-compute[75066]: DEBUG nova.network.neutron [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: 08a362a4-9353-4139-afd4-1a24fcfa65a0] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:22:36 user nova-compute[75066]: DEBUG nova.compute.manager [req-90e3c7ca-db34-499a-b951-416a8fb72b7f req-2c3b5dd2-4e5d-4a3a-adb6-98d0f48a51f3 service nova] [instance: 08a362a4-9353-4139-afd4-1a24fcfa65a0] Received event network-changed-e828e2c4-e88f-4494-815b-854289833466 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:22:36 user nova-compute[75066]: DEBUG nova.compute.manager [req-90e3c7ca-db34-499a-b951-416a8fb72b7f req-2c3b5dd2-4e5d-4a3a-adb6-98d0f48a51f3 service nova] [instance: 08a362a4-9353-4139-afd4-1a24fcfa65a0] Refreshing instance network info cache due to event network-changed-e828e2c4-e88f-4494-815b-854289833466. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:22:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-90e3c7ca-db34-499a-b951-416a8fb72b7f req-2c3b5dd2-4e5d-4a3a-adb6-98d0f48a51f3 service nova] Acquiring lock "refresh_cache-08a362a4-9353-4139-afd4-1a24fcfa65a0" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:22:37 user nova-compute[75066]: DEBUG nova.network.neutron [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: 08a362a4-9353-4139-afd4-1a24fcfa65a0] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:22:37 user nova-compute[75066]: DEBUG nova.network.neutron [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: 08a362a4-9353-4139-afd4-1a24fcfa65a0] Updating instance_info_cache with network_info: [{"id": "e828e2c4-e88f-4494-815b-854289833466", "address": "fa:16:3e:24:bb:3e", "network": {"id": "5380ccc0-6aee-42e3-a3e7-b2219a2eb53a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-952289001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ec09f9e9cee4b46a5adda7a2811e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape828e2c4-e8", "ovs_interfaceid": "e828e2c4-e88f-4494-815b-854289833466", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:22:37 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Releasing lock "refresh_cache-08a362a4-9353-4139-afd4-1a24fcfa65a0" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:22:37 user nova-compute[75066]: DEBUG nova.compute.manager [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: 08a362a4-9353-4139-afd4-1a24fcfa65a0] Instance network_info: |[{"id": "e828e2c4-e88f-4494-815b-854289833466", "address": "fa:16:3e:24:bb:3e", "network": {"id": "5380ccc0-6aee-42e3-a3e7-b2219a2eb53a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-952289001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ec09f9e9cee4b46a5adda7a2811e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape828e2c4-e8", "ovs_interfaceid": "e828e2c4-e88f-4494-815b-854289833466", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 19:22:37 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-90e3c7ca-db34-499a-b951-416a8fb72b7f req-2c3b5dd2-4e5d-4a3a-adb6-98d0f48a51f3 service nova] Acquired lock "refresh_cache-08a362a4-9353-4139-afd4-1a24fcfa65a0" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:22:37 user nova-compute[75066]: DEBUG nova.network.neutron [req-90e3c7ca-db34-499a-b951-416a8fb72b7f req-2c3b5dd2-4e5d-4a3a-adb6-98d0f48a51f3 service nova] [instance: 08a362a4-9353-4139-afd4-1a24fcfa65a0] Refreshing network info cache for port e828e2c4-e88f-4494-815b-854289833466 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:22:37 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: 08a362a4-9353-4139-afd4-1a24fcfa65a0] Start _get_guest_xml network_info=[{"id": "e828e2c4-e88f-4494-815b-854289833466", "address": "fa:16:3e:24:bb:3e", "network": {"id": "5380ccc0-6aee-42e3-a3e7-b2219a2eb53a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-952289001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ec09f9e9cee4b46a5adda7a2811e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape828e2c4-e8", "ovs_interfaceid": "e828e2c4-e88f-4494-815b-854289833466", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'image_id': '900b237b-e99c-4fdd-a44f-dcb7a08baa86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:22:37 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:22:37 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:22:37 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:22:37 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:22:37 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:22:37 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:22:37 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:22:37 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:22:37 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:22:37 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:22:37 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:22:37 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:22:37 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:22:37 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:22:37 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:22:37 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:22:37 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:22:37 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:22:37 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:22:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1277895667',display_name='tempest-VolumesAdminNegativeTest-server-1277895667',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1277895667',id=21,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6ec09f9e9cee4b46a5adda7a2811e991',ramdisk_id='',reservation_id='r-s0a9aahm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1973855036',owner_user_name='tempest-VolumesAdminNegativeTest-1973855036-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:22:36Z,user_data=None,user_id='8f807bcec6a5479cb3a97c85d7110afe',uuid=08a362a4-9353-4139-afd4-1a24fcfa65a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e828e2c4-e88f-4494-815b-854289833466", "address": "fa:16:3e:24:bb:3e", "network": {"id": "5380ccc0-6aee-42e3-a3e7-b2219a2eb53a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-952289001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ec09f9e9cee4b46a5adda7a2811e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape828e2c4-e8", "ovs_interfaceid": "e828e2c4-e88f-4494-815b-854289833466", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:22:37 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Converting VIF {"id": "e828e2c4-e88f-4494-815b-854289833466", "address": "fa:16:3e:24:bb:3e", "network": {"id": "5380ccc0-6aee-42e3-a3e7-b2219a2eb53a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-952289001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ec09f9e9cee4b46a5adda7a2811e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape828e2c4-e8", "ovs_interfaceid": "e828e2c4-e88f-4494-815b-854289833466", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:22:37 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:bb:3e,bridge_name='br-int',has_traffic_filtering=True,id=e828e2c4-e88f-4494-815b-854289833466,network=Network(5380ccc0-6aee-42e3-a3e7-b2219a2eb53a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape828e2c4-e8') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:22:37 user nova-compute[75066]: DEBUG nova.objects.instance [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Lazy-loading 'pci_devices' on Instance uuid 08a362a4-9353-4139-afd4-1a24fcfa65a0 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:22:37 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: 08a362a4-9353-4139-afd4-1a24fcfa65a0] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:22:37 user nova-compute[75066]:   <uuid>08a362a4-9353-4139-afd4-1a24fcfa65a0</uuid>
Dec 01 19:22:37 user nova-compute[75066]:   <name>instance-00000015</name>
Dec 01 19:22:37 user nova-compute[75066]:   <memory>524288</memory>
Dec 01 19:22:37 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:22:37 user nova-compute[75066]:   <metadata>
Dec 01 19:22:37 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:22:37 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:22:37 user nova-compute[75066]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1277895667</nova:name>
Dec 01 19:22:37 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:22:37</nova:creationTime>
Dec 01 19:22:37 user nova-compute[75066]:       <nova:flavor name="m1.tiny">
Dec 01 19:22:37 user nova-compute[75066]:         <nova:memory>512</nova:memory>
Dec 01 19:22:37 user nova-compute[75066]:         <nova:disk>1</nova:disk>
Dec 01 19:22:37 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:22:37 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:22:37 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:22:37 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:22:37 user nova-compute[75066]:       <nova:owner>
Dec 01 19:22:37 user nova-compute[75066]:         <nova:user uuid="8f807bcec6a5479cb3a97c85d7110afe">tempest-VolumesAdminNegativeTest-1973855036-project-member</nova:user>
Dec 01 19:22:37 user nova-compute[75066]:         <nova:project uuid="6ec09f9e9cee4b46a5adda7a2811e991">tempest-VolumesAdminNegativeTest-1973855036</nova:project>
Dec 01 19:22:37 user nova-compute[75066]:       </nova:owner>
Dec 01 19:22:37 user nova-compute[75066]:       <nova:root type="image" uuid="900b237b-e99c-4fdd-a44f-dcb7a08baa86"/>
Dec 01 19:22:37 user nova-compute[75066]:       <nova:ports>
Dec 01 19:22:37 user nova-compute[75066]:         <nova:port uuid="e828e2c4-e88f-4494-815b-854289833466">
Dec 01 19:22:37 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Dec 01 19:22:37 user nova-compute[75066]:         </nova:port>
Dec 01 19:22:37 user nova-compute[75066]:       </nova:ports>
Dec 01 19:22:37 user nova-compute[75066]:     </nova:instance>
Dec 01 19:22:37 user nova-compute[75066]:   </metadata>
Dec 01 19:22:37 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:22:37 user nova-compute[75066]:     <system>
Dec 01 19:22:37 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:22:37 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:22:37 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:22:37 user nova-compute[75066]:       <entry name="serial">08a362a4-9353-4139-afd4-1a24fcfa65a0</entry>
Dec 01 19:22:37 user nova-compute[75066]:       <entry name="uuid">08a362a4-9353-4139-afd4-1a24fcfa65a0</entry>
Dec 01 19:22:37 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:22:37 user nova-compute[75066]:     </system>
Dec 01 19:22:37 user nova-compute[75066]:   </sysinfo>
Dec 01 19:22:37 user nova-compute[75066]:   <os>
Dec 01 19:22:37 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:22:37 user nova-compute[75066]:     <boot dev="hd"/>
Dec 01 19:22:37 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:22:37 user nova-compute[75066]:   </os>
Dec 01 19:22:37 user nova-compute[75066]:   <features>
Dec 01 19:22:37 user nova-compute[75066]:     <acpi/>
Dec 01 19:22:37 user nova-compute[75066]:     <apic/>
Dec 01 19:22:37 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:22:37 user nova-compute[75066]:   </features>
Dec 01 19:22:37 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:22:37 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:22:37 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:22:37 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:22:37 user nova-compute[75066]:   </clock>
Dec 01 19:22:37 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:22:37 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:22:37 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:22:37 user nova-compute[75066]:   </cpu>
Dec 01 19:22:37 user nova-compute[75066]:   <devices>
Dec 01 19:22:37 user nova-compute[75066]:     <disk type="file" device="disk">
Dec 01 19:22:37 user nova-compute[75066]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 19:22:37 user nova-compute[75066]:       <source file="/opt/stack/data/nova/instances/08a362a4-9353-4139-afd4-1a24fcfa65a0/disk"/>
Dec 01 19:22:37 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:22:37 user nova-compute[75066]:     </disk>
Dec 01 19:22:37 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:22:37 user nova-compute[75066]:       <mac address="fa:16:3e:24:bb:3e"/>
Dec 01 19:22:37 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:22:37 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:22:37 user nova-compute[75066]:       <target dev="tape828e2c4-e8"/>
Dec 01 19:22:37 user nova-compute[75066]:     </interface>
Dec 01 19:22:37 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:22:37 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/08a362a4-9353-4139-afd4-1a24fcfa65a0/console.log" append="off"/>
Dec 01 19:22:37 user nova-compute[75066]:     </serial>
Dec 01 19:22:37 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:22:37 user nova-compute[75066]:     <video>
Dec 01 19:22:37 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:22:37 user nova-compute[75066]:     </video>
Dec 01 19:22:37 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:22:37 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:22:37 user nova-compute[75066]:     </rng>
Dec 01 19:22:37 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:22:37 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:22:37 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:22:37 user nova-compute[75066]:     </memballoon>
Dec 01 19:22:37 user nova-compute[75066]:   </devices>
Dec 01 19:22:37 user nova-compute[75066]: </domain>
Dec 01 19:22:37 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:22:37 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:22:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1277895667',display_name='tempest-VolumesAdminNegativeTest-server-1277895667',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1277895667',id=21,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6ec09f9e9cee4b46a5adda7a2811e991',ramdisk_id='',reservation_id='r-s0a9aahm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1973855036',owner_user_name='tempest-VolumesAdminNegativeTest-1973855036-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:22:36Z,user_data=None,user_id='8f807bcec6a5479cb3a97c85d7110afe',uuid=08a362a4-9353-4139-afd4-1a24fcfa65a0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e828e2c4-e88f-4494-815b-854289833466", "address": "fa:16:3e:24:bb:3e", "network": {"id": "5380ccc0-6aee-42e3-a3e7-b2219a2eb53a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-952289001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ec09f9e9cee4b46a5adda7a2811e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape828e2c4-e8", "ovs_interfaceid": "e828e2c4-e88f-4494-815b-854289833466", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:22:37 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Converting VIF {"id": "e828e2c4-e88f-4494-815b-854289833466", "address": "fa:16:3e:24:bb:3e", "network": {"id": "5380ccc0-6aee-42e3-a3e7-b2219a2eb53a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-952289001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ec09f9e9cee4b46a5adda7a2811e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape828e2c4-e8", "ovs_interfaceid": "e828e2c4-e88f-4494-815b-854289833466", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:22:37 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:bb:3e,bridge_name='br-int',has_traffic_filtering=True,id=e828e2c4-e88f-4494-815b-854289833466,network=Network(5380ccc0-6aee-42e3-a3e7-b2219a2eb53a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape828e2c4-e8') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:22:37 user nova-compute[75066]: DEBUG os_vif [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:bb:3e,bridge_name='br-int',has_traffic_filtering=True,id=e828e2c4-e88f-4494-815b-854289833466,network=Network(5380ccc0-6aee-42e3-a3e7-b2219a2eb53a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape828e2c4-e8') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:22:37 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:37 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:22:37 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:22:37 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:37 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd8ed3f03-270e-5a53-bec7-2f54f2fd37d7', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:22:37 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:37 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:22:37 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:37 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:37 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape828e2c4-e8, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:22:37 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape828e2c4-e8, col_values=(('qos', UUID('80d2a6f9-2b91-450d-b2ea-da2d9a9eb97d')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:22:37 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape828e2c4-e8, col_values=(('external_ids', {'iface-id': 'e828e2c4-e88f-4494-815b-854289833466', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:bb:3e', 'vm-uuid': '08a362a4-9353-4139-afd4-1a24fcfa65a0'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:22:37 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:37 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:22:37 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:37 user nova-compute[75066]: INFO os_vif [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:bb:3e,bridge_name='br-int',has_traffic_filtering=True,id=e828e2c4-e88f-4494-815b-854289833466,network=Network(5380ccc0-6aee-42e3-a3e7-b2219a2eb53a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape828e2c4-e8')
Dec 01 19:22:37 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:22:37 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] No VIF found with MAC fa:16:3e:24:bb:3e, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:22:37 user nova-compute[75066]: DEBUG nova.network.neutron [req-90e3c7ca-db34-499a-b951-416a8fb72b7f req-2c3b5dd2-4e5d-4a3a-adb6-98d0f48a51f3 service nova] [instance: 08a362a4-9353-4139-afd4-1a24fcfa65a0] Updated VIF entry in instance network info cache for port e828e2c4-e88f-4494-815b-854289833466. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:22:37 user nova-compute[75066]: DEBUG nova.network.neutron [req-90e3c7ca-db34-499a-b951-416a8fb72b7f req-2c3b5dd2-4e5d-4a3a-adb6-98d0f48a51f3 service nova] [instance: 08a362a4-9353-4139-afd4-1a24fcfa65a0] Updating instance_info_cache with network_info: [{"id": "e828e2c4-e88f-4494-815b-854289833466", "address": "fa:16:3e:24:bb:3e", "network": {"id": "5380ccc0-6aee-42e3-a3e7-b2219a2eb53a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-952289001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ec09f9e9cee4b46a5adda7a2811e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape828e2c4-e8", "ovs_interfaceid": "e828e2c4-e88f-4494-815b-854289833466", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:22:37 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-90e3c7ca-db34-499a-b951-416a8fb72b7f req-2c3b5dd2-4e5d-4a3a-adb6-98d0f48a51f3 service nova] Releasing lock "refresh_cache-08a362a4-9353-4139-afd4-1a24fcfa65a0" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:22:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:39 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:39 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:39 user nova-compute[75066]: DEBUG nova.compute.manager [req-8c03cc03-8649-4e5d-bd16-36c67f9938d6 req-0616d7d0-3022-49a8-b47d-74df4f2f28dc service nova] [instance: 08a362a4-9353-4139-afd4-1a24fcfa65a0] Received event network-vif-plugged-e828e2c4-e88f-4494-815b-854289833466 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:22:39 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-8c03cc03-8649-4e5d-bd16-36c67f9938d6 req-0616d7d0-3022-49a8-b47d-74df4f2f28dc service nova] Acquiring lock "08a362a4-9353-4139-afd4-1a24fcfa65a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:22:39 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-8c03cc03-8649-4e5d-bd16-36c67f9938d6 req-0616d7d0-3022-49a8-b47d-74df4f2f28dc service nova] Lock "08a362a4-9353-4139-afd4-1a24fcfa65a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:22:39 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-8c03cc03-8649-4e5d-bd16-36c67f9938d6 req-0616d7d0-3022-49a8-b47d-74df4f2f28dc service nova] Lock "08a362a4-9353-4139-afd4-1a24fcfa65a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:22:39 user nova-compute[75066]: DEBUG nova.compute.manager [req-8c03cc03-8649-4e5d-bd16-36c67f9938d6 req-0616d7d0-3022-49a8-b47d-74df4f2f28dc service nova] [instance: 08a362a4-9353-4139-afd4-1a24fcfa65a0] No waiting events found dispatching network-vif-plugged-e828e2c4-e88f-4494-815b-854289833466 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:22:39 user nova-compute[75066]: WARNING nova.compute.manager [req-8c03cc03-8649-4e5d-bd16-36c67f9938d6 req-0616d7d0-3022-49a8-b47d-74df4f2f28dc service nova] [instance: 08a362a4-9353-4139-afd4-1a24fcfa65a0] Received unexpected event network-vif-plugged-e828e2c4-e88f-4494-815b-854289833466 for instance with vm_state building and task_state spawning.
Dec 01 19:22:40 user nova-compute[75066]: DEBUG nova.compute.manager [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: 08a362a4-9353-4139-afd4-1a24fcfa65a0] Instance event wait completed in 0 seconds for  {{(pid=75066) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 19:22:40 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: 08a362a4-9353-4139-afd4-1a24fcfa65a0] Guest created on hypervisor {{(pid=75066) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 19:22:40 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 08a362a4-9353-4139-afd4-1a24fcfa65a0] Instance spawned successfully.
Dec 01 19:22:40 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: 08a362a4-9353-4139-afd4-1a24fcfa65a0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 19:22:41 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: 08a362a4-9353-4139-afd4-1a24fcfa65a0] Found default for hw_cdrom_bus of ide {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:22:41 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: 08a362a4-9353-4139-afd4-1a24fcfa65a0] Found default for hw_disk_bus of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:22:41 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: 08a362a4-9353-4139-afd4-1a24fcfa65a0] Found default for hw_input_bus of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:22:41 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: 08a362a4-9353-4139-afd4-1a24fcfa65a0] Found default for hw_pointer_model of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:22:41 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: 08a362a4-9353-4139-afd4-1a24fcfa65a0] Found default for hw_video_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:22:41 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: 08a362a4-9353-4139-afd4-1a24fcfa65a0] Found default for hw_vif_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:22:41 user nova-compute[75066]: DEBUG nova.compute.manager [req-336513ec-78cf-4540-a798-760cd925cafb req-4ebcd322-9f6d-4f68-96f3-8c29c3737044 service nova] [instance: 08a362a4-9353-4139-afd4-1a24fcfa65a0] Received event network-vif-plugged-e828e2c4-e88f-4494-815b-854289833466 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:22:41 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-336513ec-78cf-4540-a798-760cd925cafb req-4ebcd322-9f6d-4f68-96f3-8c29c3737044 service nova] Acquiring lock "08a362a4-9353-4139-afd4-1a24fcfa65a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:22:41 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-336513ec-78cf-4540-a798-760cd925cafb req-4ebcd322-9f6d-4f68-96f3-8c29c3737044 service nova] Lock "08a362a4-9353-4139-afd4-1a24fcfa65a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:22:41 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-336513ec-78cf-4540-a798-760cd925cafb req-4ebcd322-9f6d-4f68-96f3-8c29c3737044 service nova] Lock "08a362a4-9353-4139-afd4-1a24fcfa65a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:22:41 user nova-compute[75066]: DEBUG nova.compute.manager [req-336513ec-78cf-4540-a798-760cd925cafb req-4ebcd322-9f6d-4f68-96f3-8c29c3737044 service nova] [instance: 08a362a4-9353-4139-afd4-1a24fcfa65a0] No waiting events found dispatching network-vif-plugged-e828e2c4-e88f-4494-815b-854289833466 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:22:41 user nova-compute[75066]: WARNING nova.compute.manager [req-336513ec-78cf-4540-a798-760cd925cafb req-4ebcd322-9f6d-4f68-96f3-8c29c3737044 service nova] [instance: 08a362a4-9353-4139-afd4-1a24fcfa65a0] Received unexpected event network-vif-plugged-e828e2c4-e88f-4494-815b-854289833466 for instance with vm_state building and task_state spawning.
Dec 01 19:22:41 user nova-compute[75066]: INFO nova.compute.manager [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: 08a362a4-9353-4139-afd4-1a24fcfa65a0] Took 5.21 seconds to spawn the instance on the hypervisor.
Dec 01 19:22:41 user nova-compute[75066]: DEBUG nova.compute.manager [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: 08a362a4-9353-4139-afd4-1a24fcfa65a0] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:22:41 user nova-compute[75066]: INFO nova.compute.manager [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: 08a362a4-9353-4139-afd4-1a24fcfa65a0] Took 6.15 seconds to build instance.
Dec 01 19:22:41 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-89be6300-5a3b-4636-8829-8950163b1ec0 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Lock "08a362a4-9353-4139-afd4-1a24fcfa65a0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.260s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:22:42 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:43 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ce6c601f-6b1f-4881-bdca-a87740ef70d4 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 998daa1d-fd6a-4663-8df3-0683a9dbe142 is timed out.
Dec 01 19:22:43 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-ce6c601f-6b1f-4881-bdca-a87740ef70d4 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Successfully detached device vdb from instance 998daa1d-fd6a-4663-8df3-0683a9dbe142 from the live domain config.
Dec 01 19:22:43 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce6c601f-6b1f-4881-bdca-a87740ef70d4 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] calling os-brick to detach iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 19:22:43 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6c601f-6b1f-4881-bdca-a87740ef70d4 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, {'target_iqn': 'iqn.2010-10.org.openstack:6986eb1c-5a0a-4839-900b-7af58180eb89', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JVgCSEut', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:22:43 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-ce6c601f-6b1f-4881-bdca-a87740ef70d4 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:22:43 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-ce6c601f-6b1f-4881-bdca-a87740ef70d4 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:22:43 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-ce6c601f-6b1f-4881-bdca-a87740ef70d4 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:22:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:43 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[a584cc4c-4a08-49fd-a038-b5be17b960e3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6986eb1c-5a0a-4839-900b-7af58180eb89\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0974d418-ea5d-4b7c-82d8-a6e2909589bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:43 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6c601f-6b1f-4881-bdca-a87740ef70d4 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 19:22:43 user nova-compute[75066]: No targets found.
Dec 01 19:22:43 user nova-compute[75066]: iSNS:
Dec 01 19:22:43 user nova-compute[75066]: No targets found.
Dec 01 19:22:43 user nova-compute[75066]: STATIC:
Dec 01 19:22:43 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:6986eb1c-5a0a-4839-900b-7af58180eb89
Dec 01 19:22:43 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:22:43 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:22:43 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2
Dec 01 19:22:43 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:22:43 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:22:43 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:0974d418-ea5d-4b7c-82d8-a6e2909589bb
Dec 01 19:22:43 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:22:43 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:22:43 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c
Dec 01 19:22:43 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:22:43 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:22:43 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc
Dec 01 19:22:43 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:22:43 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:22:43 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb
Dec 01 19:22:43 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:22:43 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:22:43 user nova-compute[75066]: FIRMWARE:
Dec 01 19:22:43 user nova-compute[75066]: No targets found.
Dec 01 19:22:43 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:22:43 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6c601f-6b1f-4881-bdca-a87740ef70d4 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 19:22:43 user nova-compute[75066]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 19:22:43 user nova-compute[75066]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75066) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 19:22:43 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6c601f-6b1f-4881-bdca-a87740ef70d4 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6986eb1c-5a0a-4839-900b-7af58180eb89', 0)] {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 19:22:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:43 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[365abbcb-88fc-41c4-bdd4-23b76c0d7774]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0974d418-ea5d-4b7c-82d8-a6e2909589bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6986eb1c-5a0a-4839-900b-7af58180eb89\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:43 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f6c42a-9424-4724-b3a8-2a1217f8db6c]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6986eb1c-5a0a-4839-900b-7af58180eb89 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0974d418-ea5d-4b7c-82d8-a6e2909589bb (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:43 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6c601f-6b1f-4881-bdca-a87740ef70d4 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)
Dec 01 19:22:43 user nova-compute[75066]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)
Dec 01 19:22:43 user nova-compute[75066]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:22:43 user nova-compute[75066]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6986eb1c-5a0a-4839-900b-7af58180eb89 (non-flash)
Dec 01 19:22:43 user nova-compute[75066]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)
Dec 01 19:22:43 user nova-compute[75066]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0974d418-ea5d-4b7c-82d8-a6e2909589bb (non-flash)
Dec 01 19:22:43 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:22:43 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6c601f-6b1f-4881-bdca-a87740ef70d4 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)
Dec 01 19:22:43 user nova-compute[75066]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)
Dec 01 19:22:43 user nova-compute[75066]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:22:43 user nova-compute[75066]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6986eb1c-5a0a-4839-900b-7af58180eb89 (non-flash)
Dec 01 19:22:43 user nova-compute[75066]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)
Dec 01 19:22:43 user nova-compute[75066]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0974d418-ea5d-4b7c-82d8-a6e2909589bb (non-flash)
Dec 01 19:22:43 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:22:43 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6c601f-6b1f-4881-bdca-a87740ef70d4 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9190550d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6986eb1c-5a0a-4839-900b-7af58180eb89'): ({'sdc'}, set())}) {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 19:22:43 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-ce6c601f-6b1f-4881-bdca-a87740ef70d4 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Removing single pathed devices sdc {{(pid=75066) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 19:22:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:43 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[b325969e-27df-437f-9505-6791db8608f6]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:43 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[21885d38-d802-465e-8bd1-d06dbc8c9254]: (4, ('ok\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:43 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-ce6c601f-6b1f-4881-bdca-a87740ef70d4 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Flushing IO for device /dev/sdc {{(pid=75066) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 19:22:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:43 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce281d0-fc04-4611-8b57-9e114617d3d5]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:43 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-ce6c601f-6b1f-4881-bdca-a87740ef70d4 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75066) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 19:22:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:43 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba21a3c-cb50-4379-aa00-061ea35a2541]: (4, ('1', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:43 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-ce6c601f-6b1f-4881-bdca-a87740ef70d4 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 19:22:43 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-ce6c601f-6b1f-4881-bdca-a87740ef70d4 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] SCSI volumes sdc have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 19:22:43 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6c601f-6b1f-4881-bdca-a87740ef70d4 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6986eb1c-5a0a-4839-900b-7af58180eb89')] {{(pid=75066) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 19:22:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6986eb1c-5a0a-4839-900b-7af58180eb89 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6986eb1c-5a0a-4839-900b-7af58180eb89 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:43 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[c073b401-75a7-4a87-8219-6b37d75ae38a]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:43 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6c601f-6b1f-4881-bdca-a87740ef70d4 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:22:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6986eb1c-5a0a-4839-900b-7af58180eb89 -p 172.16.0.220:3260 --logout {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6986eb1c-5a0a-4839-900b-7af58180eb89 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:43 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab57f71-06b5-4ad1-bba8-99c5cbc4ced4]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:6986eb1c-5a0a-4839-900b-7af58180eb89, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:6986eb1c-5a0a-4839-900b-7af58180eb89, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:43 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6c601f-6b1f-4881-bdca-a87740ef70d4 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:6986eb1c-5a0a-4839-900b-7af58180eb89, portal: 172.16.0.220,3260]
Dec 01 19:22:43 user nova-compute[75066]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:6986eb1c-5a0a-4839-900b-7af58180eb89, portal: 172.16.0.220,3260] successful.
Dec 01 19:22:43 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:22:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6986eb1c-5a0a-4839-900b-7af58180eb89 -p 172.16.0.220:3260 --op delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6986eb1c-5a0a-4839-900b-7af58180eb89 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:43 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e94f22-e31e-470a-9932-021a77abd9aa]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:43 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6c601f-6b1f-4881-bdca-a87740ef70d4 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:22:43 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-ce6c601f-6b1f-4881-bdca-a87740ef70d4 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:22:43 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce6c601f-6b1f-4881-bdca-a87740ef70d4 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] <== disconnect_volume: return (341ms) None {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:22:43 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce6c601f-6b1f-4881-bdca-a87740ef70d4 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Disconnected iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 19:22:44 user nova-compute[75066]: DEBUG nova.objects.instance [None req-ce6c601f-6b1f-4881-bdca-a87740ef70d4 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Lazy-loading 'flavor' on Instance uuid 998daa1d-fd6a-4663-8df3-0683a9dbe142 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:22:44 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ce6c601f-6b1f-4881-bdca-a87740ef70d4 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Lock "998daa1d-fd6a-4663-8df3-0683a9dbe142" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.119s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:22:44 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-bd4281d8-d389-4d30-9f5d-c111addff1c8 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Acquiring lock "interface-998daa1d-fd6a-4663-8df3-0683a9dbe142-ecbe6e20-8532-4496-8a4c-1151c3770cdc" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:22:44 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-bd4281d8-d389-4d30-9f5d-c111addff1c8 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Lock "interface-998daa1d-fd6a-4663-8df3-0683a9dbe142-ecbe6e20-8532-4496-8a4c-1151c3770cdc" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:22:44 user nova-compute[75066]: DEBUG nova.objects.instance [None req-bd4281d8-d389-4d30-9f5d-c111addff1c8 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Lazy-loading 'flavor' on Instance uuid 998daa1d-fd6a-4663-8df3-0683a9dbe142 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:22:44 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-bd4281d8-d389-4d30-9f5d-c111addff1c8 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T19:20:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-431772117',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-431772117',id=17,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDioMIKkD17rbLefUs+CoCe2YAF5MJyWmdGP5njQ+aDOavBc08qUchmFEEnBOz9qWRNoNrJTyhIak33m8ykbjamBmaBpbrxUKAYbxyiEVNdIL8zvksuJtx/Xi7sbDuD1AA==',key_name='tempest-keypair-1571650457',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:20:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0be461a2ee174f25bdbb451e49512e75',ramdisk_id='',reservation_id='r-ymwza3b4',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-687574292',owner_user_name='tempest-TaggedAttachmentsTest-687574292-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:20:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ae99d82b8bb499595aae2098059f478',uuid=998daa1d-fd6a-4663-8df3-0683a9dbe142,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ecbe6e20-8532-4496-8a4c-1151c3770cdc", "address": "fa:16:3e:ce:51:6a", "network": {"id": "cbb49fd2-4044-4aa7-b04c-c67d5521b682", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-188466014", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0be461a2ee174f25bdbb451e49512e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecbe6e20-85", "ovs_interfaceid": "ecbe6e20-8532-4496-8a4c-1151c3770cdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:22:44 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-bd4281d8-d389-4d30-9f5d-c111addff1c8 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Converting VIF {"id": "ecbe6e20-8532-4496-8a4c-1151c3770cdc", "address": "fa:16:3e:ce:51:6a", "network": {"id": "cbb49fd2-4044-4aa7-b04c-c67d5521b682", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-188466014", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0be461a2ee174f25bdbb451e49512e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecbe6e20-85", "ovs_interfaceid": "ecbe6e20-8532-4496-8a4c-1151c3770cdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:22:44 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-bd4281d8-d389-4d30-9f5d-c111addff1c8 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:51:6a,bridge_name='br-int',has_traffic_filtering=True,id=ecbe6e20-8532-4496-8a4c-1151c3770cdc,network=Network(cbb49fd2-4044-4aa7-b04c-c67d5521b682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecbe6e20-85') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:22:44 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-bd4281d8-d389-4d30-9f5d-c111addff1c8 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:ce:51:6a"/><model type="virtio"/><mtu size="1442"/><target dev="tapecbe6e20-85"/></interface> {{(pid=75066) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Dec 01 19:22:44 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-bd4281d8-d389-4d30-9f5d-c111addff1c8 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:ce:51:6a"/><model type="virtio"/><mtu size="1442"/><target dev="tapecbe6e20-85"/></interface> {{(pid=75066) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Dec 01 19:22:44 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-bd4281d8-d389-4d30-9f5d-c111addff1c8 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Attempting to detach device tapecbe6e20-85 from instance 998daa1d-fd6a-4663-8df3-0683a9dbe142 from the persistent domain config. {{(pid=75066) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 19:22:44 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-bd4281d8-d389-4d30-9f5d-c111addff1c8 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] detach device xml: <interface type="ethernet">
Dec 01 19:22:44 user nova-compute[75066]:   <mac address="fa:16:3e:ce:51:6a"/>
Dec 01 19:22:44 user nova-compute[75066]:   <model type="virtio"/>
Dec 01 19:22:44 user nova-compute[75066]:   <mtu size="1442"/>
Dec 01 19:22:44 user nova-compute[75066]:   <target dev="tapecbe6e20-85"/>
Dec 01 19:22:44 user nova-compute[75066]: </interface>
Dec 01 19:22:44 user nova-compute[75066]:  {{(pid=75066) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 19:22:44 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-bd4281d8-d389-4d30-9f5d-c111addff1c8 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:ce:51:6a"/><model type="virtio"/><mtu size="1442"/><target dev="tapecbe6e20-85"/></interface> {{(pid=75066) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Dec 01 19:22:44 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-bd4281d8-d389-4d30-9f5d-c111addff1c8 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:ce:51:6a"/><model type="virtio"/><mtu size="1442"/><target dev="tapecbe6e20-85"/></interface>not found in domain: <domain type='kvm' id='20'>
Dec 01 19:22:44 user nova-compute[75066]:   <name>instance-00000011</name>
Dec 01 19:22:44 user nova-compute[75066]:   <uuid>998daa1d-fd6a-4663-8df3-0683a9dbe142</uuid>
Dec 01 19:22:44 user nova-compute[75066]:   <metadata>
Dec 01 19:22:44 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:22:44 user nova-compute[75066]:   <nova:package version="0.0.0"/>
Dec 01 19:22:44 user nova-compute[75066]:   <nova:name>tempest-device-tagging-server-431772117</nova:name>
Dec 01 19:22:44 user nova-compute[75066]:   <nova:creationTime>2023-12-01 19:22:08</nova:creationTime>
Dec 01 19:22:44 user nova-compute[75066]:   <nova:flavor name="m1.tiny">
Dec 01 19:22:44 user nova-compute[75066]:     <nova:memory>512</nova:memory>
Dec 01 19:22:44 user nova-compute[75066]:     <nova:disk>1</nova:disk>
Dec 01 19:22:44 user nova-compute[75066]:     <nova:swap>0</nova:swap>
Dec 01 19:22:44 user nova-compute[75066]:     <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:22:44 user nova-compute[75066]:     <nova:vcpus>1</nova:vcpus>
Dec 01 19:22:44 user nova-compute[75066]:   </nova:flavor>
Dec 01 19:22:44 user nova-compute[75066]:   <nova:owner>
Dec 01 19:22:44 user nova-compute[75066]:     <nova:user uuid="8ae99d82b8bb499595aae2098059f478">tempest-TaggedAttachmentsTest-687574292-project-member</nova:user>
Dec 01 19:22:44 user nova-compute[75066]:     <nova:project uuid="0be461a2ee174f25bdbb451e49512e75">tempest-TaggedAttachmentsTest-687574292</nova:project>
Dec 01 19:22:44 user nova-compute[75066]:   </nova:owner>
Dec 01 19:22:44 user nova-compute[75066]:   <nova:root type="image" uuid="900b237b-e99c-4fdd-a44f-dcb7a08baa86"/>
Dec 01 19:22:44 user nova-compute[75066]:   <nova:ports>
Dec 01 19:22:44 user nova-compute[75066]:     <nova:port uuid="2cf25213-8eec-4d19-bad6-b8e2fd905b3c">
Dec 01 19:22:44 user nova-compute[75066]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Dec 01 19:22:44 user nova-compute[75066]:     </nova:port>
Dec 01 19:22:44 user nova-compute[75066]:     <nova:port uuid="ecbe6e20-8532-4496-8a4c-1151c3770cdc">
Dec 01 19:22:44 user nova-compute[75066]:       <nova:ip type="fixed" address="10.10.10.51" ipVersion="4"/>
Dec 01 19:22:44 user nova-compute[75066]:     </nova:port>
Dec 01 19:22:44 user nova-compute[75066]:   </nova:ports>
Dec 01 19:22:44 user nova-compute[75066]: </nova:instance>
Dec 01 19:22:44 user nova-compute[75066]:   </metadata>
Dec 01 19:22:44 user nova-compute[75066]:   <memory unit='KiB'>524288</memory>
Dec 01 19:22:44 user nova-compute[75066]:   <currentMemory unit='KiB'>524288</currentMemory>
Dec 01 19:22:44 user nova-compute[75066]:   <vcpu placement='static'>1</vcpu>
Dec 01 19:22:44 user nova-compute[75066]:   <resource>
Dec 01 19:22:44 user nova-compute[75066]:     <partition>/machine</partition>
Dec 01 19:22:44 user nova-compute[75066]:   </resource>
Dec 01 19:22:44 user nova-compute[75066]:   <sysinfo type='smbios'>
Dec 01 19:22:44 user nova-compute[75066]:     <system>
Dec 01 19:22:44 user nova-compute[75066]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Dec 01 19:22:44 user nova-compute[75066]:       <entry name='product'>OpenStack Nova</entry>
Dec 01 19:22:44 user nova-compute[75066]:       <entry name='version'>0.0.0</entry>
Dec 01 19:22:44 user nova-compute[75066]:       <entry name='serial'>998daa1d-fd6a-4663-8df3-0683a9dbe142</entry>
Dec 01 19:22:44 user nova-compute[75066]:       <entry name='uuid'>998daa1d-fd6a-4663-8df3-0683a9dbe142</entry>
Dec 01 19:22:44 user nova-compute[75066]:       <entry name='family'>Virtual Machine</entry>
Dec 01 19:22:44 user nova-compute[75066]:     </system>
Dec 01 19:22:44 user nova-compute[75066]:   </sysinfo>
Dec 01 19:22:44 user nova-compute[75066]:   <os>
Dec 01 19:22:44 user nova-compute[75066]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Dec 01 19:22:44 user nova-compute[75066]:     <boot dev='hd'/>
Dec 01 19:22:44 user nova-compute[75066]:     <smbios mode='sysinfo'/>
Dec 01 19:22:44 user nova-compute[75066]:   </os>
Dec 01 19:22:44 user nova-compute[75066]:   <features>
Dec 01 19:22:44 user nova-compute[75066]:     <acpi/>
Dec 01 19:22:44 user nova-compute[75066]:     <apic/>
Dec 01 19:22:44 user nova-compute[75066]:     <vmcoreinfo state='on'/>
Dec 01 19:22:44 user nova-compute[75066]:   </features>
Dec 01 19:22:44 user nova-compute[75066]:   <cpu mode='custom' match='exact' check='full'>
Dec 01 19:22:44 user nova-compute[75066]:     <model fallback='forbid'>Nehalem</model>
Dec 01 19:22:44 user nova-compute[75066]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Dec 01 19:22:44 user nova-compute[75066]:     <feature policy='require' name='vme'/>
Dec 01 19:22:44 user nova-compute[75066]:     <feature policy='require' name='x2apic'/>
Dec 01 19:22:44 user nova-compute[75066]:     <feature policy='require' name='hypervisor'/>
Dec 01 19:22:44 user nova-compute[75066]:   </cpu>
Dec 01 19:22:44 user nova-compute[75066]:   <clock offset='utc'>
Dec 01 19:22:44 user nova-compute[75066]:     <timer name='pit' tickpolicy='delay'/>
Dec 01 19:22:44 user nova-compute[75066]:     <timer name='rtc' tickpolicy='catchup'/>
Dec 01 19:22:44 user nova-compute[75066]:     <timer name='hpet' present='no'/>
Dec 01 19:22:44 user nova-compute[75066]:   </clock>
Dec 01 19:22:44 user nova-compute[75066]:   <on_poweroff>destroy</on_poweroff>
Dec 01 19:22:44 user nova-compute[75066]:   <on_reboot>restart</on_reboot>
Dec 01 19:22:44 user nova-compute[75066]:   <on_crash>destroy</on_crash>
Dec 01 19:22:44 user nova-compute[75066]:   <devices>
Dec 01 19:22:44 user nova-compute[75066]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Dec 01 19:22:44 user nova-compute[75066]:     <disk type='file' device='disk'>
Dec 01 19:22:44 user nova-compute[75066]:       <driver name='qemu' type='qcow2' cache='none'/>
Dec 01 19:22:44 user nova-compute[75066]:       <source file='/opt/stack/data/nova/instances/998daa1d-fd6a-4663-8df3-0683a9dbe142/disk' index='2'/>
Dec 01 19:22:44 user nova-compute[75066]:       <backingStore type='file' index='3'>
Dec 01 19:22:44 user nova-compute[75066]:         <format type='raw'/>
Dec 01 19:22:44 user nova-compute[75066]:         <source file='/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d'/>
Dec 01 19:22:44 user nova-compute[75066]:         <backingStore/>
Dec 01 19:22:44 user nova-compute[75066]:       </backingStore>
Dec 01 19:22:44 user nova-compute[75066]:       <target dev='vda' bus='virtio'/>
Dec 01 19:22:44 user nova-compute[75066]:       <alias name='virtio-disk0'/>
Dec 01 19:22:44 user nova-compute[75066]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Dec 01 19:22:44 user nova-compute[75066]:     </disk>
Dec 01 19:22:44 user nova-compute[75066]:     <disk type='file' device='cdrom'>
Dec 01 19:22:44 user nova-compute[75066]:       <driver name='qemu' type='raw' cache='none'/>
Dec 01 19:22:44 user nova-compute[75066]:       <source file='/opt/stack/data/nova/instances/998daa1d-fd6a-4663-8df3-0683a9dbe142/disk.config' index='1'/>
Dec 01 19:22:44 user nova-compute[75066]:       <backingStore/>
Dec 01 19:22:44 user nova-compute[75066]:       <target dev='hda' bus='ide'/>
Dec 01 19:22:44 user nova-compute[75066]:       <readonly/>
Dec 01 19:22:44 user nova-compute[75066]:       <alias name='ide0-0-0'/>
Dec 01 19:22:44 user nova-compute[75066]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Dec 01 19:22:44 user nova-compute[75066]:     </disk>
Dec 01 19:22:44 user nova-compute[75066]:     <controller type='usb' index='0' model='none'>
Dec 01 19:22:44 user nova-compute[75066]:       <alias name='usb'/>
Dec 01 19:22:44 user nova-compute[75066]:     </controller>
Dec 01 19:22:44 user nova-compute[75066]:     <controller type='pci' index='0' model='pci-root'>
Dec 01 19:22:44 user nova-compute[75066]:       <alias name='pci.0'/>
Dec 01 19:22:44 user nova-compute[75066]:     </controller>
Dec 01 19:22:44 user nova-compute[75066]:     <controller type='ide' index='0'>
Dec 01 19:22:44 user nova-compute[75066]:       <alias name='ide'/>
Dec 01 19:22:44 user nova-compute[75066]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Dec 01 19:22:44 user nova-compute[75066]:     </controller>
Dec 01 19:22:44 user nova-compute[75066]:     <interface type='ethernet'>
Dec 01 19:22:44 user nova-compute[75066]:       <mac address='fa:16:3e:10:62:79'/>
Dec 01 19:22:44 user nova-compute[75066]:       <target dev='tap2cf25213-8e'/>
Dec 01 19:22:44 user nova-compute[75066]:       <model type='virtio'/>
Dec 01 19:22:44 user nova-compute[75066]:       <mtu size='1442'/>
Dec 01 19:22:44 user nova-compute[75066]:       <alias name='net0'/>
Dec 01 19:22:44 user nova-compute[75066]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Dec 01 19:22:44 user nova-compute[75066]:     </interface>
Dec 01 19:22:44 user nova-compute[75066]:     <interface type='ethernet'>
Dec 01 19:22:44 user nova-compute[75066]:       <mac address='fa:16:3e:ce:51:6a'/>
Dec 01 19:22:44 user nova-compute[75066]:       <target dev='tapecbe6e20-85'/>
Dec 01 19:22:44 user nova-compute[75066]:       <model type='virtio'/>
Dec 01 19:22:44 user nova-compute[75066]:       <mtu size='1442'/>
Dec 01 19:22:44 user nova-compute[75066]:       <alias name='net1'/>
Dec 01 19:22:44 user nova-compute[75066]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Dec 01 19:22:44 user nova-compute[75066]:     </interface>
Dec 01 19:22:44 user nova-compute[75066]:     <serial type='pty'>
Dec 01 19:22:44 user nova-compute[75066]:       <source path='/dev/pts/3'/>
Dec 01 19:22:44 user nova-compute[75066]:       <log file='/opt/stack/data/nova/instances/998daa1d-fd6a-4663-8df3-0683a9dbe142/console.log' append='off'/>
Dec 01 19:22:44 user nova-compute[75066]:       <target type='isa-serial' port='0'>
Dec 01 19:22:44 user nova-compute[75066]:         <model name='isa-serial'/>
Dec 01 19:22:44 user nova-compute[75066]:       </target>
Dec 01 19:22:44 user nova-compute[75066]:       <alias name='serial0'/>
Dec 01 19:22:44 user nova-compute[75066]:     </serial>
Dec 01 19:22:44 user nova-compute[75066]:     <console type='pty' tty='/dev/pts/3'>
Dec 01 19:22:44 user nova-compute[75066]:       <source path='/dev/pts/3'/>
Dec 01 19:22:44 user nova-compute[75066]:       <log file='/opt/stack/data/nova/instances/998daa1d-fd6a-4663-8df3-0683a9dbe142/console.log' append='off'/>
Dec 01 19:22:44 user nova-compute[75066]:       <target type='serial' port='0'/>
Dec 01 19:22:44 user nova-compute[75066]:       <alias name='serial0'/>
Dec 01 19:22:44 user nova-compute[75066]:     </console>
Dec 01 19:22:44 user nova-compute[75066]:     <input type='mouse' bus='ps2'>
Dec 01 19:22:44 user nova-compute[75066]:       <alias name='input0'/>
Dec 01 19:22:44 user nova-compute[75066]:     </input>
Dec 01 19:22:44 user nova-compute[75066]:     <input type='keyboard' bus='ps2'>
Dec 01 19:22:44 user nova-compute[75066]:       <alias name='input1'/>
Dec 01 19:22:44 user nova-compute[75066]:     </input>
Dec 01 19:22:44 user nova-compute[75066]:     <graphics type='vnc' port='5910' autoport='yes' listen='0.0.0.0'>
Dec 01 19:22:44 user nova-compute[75066]:       <listen type='address' address='0.0.0.0'/>
Dec 01 19:22:44 user nova-compute[75066]:     </graphics>
Dec 01 19:22:44 user nova-compute[75066]:     <audio id='1' type='none'/>
Dec 01 19:22:44 user nova-compute[75066]:     <video>
Dec 01 19:22:44 user nova-compute[75066]:       <model type='virtio' heads='1' primary='yes'/>
Dec 01 19:22:44 user nova-compute[75066]:       <alias name='video0'/>
Dec 01 19:22:44 user nova-compute[75066]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Dec 01 19:22:44 user nova-compute[75066]:     </video>
Dec 01 19:22:44 user nova-compute[75066]:     <memballoon model='virtio'>
Dec 01 19:22:44 user nova-compute[75066]:       <stats period='10'/>
Dec 01 19:22:44 user nova-compute[75066]:       <alias name='balloon0'/>
Dec 01 19:22:44 user nova-compute[75066]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Dec 01 19:22:44 user nova-compute[75066]:     </memballoon>
Dec 01 19:22:44 user nova-compute[75066]:     <rng model='virtio'>
Dec 01 19:22:44 user nova-compute[75066]:       <backend model='random'>/dev/urandom</backend>
Dec 01 19:22:44 user nova-compute[75066]:       <alias name='rng0'/>
Dec 01 19:22:44 user nova-compute[75066]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Dec 01 19:22:44 user nova-compute[75066]:     </rng>
Dec 01 19:22:44 user nova-compute[75066]:   </devices>
Dec 01 19:22:44 user nova-compute[75066]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Dec 01 19:22:44 user nova-compute[75066]:     <label>libvirt-998daa1d-fd6a-4663-8df3-0683a9dbe142</label>
Dec 01 19:22:44 user nova-compute[75066]:     <imagelabel>libvirt-998daa1d-fd6a-4663-8df3-0683a9dbe142</imagelabel>
Dec 01 19:22:44 user nova-compute[75066]:   </seclabel>
Dec 01 19:22:44 user nova-compute[75066]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Dec 01 19:22:44 user nova-compute[75066]:     <label>+64055:+108</label>
Dec 01 19:22:44 user nova-compute[75066]:     <imagelabel>+64055:+108</imagelabel>
Dec 01 19:22:44 user nova-compute[75066]:   </seclabel>
Dec 01 19:22:44 user nova-compute[75066]: </domain>
Dec 01 19:22:44 user nova-compute[75066]:  {{(pid=75066) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Dec 01 19:22:44 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-bd4281d8-d389-4d30-9f5d-c111addff1c8 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Successfully detached device tapecbe6e20-85 from instance 998daa1d-fd6a-4663-8df3-0683a9dbe142 from the persistent domain config.
Dec 01 19:22:44 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-bd4281d8-d389-4d30-9f5d-c111addff1c8 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] (1/8): Attempting to detach device tapecbe6e20-85 with device alias net1 from instance 998daa1d-fd6a-4663-8df3-0683a9dbe142 from the live domain config. {{(pid=75066) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 19:22:44 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-bd4281d8-d389-4d30-9f5d-c111addff1c8 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] detach device xml: <interface type="ethernet">
Dec 01 19:22:44 user nova-compute[75066]:   <mac address="fa:16:3e:ce:51:6a"/>
Dec 01 19:22:44 user nova-compute[75066]:   <model type="virtio"/>
Dec 01 19:22:44 user nova-compute[75066]:   <mtu size="1442"/>
Dec 01 19:22:44 user nova-compute[75066]:   <target dev="tapecbe6e20-85"/>
Dec 01 19:22:44 user nova-compute[75066]: </interface>
Dec 01 19:22:44 user nova-compute[75066]:  {{(pid=75066) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 19:22:45 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:45 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-bd4281d8-d389-4d30-9f5d-c111addff1c8 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Start waiting for the detach event from libvirt for device tapecbe6e20-85 with device alias net1 for instance 998daa1d-fd6a-4663-8df3-0683a9dbe142 {{(pid=75066) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 19:22:45 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:45 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:45 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:45 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:45 user nova-compute[75066]: DEBUG nova.compute.manager [req-ee65541b-2a8c-45d6-9360-340d17605c08 req-e4e8a0b5-abbd-478a-ab57-3b80847eba0f service nova] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Received event network-vif-unplugged-ecbe6e20-8532-4496-8a4c-1151c3770cdc {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:22:45 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-ee65541b-2a8c-45d6-9360-340d17605c08 req-e4e8a0b5-abbd-478a-ab57-3b80847eba0f service nova] Acquiring lock "998daa1d-fd6a-4663-8df3-0683a9dbe142-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:22:45 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-ee65541b-2a8c-45d6-9360-340d17605c08 req-e4e8a0b5-abbd-478a-ab57-3b80847eba0f service nova] Lock "998daa1d-fd6a-4663-8df3-0683a9dbe142-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:22:45 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-ee65541b-2a8c-45d6-9360-340d17605c08 req-e4e8a0b5-abbd-478a-ab57-3b80847eba0f service nova] Lock "998daa1d-fd6a-4663-8df3-0683a9dbe142-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:22:45 user nova-compute[75066]: DEBUG nova.compute.manager [req-ee65541b-2a8c-45d6-9360-340d17605c08 req-e4e8a0b5-abbd-478a-ab57-3b80847eba0f service nova] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] No waiting events found dispatching network-vif-unplugged-ecbe6e20-8532-4496-8a4c-1151c3770cdc {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:22:45 user nova-compute[75066]: WARNING nova.compute.manager [req-ee65541b-2a8c-45d6-9360-340d17605c08 req-e4e8a0b5-abbd-478a-ab57-3b80847eba0f service nova] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Received unexpected event network-vif-unplugged-ecbe6e20-8532-4496-8a4c-1151c3770cdc for instance with vm_state active and task_state None.
Dec 01 19:22:47 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:47 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:47 user nova-compute[75066]: DEBUG nova.compute.manager [req-a2be4398-1383-4f49-b640-1cea2a220b42 req-e244fc0d-7d0c-43fe-b39c-fbf75eec4b3d service nova] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Received event network-vif-plugged-ecbe6e20-8532-4496-8a4c-1151c3770cdc {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:22:47 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a2be4398-1383-4f49-b640-1cea2a220b42 req-e244fc0d-7d0c-43fe-b39c-fbf75eec4b3d service nova] Acquiring lock "998daa1d-fd6a-4663-8df3-0683a9dbe142-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:22:47 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a2be4398-1383-4f49-b640-1cea2a220b42 req-e244fc0d-7d0c-43fe-b39c-fbf75eec4b3d service nova] Lock "998daa1d-fd6a-4663-8df3-0683a9dbe142-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:22:47 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a2be4398-1383-4f49-b640-1cea2a220b42 req-e244fc0d-7d0c-43fe-b39c-fbf75eec4b3d service nova] Lock "998daa1d-fd6a-4663-8df3-0683a9dbe142-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:22:47 user nova-compute[75066]: DEBUG nova.compute.manager [req-a2be4398-1383-4f49-b640-1cea2a220b42 req-e244fc0d-7d0c-43fe-b39c-fbf75eec4b3d service nova] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] No waiting events found dispatching network-vif-plugged-ecbe6e20-8532-4496-8a4c-1151c3770cdc {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:22:47 user nova-compute[75066]: WARNING nova.compute.manager [req-a2be4398-1383-4f49-b640-1cea2a220b42 req-e244fc0d-7d0c-43fe-b39c-fbf75eec4b3d service nova] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Received unexpected event network-vif-plugged-ecbe6e20-8532-4496-8a4c-1151c3770cdc for instance with vm_state active and task_state None.
Dec 01 19:22:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:54 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ec1e147e-1f7b-45f1-8d77-a531a16fa038 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a553e030-0d69-4725-9f84-6c0c63556ed4 is timed out.
Dec 01 19:22:54 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-ec1e147e-1f7b-45f1-8d77-a531a16fa038 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Successfully detached device vdb from instance a553e030-0d69-4725-9f84-6c0c63556ed4 from the live domain config.
Dec 01 19:22:54 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec1e147e-1f7b-45f1-8d77-a531a16fa038 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] calling os-brick to detach iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 19:22:54 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec1e147e-1f7b-45f1-8d77-a531a16fa038 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, {'target_iqn': 'iqn.2010-10.org.openstack:0974d418-ea5d-4b7c-82d8-a6e2909589bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AoaCduYI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:22:54 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-ec1e147e-1f7b-45f1-8d77-a531a16fa038 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:22:54 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-ec1e147e-1f7b-45f1-8d77-a531a16fa038 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:22:54 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-ec1e147e-1f7b-45f1-8d77-a531a16fa038 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:22:54 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:54 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:54 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12a79ca-8680-4c0a-ac9b-56fd20ff1881]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0974d418-ea5d-4b7c-82d8-a6e2909589bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:54 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec1e147e-1f7b-45f1-8d77-a531a16fa038 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 19:22:54 user nova-compute[75066]: No targets found.
Dec 01 19:22:54 user nova-compute[75066]: iSNS:
Dec 01 19:22:54 user nova-compute[75066]: No targets found.
Dec 01 19:22:54 user nova-compute[75066]: STATIC:
Dec 01 19:22:54 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2
Dec 01 19:22:54 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:22:54 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:22:54 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:0974d418-ea5d-4b7c-82d8-a6e2909589bb
Dec 01 19:22:54 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:22:54 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:22:54 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c
Dec 01 19:22:54 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:22:54 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:22:54 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc
Dec 01 19:22:54 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:22:54 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:22:54 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb
Dec 01 19:22:54 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:22:54 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:22:54 user nova-compute[75066]: FIRMWARE:
Dec 01 19:22:54 user nova-compute[75066]: No targets found.
Dec 01 19:22:54 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:22:54 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec1e147e-1f7b-45f1-8d77-a531a16fa038 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 19:22:54 user nova-compute[75066]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 19:22:54 user nova-compute[75066]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75066) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 19:22:54 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec1e147e-1f7b-45f1-8d77-a531a16fa038 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0974d418-ea5d-4b7c-82d8-a6e2909589bb', 0)] {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 19:22:54 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:54 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:54 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0fa59a4-b0f2-42d4-8859-78b82ce10049]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0974d418-ea5d-4b7c-82d8-a6e2909589bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:54 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:54 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:54 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[97463e97-55db-4a4d-88fa-6e3256afa3aa]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0974d418-ea5d-4b7c-82d8-a6e2909589bb (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:54 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec1e147e-1f7b-45f1-8d77-a531a16fa038 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)
Dec 01 19:22:54 user nova-compute[75066]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)
Dec 01 19:22:54 user nova-compute[75066]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:22:54 user nova-compute[75066]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)
Dec 01 19:22:54 user nova-compute[75066]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0974d418-ea5d-4b7c-82d8-a6e2909589bb (non-flash)
Dec 01 19:22:54 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:22:54 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec1e147e-1f7b-45f1-8d77-a531a16fa038 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)
Dec 01 19:22:54 user nova-compute[75066]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)
Dec 01 19:22:54 user nova-compute[75066]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:22:54 user nova-compute[75066]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)
Dec 01 19:22:54 user nova-compute[75066]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0974d418-ea5d-4b7c-82d8-a6e2909589bb (non-flash)
Dec 01 19:22:54 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:22:54 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec1e147e-1f7b-45f1-8d77-a531a16fa038 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f917074ff40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0974d418-ea5d-4b7c-82d8-a6e2909589bb'): ({'sdg'}, set())}) {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 19:22:54 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-ec1e147e-1f7b-45f1-8d77-a531a16fa038 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Removing single pathed devices sdg {{(pid=75066) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 19:22:54 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:54 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:54 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b266e4-06e4-454d-8bf8-894852a72cf2]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:54 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:54 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.022s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:54 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[a200796c-3861-4c35-81a2-8f9304bf2bae]: (4, ('ok\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:54 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-ec1e147e-1f7b-45f1-8d77-a531a16fa038 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Flushing IO for device /dev/sdg {{(pid=75066) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 19:22:54 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:54 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:54 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[9edad0a2-7d1a-4127-90f6-1a67c8598d9e]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:54 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-ec1e147e-1f7b-45f1-8d77-a531a16fa038 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75066) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 19:22:54 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:54 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.071s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:54 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[f075d286-1a34-4250-a6ef-b8cc24e01866]: (4, ('1', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:54 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-ec1e147e-1f7b-45f1-8d77-a531a16fa038 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 19:22:54 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-ec1e147e-1f7b-45f1-8d77-a531a16fa038 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] SCSI volumes sdg have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 19:22:54 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec1e147e-1f7b-45f1-8d77-a531a16fa038 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0974d418-ea5d-4b7c-82d8-a6e2909589bb')] {{(pid=75066) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 19:22:54 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0974d418-ea5d-4b7c-82d8-a6e2909589bb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:54 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0974d418-ea5d-4b7c-82d8-a6e2909589bb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:54 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c696d2-7a5d-44df-a4af-dd193b3fe846]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:54 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec1e147e-1f7b-45f1-8d77-a531a16fa038 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:22:54 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0974d418-ea5d-4b7c-82d8-a6e2909589bb -p 172.16.0.220:3260 --logout {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:54 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0974d418-ea5d-4b7c-82d8-a6e2909589bb -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:54 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a189bd-1d3f-4c24-aba1-6e27c681698e]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:0974d418-ea5d-4b7c-82d8-a6e2909589bb, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:0974d418-ea5d-4b7c-82d8-a6e2909589bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:54 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec1e147e-1f7b-45f1-8d77-a531a16fa038 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:0974d418-ea5d-4b7c-82d8-a6e2909589bb, portal: 172.16.0.220,3260]
Dec 01 19:22:54 user nova-compute[75066]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:0974d418-ea5d-4b7c-82d8-a6e2909589bb, portal: 172.16.0.220,3260] successful.
Dec 01 19:22:54 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:22:54 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0974d418-ea5d-4b7c-82d8-a6e2909589bb -p 172.16.0.220:3260 --op delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:22:54 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0974d418-ea5d-4b7c-82d8-a6e2909589bb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:22:54 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[963cf4c3-78ea-48a8-8ec4-c13bb7aa888e]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:22:54 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec1e147e-1f7b-45f1-8d77-a531a16fa038 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:22:54 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-ec1e147e-1f7b-45f1-8d77-a531a16fa038 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:22:54 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec1e147e-1f7b-45f1-8d77-a531a16fa038 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] <== disconnect_volume: return (348ms) None {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:22:54 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec1e147e-1f7b-45f1-8d77-a531a16fa038 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Disconnected iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 19:22:55 user nova-compute[75066]: DEBUG nova.objects.instance [None req-ec1e147e-1f7b-45f1-8d77-a531a16fa038 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lazy-loading 'flavor' on Instance uuid a553e030-0d69-4725-9f84-6c0c63556ed4 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:22:55 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ec1e147e-1f7b-45f1-8d77-a531a16fa038 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lock "a553e030-0d69-4725-9f84-6c0c63556ed4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.732s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:22:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:22:59 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:23:01 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:23:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:03 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:23:03 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:23:03 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:23:03 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:23:03 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:23:03 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:23:03 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75066) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 19:23:03 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/933210b1-5c5e-421a-9b63-4595fc5f5f25/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:03 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/933210b1-5c5e-421a-9b63-4595fc5f5f25/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:03 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/933210b1-5c5e-421a-9b63-4595fc5f5f25/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:03 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/933210b1-5c5e-421a-9b63-4595fc5f5f25/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:03 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a553e030-0d69-4725-9f84-6c0c63556ed4/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a553e030-0d69-4725-9f84-6c0c63556ed4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a553e030-0d69-4725-9f84-6c0c63556ed4/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a553e030-0d69-4725-9f84-6c0c63556ed4/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:04 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:23:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:05 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-bd4281d8-d389-4d30-9f5d-c111addff1c8 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Waiting for libvirt event about the detach of device tapecbe6e20-85 with device alias net1 from instance 998daa1d-fd6a-4663-8df3-0683a9dbe142 is timed out.
Dec 01 19:23:05 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-bd4281d8-d389-4d30-9f5d-c111addff1c8 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:ce:51:6a"/><model type="virtio"/><mtu size="1442"/><target dev="tapecbe6e20-85"/></interface> {{(pid=75066) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Dec 01 19:23:05 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-bd4281d8-d389-4d30-9f5d-c111addff1c8 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:ce:51:6a"/><model type="virtio"/><mtu size="1442"/><target dev="tapecbe6e20-85"/></interface>not found in domain: <domain type='kvm' id='20'>
Dec 01 19:23:05 user nova-compute[75066]:   <name>instance-00000011</name>
Dec 01 19:23:05 user nova-compute[75066]:   <uuid>998daa1d-fd6a-4663-8df3-0683a9dbe142</uuid>
Dec 01 19:23:05 user nova-compute[75066]:   <metadata>
Dec 01 19:23:05 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:23:05 user nova-compute[75066]:   <nova:package version="0.0.0"/>
Dec 01 19:23:05 user nova-compute[75066]:   <nova:name>tempest-device-tagging-server-431772117</nova:name>
Dec 01 19:23:05 user nova-compute[75066]:   <nova:creationTime>2023-12-01 19:22:08</nova:creationTime>
Dec 01 19:23:05 user nova-compute[75066]:   <nova:flavor name="m1.tiny">
Dec 01 19:23:05 user nova-compute[75066]:     <nova:memory>512</nova:memory>
Dec 01 19:23:05 user nova-compute[75066]:     <nova:disk>1</nova:disk>
Dec 01 19:23:05 user nova-compute[75066]:     <nova:swap>0</nova:swap>
Dec 01 19:23:05 user nova-compute[75066]:     <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:23:05 user nova-compute[75066]:     <nova:vcpus>1</nova:vcpus>
Dec 01 19:23:05 user nova-compute[75066]:   </nova:flavor>
Dec 01 19:23:05 user nova-compute[75066]:   <nova:owner>
Dec 01 19:23:05 user nova-compute[75066]:     <nova:user uuid="8ae99d82b8bb499595aae2098059f478">tempest-TaggedAttachmentsTest-687574292-project-member</nova:user>
Dec 01 19:23:05 user nova-compute[75066]:     <nova:project uuid="0be461a2ee174f25bdbb451e49512e75">tempest-TaggedAttachmentsTest-687574292</nova:project>
Dec 01 19:23:05 user nova-compute[75066]:   </nova:owner>
Dec 01 19:23:05 user nova-compute[75066]:   <nova:root type="image" uuid="900b237b-e99c-4fdd-a44f-dcb7a08baa86"/>
Dec 01 19:23:05 user nova-compute[75066]:   <nova:ports>
Dec 01 19:23:05 user nova-compute[75066]:     <nova:port uuid="2cf25213-8eec-4d19-bad6-b8e2fd905b3c">
Dec 01 19:23:05 user nova-compute[75066]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Dec 01 19:23:05 user nova-compute[75066]:     </nova:port>
Dec 01 19:23:05 user nova-compute[75066]:     <nova:port uuid="ecbe6e20-8532-4496-8a4c-1151c3770cdc">
Dec 01 19:23:05 user nova-compute[75066]:       <nova:ip type="fixed" address="10.10.10.51" ipVersion="4"/>
Dec 01 19:23:05 user nova-compute[75066]:     </nova:port>
Dec 01 19:23:05 user nova-compute[75066]:   </nova:ports>
Dec 01 19:23:05 user nova-compute[75066]: </nova:instance>
Dec 01 19:23:05 user nova-compute[75066]:   </metadata>
Dec 01 19:23:05 user nova-compute[75066]:   <memory unit='KiB'>524288</memory>
Dec 01 19:23:05 user nova-compute[75066]:   <currentMemory unit='KiB'>524288</currentMemory>
Dec 01 19:23:05 user nova-compute[75066]:   <vcpu placement='static'>1</vcpu>
Dec 01 19:23:05 user nova-compute[75066]:   <resource>
Dec 01 19:23:05 user nova-compute[75066]:     <partition>/machine</partition>
Dec 01 19:23:05 user nova-compute[75066]:   </resource>
Dec 01 19:23:05 user nova-compute[75066]:   <sysinfo type='smbios'>
Dec 01 19:23:05 user nova-compute[75066]:     <system>
Dec 01 19:23:05 user nova-compute[75066]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Dec 01 19:23:05 user nova-compute[75066]:       <entry name='product'>OpenStack Nova</entry>
Dec 01 19:23:05 user nova-compute[75066]:       <entry name='version'>0.0.0</entry>
Dec 01 19:23:05 user nova-compute[75066]:       <entry name='serial'>998daa1d-fd6a-4663-8df3-0683a9dbe142</entry>
Dec 01 19:23:05 user nova-compute[75066]:       <entry name='uuid'>998daa1d-fd6a-4663-8df3-0683a9dbe142</entry>
Dec 01 19:23:05 user nova-compute[75066]:       <entry name='family'>Virtual Machine</entry>
Dec 01 19:23:05 user nova-compute[75066]:     </system>
Dec 01 19:23:05 user nova-compute[75066]:   </sysinfo>
Dec 01 19:23:05 user nova-compute[75066]:   <os>
Dec 01 19:23:05 user nova-compute[75066]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Dec 01 19:23:05 user nova-compute[75066]:     <boot dev='hd'/>
Dec 01 19:23:05 user nova-compute[75066]:     <smbios mode='sysinfo'/>
Dec 01 19:23:05 user nova-compute[75066]:   </os>
Dec 01 19:23:05 user nova-compute[75066]:   <features>
Dec 01 19:23:05 user nova-compute[75066]:     <acpi/>
Dec 01 19:23:05 user nova-compute[75066]:     <apic/>
Dec 01 19:23:05 user nova-compute[75066]:     <vmcoreinfo state='on'/>
Dec 01 19:23:05 user nova-compute[75066]:   </features>
Dec 01 19:23:05 user nova-compute[75066]:   <cpu mode='custom' match='exact' check='full'>
Dec 01 19:23:05 user nova-compute[75066]:     <model fallback='forbid'>Nehalem</model>
Dec 01 19:23:05 user nova-compute[75066]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Dec 01 19:23:05 user nova-compute[75066]:     <feature policy='require' name='vme'/>
Dec 01 19:23:05 user nova-compute[75066]:     <feature policy='require' name='x2apic'/>
Dec 01 19:23:05 user nova-compute[75066]:     <feature policy='require' name='hypervisor'/>
Dec 01 19:23:05 user nova-compute[75066]:   </cpu>
Dec 01 19:23:05 user nova-compute[75066]:   <clock offset='utc'>
Dec 01 19:23:05 user nova-compute[75066]:     <timer name='pit' tickpolicy='delay'/>
Dec 01 19:23:05 user nova-compute[75066]:     <timer name='rtc' tickpolicy='catchup'/>
Dec 01 19:23:05 user nova-compute[75066]:     <timer name='hpet' present='no'/>
Dec 01 19:23:05 user nova-compute[75066]:   </clock>
Dec 01 19:23:05 user nova-compute[75066]:   <on_poweroff>destroy</on_poweroff>
Dec 01 19:23:05 user nova-compute[75066]:   <on_reboot>restart</on_reboot>
Dec 01 19:23:05 user nova-compute[75066]:   <on_crash>destroy</on_crash>
Dec 01 19:23:05 user nova-compute[75066]:   <devices>
Dec 01 19:23:05 user nova-compute[75066]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Dec 01 19:23:05 user nova-compute[75066]:     <disk type='file' device='disk'>
Dec 01 19:23:05 user nova-compute[75066]:       <driver name='qemu' type='qcow2' cache='none'/>
Dec 01 19:23:05 user nova-compute[75066]:       <source file='/opt/stack/data/nova/instances/998daa1d-fd6a-4663-8df3-0683a9dbe142/disk' index='2'/>
Dec 01 19:23:05 user nova-compute[75066]:       <backingStore type='file' index='3'>
Dec 01 19:23:05 user nova-compute[75066]:         <format type='raw'/>
Dec 01 19:23:05 user nova-compute[75066]:         <source file='/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d'/>
Dec 01 19:23:05 user nova-compute[75066]:         <backingStore/>
Dec 01 19:23:05 user nova-compute[75066]:       </backingStore>
Dec 01 19:23:05 user nova-compute[75066]:       <target dev='vda' bus='virtio'/>
Dec 01 19:23:05 user nova-compute[75066]:       <alias name='virtio-disk0'/>
Dec 01 19:23:05 user nova-compute[75066]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Dec 01 19:23:05 user nova-compute[75066]:     </disk>
Dec 01 19:23:05 user nova-compute[75066]:     <disk type='file' device='cdrom'>
Dec 01 19:23:05 user nova-compute[75066]:       <driver name='qemu' type='raw' cache='none'/>
Dec 01 19:23:05 user nova-compute[75066]:       <source file='/opt/stack/data/nova/instances/998daa1d-fd6a-4663-8df3-0683a9dbe142/disk.config' index='1'/>
Dec 01 19:23:05 user nova-compute[75066]:       <backingStore/>
Dec 01 19:23:05 user nova-compute[75066]:       <target dev='hda' bus='ide'/>
Dec 01 19:23:05 user nova-compute[75066]:       <readonly/>
Dec 01 19:23:05 user nova-compute[75066]:       <alias name='ide0-0-0'/>
Dec 01 19:23:05 user nova-compute[75066]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Dec 01 19:23:05 user nova-compute[75066]:     </disk>
Dec 01 19:23:05 user nova-compute[75066]:     <controller type='usb' index='0' model='none'>
Dec 01 19:23:05 user nova-compute[75066]:       <alias name='usb'/>
Dec 01 19:23:05 user nova-compute[75066]:     </controller>
Dec 01 19:23:05 user nova-compute[75066]:     <controller type='pci' index='0' model='pci-root'>
Dec 01 19:23:05 user nova-compute[75066]:       <alias name='pci.0'/>
Dec 01 19:23:05 user nova-compute[75066]:     </controller>
Dec 01 19:23:05 user nova-compute[75066]:     <controller type='ide' index='0'>
Dec 01 19:23:05 user nova-compute[75066]:       <alias name='ide'/>
Dec 01 19:23:05 user nova-compute[75066]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Dec 01 19:23:05 user nova-compute[75066]:     </controller>
Dec 01 19:23:05 user nova-compute[75066]:     <interface type='ethernet'>
Dec 01 19:23:05 user nova-compute[75066]:       <mac address='fa:16:3e:10:62:79'/>
Dec 01 19:23:05 user nova-compute[75066]:       <target dev='tap2cf25213-8e'/>
Dec 01 19:23:05 user nova-compute[75066]:       <model type='virtio'/>
Dec 01 19:23:05 user nova-compute[75066]:       <mtu size='1442'/>
Dec 01 19:23:05 user nova-compute[75066]:       <alias name='net0'/>
Dec 01 19:23:05 user nova-compute[75066]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Dec 01 19:23:05 user nova-compute[75066]:     </interface>
Dec 01 19:23:05 user nova-compute[75066]:     <serial type='pty'>
Dec 01 19:23:05 user nova-compute[75066]:       <source path='/dev/pts/3'/>
Dec 01 19:23:05 user nova-compute[75066]:       <log file='/opt/stack/data/nova/instances/998daa1d-fd6a-4663-8df3-0683a9dbe142/console.log' append='off'/>
Dec 01 19:23:05 user nova-compute[75066]:       <target type='isa-serial' port='0'>
Dec 01 19:23:05 user nova-compute[75066]:         <model name='isa-serial'/>
Dec 01 19:23:05 user nova-compute[75066]:       </target>
Dec 01 19:23:05 user nova-compute[75066]:       <alias name='serial0'/>
Dec 01 19:23:05 user nova-compute[75066]:     </serial>
Dec 01 19:23:05 user nova-compute[75066]:     <console type='pty' tty='/dev/pts/3'>
Dec 01 19:23:05 user nova-compute[75066]:       <source path='/dev/pts/3'/>
Dec 01 19:23:05 user nova-compute[75066]:       <log file='/opt/stack/data/nova/instances/998daa1d-fd6a-4663-8df3-0683a9dbe142/console.log' append='off'/>
Dec 01 19:23:05 user nova-compute[75066]:       <target type='serial' port='0'/>
Dec 01 19:23:05 user nova-compute[75066]:       <alias name='serial0'/>
Dec 01 19:23:05 user nova-compute[75066]:     </console>
Dec 01 19:23:05 user nova-compute[75066]:     <input type='mouse' bus='ps2'>
Dec 01 19:23:05 user nova-compute[75066]:       <alias name='input0'/>
Dec 01 19:23:05 user nova-compute[75066]:     </input>
Dec 01 19:23:05 user nova-compute[75066]:     <input type='keyboard' bus='ps2'>
Dec 01 19:23:05 user nova-compute[75066]:       <alias name='input1'/>
Dec 01 19:23:05 user nova-compute[75066]:     </input>
Dec 01 19:23:05 user nova-compute[75066]:     <graphics type='vnc' port='5910' autoport='yes' listen='0.0.0.0'>
Dec 01 19:23:05 user nova-compute[75066]:       <listen type='address' address='0.0.0.0'/>
Dec 01 19:23:05 user nova-compute[75066]:     </graphics>
Dec 01 19:23:05 user nova-compute[75066]:     <audio id='1' type='none'/>
Dec 01 19:23:05 user nova-compute[75066]:     <video>
Dec 01 19:23:05 user nova-compute[75066]:       <model type='virtio' heads='1' primary='yes'/>
Dec 01 19:23:05 user nova-compute[75066]:       <alias name='video0'/>
Dec 01 19:23:05 user nova-compute[75066]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Dec 01 19:23:05 user nova-compute[75066]:     </video>
Dec 01 19:23:05 user nova-compute[75066]:     <memballoon model='virtio'>
Dec 01 19:23:05 user nova-compute[75066]:       <stats period='10'/>
Dec 01 19:23:05 user nova-compute[75066]:       <alias name='balloon0'/>
Dec 01 19:23:05 user nova-compute[75066]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Dec 01 19:23:05 user nova-compute[75066]:     </memballoon>
Dec 01 19:23:05 user nova-compute[75066]:     <rng model='virtio'>
Dec 01 19:23:05 user nova-compute[75066]:       <backend model='random'>/dev/urandom</backend>
Dec 01 19:23:05 user nova-compute[75066]:       <alias name='rng0'/>
Dec 01 19:23:05 user nova-compute[75066]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Dec 01 19:23:05 user nova-compute[75066]:     </rng>
Dec 01 19:23:05 user nova-compute[75066]:   </devices>
Dec 01 19:23:05 user nova-compute[75066]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Dec 01 19:23:05 user nova-compute[75066]:     <label>libvirt-998daa1d-fd6a-4663-8df3-0683a9dbe142</label>
Dec 01 19:23:05 user nova-compute[75066]:     <imagelabel>libvirt-998daa1d-fd6a-4663-8df3-0683a9dbe142</imagelabel>
Dec 01 19:23:05 user nova-compute[75066]:   </seclabel>
Dec 01 19:23:05 user nova-compute[75066]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Dec 01 19:23:05 user nova-compute[75066]:     <label>+64055:+108</label>
Dec 01 19:23:05 user nova-compute[75066]:     <imagelabel>+64055:+108</imagelabel>
Dec 01 19:23:05 user nova-compute[75066]:   </seclabel>
Dec 01 19:23:05 user nova-compute[75066]: </domain>
Dec 01 19:23:05 user nova-compute[75066]:  {{(pid=75066) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Dec 01 19:23:05 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-bd4281d8-d389-4d30-9f5d-c111addff1c8 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Successfully detached device tapecbe6e20-85 from instance 998daa1d-fd6a-4663-8df3-0683a9dbe142 from the live domain config.
Dec 01 19:23:05 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-bd4281d8-d389-4d30-9f5d-c111addff1c8 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T19:20:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-431772117',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-431772117',id=17,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDioMIKkD17rbLefUs+CoCe2YAF5MJyWmdGP5njQ+aDOavBc08qUchmFEEnBOz9qWRNoNrJTyhIak33m8ykbjamBmaBpbrxUKAYbxyiEVNdIL8zvksuJtx/Xi7sbDuD1AA==',key_name='tempest-keypair-1571650457',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:20:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0be461a2ee174f25bdbb451e49512e75',ramdisk_id='',reservation_id='r-ymwza3b4',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-687574292',owner_user_name='tempest-TaggedAttachmentsTest-687574292-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:20:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ae99d82b8bb499595aae2098059f478',uuid=998daa1d-fd6a-4663-8df3-0683a9dbe142,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ecbe6e20-8532-4496-8a4c-1151c3770cdc", "address": "fa:16:3e:ce:51:6a", "network": {"id": "cbb49fd2-4044-4aa7-b04c-c67d5521b682", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-188466014", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0be461a2ee174f25bdbb451e49512e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecbe6e20-85", "ovs_interfaceid": "ecbe6e20-8532-4496-8a4c-1151c3770cdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:23:05 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-bd4281d8-d389-4d30-9f5d-c111addff1c8 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Converting VIF {"id": "ecbe6e20-8532-4496-8a4c-1151c3770cdc", "address": "fa:16:3e:ce:51:6a", "network": {"id": "cbb49fd2-4044-4aa7-b04c-c67d5521b682", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-188466014", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0be461a2ee174f25bdbb451e49512e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecbe6e20-85", "ovs_interfaceid": "ecbe6e20-8532-4496-8a4c-1151c3770cdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:23:05 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-bd4281d8-d389-4d30-9f5d-c111addff1c8 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:51:6a,bridge_name='br-int',has_traffic_filtering=True,id=ecbe6e20-8532-4496-8a4c-1151c3770cdc,network=Network(cbb49fd2-4044-4aa7-b04c-c67d5521b682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecbe6e20-85') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:23:05 user nova-compute[75066]: DEBUG os_vif [None req-bd4281d8-d389-4d30-9f5d-c111addff1c8 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:51:6a,bridge_name='br-int',has_traffic_filtering=True,id=ecbe6e20-8532-4496-8a4c-1151c3770cdc,network=Network(cbb49fd2-4044-4aa7-b04c-c67d5521b682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecbe6e20-85') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:23:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:05 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:05 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapecbe6e20-85, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:23:05 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:05 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:23:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:05 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:05 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:05 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=74e51940-0df0-42a8-aa17-ec0a6f764804) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:23:05 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:05 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:23:05 user nova-compute[75066]: INFO os_vif [None req-bd4281d8-d389-4d30-9f5d-c111addff1c8 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:51:6a,bridge_name='br-int',has_traffic_filtering=True,id=ecbe6e20-8532-4496-8a4c-1151c3770cdc,network=Network(cbb49fd2-4044-4aa7-b04c-c67d5521b682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecbe6e20-85')
Dec 01 19:23:05 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-bd4281d8-d389-4d30-9f5d-c111addff1c8 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:23:05 user nova-compute[75066]:   <nova:package version="0.0.0"/>
Dec 01 19:23:05 user nova-compute[75066]:   <nova:name>tempest-device-tagging-server-431772117</nova:name>
Dec 01 19:23:05 user nova-compute[75066]:   <nova:creationTime>2023-12-01 19:23:05</nova:creationTime>
Dec 01 19:23:05 user nova-compute[75066]:   <nova:flavor name="m1.tiny">
Dec 01 19:23:05 user nova-compute[75066]:     <nova:memory>512</nova:memory>
Dec 01 19:23:05 user nova-compute[75066]:     <nova:disk>1</nova:disk>
Dec 01 19:23:05 user nova-compute[75066]:     <nova:swap>0</nova:swap>
Dec 01 19:23:05 user nova-compute[75066]:     <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:23:05 user nova-compute[75066]:     <nova:vcpus>1</nova:vcpus>
Dec 01 19:23:05 user nova-compute[75066]:   </nova:flavor>
Dec 01 19:23:05 user nova-compute[75066]:   <nova:owner>
Dec 01 19:23:05 user nova-compute[75066]:     <nova:user uuid="8ae99d82b8bb499595aae2098059f478">tempest-TaggedAttachmentsTest-687574292-project-member</nova:user>
Dec 01 19:23:05 user nova-compute[75066]:     <nova:project uuid="0be461a2ee174f25bdbb451e49512e75">tempest-TaggedAttachmentsTest-687574292</nova:project>
Dec 01 19:23:05 user nova-compute[75066]:   </nova:owner>
Dec 01 19:23:05 user nova-compute[75066]:   <nova:root type="image" uuid="900b237b-e99c-4fdd-a44f-dcb7a08baa86"/>
Dec 01 19:23:05 user nova-compute[75066]:   <nova:ports>
Dec 01 19:23:05 user nova-compute[75066]:     <nova:port uuid="2cf25213-8eec-4d19-bad6-b8e2fd905b3c">
Dec 01 19:23:05 user nova-compute[75066]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Dec 01 19:23:05 user nova-compute[75066]:     </nova:port>
Dec 01 19:23:05 user nova-compute[75066]:   </nova:ports>
Dec 01 19:23:05 user nova-compute[75066]: </nova:instance>
Dec 01 19:23:05 user nova-compute[75066]:  {{(pid=75066) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Dec 01 19:23:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:06 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:23:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk.rescue --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:06 user nova-compute[75066]: DEBUG nova.compute.manager [req-f02f8315-d86f-4acf-892a-86f91348a7f4 req-7403c94a-5d11-4947-84e7-7d4400c99ab8 service nova] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Received event network-vif-deleted-ecbe6e20-8532-4496-8a4c-1151c3770cdc {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:23:06 user nova-compute[75066]: INFO nova.compute.manager [req-f02f8315-d86f-4acf-892a-86f91348a7f4 req-7403c94a-5d11-4947-84e7-7d4400c99ab8 service nova] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Neutron deleted interface ecbe6e20-8532-4496-8a4c-1151c3770cdc; detaching it from the instance and deleting it from the info cache
Dec 01 19:23:06 user nova-compute[75066]: DEBUG nova.network.neutron [req-f02f8315-d86f-4acf-892a-86f91348a7f4 req-7403c94a-5d11-4947-84e7-7d4400c99ab8 service nova] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Updating instance_info_cache with network_info: [{"id": "2cf25213-8eec-4d19-bad6-b8e2fd905b3c", "address": "fa:16:3e:10:62:79", "network": {"id": "13655709-cc3e-4378-850f-1eb7bc944811", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1907265443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0be461a2ee174f25bdbb451e49512e75", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf25213-8e", "ovs_interfaceid": "2cf25213-8eec-4d19-bad6-b8e2fd905b3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:23:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk.rescue --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-bd4281d8-d389-4d30-9f5d-c111addff1c8 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Acquiring lock "refresh_cache-998daa1d-fd6a-4663-8df3-0683a9dbe142" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:23:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-bd4281d8-d389-4d30-9f5d-c111addff1c8 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Acquired lock "refresh_cache-998daa1d-fd6a-4663-8df3-0683a9dbe142" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:23:06 user nova-compute[75066]: DEBUG nova.network.neutron [None req-bd4281d8-d389-4d30-9f5d-c111addff1c8 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:23:06 user nova-compute[75066]: DEBUG nova.objects.instance [req-f02f8315-d86f-4acf-892a-86f91348a7f4 req-7403c94a-5d11-4947-84e7-7d4400c99ab8 service nova] Lazy-loading 'system_metadata' on Instance uuid 998daa1d-fd6a-4663-8df3-0683a9dbe142 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:23:06 user nova-compute[75066]: DEBUG nova.objects.instance [req-f02f8315-d86f-4acf-892a-86f91348a7f4 req-7403c94a-5d11-4947-84e7-7d4400c99ab8 service nova] Lazy-loading 'flavor' on Instance uuid 998daa1d-fd6a-4663-8df3-0683a9dbe142 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:23:06 user nova-compute[75066]: DEBUG nova.objects.base [req-f02f8315-d86f-4acf-892a-86f91348a7f4 req-7403c94a-5d11-4947-84e7-7d4400c99ab8 service nova] Object Instance<998daa1d-fd6a-4663-8df3-0683a9dbe142> lazy-loaded attributes: system_metadata,flavor {{(pid=75066) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 19:23:06 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [req-f02f8315-d86f-4acf-892a-86f91348a7f4 req-7403c94a-5d11-4947-84e7-7d4400c99ab8 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T19:20:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-431772117',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-431772117',id=17,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDioMIKkD17rbLefUs+CoCe2YAF5MJyWmdGP5njQ+aDOavBc08qUchmFEEnBOz9qWRNoNrJTyhIak33m8ykbjamBmaBpbrxUKAYbxyiEVNdIL8zvksuJtx/Xi7sbDuD1AA==',key_name='tempest-keypair-1571650457',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:20:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0be461a2ee174f25bdbb451e49512e75',ramdisk_id='',reservation_id='r-ymwza3b4',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-687574292',owner_user_name='tempest-TaggedAttachmentsTest-687574292-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:20:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ae99d82b8bb499595aae2098059f478',uuid=998daa1d-fd6a-4663-8df3-0683a9dbe142,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ecbe6e20-8532-4496-8a4c-1151c3770cdc", "address": "fa:16:3e:ce:51:6a", "network": {"id": "cbb49fd2-4044-4aa7-b04c-c67d5521b682", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-188466014", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0be461a2ee174f25bdbb451e49512e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecbe6e20-85", "ovs_interfaceid": "ecbe6e20-8532-4496-8a4c-1151c3770cdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:23:06 user nova-compute[75066]: DEBUG nova.network.os_vif_util [req-f02f8315-d86f-4acf-892a-86f91348a7f4 req-7403c94a-5d11-4947-84e7-7d4400c99ab8 service nova] Converting VIF {"id": "ecbe6e20-8532-4496-8a4c-1151c3770cdc", "address": "fa:16:3e:ce:51:6a", "network": {"id": "cbb49fd2-4044-4aa7-b04c-c67d5521b682", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-188466014", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0be461a2ee174f25bdbb451e49512e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecbe6e20-85", "ovs_interfaceid": "ecbe6e20-8532-4496-8a4c-1151c3770cdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:23:06 user nova-compute[75066]: DEBUG nova.network.os_vif_util [req-f02f8315-d86f-4acf-892a-86f91348a7f4 req-7403c94a-5d11-4947-84e7-7d4400c99ab8 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:51:6a,bridge_name='br-int',has_traffic_filtering=True,id=ecbe6e20-8532-4496-8a4c-1151c3770cdc,network=Network(cbb49fd2-4044-4aa7-b04c-c67d5521b682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecbe6e20-85') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:23:06 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [req-f02f8315-d86f-4acf-892a-86f91348a7f4 req-7403c94a-5d11-4947-84e7-7d4400c99ab8 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:ce:51:6a"/><model type="virtio"/><mtu size="1442"/><target dev="tapecbe6e20-85"/></interface> {{(pid=75066) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Dec 01 19:23:06 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [req-f02f8315-d86f-4acf-892a-86f91348a7f4 req-7403c94a-5d11-4947-84e7-7d4400c99ab8 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:ce:51:6a"/><model type="virtio"/><mtu size="1442"/><target dev="tapecbe6e20-85"/></interface>not found in domain: <domain type='kvm' id='20'>
Dec 01 19:23:06 user nova-compute[75066]:   <name>instance-00000011</name>
Dec 01 19:23:06 user nova-compute[75066]:   <uuid>998daa1d-fd6a-4663-8df3-0683a9dbe142</uuid>
Dec 01 19:23:06 user nova-compute[75066]:   <metadata>
Dec 01 19:23:06 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:23:06 user nova-compute[75066]:   <nova:package version="0.0.0"/>
Dec 01 19:23:06 user nova-compute[75066]:   <nova:name>tempest-device-tagging-server-431772117</nova:name>
Dec 01 19:23:06 user nova-compute[75066]:   <nova:creationTime>2023-12-01 19:23:05</nova:creationTime>
Dec 01 19:23:06 user nova-compute[75066]:   <nova:flavor name="m1.tiny">
Dec 01 19:23:06 user nova-compute[75066]:     <nova:memory>512</nova:memory>
Dec 01 19:23:06 user nova-compute[75066]:     <nova:disk>1</nova:disk>
Dec 01 19:23:06 user nova-compute[75066]:     <nova:swap>0</nova:swap>
Dec 01 19:23:06 user nova-compute[75066]:     <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:23:06 user nova-compute[75066]:     <nova:vcpus>1</nova:vcpus>
Dec 01 19:23:06 user nova-compute[75066]:   </nova:flavor>
Dec 01 19:23:06 user nova-compute[75066]:   <nova:owner>
Dec 01 19:23:06 user nova-compute[75066]:     <nova:user uuid="8ae99d82b8bb499595aae2098059f478">tempest-TaggedAttachmentsTest-687574292-project-member</nova:user>
Dec 01 19:23:06 user nova-compute[75066]:     <nova:project uuid="0be461a2ee174f25bdbb451e49512e75">tempest-TaggedAttachmentsTest-687574292</nova:project>
Dec 01 19:23:06 user nova-compute[75066]:   </nova:owner>
Dec 01 19:23:06 user nova-compute[75066]:   <nova:root type="image" uuid="900b237b-e99c-4fdd-a44f-dcb7a08baa86"/>
Dec 01 19:23:06 user nova-compute[75066]:   <nova:ports>
Dec 01 19:23:06 user nova-compute[75066]:     <nova:port uuid="2cf25213-8eec-4d19-bad6-b8e2fd905b3c">
Dec 01 19:23:06 user nova-compute[75066]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Dec 01 19:23:06 user nova-compute[75066]:     </nova:port>
Dec 01 19:23:06 user nova-compute[75066]:   </nova:ports>
Dec 01 19:23:06 user nova-compute[75066]: </nova:instance>
Dec 01 19:23:06 user nova-compute[75066]:   </metadata>
Dec 01 19:23:06 user nova-compute[75066]:   <memory unit='KiB'>524288</memory>
Dec 01 19:23:06 user nova-compute[75066]:   <currentMemory unit='KiB'>524288</currentMemory>
Dec 01 19:23:06 user nova-compute[75066]:   <vcpu placement='static'>1</vcpu>
Dec 01 19:23:06 user nova-compute[75066]:   <resource>
Dec 01 19:23:06 user nova-compute[75066]:     <partition>/machine</partition>
Dec 01 19:23:06 user nova-compute[75066]:   </resource>
Dec 01 19:23:06 user nova-compute[75066]:   <sysinfo type='smbios'>
Dec 01 19:23:06 user nova-compute[75066]:     <system>
Dec 01 19:23:06 user nova-compute[75066]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Dec 01 19:23:06 user nova-compute[75066]:       <entry name='product'>OpenStack Nova</entry>
Dec 01 19:23:06 user nova-compute[75066]:       <entry name='version'>0.0.0</entry>
Dec 01 19:23:06 user nova-compute[75066]:       <entry name='serial'>998daa1d-fd6a-4663-8df3-0683a9dbe142</entry>
Dec 01 19:23:06 user nova-compute[75066]:       <entry name='uuid'>998daa1d-fd6a-4663-8df3-0683a9dbe142</entry>
Dec 01 19:23:06 user nova-compute[75066]:       <entry name='family'>Virtual Machine</entry>
Dec 01 19:23:06 user nova-compute[75066]:     </system>
Dec 01 19:23:06 user nova-compute[75066]:   </sysinfo>
Dec 01 19:23:06 user nova-compute[75066]:   <os>
Dec 01 19:23:06 user nova-compute[75066]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Dec 01 19:23:06 user nova-compute[75066]:     <boot dev='hd'/>
Dec 01 19:23:06 user nova-compute[75066]:     <smbios mode='sysinfo'/>
Dec 01 19:23:06 user nova-compute[75066]:   </os>
Dec 01 19:23:06 user nova-compute[75066]:   <features>
Dec 01 19:23:06 user nova-compute[75066]:     <acpi/>
Dec 01 19:23:06 user nova-compute[75066]:     <apic/>
Dec 01 19:23:06 user nova-compute[75066]:     <vmcoreinfo state='on'/>
Dec 01 19:23:06 user nova-compute[75066]:   </features>
Dec 01 19:23:06 user nova-compute[75066]:   <cpu mode='custom' match='exact' check='full'>
Dec 01 19:23:06 user nova-compute[75066]:     <model fallback='forbid'>Nehalem</model>
Dec 01 19:23:06 user nova-compute[75066]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Dec 01 19:23:06 user nova-compute[75066]:     <feature policy='require' name='vme'/>
Dec 01 19:23:06 user nova-compute[75066]:     <feature policy='require' name='x2apic'/>
Dec 01 19:23:06 user nova-compute[75066]:     <feature policy='require' name='hypervisor'/>
Dec 01 19:23:06 user nova-compute[75066]:   </cpu>
Dec 01 19:23:06 user nova-compute[75066]:   <clock offset='utc'>
Dec 01 19:23:06 user nova-compute[75066]:     <timer name='pit' tickpolicy='delay'/>
Dec 01 19:23:06 user nova-compute[75066]:     <timer name='rtc' tickpolicy='catchup'/>
Dec 01 19:23:06 user nova-compute[75066]:     <timer name='hpet' present='no'/>
Dec 01 19:23:06 user nova-compute[75066]:   </clock>
Dec 01 19:23:06 user nova-compute[75066]:   <on_poweroff>destroy</on_poweroff>
Dec 01 19:23:06 user nova-compute[75066]:   <on_reboot>restart</on_reboot>
Dec 01 19:23:06 user nova-compute[75066]:   <on_crash>destroy</on_crash>
Dec 01 19:23:06 user nova-compute[75066]:   <devices>
Dec 01 19:23:06 user nova-compute[75066]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Dec 01 19:23:06 user nova-compute[75066]:     <disk type='file' device='disk'>
Dec 01 19:23:06 user nova-compute[75066]:       <driver name='qemu' type='qcow2' cache='none'/>
Dec 01 19:23:06 user nova-compute[75066]:       <source file='/opt/stack/data/nova/instances/998daa1d-fd6a-4663-8df3-0683a9dbe142/disk' index='2'/>
Dec 01 19:23:06 user nova-compute[75066]:       <backingStore type='file' index='3'>
Dec 01 19:23:06 user nova-compute[75066]:         <format type='raw'/>
Dec 01 19:23:06 user nova-compute[75066]:         <source file='/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d'/>
Dec 01 19:23:06 user nova-compute[75066]:         <backingStore/>
Dec 01 19:23:06 user nova-compute[75066]:       </backingStore>
Dec 01 19:23:06 user nova-compute[75066]:       <target dev='vda' bus='virtio'/>
Dec 01 19:23:06 user nova-compute[75066]:       <alias name='virtio-disk0'/>
Dec 01 19:23:06 user nova-compute[75066]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Dec 01 19:23:06 user nova-compute[75066]:     </disk>
Dec 01 19:23:06 user nova-compute[75066]:     <disk type='file' device='cdrom'>
Dec 01 19:23:06 user nova-compute[75066]:       <driver name='qemu' type='raw' cache='none'/>
Dec 01 19:23:06 user nova-compute[75066]:       <source file='/opt/stack/data/nova/instances/998daa1d-fd6a-4663-8df3-0683a9dbe142/disk.config' index='1'/>
Dec 01 19:23:06 user nova-compute[75066]:       <backingStore/>
Dec 01 19:23:06 user nova-compute[75066]:       <target dev='hda' bus='ide'/>
Dec 01 19:23:06 user nova-compute[75066]:       <readonly/>
Dec 01 19:23:06 user nova-compute[75066]:       <alias name='ide0-0-0'/>
Dec 01 19:23:06 user nova-compute[75066]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Dec 01 19:23:06 user nova-compute[75066]:     </disk>
Dec 01 19:23:06 user nova-compute[75066]:     <controller type='usb' index='0' model='none'>
Dec 01 19:23:06 user nova-compute[75066]:       <alias name='usb'/>
Dec 01 19:23:06 user nova-compute[75066]:     </controller>
Dec 01 19:23:06 user nova-compute[75066]:     <controller type='pci' index='0' model='pci-root'>
Dec 01 19:23:06 user nova-compute[75066]:       <alias name='pci.0'/>
Dec 01 19:23:06 user nova-compute[75066]:     </controller>
Dec 01 19:23:06 user nova-compute[75066]:     <controller type='ide' index='0'>
Dec 01 19:23:06 user nova-compute[75066]:       <alias name='ide'/>
Dec 01 19:23:06 user nova-compute[75066]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Dec 01 19:23:06 user nova-compute[75066]:     </controller>
Dec 01 19:23:06 user nova-compute[75066]:     <interface type='ethernet'>
Dec 01 19:23:06 user nova-compute[75066]:       <mac address='fa:16:3e:10:62:79'/>
Dec 01 19:23:06 user nova-compute[75066]:       <target dev='tap2cf25213-8e'/>
Dec 01 19:23:06 user nova-compute[75066]:       <model type='virtio'/>
Dec 01 19:23:06 user nova-compute[75066]:       <mtu size='1442'/>
Dec 01 19:23:06 user nova-compute[75066]:       <alias name='net0'/>
Dec 01 19:23:06 user nova-compute[75066]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Dec 01 19:23:06 user nova-compute[75066]:     </interface>
Dec 01 19:23:06 user nova-compute[75066]:     <serial type='pty'>
Dec 01 19:23:06 user nova-compute[75066]:       <source path='/dev/pts/3'/>
Dec 01 19:23:06 user nova-compute[75066]:       <log file='/opt/stack/data/nova/instances/998daa1d-fd6a-4663-8df3-0683a9dbe142/console.log' append='off'/>
Dec 01 19:23:06 user nova-compute[75066]:       <target type='isa-serial' port='0'>
Dec 01 19:23:06 user nova-compute[75066]:         <model name='isa-serial'/>
Dec 01 19:23:06 user nova-compute[75066]:       </target>
Dec 01 19:23:06 user nova-compute[75066]:       <alias name='serial0'/>
Dec 01 19:23:06 user nova-compute[75066]:     </serial>
Dec 01 19:23:06 user nova-compute[75066]:     <console type='pty' tty='/dev/pts/3'>
Dec 01 19:23:06 user nova-compute[75066]:       <source path='/dev/pts/3'/>
Dec 01 19:23:06 user nova-compute[75066]:       <log file='/opt/stack/data/nova/instances/998daa1d-fd6a-4663-8df3-0683a9dbe142/console.log' append='off'/>
Dec 01 19:23:06 user nova-compute[75066]:       <target type='serial' port='0'/>
Dec 01 19:23:06 user nova-compute[75066]:       <alias name='serial0'/>
Dec 01 19:23:06 user nova-compute[75066]:     </console>
Dec 01 19:23:06 user nova-compute[75066]:     <input type='mouse' bus='ps2'>
Dec 01 19:23:06 user nova-compute[75066]:       <alias name='input0'/>
Dec 01 19:23:06 user nova-compute[75066]:     </input>
Dec 01 19:23:06 user nova-compute[75066]:     <input type='keyboard' bus='ps2'>
Dec 01 19:23:06 user nova-compute[75066]:       <alias name='input1'/>
Dec 01 19:23:06 user nova-compute[75066]:     </input>
Dec 01 19:23:06 user nova-compute[75066]:     <graphics type='vnc' port='5910' autoport='yes' listen='0.0.0.0'>
Dec 01 19:23:06 user nova-compute[75066]:       <listen type='address' address='0.0.0.0'/>
Dec 01 19:23:06 user nova-compute[75066]:     </graphics>
Dec 01 19:23:06 user nova-compute[75066]:     <audio id='1' type='none'/>
Dec 01 19:23:06 user nova-compute[75066]:     <video>
Dec 01 19:23:06 user nova-compute[75066]:       <model type='virtio' heads='1' primary='yes'/>
Dec 01 19:23:06 user nova-compute[75066]:       <alias name='video0'/>
Dec 01 19:23:06 user nova-compute[75066]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Dec 01 19:23:06 user nova-compute[75066]:     </video>
Dec 01 19:23:06 user nova-compute[75066]:     <memballoon model='virtio'>
Dec 01 19:23:06 user nova-compute[75066]:       <stats period='10'/>
Dec 01 19:23:06 user nova-compute[75066]:       <alias name='balloon0'/>
Dec 01 19:23:06 user nova-compute[75066]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Dec 01 19:23:06 user nova-compute[75066]:     </memballoon>
Dec 01 19:23:06 user nova-compute[75066]:     <rng model='virtio'>
Dec 01 19:23:06 user nova-compute[75066]:       <backend model='random'>/dev/urandom</backend>
Dec 01 19:23:06 user nova-compute[75066]:       <alias name='rng0'/>
Dec 01 19:23:06 user nova-compute[75066]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Dec 01 19:23:06 user nova-compute[75066]:     </rng>
Dec 01 19:23:06 user nova-compute[75066]:   </devices>
Dec 01 19:23:06 user nova-compute[75066]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Dec 01 19:23:06 user nova-compute[75066]:     <label>libvirt-998daa1d-fd6a-4663-8df3-0683a9dbe142</label>
Dec 01 19:23:06 user nova-compute[75066]:     <imagelabel>libvirt-998daa1d-fd6a-4663-8df3-0683a9dbe142</imagelabel>
Dec 01 19:23:06 user nova-compute[75066]:   </seclabel>
Dec 01 19:23:06 user nova-compute[75066]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Dec 01 19:23:06 user nova-compute[75066]:     <label>+64055:+108</label>
Dec 01 19:23:06 user nova-compute[75066]:     <imagelabel>+64055:+108</imagelabel>
Dec 01 19:23:06 user nova-compute[75066]:   </seclabel>
Dec 01 19:23:06 user nova-compute[75066]: </domain>
Dec 01 19:23:06 user nova-compute[75066]:  {{(pid=75066) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Dec 01 19:23:06 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [req-f02f8315-d86f-4acf-892a-86f91348a7f4 req-7403c94a-5d11-4947-84e7-7d4400c99ab8 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:ce:51:6a"/><model type="virtio"/><mtu size="1442"/><target dev="tapecbe6e20-85"/></interface> {{(pid=75066) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Dec 01 19:23:06 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [req-f02f8315-d86f-4acf-892a-86f91348a7f4 req-7403c94a-5d11-4947-84e7-7d4400c99ab8 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:ce:51:6a"/><model type="virtio"/><mtu size="1442"/><target dev="tapecbe6e20-85"/></interface>not found in domain: <domain type='kvm' id='20'>
Dec 01 19:23:06 user nova-compute[75066]:   <name>instance-00000011</name>
Dec 01 19:23:06 user nova-compute[75066]:   <uuid>998daa1d-fd6a-4663-8df3-0683a9dbe142</uuid>
Dec 01 19:23:06 user nova-compute[75066]:   <metadata>
Dec 01 19:23:06 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:23:06 user nova-compute[75066]:   <nova:package version="0.0.0"/>
Dec 01 19:23:06 user nova-compute[75066]:   <nova:name>tempest-device-tagging-server-431772117</nova:name>
Dec 01 19:23:06 user nova-compute[75066]:   <nova:creationTime>2023-12-01 19:23:05</nova:creationTime>
Dec 01 19:23:06 user nova-compute[75066]:   <nova:flavor name="m1.tiny">
Dec 01 19:23:06 user nova-compute[75066]:     <nova:memory>512</nova:memory>
Dec 01 19:23:06 user nova-compute[75066]:     <nova:disk>1</nova:disk>
Dec 01 19:23:06 user nova-compute[75066]:     <nova:swap>0</nova:swap>
Dec 01 19:23:06 user nova-compute[75066]:     <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:23:06 user nova-compute[75066]:     <nova:vcpus>1</nova:vcpus>
Dec 01 19:23:06 user nova-compute[75066]:   </nova:flavor>
Dec 01 19:23:06 user nova-compute[75066]:   <nova:owner>
Dec 01 19:23:06 user nova-compute[75066]:     <nova:user uuid="8ae99d82b8bb499595aae2098059f478">tempest-TaggedAttachmentsTest-687574292-project-member</nova:user>
Dec 01 19:23:06 user nova-compute[75066]:     <nova:project uuid="0be461a2ee174f25bdbb451e49512e75">tempest-TaggedAttachmentsTest-687574292</nova:project>
Dec 01 19:23:06 user nova-compute[75066]:   </nova:owner>
Dec 01 19:23:06 user nova-compute[75066]:   <nova:root type="image" uuid="900b237b-e99c-4fdd-a44f-dcb7a08baa86"/>
Dec 01 19:23:06 user nova-compute[75066]:   <nova:ports>
Dec 01 19:23:06 user nova-compute[75066]:     <nova:port uuid="2cf25213-8eec-4d19-bad6-b8e2fd905b3c">
Dec 01 19:23:06 user nova-compute[75066]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Dec 01 19:23:06 user nova-compute[75066]:     </nova:port>
Dec 01 19:23:06 user nova-compute[75066]:   </nova:ports>
Dec 01 19:23:06 user nova-compute[75066]: </nova:instance>
Dec 01 19:23:06 user nova-compute[75066]:   </metadata>
Dec 01 19:23:06 user nova-compute[75066]:   <memory unit='KiB'>524288</memory>
Dec 01 19:23:06 user nova-compute[75066]:   <currentMemory unit='KiB'>524288</currentMemory>
Dec 01 19:23:06 user nova-compute[75066]:   <vcpu placement='static'>1</vcpu>
Dec 01 19:23:06 user nova-compute[75066]:   <resource>
Dec 01 19:23:06 user nova-compute[75066]:     <partition>/machine</partition>
Dec 01 19:23:06 user nova-compute[75066]:   </resource>
Dec 01 19:23:06 user nova-compute[75066]:   <sysinfo type='smbios'>
Dec 01 19:23:06 user nova-compute[75066]:     <system>
Dec 01 19:23:06 user nova-compute[75066]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Dec 01 19:23:06 user nova-compute[75066]:       <entry name='product'>OpenStack Nova</entry>
Dec 01 19:23:06 user nova-compute[75066]:       <entry name='version'>0.0.0</entry>
Dec 01 19:23:06 user nova-compute[75066]:       <entry name='serial'>998daa1d-fd6a-4663-8df3-0683a9dbe142</entry>
Dec 01 19:23:06 user nova-compute[75066]:       <entry name='uuid'>998daa1d-fd6a-4663-8df3-0683a9dbe142</entry>
Dec 01 19:23:06 user nova-compute[75066]:       <entry name='family'>Virtual Machine</entry>
Dec 01 19:23:06 user nova-compute[75066]:     </system>
Dec 01 19:23:06 user nova-compute[75066]:   </sysinfo>
Dec 01 19:23:06 user nova-compute[75066]:   <os>
Dec 01 19:23:06 user nova-compute[75066]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Dec 01 19:23:06 user nova-compute[75066]:     <boot dev='hd'/>
Dec 01 19:23:06 user nova-compute[75066]:     <smbios mode='sysinfo'/>
Dec 01 19:23:06 user nova-compute[75066]:   </os>
Dec 01 19:23:06 user nova-compute[75066]:   <features>
Dec 01 19:23:06 user nova-compute[75066]:     <acpi/>
Dec 01 19:23:06 user nova-compute[75066]:     <apic/>
Dec 01 19:23:06 user nova-compute[75066]:     <vmcoreinfo state='on'/>
Dec 01 19:23:06 user nova-compute[75066]:   </features>
Dec 01 19:23:06 user nova-compute[75066]:   <cpu mode='custom' match='exact' check='full'>
Dec 01 19:23:06 user nova-compute[75066]:     <model fallback='forbid'>Nehalem</model>
Dec 01 19:23:06 user nova-compute[75066]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Dec 01 19:23:06 user nova-compute[75066]:     <feature policy='require' name='vme'/>
Dec 01 19:23:06 user nova-compute[75066]:     <feature policy='require' name='x2apic'/>
Dec 01 19:23:06 user nova-compute[75066]:     <feature policy='require' name='hypervisor'/>
Dec 01 19:23:06 user nova-compute[75066]:   </cpu>
Dec 01 19:23:06 user nova-compute[75066]:   <clock offset='utc'>
Dec 01 19:23:06 user nova-compute[75066]:     <timer name='pit' tickpolicy='delay'/>
Dec 01 19:23:06 user nova-compute[75066]:     <timer name='rtc' tickpolicy='catchup'/>
Dec 01 19:23:06 user nova-compute[75066]:     <timer name='hpet' present='no'/>
Dec 01 19:23:06 user nova-compute[75066]:   </clock>
Dec 01 19:23:06 user nova-compute[75066]:   <on_poweroff>destroy</on_poweroff>
Dec 01 19:23:06 user nova-compute[75066]:   <on_reboot>restart</on_reboot>
Dec 01 19:23:06 user nova-compute[75066]:   <on_crash>destroy</on_crash>
Dec 01 19:23:06 user nova-compute[75066]:   <devices>
Dec 01 19:23:06 user nova-compute[75066]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Dec 01 19:23:06 user nova-compute[75066]:     <disk type='file' device='disk'>
Dec 01 19:23:06 user nova-compute[75066]:       <driver name='qemu' type='qcow2' cache='none'/>
Dec 01 19:23:06 user nova-compute[75066]:       <source file='/opt/stack/data/nova/instances/998daa1d-fd6a-4663-8df3-0683a9dbe142/disk' index='2'/>
Dec 01 19:23:06 user nova-compute[75066]:       <backingStore type='file' index='3'>
Dec 01 19:23:06 user nova-compute[75066]:         <format type='raw'/>
Dec 01 19:23:06 user nova-compute[75066]:         <source file='/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d'/>
Dec 01 19:23:06 user nova-compute[75066]:         <backingStore/>
Dec 01 19:23:06 user nova-compute[75066]:       </backingStore>
Dec 01 19:23:06 user nova-compute[75066]:       <target dev='vda' bus='virtio'/>
Dec 01 19:23:06 user nova-compute[75066]:       <alias name='virtio-disk0'/>
Dec 01 19:23:06 user nova-compute[75066]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Dec 01 19:23:06 user nova-compute[75066]:     </disk>
Dec 01 19:23:06 user nova-compute[75066]:     <disk type='file' device='cdrom'>
Dec 01 19:23:06 user nova-compute[75066]:       <driver name='qemu' type='raw' cache='none'/>
Dec 01 19:23:06 user nova-compute[75066]:       <source file='/opt/stack/data/nova/instances/998daa1d-fd6a-4663-8df3-0683a9dbe142/disk.config' index='1'/>
Dec 01 19:23:06 user nova-compute[75066]:       <backingStore/>
Dec 01 19:23:06 user nova-compute[75066]:       <target dev='hda' bus='ide'/>
Dec 01 19:23:06 user nova-compute[75066]:       <readonly/>
Dec 01 19:23:06 user nova-compute[75066]:       <alias name='ide0-0-0'/>
Dec 01 19:23:06 user nova-compute[75066]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Dec 01 19:23:06 user nova-compute[75066]:     </disk>
Dec 01 19:23:06 user nova-compute[75066]:     <controller type='usb' index='0' model='none'>
Dec 01 19:23:06 user nova-compute[75066]:       <alias name='usb'/>
Dec 01 19:23:06 user nova-compute[75066]:     </controller>
Dec 01 19:23:06 user nova-compute[75066]:     <controller type='pci' index='0' model='pci-root'>
Dec 01 19:23:06 user nova-compute[75066]:       <alias name='pci.0'/>
Dec 01 19:23:06 user nova-compute[75066]:     </controller>
Dec 01 19:23:06 user nova-compute[75066]:     <controller type='ide' index='0'>
Dec 01 19:23:06 user nova-compute[75066]:       <alias name='ide'/>
Dec 01 19:23:06 user nova-compute[75066]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Dec 01 19:23:06 user nova-compute[75066]:     </controller>
Dec 01 19:23:06 user nova-compute[75066]:     <interface type='ethernet'>
Dec 01 19:23:06 user nova-compute[75066]:       <mac address='fa:16:3e:10:62:79'/>
Dec 01 19:23:06 user nova-compute[75066]:       <target dev='tap2cf25213-8e'/>
Dec 01 19:23:06 user nova-compute[75066]:       <model type='virtio'/>
Dec 01 19:23:06 user nova-compute[75066]:       <mtu size='1442'/>
Dec 01 19:23:06 user nova-compute[75066]:       <alias name='net0'/>
Dec 01 19:23:06 user nova-compute[75066]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Dec 01 19:23:06 user nova-compute[75066]:     </interface>
Dec 01 19:23:06 user nova-compute[75066]:     <serial type='pty'>
Dec 01 19:23:06 user nova-compute[75066]:       <source path='/dev/pts/3'/>
Dec 01 19:23:06 user nova-compute[75066]:       <log file='/opt/stack/data/nova/instances/998daa1d-fd6a-4663-8df3-0683a9dbe142/console.log' append='off'/>
Dec 01 19:23:06 user nova-compute[75066]:       <target type='isa-serial' port='0'>
Dec 01 19:23:06 user nova-compute[75066]:         <model name='isa-serial'/>
Dec 01 19:23:06 user nova-compute[75066]:       </target>
Dec 01 19:23:06 user nova-compute[75066]:       <alias name='serial0'/>
Dec 01 19:23:06 user nova-compute[75066]:     </serial>
Dec 01 19:23:06 user nova-compute[75066]:     <console type='pty' tty='/dev/pts/3'>
Dec 01 19:23:06 user nova-compute[75066]:       <source path='/dev/pts/3'/>
Dec 01 19:23:06 user nova-compute[75066]:       <log file='/opt/stack/data/nova/instances/998daa1d-fd6a-4663-8df3-0683a9dbe142/console.log' append='off'/>
Dec 01 19:23:06 user nova-compute[75066]:       <target type='serial' port='0'/>
Dec 01 19:23:06 user nova-compute[75066]:       <alias name='serial0'/>
Dec 01 19:23:06 user nova-compute[75066]:     </console>
Dec 01 19:23:06 user nova-compute[75066]:     <input type='mouse' bus='ps2'>
Dec 01 19:23:06 user nova-compute[75066]:       <alias name='input0'/>
Dec 01 19:23:06 user nova-compute[75066]:     </input>
Dec 01 19:23:06 user nova-compute[75066]:     <input type='keyboard' bus='ps2'>
Dec 01 19:23:06 user nova-compute[75066]:       <alias name='input1'/>
Dec 01 19:23:06 user nova-compute[75066]:     </input>
Dec 01 19:23:06 user nova-compute[75066]:     <graphics type='vnc' port='5910' autoport='yes' listen='0.0.0.0'>
Dec 01 19:23:06 user nova-compute[75066]:       <listen type='address' address='0.0.0.0'/>
Dec 01 19:23:06 user nova-compute[75066]:     </graphics>
Dec 01 19:23:06 user nova-compute[75066]:     <audio id='1' type='none'/>
Dec 01 19:23:06 user nova-compute[75066]:     <video>
Dec 01 19:23:06 user nova-compute[75066]:       <model type='virtio' heads='1' primary='yes'/>
Dec 01 19:23:06 user nova-compute[75066]:       <alias name='video0'/>
Dec 01 19:23:06 user nova-compute[75066]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Dec 01 19:23:06 user nova-compute[75066]:     </video>
Dec 01 19:23:06 user nova-compute[75066]:     <memballoon model='virtio'>
Dec 01 19:23:06 user nova-compute[75066]:       <stats period='10'/>
Dec 01 19:23:06 user nova-compute[75066]:       <alias name='balloon0'/>
Dec 01 19:23:06 user nova-compute[75066]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Dec 01 19:23:06 user nova-compute[75066]:     </memballoon>
Dec 01 19:23:06 user nova-compute[75066]:     <rng model='virtio'>
Dec 01 19:23:06 user nova-compute[75066]:       <backend model='random'>/dev/urandom</backend>
Dec 01 19:23:06 user nova-compute[75066]:       <alias name='rng0'/>
Dec 01 19:23:06 user nova-compute[75066]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Dec 01 19:23:06 user nova-compute[75066]:     </rng>
Dec 01 19:23:06 user nova-compute[75066]:   </devices>
Dec 01 19:23:06 user nova-compute[75066]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Dec 01 19:23:06 user nova-compute[75066]:     <label>libvirt-998daa1d-fd6a-4663-8df3-0683a9dbe142</label>
Dec 01 19:23:06 user nova-compute[75066]:     <imagelabel>libvirt-998daa1d-fd6a-4663-8df3-0683a9dbe142</imagelabel>
Dec 01 19:23:06 user nova-compute[75066]:   </seclabel>
Dec 01 19:23:06 user nova-compute[75066]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Dec 01 19:23:06 user nova-compute[75066]:     <label>+64055:+108</label>
Dec 01 19:23:06 user nova-compute[75066]:     <imagelabel>+64055:+108</imagelabel>
Dec 01 19:23:06 user nova-compute[75066]:   </seclabel>
Dec 01 19:23:06 user nova-compute[75066]: </domain>
Dec 01 19:23:06 user nova-compute[75066]:  {{(pid=75066) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Dec 01 19:23:06 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [req-f02f8315-d86f-4acf-892a-86f91348a7f4 req-7403c94a-5d11-4947-84e7-7d4400c99ab8 service nova] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Detaching interface fa:16:3e:ce:51:6a failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapecbe6e20-85' not found.
Dec 01 19:23:06 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [req-f02f8315-d86f-4acf-892a-86f91348a7f4 req-7403c94a-5d11-4947-84e7-7d4400c99ab8 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T19:20:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-431772117',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-431772117',id=17,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDioMIKkD17rbLefUs+CoCe2YAF5MJyWmdGP5njQ+aDOavBc08qUchmFEEnBOz9qWRNoNrJTyhIak33m8ykbjamBmaBpbrxUKAYbxyiEVNdIL8zvksuJtx/Xi7sbDuD1AA==',key_name='tempest-keypair-1571650457',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:20:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0be461a2ee174f25bdbb451e49512e75',ramdisk_id='',reservation_id='r-ymwza3b4',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-687574292',owner_user_name='tempest-TaggedAttachmentsTest-687574292-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:20:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ae99d82b8bb499595aae2098059f478',uuid=998daa1d-fd6a-4663-8df3-0683a9dbe142,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ecbe6e20-8532-4496-8a4c-1151c3770cdc", "address": "fa:16:3e:ce:51:6a", "network": {"id": "cbb49fd2-4044-4aa7-b04c-c67d5521b682", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-188466014", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0be461a2ee174f25bdbb451e49512e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecbe6e20-85", "ovs_interfaceid": "ecbe6e20-8532-4496-8a4c-1151c3770cdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:23:06 user nova-compute[75066]: DEBUG nova.network.os_vif_util [req-f02f8315-d86f-4acf-892a-86f91348a7f4 req-7403c94a-5d11-4947-84e7-7d4400c99ab8 service nova] Converting VIF {"id": "ecbe6e20-8532-4496-8a4c-1151c3770cdc", "address": "fa:16:3e:ce:51:6a", "network": {"id": "cbb49fd2-4044-4aa7-b04c-c67d5521b682", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-188466014", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.51", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0be461a2ee174f25bdbb451e49512e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecbe6e20-85", "ovs_interfaceid": "ecbe6e20-8532-4496-8a4c-1151c3770cdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:23:06 user nova-compute[75066]: DEBUG nova.network.os_vif_util [req-f02f8315-d86f-4acf-892a-86f91348a7f4 req-7403c94a-5d11-4947-84e7-7d4400c99ab8 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:51:6a,bridge_name='br-int',has_traffic_filtering=True,id=ecbe6e20-8532-4496-8a4c-1151c3770cdc,network=Network(cbb49fd2-4044-4aa7-b04c-c67d5521b682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecbe6e20-85') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:23:06 user nova-compute[75066]: DEBUG os_vif [req-f02f8315-d86f-4acf-892a-86f91348a7f4 req-7403c94a-5d11-4947-84e7-7d4400c99ab8 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:51:6a,bridge_name='br-int',has_traffic_filtering=True,id=ecbe6e20-8532-4496-8a4c-1151c3770cdc,network=Network(cbb49fd2-4044-4aa7-b04c-c67d5521b682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecbe6e20-85') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:23:06 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:06 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapecbe6e20-85, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:23:06 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:23:06 user nova-compute[75066]: INFO os_vif [req-f02f8315-d86f-4acf-892a-86f91348a7f4 req-7403c94a-5d11-4947-84e7-7d4400c99ab8 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:51:6a,bridge_name='br-int',has_traffic_filtering=True,id=ecbe6e20-8532-4496-8a4c-1151c3770cdc,network=Network(cbb49fd2-4044-4aa7-b04c-c67d5521b682),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecbe6e20-85')
Dec 01 19:23:06 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [req-f02f8315-d86f-4acf-892a-86f91348a7f4 req-7403c94a-5d11-4947-84e7-7d4400c99ab8 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:23:06 user nova-compute[75066]:   <nova:package version="0.0.0"/>
Dec 01 19:23:06 user nova-compute[75066]:   <nova:name>tempest-device-tagging-server-431772117</nova:name>
Dec 01 19:23:06 user nova-compute[75066]:   <nova:creationTime>2023-12-01 19:23:06</nova:creationTime>
Dec 01 19:23:06 user nova-compute[75066]:   <nova:flavor name="m1.tiny">
Dec 01 19:23:06 user nova-compute[75066]:     <nova:memory>512</nova:memory>
Dec 01 19:23:06 user nova-compute[75066]:     <nova:disk>1</nova:disk>
Dec 01 19:23:06 user nova-compute[75066]:     <nova:swap>0</nova:swap>
Dec 01 19:23:06 user nova-compute[75066]:     <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:23:06 user nova-compute[75066]:     <nova:vcpus>1</nova:vcpus>
Dec 01 19:23:06 user nova-compute[75066]:   </nova:flavor>
Dec 01 19:23:06 user nova-compute[75066]:   <nova:owner>
Dec 01 19:23:06 user nova-compute[75066]:     <nova:user uuid="8ae99d82b8bb499595aae2098059f478">tempest-TaggedAttachmentsTest-687574292-project-member</nova:user>
Dec 01 19:23:06 user nova-compute[75066]:     <nova:project uuid="0be461a2ee174f25bdbb451e49512e75">tempest-TaggedAttachmentsTest-687574292</nova:project>
Dec 01 19:23:06 user nova-compute[75066]:   </nova:owner>
Dec 01 19:23:06 user nova-compute[75066]:   <nova:root type="image" uuid="900b237b-e99c-4fdd-a44f-dcb7a08baa86"/>
Dec 01 19:23:06 user nova-compute[75066]:   <nova:ports>
Dec 01 19:23:06 user nova-compute[75066]:     <nova:port uuid="2cf25213-8eec-4d19-bad6-b8e2fd905b3c">
Dec 01 19:23:06 user nova-compute[75066]:       <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Dec 01 19:23:06 user nova-compute[75066]:     </nova:port>
Dec 01 19:23:06 user nova-compute[75066]:   </nova:ports>
Dec 01 19:23:06 user nova-compute[75066]: </nova:instance>
Dec 01 19:23:06 user nova-compute[75066]:  {{(pid=75066) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Dec 01 19:23:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:06 user nova-compute[75066]: DEBUG nova.network.neutron [None req-bd4281d8-d389-4d30-9f5d-c111addff1c8 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Updating instance_info_cache with network_info: [{"id": "2cf25213-8eec-4d19-bad6-b8e2fd905b3c", "address": "fa:16:3e:10:62:79", "network": {"id": "13655709-cc3e-4378-850f-1eb7bc944811", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1907265443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0be461a2ee174f25bdbb451e49512e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf25213-8e", "ovs_interfaceid": "2cf25213-8eec-4d19-bad6-b8e2fd905b3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:23:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-bd4281d8-d389-4d30-9f5d-c111addff1c8 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Releasing lock "refresh_cache-998daa1d-fd6a-4663-8df3-0683a9dbe142" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:23:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-bd4281d8-d389-4d30-9f5d-c111addff1c8 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Lock "interface-998daa1d-fd6a-4663-8df3-0683a9dbe142-ecbe6e20-8532-4496-8a4c-1151c3770cdc" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.951s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:23:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d86a5a-c62e-41f7-9f33-1a0c61af6a49/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d86a5a-c62e-41f7-9f33-1a0c61af6a49/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d86a5a-c62e-41f7-9f33-1a0c61af6a49/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d86a5a-c62e-41f7-9f33-1a0c61af6a49/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:07 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:23:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/998daa1d-fd6a-4663-8df3-0683a9dbe142/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/998daa1d-fd6a-4663-8df3-0683a9dbe142/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/998daa1d-fd6a-4663-8df3-0683a9dbe142/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:07 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/998daa1d-fd6a-4663-8df3-0683a9dbe142/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d340166-c58b-4213-b8d3-5036ade48d2d/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d340166-c58b-4213-b8d3-5036ade48d2d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d340166-c58b-4213-b8d3-5036ade48d2d/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d340166-c58b-4213-b8d3-5036ade48d2d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:07 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:23:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08a362a4-9353-4139-afd4-1a24fcfa65a0/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08a362a4-9353-4139-afd4-1a24fcfa65a0/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08a362a4-9353-4139-afd4-1a24fcfa65a0/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08a362a4-9353-4139-afd4-1a24fcfa65a0/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:08 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:23:08 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:23:08 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Hypervisor/Node resource view: name=user free_ram=7076MB free_disk=25.066829681396484GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75066) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 19:23:08 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:23:08 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:23:08 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance c223be70-8b9c-46d4-9b5a-3b83dfc05a17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:23:08 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance c3ceeca4-c16c-4cf5-adfd-7d5a2925f435 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:23:08 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 90c49be6-97aa-45f1-bcbe-b9a3875226a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:23:08 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 3d340166-c58b-4213-b8d3-5036ade48d2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:23:08 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance dd546862-fcd5-4b69-8ea3-a8fa4859a489 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:23:08 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance b7d86a5a-c62e-41f7-9f33-1a0c61af6a49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:23:08 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance d564b128-598b-4ad4-8618-afa4dc8a7347 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:23:08 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 14de9d20-9e66-4517-b904-2967e0a06a97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:23:08 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 998daa1d-fd6a-4663-8df3-0683a9dbe142 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:23:08 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance a553e030-0d69-4725-9f84-6c0c63556ed4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:23:08 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 933210b1-5c5e-421a-9b63-4595fc5f5f25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:23:08 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:23:08 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 10fc72fa-64a3-4704-ad91-2e3ae88d5424 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:23:08 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 08a362a4-9353-4139-afd4-1a24fcfa65a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:23:08 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 19:23:08 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 19:23:09 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:23:09 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:23:09 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Compute_service record updated for user:user {{(pid=75066) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 19:23:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.546s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:23:10 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:23:10 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:23:10 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Starting heal instance info cache {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 19:23:10 user nova-compute[75066]: DEBUG nova.compute.manager [req-25033383-e303-4711-8d8d-fddf22105581 req-2bb75b1e-eb7d-4b98-bd61-4c0a55e72871 service nova] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Received event network-changed-171473a9-1228-4e96-b10f-c3d9a58b91eb {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:23:10 user nova-compute[75066]: DEBUG nova.compute.manager [req-25033383-e303-4711-8d8d-fddf22105581 req-2bb75b1e-eb7d-4b98-bd61-4c0a55e72871 service nova] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Refreshing instance network info cache due to event network-changed-171473a9-1228-4e96-b10f-c3d9a58b91eb. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:23:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-25033383-e303-4711-8d8d-fddf22105581 req-2bb75b1e-eb7d-4b98-bd61-4c0a55e72871 service nova] Acquiring lock "refresh_cache-933210b1-5c5e-421a-9b63-4595fc5f5f25" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:23:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-25033383-e303-4711-8d8d-fddf22105581 req-2bb75b1e-eb7d-4b98-bd61-4c0a55e72871 service nova] Acquired lock "refresh_cache-933210b1-5c5e-421a-9b63-4595fc5f5f25" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:23:10 user nova-compute[75066]: DEBUG nova.network.neutron [req-25033383-e303-4711-8d8d-fddf22105581 req-2bb75b1e-eb7d-4b98-bd61-4c0a55e72871 service nova] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Refreshing network info cache for port 171473a9-1228-4e96-b10f-c3d9a58b91eb {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:23:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "refresh_cache-c223be70-8b9c-46d4-9b5a-3b83dfc05a17" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:23:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquired lock "refresh_cache-c223be70-8b9c-46d4-9b5a-3b83dfc05a17" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:23:10 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Forcefully refreshing network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 19:23:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-2b0dcfa5-c11f-4aee-a20e-e124e3018a44 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Acquiring lock "933210b1-5c5e-421a-9b63-4595fc5f5f25" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:23:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-2b0dcfa5-c11f-4aee-a20e-e124e3018a44 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lock "933210b1-5c5e-421a-9b63-4595fc5f5f25" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:23:10 user nova-compute[75066]: DEBUG nova.objects.instance [None req-2b0dcfa5-c11f-4aee-a20e-e124e3018a44 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lazy-loading 'flavor' on Instance uuid 933210b1-5c5e-421a-9b63-4595fc5f5f25 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:23:10 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-2b0dcfa5-c11f-4aee-a20e-e124e3018a44 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Ignoring supplied device name: /dev/vdb
Dec 01 19:23:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-2b0dcfa5-c11f-4aee-a20e-e124e3018a44 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lock "933210b1-5c5e-421a-9b63-4595fc5f5f25" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:23:10 user nova-compute[75066]: DEBUG nova.network.neutron [req-25033383-e303-4711-8d8d-fddf22105581 req-2bb75b1e-eb7d-4b98-bd61-4c0a55e72871 service nova] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Updated VIF entry in instance network info cache for port 171473a9-1228-4e96-b10f-c3d9a58b91eb. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:23:10 user nova-compute[75066]: DEBUG nova.network.neutron [req-25033383-e303-4711-8d8d-fddf22105581 req-2bb75b1e-eb7d-4b98-bd61-4c0a55e72871 service nova] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Updating instance_info_cache with network_info: [{"id": "171473a9-1228-4e96-b10f-c3d9a58b91eb", "address": "fa:16:3e:09:a8:0f", "network": {"id": "195edf10-5722-4eef-b117-7a450e973afa", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2017280124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fb5b77e2da142499315e0a96f86d959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap171473a9-12", "ovs_interfaceid": "171473a9-1228-4e96-b10f-c3d9a58b91eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:23:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-25033383-e303-4711-8d8d-fddf22105581 req-2bb75b1e-eb7d-4b98-bd61-4c0a55e72871 service nova] Releasing lock "refresh_cache-933210b1-5c5e-421a-9b63-4595fc5f5f25" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:23:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-2b0dcfa5-c11f-4aee-a20e-e124e3018a44 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Acquiring lock "933210b1-5c5e-421a-9b63-4595fc5f5f25" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:23:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-2b0dcfa5-c11f-4aee-a20e-e124e3018a44 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lock "933210b1-5c5e-421a-9b63-4595fc5f5f25" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:23:10 user nova-compute[75066]: INFO nova.compute.manager [None req-2b0dcfa5-c11f-4aee-a20e-e124e3018a44 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Attaching volume 54688856-5adb-495a-91ae-7e593169bf98 to /dev/vdb
Dec 01 19:23:10 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Updating instance_info_cache with network_info: [{"id": "2698607a-e8b6-4da8-bfc7-90dc528ade6b", "address": "fa:16:3e:52:d6:e9", "network": {"id": "9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-696310557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0f7516d1db4dd5bc7d77a0bd1d44d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2698607a-e8", "ovs_interfaceid": "2698607a-e8b6-4da8-bfc7-90dc528ade6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:23:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Releasing lock "refresh_cache-c223be70-8b9c-46d4-9b5a-3b83dfc05a17" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:23:10 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Updated the network info_cache for instance {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 19:23:10 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:23:10 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:23:10 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:23:10 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75066) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 19:23:11 user nova-compute[75066]: DEBUG os_brick.utils [None req-2b0dcfa5-c11f-4aee-a20e-e124e3018a44 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:23:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:11 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[00772375-570c-4fce-b22a-c19ac2f564af]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1959854982f\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:23:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:11 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[05fc1dc3-f211-406a-a17c-6bcbc2a82ca9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:23:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:11 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f0254e-ebdb-4fc9-a7bb-ad570891a4aa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:23:11 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4691cf-0148-406f-b9c7-555aaa6b0138]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:23:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-2b0dcfa5-c11f-4aee-a20e-e124e3018a44 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Running cmd (subprocess): nvme version {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-2b0dcfa5-c11f-4aee-a20e-e124e3018a44 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] 'nvme version' failed. Not Retrying. {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:23:11 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2b0dcfa5-c11f-4aee-a20e-e124e3018a44 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] nvme not present on system {{(pid=75066) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 19:23:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:23:11 user nova-compute[75066]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 19:23:11 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b8f754-ae27-40a7-af62-35fb2419ad93]: (4, '') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:23:11 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-2b0dcfa5-c11f-4aee-a20e-e124e3018a44 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75066) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 19:23:11 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-2b0dcfa5-c11f-4aee-a20e-e124e3018a44 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 19:23:11 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-2b0dcfa5-c11f-4aee-a20e-e124e3018a44 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] LIGHTOS: no hostnqn found. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 19:23:11 user nova-compute[75066]: DEBUG os_brick.utils [None req-2b0dcfa5-c11f-4aee-a20e-e124e3018a44 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1959854982f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:23:11 user nova-compute[75066]: DEBUG nova.virt.block_device [None req-2b0dcfa5-c11f-4aee-a20e-e124e3018a44 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Updating existing volume attachment record: ddc86fca-fb5c-4372-a307-dc0e0d2eddca {{(pid=75066) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 19:23:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:17 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:18 user nova-compute[75066]: DEBUG nova.objects.instance [None req-32731755-bd32-46c9-9a77-a48da9a1cb8b tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lazy-loading 'flavor' on Instance uuid c3ceeca4-c16c-4cf5-adfd-7d5a2925f435 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:23:18 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-32731755-bd32-46c9-9a77-a48da9a1cb8b tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Acquiring lock "refresh_cache-c3ceeca4-c16c-4cf5-adfd-7d5a2925f435" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:23:18 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-32731755-bd32-46c9-9a77-a48da9a1cb8b tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Acquired lock "refresh_cache-c3ceeca4-c16c-4cf5-adfd-7d5a2925f435" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:23:18 user nova-compute[75066]: DEBUG nova.network.neutron [None req-32731755-bd32-46c9-9a77-a48da9a1cb8b tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:23:18 user nova-compute[75066]: DEBUG nova.objects.instance [None req-32731755-bd32-46c9-9a77-a48da9a1cb8b tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lazy-loading 'info_cache' on Instance uuid c3ceeca4-c16c-4cf5-adfd-7d5a2925f435 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:23:18 user nova-compute[75066]: DEBUG nova.objects.base [None req-32731755-bd32-46c9-9a77-a48da9a1cb8b tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Object Instance<c3ceeca4-c16c-4cf5-adfd-7d5a2925f435> lazy-loaded attributes: flavor,info_cache {{(pid=75066) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 19:23:19 user nova-compute[75066]: DEBUG nova.network.neutron [None req-32731755-bd32-46c9-9a77-a48da9a1cb8b tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Updating instance_info_cache with network_info: [{"id": "c9353199-d4a3-488f-857d-b0ebdb31a68f", "address": "fa:16:3e:d4:7c:91", "network": {"id": "4a6c6c26-4d29-486c-b11e-fc53769083ea", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1139388453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "492e0b2da61e4e4f9ea991df15531e24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9353199-d4", "ovs_interfaceid": "c9353199-d4a3-488f-857d-b0ebdb31a68f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:23:19 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-32731755-bd32-46c9-9a77-a48da9a1cb8b tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Releasing lock "refresh_cache-c3ceeca4-c16c-4cf5-adfd-7d5a2925f435" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:23:19 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Instance destroyed successfully.
Dec 01 19:23:19 user nova-compute[75066]: DEBUG nova.objects.instance [None req-32731755-bd32-46c9-9a77-a48da9a1cb8b tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lazy-loading 'resources' on Instance uuid c3ceeca4-c16c-4cf5-adfd-7d5a2925f435 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:23:19 user nova-compute[75066]: DEBUG nova.objects.base [None req-32731755-bd32-46c9-9a77-a48da9a1cb8b tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Object Instance<c3ceeca4-c16c-4cf5-adfd-7d5a2925f435> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75066) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 19:23:19 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-32731755-bd32-46c9-9a77-a48da9a1cb8b tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:15:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-24114443',display_name='tempest-AttachVolumeTestJSON-server-24114443',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-24114443',id=4,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGLScdrbjNBUKzk1xw2/kR+RAsIU9zFWMcYM+4wt8kIDoD28bEQj/IZzhB52jLd7ItVSKAdt9hCSnaKdaqoB8QmfEIsszcxk4SoK4okQhg235yQ27ClCZrLdhVk+g2LNPw==',key_name='tempest-keypair-1548189004',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:15:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='492e0b2da61e4e4f9ea991df15531e24',ramdisk_id='',reservation_id='r-f8zkyh7r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1914192398',owner_user_name='tempest-AttachVolumeTestJSON-1914192398-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:21:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e047112719c414d900ccb2adccf963a',uuid=c3ceeca4-c16c-4cf5-adfd-7d5a2925f435,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "c9353199-d4a3-488f-857d-b0ebdb31a68f", "address": "fa:16:3e:d4:7c:91", "network": {"id": "4a6c6c26-4d29-486c-b11e-fc53769083ea", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1139388453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "492e0b2da61e4e4f9ea991df15531e24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9353199-d4", "ovs_interfaceid": "c9353199-d4a3-488f-857d-b0ebdb31a68f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:23:19 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-32731755-bd32-46c9-9a77-a48da9a1cb8b tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Converting VIF {"id": "c9353199-d4a3-488f-857d-b0ebdb31a68f", "address": "fa:16:3e:d4:7c:91", "network": {"id": "4a6c6c26-4d29-486c-b11e-fc53769083ea", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1139388453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "492e0b2da61e4e4f9ea991df15531e24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9353199-d4", "ovs_interfaceid": "c9353199-d4a3-488f-857d-b0ebdb31a68f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:23:19 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-32731755-bd32-46c9-9a77-a48da9a1cb8b tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:7c:91,bridge_name='br-int',has_traffic_filtering=True,id=c9353199-d4a3-488f-857d-b0ebdb31a68f,network=Network(4a6c6c26-4d29-486c-b11e-fc53769083ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9353199-d4') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:23:19 user nova-compute[75066]: DEBUG os_vif [None req-32731755-bd32-46c9-9a77-a48da9a1cb8b tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:7c:91,bridge_name='br-int',has_traffic_filtering=True,id=c9353199-d4a3-488f-857d-b0ebdb31a68f,network=Network(4a6c6c26-4d29-486c-b11e-fc53769083ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9353199-d4') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:23:19 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:19 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc9353199-d4, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:23:19 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:19 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:19 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d2f9b8b9-6b1c-456f-8c1a-d5314127e66f) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:23:19 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:19 user nova-compute[75066]: INFO os_vif [None req-32731755-bd32-46c9-9a77-a48da9a1cb8b tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:7c:91,bridge_name='br-int',has_traffic_filtering=True,id=c9353199-d4a3-488f-857d-b0ebdb31a68f,network=Network(4a6c6c26-4d29-486c-b11e-fc53769083ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9353199-d4')
Dec 01 19:23:19 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-32731755-bd32-46c9-9a77-a48da9a1cb8b tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Start _get_guest_xml network_info=[{"id": "c9353199-d4a3-488f-857d-b0ebdb31a68f", "address": "fa:16:3e:d4:7c:91", "network": {"id": "4a6c6c26-4d29-486c-b11e-fc53769083ea", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1139388453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "492e0b2da61e4e4f9ea991df15531e24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9353199-d4", "ovs_interfaceid": "c9353199-d4a3-488f-857d-b0ebdb31a68f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'image_id': '900b237b-e99c-4fdd-a44f-dcb7a08baa86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:23:19 user nova-compute[75066]: DEBUG nova.objects.instance [None req-32731755-bd32-46c9-9a77-a48da9a1cb8b tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lazy-loading 'numa_topology' on Instance uuid c3ceeca4-c16c-4cf5-adfd-7d5a2925f435 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:23:19 user nova-compute[75066]: DEBUG nova.objects.base [None req-32731755-bd32-46c9-9a77-a48da9a1cb8b tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Object Instance<c3ceeca4-c16c-4cf5-adfd-7d5a2925f435> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75066) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 19:23:19 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-32731755-bd32-46c9-9a77-a48da9a1cb8b tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:23:19 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-32731755-bd32-46c9-9a77-a48da9a1cb8b tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:23:19 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-32731755-bd32-46c9-9a77-a48da9a1cb8b tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:23:19 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-32731755-bd32-46c9-9a77-a48da9a1cb8b tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:23:19 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-32731755-bd32-46c9-9a77-a48da9a1cb8b tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:23:19 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-32731755-bd32-46c9-9a77-a48da9a1cb8b tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:23:19 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-32731755-bd32-46c9-9a77-a48da9a1cb8b tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:23:19 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-32731755-bd32-46c9-9a77-a48da9a1cb8b tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:23:19 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-32731755-bd32-46c9-9a77-a48da9a1cb8b tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:23:19 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-32731755-bd32-46c9-9a77-a48da9a1cb8b tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:23:19 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-32731755-bd32-46c9-9a77-a48da9a1cb8b tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:23:19 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-32731755-bd32-46c9-9a77-a48da9a1cb8b tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:23:19 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-32731755-bd32-46c9-9a77-a48da9a1cb8b tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:23:19 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-32731755-bd32-46c9-9a77-a48da9a1cb8b tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:23:19 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-32731755-bd32-46c9-9a77-a48da9a1cb8b tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:23:19 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-32731755-bd32-46c9-9a77-a48da9a1cb8b tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:23:19 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-32731755-bd32-46c9-9a77-a48da9a1cb8b tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:23:19 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-32731755-bd32-46c9-9a77-a48da9a1cb8b tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:23:19 user nova-compute[75066]: DEBUG nova.objects.instance [None req-32731755-bd32-46c9-9a77-a48da9a1cb8b tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lazy-loading 'vcpu_model' on Instance uuid c3ceeca4-c16c-4cf5-adfd-7d5a2925f435 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:23:19 user nova-compute[75066]: DEBUG nova.objects.base [None req-32731755-bd32-46c9-9a77-a48da9a1cb8b tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Object Instance<c3ceeca4-c16c-4cf5-adfd-7d5a2925f435> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75066) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 19:23:19 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-32731755-bd32-46c9-9a77-a48da9a1cb8b tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:15:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-24114443',display_name='tempest-AttachVolumeTestJSON-server-24114443',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-24114443',id=4,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGLScdrbjNBUKzk1xw2/kR+RAsIU9zFWMcYM+4wt8kIDoD28bEQj/IZzhB52jLd7ItVSKAdt9hCSnaKdaqoB8QmfEIsszcxk4SoK4okQhg235yQ27ClCZrLdhVk+g2LNPw==',key_name='tempest-keypair-1548189004',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:15:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='492e0b2da61e4e4f9ea991df15531e24',ramdisk_id='',reservation_id='r-f8zkyh7r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1914192398',owner_user_name='tempest-AttachVolumeTestJSON-1914192398-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:21:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e047112719c414d900ccb2adccf963a',uuid=c3ceeca4-c16c-4cf5-adfd-7d5a2925f435,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "c9353199-d4a3-488f-857d-b0ebdb31a68f", "address": "fa:16:3e:d4:7c:91", "network": {"id": "4a6c6c26-4d29-486c-b11e-fc53769083ea", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1139388453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "492e0b2da61e4e4f9ea991df15531e24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9353199-d4", "ovs_interfaceid": "c9353199-d4a3-488f-857d-b0ebdb31a68f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:23:19 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-32731755-bd32-46c9-9a77-a48da9a1cb8b tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Converting VIF {"id": "c9353199-d4a3-488f-857d-b0ebdb31a68f", "address": "fa:16:3e:d4:7c:91", "network": {"id": "4a6c6c26-4d29-486c-b11e-fc53769083ea", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1139388453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "492e0b2da61e4e4f9ea991df15531e24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9353199-d4", "ovs_interfaceid": "c9353199-d4a3-488f-857d-b0ebdb31a68f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:23:19 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-32731755-bd32-46c9-9a77-a48da9a1cb8b tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:7c:91,bridge_name='br-int',has_traffic_filtering=True,id=c9353199-d4a3-488f-857d-b0ebdb31a68f,network=Network(4a6c6c26-4d29-486c-b11e-fc53769083ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9353199-d4') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:23:19 user nova-compute[75066]: DEBUG nova.objects.instance [None req-32731755-bd32-46c9-9a77-a48da9a1cb8b tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lazy-loading 'pci_devices' on Instance uuid c3ceeca4-c16c-4cf5-adfd-7d5a2925f435 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:23:19 user nova-compute[75066]: DEBUG nova.objects.base [None req-32731755-bd32-46c9-9a77-a48da9a1cb8b tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Object Instance<c3ceeca4-c16c-4cf5-adfd-7d5a2925f435> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75066) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 19:23:19 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-32731755-bd32-46c9-9a77-a48da9a1cb8b tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:23:19 user nova-compute[75066]:   <uuid>c3ceeca4-c16c-4cf5-adfd-7d5a2925f435</uuid>
Dec 01 19:23:19 user nova-compute[75066]:   <name>instance-00000004</name>
Dec 01 19:23:19 user nova-compute[75066]:   <memory>524288</memory>
Dec 01 19:23:19 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:23:19 user nova-compute[75066]:   <metadata>
Dec 01 19:23:19 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:23:19 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:23:19 user nova-compute[75066]:       <nova:name>tempest-AttachVolumeTestJSON-server-24114443</nova:name>
Dec 01 19:23:19 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:23:19</nova:creationTime>
Dec 01 19:23:19 user nova-compute[75066]:       <nova:flavor name="m1.tiny">
Dec 01 19:23:19 user nova-compute[75066]:         <nova:memory>512</nova:memory>
Dec 01 19:23:19 user nova-compute[75066]:         <nova:disk>1</nova:disk>
Dec 01 19:23:19 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:23:19 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:23:19 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:23:19 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:23:19 user nova-compute[75066]:       <nova:owner>
Dec 01 19:23:19 user nova-compute[75066]:         <nova:user uuid="2e047112719c414d900ccb2adccf963a">tempest-AttachVolumeTestJSON-1914192398-project-member</nova:user>
Dec 01 19:23:19 user nova-compute[75066]:         <nova:project uuid="492e0b2da61e4e4f9ea991df15531e24">tempest-AttachVolumeTestJSON-1914192398</nova:project>
Dec 01 19:23:19 user nova-compute[75066]:       </nova:owner>
Dec 01 19:23:19 user nova-compute[75066]:       <nova:root type="image" uuid="900b237b-e99c-4fdd-a44f-dcb7a08baa86"/>
Dec 01 19:23:19 user nova-compute[75066]:       <nova:ports>
Dec 01 19:23:19 user nova-compute[75066]:         <nova:port uuid="c9353199-d4a3-488f-857d-b0ebdb31a68f">
Dec 01 19:23:19 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 01 19:23:19 user nova-compute[75066]:         </nova:port>
Dec 01 19:23:19 user nova-compute[75066]:       </nova:ports>
Dec 01 19:23:19 user nova-compute[75066]:     </nova:instance>
Dec 01 19:23:19 user nova-compute[75066]:   </metadata>
Dec 01 19:23:19 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:23:19 user nova-compute[75066]:     <system>
Dec 01 19:23:19 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:23:19 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:23:19 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:23:19 user nova-compute[75066]:       <entry name="serial">c3ceeca4-c16c-4cf5-adfd-7d5a2925f435</entry>
Dec 01 19:23:19 user nova-compute[75066]:       <entry name="uuid">c3ceeca4-c16c-4cf5-adfd-7d5a2925f435</entry>
Dec 01 19:23:19 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:23:19 user nova-compute[75066]:     </system>
Dec 01 19:23:19 user nova-compute[75066]:   </sysinfo>
Dec 01 19:23:19 user nova-compute[75066]:   <os>
Dec 01 19:23:19 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:23:19 user nova-compute[75066]:     <boot dev="hd"/>
Dec 01 19:23:19 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:23:19 user nova-compute[75066]:   </os>
Dec 01 19:23:19 user nova-compute[75066]:   <features>
Dec 01 19:23:19 user nova-compute[75066]:     <acpi/>
Dec 01 19:23:19 user nova-compute[75066]:     <apic/>
Dec 01 19:23:19 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:23:19 user nova-compute[75066]:   </features>
Dec 01 19:23:19 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:23:19 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:23:19 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:23:19 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:23:19 user nova-compute[75066]:   </clock>
Dec 01 19:23:19 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:23:19 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:23:19 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:23:19 user nova-compute[75066]:   </cpu>
Dec 01 19:23:19 user nova-compute[75066]:   <devices>
Dec 01 19:23:19 user nova-compute[75066]:     <disk type="file" device="disk">
Dec 01 19:23:19 user nova-compute[75066]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 19:23:19 user nova-compute[75066]:       <source file="/opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk"/>
Dec 01 19:23:19 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:23:19 user nova-compute[75066]:     </disk>
Dec 01 19:23:19 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:23:19 user nova-compute[75066]:       <mac address="fa:16:3e:d4:7c:91"/>
Dec 01 19:23:19 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:23:19 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:23:19 user nova-compute[75066]:       <target dev="tapc9353199-d4"/>
Dec 01 19:23:19 user nova-compute[75066]:     </interface>
Dec 01 19:23:19 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:23:19 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/console.log" append="off"/>
Dec 01 19:23:19 user nova-compute[75066]:     </serial>
Dec 01 19:23:19 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:23:19 user nova-compute[75066]:     <video>
Dec 01 19:23:19 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:23:19 user nova-compute[75066]:     </video>
Dec 01 19:23:19 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:23:19 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:23:19 user nova-compute[75066]:     </rng>
Dec 01 19:23:19 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:23:19 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:23:19 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:23:19 user nova-compute[75066]:     </memballoon>
Dec 01 19:23:19 user nova-compute[75066]:   </devices>
Dec 01 19:23:19 user nova-compute[75066]: </domain>
Dec 01 19:23:19 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:23:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-32731755-bd32-46c9-9a77-a48da9a1cb8b tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:19 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-32731755-bd32-46c9-9a77-a48da9a1cb8b tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-32731755-bd32-46c9-9a77-a48da9a1cb8b tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-32731755-bd32-46c9-9a77-a48da9a1cb8b tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:19 user nova-compute[75066]: DEBUG nova.objects.instance [None req-32731755-bd32-46c9-9a77-a48da9a1cb8b tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lazy-loading 'trusted_certs' on Instance uuid c3ceeca4-c16c-4cf5-adfd-7d5a2925f435 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:23:19 user nova-compute[75066]: DEBUG nova.objects.base [None req-32731755-bd32-46c9-9a77-a48da9a1cb8b tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Object Instance<c3ceeca4-c16c-4cf5-adfd-7d5a2925f435> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75066) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 19:23:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-32731755-bd32-46c9-9a77-a48da9a1cb8b tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-32731755-bd32-46c9-9a77-a48da9a1cb8b tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.176s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:20 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-32731755-bd32-46c9-9a77-a48da9a1cb8b tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk. size=1073741824 {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 19:23:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-32731755-bd32-46c9-9a77-a48da9a1cb8b tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-32731755-bd32-46c9-9a77-a48da9a1cb8b tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:20 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-32731755-bd32-46c9-9a77-a48da9a1cb8b tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Cannot resize image /opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk to a smaller size. {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 19:23:20 user nova-compute[75066]: DEBUG nova.objects.instance [None req-32731755-bd32-46c9-9a77-a48da9a1cb8b tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lazy-loading 'migration_context' on Instance uuid c3ceeca4-c16c-4cf5-adfd-7d5a2925f435 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:23:20 user nova-compute[75066]: DEBUG nova.objects.base [None req-32731755-bd32-46c9-9a77-a48da9a1cb8b tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Object Instance<c3ceeca4-c16c-4cf5-adfd-7d5a2925f435> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75066) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 19:23:20 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-32731755-bd32-46c9-9a77-a48da9a1cb8b tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:15:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-24114443',display_name='tempest-AttachVolumeTestJSON-server-24114443',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-24114443',id=4,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGLScdrbjNBUKzk1xw2/kR+RAsIU9zFWMcYM+4wt8kIDoD28bEQj/IZzhB52jLd7ItVSKAdt9hCSnaKdaqoB8QmfEIsszcxk4SoK4okQhg235yQ27ClCZrLdhVk+g2LNPw==',key_name='tempest-keypair-1548189004',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:15:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='492e0b2da61e4e4f9ea991df15531e24',ramdisk_id='',reservation_id='r-f8zkyh7r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1914192398',owner_user_name='tempest-AttachVolumeTestJSON-1914192398-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:21:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e047112719c414d900ccb2adccf963a',uuid=c3ceeca4-c16c-4cf5-adfd-7d5a2925f435,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "c9353199-d4a3-488f-857d-b0ebdb31a68f", "address": "fa:16:3e:d4:7c:91", "network": {"id": "4a6c6c26-4d29-486c-b11e-fc53769083ea", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1139388453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "492e0b2da61e4e4f9ea991df15531e24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9353199-d4", "ovs_interfaceid": "c9353199-d4a3-488f-857d-b0ebdb31a68f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:23:20 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-32731755-bd32-46c9-9a77-a48da9a1cb8b tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Converting VIF {"id": "c9353199-d4a3-488f-857d-b0ebdb31a68f", "address": "fa:16:3e:d4:7c:91", "network": {"id": "4a6c6c26-4d29-486c-b11e-fc53769083ea", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1139388453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "492e0b2da61e4e4f9ea991df15531e24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9353199-d4", "ovs_interfaceid": "c9353199-d4a3-488f-857d-b0ebdb31a68f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:23:20 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-32731755-bd32-46c9-9a77-a48da9a1cb8b tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:7c:91,bridge_name='br-int',has_traffic_filtering=True,id=c9353199-d4a3-488f-857d-b0ebdb31a68f,network=Network(4a6c6c26-4d29-486c-b11e-fc53769083ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9353199-d4') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:23:20 user nova-compute[75066]: DEBUG os_vif [None req-32731755-bd32-46c9-9a77-a48da9a1cb8b tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:7c:91,bridge_name='br-int',has_traffic_filtering=True,id=c9353199-d4a3-488f-857d-b0ebdb31a68f,network=Network(4a6c6c26-4d29-486c-b11e-fc53769083ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9353199-d4') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:23:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:23:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:23:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0408b5d0-0c90-551f-96b6-b0660c946d93', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:23:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:23:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc9353199-d4, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:23:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc9353199-d4, col_values=(('qos', UUID('1707aec9-e665-4473-bc71-c65fb9f00063')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:23:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc9353199-d4, col_values=(('external_ids', {'iface-id': 'c9353199-d4a3-488f-857d-b0ebdb31a68f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:7c:91', 'vm-uuid': 'c3ceeca4-c16c-4cf5-adfd-7d5a2925f435'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:23:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:23:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:20 user nova-compute[75066]: INFO os_vif [None req-32731755-bd32-46c9-9a77-a48da9a1cb8b tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:7c:91,bridge_name='br-int',has_traffic_filtering=True,id=c9353199-d4a3-488f-857d-b0ebdb31a68f,network=Network(4a6c6c26-4d29-486c-b11e-fc53769083ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9353199-d4')
Dec 01 19:23:20 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b0dcfa5-c11f-4aee-a20e-e124e3018a44 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Calling os-brick to attach iSCSI Volume {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 19:23:20 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0dcfa5-c11f-4aee-a20e-e124e3018a44 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bciFqMWC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:23:20 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-2b0dcfa5-c11f-4aee-a20e-e124e3018a44 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:23:20 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-2b0dcfa5-c11f-4aee-a20e-e124e3018a44 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:23:20 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-2b0dcfa5-c11f-4aee-a20e-e124e3018a44 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:23:20 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-2b0dcfa5-c11f-4aee-a20e-e124e3018a44 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:23:20 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-2b0dcfa5-c11f-4aee-a20e-e124e3018a44 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:23:20 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-2b0dcfa5-c11f-4aee-a20e-e124e3018a44 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:23:20 user nova-compute[75066]: INFO os_brick.initiator.connectors.iscsi [None req-2b0dcfa5-c11f-4aee-a20e-e124e3018a44 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 19:23:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98 -p 172.16.0.220:3260 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:20 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[8235dfea-81fe-449a-b04d-e17acc244a49]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:23:20 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0dcfa5-c11f-4aee-a20e-e124e3018a44 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 19:23:20 user nova-compute[75066]:  {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:23:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98 -p 172.16.0.220:3260 --interface default --op new {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:20 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bee0947-296c-4a78-b5b6-f36206cf98ce]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98] added\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:23:20 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0dcfa5-c11f-4aee-a20e-e124e3018a44 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98] added
Dec 01 19:23:20 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:23:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:20 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[efce643c-64cc-4ab0-9804-7789a87cb2e2]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:23:20 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0dcfa5-c11f-4aee-a20e-e124e3018a44 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:23:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:20 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dfac980-be9c-45fb-b9bb-ecefc761782b]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:23:20 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0dcfa5-c11f-4aee-a20e-e124e3018a44 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:23:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bciFqMWC {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bciFqMWC" returned: 0 in 0.023s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:20 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[6357241d-a872-44ff-b17c-a098ecd3600e]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:23:20 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0dcfa5-c11f-4aee-a20e-e124e3018a44 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bciFqMWC'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:23:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:21 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[37629fcd-ff9f-42c6-be4b-24d22bf94436]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:23:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0dcfa5-c11f-4aee-a20e-e124e3018a44 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:23:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:21 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93ce3f3-11a8-4d3d-8556-1ddaf344bae8]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:23:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0dcfa5-c11f-4aee-a20e-e124e3018a44 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)
Dec 01 19:23:21 user nova-compute[75066]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)
Dec 01 19:23:21 user nova-compute[75066]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:23:21 user nova-compute[75066]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)
Dec 01 19:23:21 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:23:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0dcfa5-c11f-4aee-a20e-e124e3018a44 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)
Dec 01 19:23:21 user nova-compute[75066]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)
Dec 01 19:23:21 user nova-compute[75066]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:23:21 user nova-compute[75066]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)
Dec 01 19:23:21 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:23:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98 -p 172.16.0.220:3260 --login {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:21 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb32ac0-cf67-491f-9265-90e7f5ca797d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:23:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0dcfa5-c11f-4aee-a20e-e124e3018a44 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98, portal: 172.16.0.220,3260]
Dec 01 19:23:21 user nova-compute[75066]: Login to [iface: default, target: iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98, portal: 172.16.0.220,3260] successful.
Dec 01 19:23:21 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:23:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:21 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3bb69a8-cf28-42a9-981c-776571675d51]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:23:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0dcfa5-c11f-4aee-a20e-e124e3018a44 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:23:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:21 user nova-compute[75066]: INFO nova.compute.manager [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Rescuing
Dec 01 19:23:21 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Acquiring lock "refresh_cache-905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:23:21 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Acquired lock "refresh_cache-905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:23:21 user nova-compute[75066]: DEBUG nova.network.neutron [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:23:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:21 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[617055a5-c460-4d54-80f8-d34bb77a9650]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:23:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0dcfa5-c11f-4aee-a20e-e124e3018a44 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)
Dec 01 19:23:21 user nova-compute[75066]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)
Dec 01 19:23:21 user nova-compute[75066]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:23:21 user nova-compute[75066]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)
Dec 01 19:23:21 user nova-compute[75066]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98 (non-flash)
Dec 01 19:23:21 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:23:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0dcfa5-c11f-4aee-a20e-e124e3018a44 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)
Dec 01 19:23:21 user nova-compute[75066]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)
Dec 01 19:23:21 user nova-compute[75066]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:23:21 user nova-compute[75066]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)
Dec 01 19:23:21 user nova-compute[75066]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98 (non-flash)
Dec 01 19:23:21 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:23:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-2b0dcfa5-c11f-4aee-a20e-e124e3018a44 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:23:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0dcfa5-c11f-4aee-a20e-e124e3018a44 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Connected to 172.16.0.220:3260 {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 19:23:21 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-2b0dcfa5-c11f-4aee-a20e-e124e3018a44 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=75066) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 19:23:21 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-2b0dcfa5-c11f-4aee-a20e-e124e3018a44 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75066) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 19:23:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:21 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d234f4-dc56-49c4-92e5-a2b9a41406ad]: (4, ('- - 0', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:23:21 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-2b0dcfa5-c11f-4aee-a20e-e124e3018a44 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:23:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0dcfa5-c11f-4aee-a20e-e124e3018a44 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bciFqMWC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 19:23:21 user nova-compute[75066]: DEBUG nova.network.neutron [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Updating instance_info_cache with network_info: [{"id": "6c41fc1e-7ed5-490d-a375-0db34c7ae40b", "address": "fa:16:3e:ed:e9:7c", "network": {"id": "6b0f48b7-3db2-49b2-a238-8fd811b52d62", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1688127634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e000d89bca44cd8acba504256d8d1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c41fc1e-7e", "ovs_interfaceid": "6c41fc1e-7ed5-490d-a375-0db34c7ae40b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:23:21 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:21 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Releasing lock "refresh_cache-905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:23:21 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:21 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:21 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:21 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:21 user nova-compute[75066]: DEBUG nova.compute.manager [req-5c7335d6-5d2f-4be9-ab94-0ef68e5ffb5d req-d3a58301-3f23-49ba-aa62-588dc2273f5c service nova] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Received event network-vif-plugged-c9353199-d4a3-488f-857d-b0ebdb31a68f {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:23:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-5c7335d6-5d2f-4be9-ab94-0ef68e5ffb5d req-d3a58301-3f23-49ba-aa62-588dc2273f5c service nova] Acquiring lock "c3ceeca4-c16c-4cf5-adfd-7d5a2925f435-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:23:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-5c7335d6-5d2f-4be9-ab94-0ef68e5ffb5d req-d3a58301-3f23-49ba-aa62-588dc2273f5c service nova] Lock "c3ceeca4-c16c-4cf5-adfd-7d5a2925f435-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:23:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-5c7335d6-5d2f-4be9-ab94-0ef68e5ffb5d req-d3a58301-3f23-49ba-aa62-588dc2273f5c service nova] Lock "c3ceeca4-c16c-4cf5-adfd-7d5a2925f435-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:23:22 user nova-compute[75066]: DEBUG nova.compute.manager [req-5c7335d6-5d2f-4be9-ab94-0ef68e5ffb5d req-d3a58301-3f23-49ba-aa62-588dc2273f5c service nova] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] No waiting events found dispatching network-vif-plugged-c9353199-d4a3-488f-857d-b0ebdb31a68f {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:23:22 user nova-compute[75066]: WARNING nova.compute.manager [req-5c7335d6-5d2f-4be9-ab94-0ef68e5ffb5d req-d3a58301-3f23-49ba-aa62-588dc2273f5c service nova] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Received unexpected event network-vif-plugged-c9353199-d4a3-488f-857d-b0ebdb31a68f for instance with vm_state stopped and task_state powering-on.
Dec 01 19:23:22 user nova-compute[75066]: DEBUG nova.compute.manager [req-b15a6dad-ba76-4ae6-beba-eb0d99536544 req-48ad58f7-3033-479c-b7cf-4ef6c6f9cfac service nova] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Received event network-vif-unplugged-6c41fc1e-7ed5-490d-a375-0db34c7ae40b {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:23:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-b15a6dad-ba76-4ae6-beba-eb0d99536544 req-48ad58f7-3033-479c-b7cf-4ef6c6f9cfac service nova] Acquiring lock "905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:23:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-b15a6dad-ba76-4ae6-beba-eb0d99536544 req-48ad58f7-3033-479c-b7cf-4ef6c6f9cfac service nova] Lock "905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:23:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-b15a6dad-ba76-4ae6-beba-eb0d99536544 req-48ad58f7-3033-479c-b7cf-4ef6c6f9cfac service nova] Lock "905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:23:22 user nova-compute[75066]: DEBUG nova.compute.manager [req-b15a6dad-ba76-4ae6-beba-eb0d99536544 req-48ad58f7-3033-479c-b7cf-4ef6c6f9cfac service nova] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] No waiting events found dispatching network-vif-unplugged-6c41fc1e-7ed5-490d-a375-0db34c7ae40b {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:23:22 user nova-compute[75066]: WARNING nova.compute.manager [req-b15a6dad-ba76-4ae6-beba-eb0d99536544 req-48ad58f7-3033-479c-b7cf-4ef6c6f9cfac service nova] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Received unexpected event network-vif-unplugged-6c41fc1e-7ed5-490d-a375-0db34c7ae40b for instance with vm_state active and task_state rescuing.
Dec 01 19:23:22 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-2b0dcfa5-c11f-4aee-a20e-e124e3018a44 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:23:22 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b0dcfa5-c11f-4aee-a20e-e124e3018a44 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '26135636439353939', 'path': '/dev/sdc'} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:23:22 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b0dcfa5-c11f-4aee-a20e-e124e3018a44 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135636439353939', 'path': '/dev/sdc'} {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 19:23:22 user nova-compute[75066]: DEBUG nova.objects.instance [None req-2b0dcfa5-c11f-4aee-a20e-e124e3018a44 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lazy-loading 'flavor' on Instance uuid 933210b1-5c5e-421a-9b63-4595fc5f5f25 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:23:22 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-2b0dcfa5-c11f-4aee-a20e-e124e3018a44 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 19:23:22 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:23:22 user nova-compute[75066]:   <source dev="/dev/sdc"/>
Dec 01 19:23:22 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:23:22 user nova-compute[75066]:   <serial>54688856-5adb-495a-91ae-7e593169bf98</serial>
Dec 01 19:23:22 user nova-compute[75066]: </disk>
Dec 01 19:23:22 user nova-compute[75066]:  {{(pid=75066) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 19:23:22 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:22 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:22 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:22 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:22 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:22 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:22 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:22 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:22 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Instance destroyed successfully.
Dec 01 19:23:22 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Attempting a stable device rescue
Dec 01 19:23:22 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75066) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4314}}
Dec 01 19:23:22 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Instance directory exists: not creating {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4719}}
Dec 01 19:23:22 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Creating image(s)
Dec 01 19:23:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Acquiring lock "/opt/stack/data/nova/instances/905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:23:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "/opt/stack/data/nova/instances/905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:23:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "/opt/stack/data/nova/instances/905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:23:22 user nova-compute[75066]: DEBUG nova.objects.instance [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lazy-loading 'trusted_certs' on Instance uuid 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:23:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Acquiring lock "9bbb263f5c46f59f5f5cb5bdb1912b4b119eab4d" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:23:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "9bbb263f5c46f59f5f5cb5bdb1912b4b119eab4d" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:23:22 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-2b0dcfa5-c11f-4aee-a20e-e124e3018a44 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:23:22 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-2b0dcfa5-c11f-4aee-a20e-e124e3018a44 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:23:22 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-2b0dcfa5-c11f-4aee-a20e-e124e3018a44 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] No VIF found with MAC fa:16:3e:09:a8:0f, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:23:23 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bbb263f5c46f59f5f5cb5bdb1912b4b119eab4d.part --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:23 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-2b0dcfa5-c11f-4aee-a20e-e124e3018a44 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lock "933210b1-5c5e-421a-9b63-4595fc5f5f25" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.792s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:23:23 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bbb263f5c46f59f5f5cb5bdb1912b4b119eab4d.part --force-share --output=json" returned: 0 in 0.183s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:23 user nova-compute[75066]: DEBUG nova.virt.images [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] 876668a5-f5da-49c9-b7e0-8046bda76842 was qcow2, converting to raw {{(pid=75066) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 01 19:23:23 user nova-compute[75066]: DEBUG nova.privsep.utils [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75066) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 01 19:23:23 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9bbb263f5c46f59f5f5cb5bdb1912b4b119eab4d.part /opt/stack/data/nova/instances/_base/9bbb263f5c46f59f5f5cb5bdb1912b4b119eab4d.converted {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:24 user nova-compute[75066]: DEBUG nova.compute.manager [None req-32731755-bd32-46c9-9a77-a48da9a1cb8b tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Instance event wait completed in 0 seconds for  {{(pid=75066) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 19:23:24 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Instance rebooted successfully.
Dec 01 19:23:24 user nova-compute[75066]: DEBUG nova.compute.manager [None req-32731755-bd32-46c9-9a77-a48da9a1cb8b tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:23:24 user nova-compute[75066]: DEBUG nova.compute.manager [req-cb650791-01c2-42f3-b1c9-2acb7ed7fd4c req-c8670275-4a09-4416-a458-9b304335f8b5 service nova] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Received event network-vif-plugged-c9353199-d4a3-488f-857d-b0ebdb31a68f {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:23:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-cb650791-01c2-42f3-b1c9-2acb7ed7fd4c req-c8670275-4a09-4416-a458-9b304335f8b5 service nova] Acquiring lock "c3ceeca4-c16c-4cf5-adfd-7d5a2925f435-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:23:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-cb650791-01c2-42f3-b1c9-2acb7ed7fd4c req-c8670275-4a09-4416-a458-9b304335f8b5 service nova] Lock "c3ceeca4-c16c-4cf5-adfd-7d5a2925f435-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:23:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-cb650791-01c2-42f3-b1c9-2acb7ed7fd4c req-c8670275-4a09-4416-a458-9b304335f8b5 service nova] Lock "c3ceeca4-c16c-4cf5-adfd-7d5a2925f435-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:23:24 user nova-compute[75066]: DEBUG nova.compute.manager [req-cb650791-01c2-42f3-b1c9-2acb7ed7fd4c req-c8670275-4a09-4416-a458-9b304335f8b5 service nova] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] No waiting events found dispatching network-vif-plugged-c9353199-d4a3-488f-857d-b0ebdb31a68f {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:23:24 user nova-compute[75066]: WARNING nova.compute.manager [req-cb650791-01c2-42f3-b1c9-2acb7ed7fd4c req-c8670275-4a09-4416-a458-9b304335f8b5 service nova] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Received unexpected event network-vif-plugged-c9353199-d4a3-488f-857d-b0ebdb31a68f for instance with vm_state stopped and task_state powering-on.
Dec 01 19:23:24 user nova-compute[75066]: DEBUG nova.compute.manager [req-7ae7871b-16f8-4e93-85db-be1062f7a8ba req-fa03c06f-e053-4013-b55d-c833bcda0d49 service nova] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Received event network-vif-plugged-6c41fc1e-7ed5-490d-a375-0db34c7ae40b {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:23:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-7ae7871b-16f8-4e93-85db-be1062f7a8ba req-fa03c06f-e053-4013-b55d-c833bcda0d49 service nova] Acquiring lock "905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:23:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-7ae7871b-16f8-4e93-85db-be1062f7a8ba req-fa03c06f-e053-4013-b55d-c833bcda0d49 service nova] Lock "905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:23:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-7ae7871b-16f8-4e93-85db-be1062f7a8ba req-fa03c06f-e053-4013-b55d-c833bcda0d49 service nova] Lock "905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:23:24 user nova-compute[75066]: DEBUG nova.compute.manager [req-7ae7871b-16f8-4e93-85db-be1062f7a8ba req-fa03c06f-e053-4013-b55d-c833bcda0d49 service nova] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] No waiting events found dispatching network-vif-plugged-6c41fc1e-7ed5-490d-a375-0db34c7ae40b {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:23:24 user nova-compute[75066]: WARNING nova.compute.manager [req-7ae7871b-16f8-4e93-85db-be1062f7a8ba req-fa03c06f-e053-4013-b55d-c833bcda0d49 service nova] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Received unexpected event network-vif-plugged-6c41fc1e-7ed5-490d-a375-0db34c7ae40b for instance with vm_state active and task_state rescuing.
Dec 01 19:23:24 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9bbb263f5c46f59f5f5cb5bdb1912b4b119eab4d.part /opt/stack/data/nova/instances/_base/9bbb263f5c46f59f5f5cb5bdb1912b4b119eab4d.converted" returned: 0 in 0.401s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:24 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bbb263f5c46f59f5f5cb5bdb1912b4b119eab4d.converted --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:24 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bbb263f5c46f59f5f5cb5bdb1912b4b119eab4d.converted --force-share --output=json" returned: 0 in 0.174s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "9bbb263f5c46f59f5f5cb5bdb1912b4b119eab4d" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.558s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:23:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Acquiring lock "9bbb263f5c46f59f5f5cb5bdb1912b4b119eab4d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:23:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "9bbb263f5c46f59f5f5cb5bdb1912b4b119eab4d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:23:24 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bbb263f5c46f59f5f5cb5bdb1912b4b119eab4d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:24 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9bbb263f5c46f59f5f5cb5bdb1912b4b119eab4d --force-share --output=json" returned: 0 in 0.177s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:24 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bbb263f5c46f59f5f5cb5bdb1912b4b119eab4d,backing_fmt=raw /opt/stack/data/nova/instances/905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436/disk.rescue {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:24 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9bbb263f5c46f59f5f5cb5bdb1912b4b119eab4d,backing_fmt=raw /opt/stack/data/nova/instances/905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436/disk.rescue" returned: 0 in 0.054s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "9bbb263f5c46f59f5f5cb5bdb1912b4b119eab4d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:23:24 user nova-compute[75066]: DEBUG nova.objects.instance [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lazy-loading 'migration_context' on Instance uuid 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:23:24 user nova-compute[75066]: DEBUG nova.objects.base [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Object Instance<905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75066) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 19:23:24 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Created local disks {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 19:23:24 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Start _get_guest_xml network_info=[{"id": "6c41fc1e-7ed5-490d-a375-0db34c7ae40b", "address": "fa:16:3e:ed:e9:7c", "network": {"id": "6b0f48b7-3db2-49b2-a238-8fd811b52d62", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1688127634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1688127634-network", "vif_mac": "fa:16:3e:ed:e9:7c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e000d89bca44cd8acba504256d8d1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c41fc1e-7e", "ovs_interfaceid": "6c41fc1e-7ed5-490d-a375-0db34c7ae40b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '876668a5-f5da-49c9-b7e0-8046bda76842', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': False, 'attachment_id': 'e0c109bf-cc94-4073-b781-f3cc8ec19c2b', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fQZgCqOJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436', 'attached_at': '', 'detached_at': '', 'volume_id': '1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb', 'serial': '1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:23:24 user nova-compute[75066]: DEBUG nova.objects.instance [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lazy-loading 'resources' on Instance uuid 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:23:24 user nova-compute[75066]: DEBUG nova.objects.base [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Object Instance<905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75066) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 19:23:24 user nova-compute[75066]: DEBUG nova.objects.instance [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lazy-loading 'numa_topology' on Instance uuid 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:23:24 user nova-compute[75066]: DEBUG nova.objects.base [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Object Instance<905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75066) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 19:23:24 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:23:24 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:23:24 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:23:24 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:23:24 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:23:24 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:23:24 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:23:24 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:23:24 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:23:24 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:23:24 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:23:24 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:23:24 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:23:24 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:23:24 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:23:24 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:23:24 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:23:24 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:23:24 user nova-compute[75066]: DEBUG nova.objects.instance [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lazy-loading 'vcpu_model' on Instance uuid 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:23:24 user nova-compute[75066]: DEBUG nova.objects.base [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Object Instance<905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75066) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 19:23:24 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Calling os-brick to attach iSCSI Volume {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 19:23:24 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fQZgCqOJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:23:24 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:23:24 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:23:24 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:23:24 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:23:24 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:23:24 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:23:24 user nova-compute[75066]: INFO os_brick.initiator.connectors.iscsi [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 19:23:24 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb -p 172.16.0.220:3260 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:24 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb -p 172.16.0.220:3260" returned: 0 in 0.034s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:24 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[9837e5cf-0e92-4d36-9ae0-fe90f1c6491c]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = fQZgCqOJ\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:23:24 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Dec 01 19:23:24 user nova-compute[75066]: node.name = iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb
Dec 01 19:23:24 user nova-compute[75066]: node.tpgt = -1
Dec 01 19:23:24 user nova-compute[75066]: node.startup = automatic
Dec 01 19:23:24 user nova-compute[75066]: node.leading_login = No
Dec 01 19:23:24 user nova-compute[75066]: iface.iscsi_ifacename = default
Dec 01 19:23:24 user nova-compute[75066]: iface.net_ifacename = <empty>
Dec 01 19:23:24 user nova-compute[75066]: iface.ipaddress = <empty>
Dec 01 19:23:24 user nova-compute[75066]: iface.prefix_len = 0
Dec 01 19:23:24 user nova-compute[75066]: iface.hwaddress = <empty>
Dec 01 19:23:24 user nova-compute[75066]: iface.transport_name = tcp
Dec 01 19:23:24 user nova-compute[75066]: iface.initiatorname = <empty>
Dec 01 19:23:24 user nova-compute[75066]: iface.state = <empty>
Dec 01 19:23:24 user nova-compute[75066]: iface.vlan_id = 0
Dec 01 19:23:24 user nova-compute[75066]: iface.vlan_priority = 0
Dec 01 19:23:24 user nova-compute[75066]: iface.vlan_state = <empty>
Dec 01 19:23:24 user nova-compute[75066]: iface.iface_num = 0
Dec 01 19:23:24 user nova-compute[75066]: iface.mtu = 0
Dec 01 19:23:24 user nova-compute[75066]: iface.port = 0
Dec 01 19:23:24 user nova-compute[75066]: iface.bootproto = <empty>
Dec 01 19:23:24 user nova-compute[75066]: iface.subnet_mask = <empty>
Dec 01 19:23:24 user nova-compute[75066]: iface.gateway = <empty>
Dec 01 19:23:24 user nova-compute[75066]: iface.dhcp_alt_client_id_state = <empty>
Dec 01 19:23:24 user nova-compute[75066]: iface.dhcp_alt_client_id = <empty>
Dec 01 19:23:24 user nova-compute[75066]: iface.dhcp_dns = <empty>
Dec 01 19:23:24 user nova-compute[75066]: iface.dhcp_learn_iqn = <empty>
Dec 01 19:23:24 user nova-compute[75066]: iface.dhcp_req_vendor_id_state = <empty>
Dec 01 19:23:24 user nova-compute[75066]: iface.dhcp_vendor_id_state = <empty>
Dec 01 19:23:24 user nova-compute[75066]: iface.dhcp_vendor_id = <empty>
Dec 01 19:23:24 user nova-compute[75066]: iface.dhcp_slp_da = <empty>
Dec 01 19:23:24 user nova-compute[75066]: iface.fragmentation = <empty>
Dec 01 19:23:24 user nova-compute[75066]: iface.gratuitous_arp = <empty>
Dec 01 19:23:24 user nova-compute[75066]: iface.incoming_forwarding = <empty>
Dec 01 19:23:24 user nova-compute[75066]: iface.tos_state = <empty>
Dec 01 19:23:24 user nova-compute[75066]: iface.tos = 0
Dec 01 19:23:24 user nova-compute[75066]: iface.ttl = 0
Dec 01 19:23:24 user nova-compute[75066]: iface.delayed_ack = <empty>
Dec 01 19:23:24 user nova-compute[75066]: iface.tcp_nagle = <empty>
Dec 01 19:23:24 user nova-compute[75066]: iface.tcp_wsf_state = <empty>
Dec 01 19:23:24 user nova-compute[75066]: iface.tcp_wsf = 0
Dec 01 19:23:24 user nova-compute[75066]: iface.tcp_timer_scale = 0
Dec 01 19:23:24 user nova-compute[75066]: iface.tcp_timestamp = <empty>
Dec 01 19:23:24 user nova-compute[75066]: iface.redirect = <empty>
Dec 01 19:23:24 user nova-compute[75066]: iface.def_task_mgmt_timeout = 0
Dec 01 19:23:24 user nova-compute[75066]: iface.header_digest = <empty>
Dec 01 19:23:24 user nova-compute[75066]: iface.data_digest = <empty>
Dec 01 19:23:24 user nova-compute[75066]: iface.immediate_data = <empty>
Dec 01 19:23:24 user nova-compute[75066]: iface.initial_r2t = <empty>
Dec 01 19:23:24 user nova-compute[75066]: iface.data_seq_inorder = <empty>
Dec 01 19:23:24 user nova-compute[75066]: iface.data_pdu_inorder = <empty>
Dec 01 19:23:24 user nova-compute[75066]: iface.erl = 0
Dec 01 19:23:24 user nova-compute[75066]: iface.max_receive_data_len = 0
Dec 01 19:23:24 user nova-compute[75066]: iface.first_burst_len = 0
Dec 01 19:23:24 user nova-compute[75066]: iface.max_outstanding_r2t = 0
Dec 01 19:23:24 user nova-compute[75066]: iface.max_burst_len = 0
Dec 01 19:23:24 user nova-compute[75066]: iface.chap_auth = <empty>
Dec 01 19:23:24 user nova-compute[75066]: iface.bidi_chap = <empty>
Dec 01 19:23:24 user nova-compute[75066]: iface.strict_login_compliance = <empty>
Dec 01 19:23:24 user nova-compute[75066]: iface.discovery_auth = <empty>
Dec 01 19:23:24 user nova-compute[75066]: iface.discovery_logout = <empty>
Dec 01 19:23:24 user nova-compute[75066]: node.discovery_address = <empty>
Dec 01 19:23:24 user nova-compute[75066]: node.discovery_port = 0
Dec 01 19:23:24 user nova-compute[75066]: node.discovery_type = static
Dec 01 19:23:24 user nova-compute[75066]: node.session.initial_cmdsn = 0
Dec 01 19:23:24 user nova-compute[75066]: node.session.initial_login_retry_max = 8
Dec 01 19:23:24 user nova-compute[75066]: node.session.xmit_thread_priority = -20
Dec 01 19:23:24 user nova-compute[75066]: node.session.cmds_max = 128
Dec 01 19:23:24 user nova-compute[75066]: node.session.queue_depth = 32
Dec 01 19:23:24 user nova-compute[75066]: node.session.nr_sessions = 1
Dec 01 19:23:24 user nova-compute[75066]: node.session.auth.authmethod = CHAP
Dec 01 19:23:24 user nova-compute[75066]: node.session.auth.username = fQZgCqOJ
Dec 01 19:23:24 user nova-compute[75066]: node.session.auth.password = ***
Dec 01 19:23:24 user nova-compute[75066]: node.session.auth.username_in = <empty>
Dec 01 19:23:24 user nova-compute[75066]: node.session.auth.password_in = <empty>
Dec 01 19:23:24 user nova-compute[75066]: node.session.auth.chap_algs = MD5
Dec 01 19:23:24 user nova-compute[75066]: node.session.timeo.replacement_timeout = 120
Dec 01 19:23:24 user nova-compute[75066]: node.session.err_timeo.abort_timeout = 15
Dec 01 19:23:24 user nova-compute[75066]: node.session.err_timeo.lu_reset_timeout = 30
Dec 01 19:23:24 user nova-compute[75066]: node.session.err_timeo.tgt_reset_timeout = 30
Dec 01 19:23:24 user nova-compute[75066]: node.session.err_timeo.host_reset_timeout = 60
Dec 01 19:23:24 user nova-compute[75066]: node.session.iscsi.FastAbort = Yes
Dec 01 19:23:24 user nova-compute[75066]: node.session.iscsi.InitialR2T = No
Dec 01 19:23:24 user nova-compute[75066]: node.session.iscsi.ImmediateData = Yes
Dec 01 19:23:24 user nova-compute[75066]: node.session.iscsi.FirstBurstLength = 262144
Dec 01 19:23:24 user nova-compute[75066]: node.session.iscsi.MaxBurstLength = 16776192
Dec 01 19:23:24 user nova-compute[75066]: node.session.iscsi.DefaultTime2Retain = 0
Dec 01 19:23:24 user nova-compute[75066]: node.session.iscsi.DefaultTime2Wait = 2
Dec 01 19:23:24 user nova-compute[75066]: node.session.iscsi.MaxConnections = 1
Dec 01 19:23:24 user nova-compute[75066]: node.session.iscsi.MaxOutstandingR2T = 1
Dec 01 19:23:24 user nova-compute[75066]: node.session.iscsi.ERL = 0
Dec 01 19:23:24 user nova-compute[75066]: node.session.scan = manual
Dec 01 19:23:24 user nova-compute[75066]: node.session.reopen_max = 0
Dec 01 19:23:24 user nova-compute[75066]: node.conn[0].address = 172.16.0.220
Dec 01 19:23:24 user nova-compute[75066]: node.conn[0].port = 3260
Dec 01 19:23:24 user nova-compute[75066]: node.conn[0].startup = manual
Dec 01 19:23:24 user nova-compute[75066]: node.conn[0].tcp.window_size = 524288
Dec 01 19:23:24 user nova-compute[75066]: node.conn[0].tcp.type_of_service = 0
Dec 01 19:23:24 user nova-compute[75066]: node.conn[0].timeo.logout_timeout = 15
Dec 01 19:23:24 user nova-compute[75066]: node.conn[0].timeo.login_timeout = 15
Dec 01 19:23:24 user nova-compute[75066]: node.conn[0].timeo.auth_timeout = 45
Dec 01 19:23:24 user nova-compute[75066]: node.conn[0].timeo.noop_out_interval = 5
Dec 01 19:23:24 user nova-compute[75066]: node.conn[0].timeo.noop_out_timeout = 5
Dec 01 19:23:24 user nova-compute[75066]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Dec 01 19:23:24 user nova-compute[75066]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Dec 01 19:23:24 user nova-compute[75066]: node.conn[0].iscsi.HeaderDigest = None
Dec 01 19:23:24 user nova-compute[75066]: node.conn[0].iscsi.DataDigest = None
Dec 01 19:23:24 user nova-compute[75066]: node.conn[0].iscsi.IFMarker = No
Dec 01 19:23:24 user nova-compute[75066]: node.conn[0].iscsi.OFMarker = No
Dec 01 19:23:24 user nova-compute[75066]: # END RECORD
Dec 01 19:23:24 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:23:24 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:24 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:24 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab068919-c347-4fcf-b4bc-095023debc16]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:23:24 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:23:24 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:24 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:24 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f3fbd0-1d55-4968-adee-4810243a55b8]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:23:24 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:23:24 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fQZgCqOJ {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:25 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fQZgCqOJ" returned: 0 in 0.021s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:25 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[b236ceb5-1cfc-4be2-ac4f-e2b170cb1375]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:23:25 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fQZgCqOJ'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:23:25 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:25 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:25 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a3f904-3029-4efb-b0ca-a064269b6086]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:23:25 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:23:25 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:25 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:25 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f88000-da80-4540-9003-d94b4a8d789e]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:23:25 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)
Dec 01 19:23:25 user nova-compute[75066]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)
Dec 01 19:23:25 user nova-compute[75066]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:23:25 user nova-compute[75066]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)
Dec 01 19:23:25 user nova-compute[75066]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98 (non-flash)
Dec 01 19:23:25 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:23:25 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)
Dec 01 19:23:25 user nova-compute[75066]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)
Dec 01 19:23:25 user nova-compute[75066]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:23:25 user nova-compute[75066]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)
Dec 01 19:23:25 user nova-compute[75066]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98 (non-flash)
Dec 01 19:23:25 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:23:25 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.221s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:23:25 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Connected to 172.16.0.220:3260 {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 19:23:25 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] HCTL ('37', '0', '0', 0) found on session 21 with lun 0 {{(pid=75066) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 19:23:25 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=75066) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 19:23:25 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:25 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:25 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[2949da2f-d527-4620-92bc-a275cb6ddb96]: (4, ('0 0 0', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:23:25 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Searching for a device in session 21 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:23:25 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fQZgCqOJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 19:23:25 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.249s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:23:25 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] <== connect_volume: return (250ms) {'type': 'block', 'scsi_wwn': '23333656132396164', 'path': '/dev/sdf'} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:23:25 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333656132396164', 'path': '/dev/sdf'} {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 19:23:25 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:21:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1711948720',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1711948720',id=20,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:21:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e000d89bca44cd8acba504256d8d1f1',ramdisk_id='',reservation_id='r-dxnjcyj0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-454493649',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:21:53Z,user_data=None,user_id='964c1681ca8745d0b3879266d24f507e',uuid=905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6c41fc1e-7ed5-490d-a375-0db34c7ae40b", "address": "fa:16:3e:ed:e9:7c", "network": {"id": "6b0f48b7-3db2-49b2-a238-8fd811b52d62", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1688127634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1688127634-network", "vif_mac": "fa:16:3e:ed:e9:7c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e000d89bca44cd8acba504256d8d1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c41fc1e-7e", "ovs_interfaceid": "6c41fc1e-7ed5-490d-a375-0db34c7ae40b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:23:25 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Converting VIF {"id": "6c41fc1e-7ed5-490d-a375-0db34c7ae40b", "address": "fa:16:3e:ed:e9:7c", "network": {"id": "6b0f48b7-3db2-49b2-a238-8fd811b52d62", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1688127634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1688127634-network", "vif_mac": "fa:16:3e:ed:e9:7c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e000d89bca44cd8acba504256d8d1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c41fc1e-7e", "ovs_interfaceid": "6c41fc1e-7ed5-490d-a375-0db34c7ae40b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:23:25 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:e9:7c,bridge_name='br-int',has_traffic_filtering=True,id=6c41fc1e-7ed5-490d-a375-0db34c7ae40b,network=Network(6b0f48b7-3db2-49b2-a238-8fd811b52d62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c41fc1e-7e') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:23:25 user nova-compute[75066]: DEBUG nova.objects.instance [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lazy-loading 'pci_devices' on Instance uuid 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:23:25 user nova-compute[75066]: DEBUG nova.objects.base [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Object Instance<905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75066) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 19:23:25 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:23:25 user nova-compute[75066]:   <uuid>905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436</uuid>
Dec 01 19:23:25 user nova-compute[75066]:   <name>instance-00000014</name>
Dec 01 19:23:25 user nova-compute[75066]:   <memory>524288</memory>
Dec 01 19:23:25 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:23:25 user nova-compute[75066]:   <metadata>
Dec 01 19:23:25 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:23:25 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:23:25 user nova-compute[75066]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1711948720</nova:name>
Dec 01 19:23:25 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:23:24</nova:creationTime>
Dec 01 19:23:25 user nova-compute[75066]:       <nova:flavor name="m1.tiny">
Dec 01 19:23:25 user nova-compute[75066]:         <nova:memory>512</nova:memory>
Dec 01 19:23:25 user nova-compute[75066]:         <nova:disk>1</nova:disk>
Dec 01 19:23:25 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:23:25 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:23:25 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:23:25 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:23:25 user nova-compute[75066]:       <nova:owner>
Dec 01 19:23:25 user nova-compute[75066]:         <nova:user uuid="964c1681ca8745d0b3879266d24f507e">tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member</nova:user>
Dec 01 19:23:25 user nova-compute[75066]:         <nova:project uuid="2e000d89bca44cd8acba504256d8d1f1">tempest-ServerBootFromVolumeStableRescueTest-454493649</nova:project>
Dec 01 19:23:25 user nova-compute[75066]:       </nova:owner>
Dec 01 19:23:25 user nova-compute[75066]:       <nova:root type="image" uuid="900b237b-e99c-4fdd-a44f-dcb7a08baa86"/>
Dec 01 19:23:25 user nova-compute[75066]:       <nova:ports>
Dec 01 19:23:25 user nova-compute[75066]:         <nova:port uuid="6c41fc1e-7ed5-490d-a375-0db34c7ae40b">
Dec 01 19:23:25 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Dec 01 19:23:25 user nova-compute[75066]:         </nova:port>
Dec 01 19:23:25 user nova-compute[75066]:       </nova:ports>
Dec 01 19:23:25 user nova-compute[75066]:     </nova:instance>
Dec 01 19:23:25 user nova-compute[75066]:   </metadata>
Dec 01 19:23:25 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:23:25 user nova-compute[75066]:     <system>
Dec 01 19:23:25 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:23:25 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:23:25 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:23:25 user nova-compute[75066]:       <entry name="serial">905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436</entry>
Dec 01 19:23:25 user nova-compute[75066]:       <entry name="uuid">905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436</entry>
Dec 01 19:23:25 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:23:25 user nova-compute[75066]:     </system>
Dec 01 19:23:25 user nova-compute[75066]:   </sysinfo>
Dec 01 19:23:25 user nova-compute[75066]:   <os>
Dec 01 19:23:25 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:23:25 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:23:25 user nova-compute[75066]:   </os>
Dec 01 19:23:25 user nova-compute[75066]:   <features>
Dec 01 19:23:25 user nova-compute[75066]:     <acpi/>
Dec 01 19:23:25 user nova-compute[75066]:     <apic/>
Dec 01 19:23:25 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:23:25 user nova-compute[75066]:   </features>
Dec 01 19:23:25 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:23:25 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:23:25 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:23:25 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:23:25 user nova-compute[75066]:   </clock>
Dec 01 19:23:25 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:23:25 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:23:25 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:23:25 user nova-compute[75066]:   </cpu>
Dec 01 19:23:25 user nova-compute[75066]:   <devices>
Dec 01 19:23:25 user nova-compute[75066]:     <disk type="block" device="disk">
Dec 01 19:23:25 user nova-compute[75066]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:23:25 user nova-compute[75066]:       <source dev="/dev/sdf"/>
Dec 01 19:23:25 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:23:25 user nova-compute[75066]:       <serial>1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb</serial>
Dec 01 19:23:25 user nova-compute[75066]:     </disk>
Dec 01 19:23:25 user nova-compute[75066]:     <disk type="file" device="disk">
Dec 01 19:23:25 user nova-compute[75066]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 19:23:25 user nova-compute[75066]:       <source file="/opt/stack/data/nova/instances/905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436/disk.rescue"/>
Dec 01 19:23:25 user nova-compute[75066]:       <target dev="vdb" bus="virtio"/>
Dec 01 19:23:25 user nova-compute[75066]:       <boot order="1"/>
Dec 01 19:23:25 user nova-compute[75066]:     </disk>
Dec 01 19:23:25 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:23:25 user nova-compute[75066]:       <mac address="fa:16:3e:ed:e9:7c"/>
Dec 01 19:23:25 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:23:25 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:23:25 user nova-compute[75066]:       <target dev="tap6c41fc1e-7e"/>
Dec 01 19:23:25 user nova-compute[75066]:     </interface>
Dec 01 19:23:25 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:23:25 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436/console.log" append="off"/>
Dec 01 19:23:25 user nova-compute[75066]:     </serial>
Dec 01 19:23:25 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:23:25 user nova-compute[75066]:     <video>
Dec 01 19:23:25 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:23:25 user nova-compute[75066]:     </video>
Dec 01 19:23:25 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:23:25 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:23:25 user nova-compute[75066]:     </rng>
Dec 01 19:23:25 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:23:25 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:23:25 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:23:25 user nova-compute[75066]:     </memballoon>
Dec 01 19:23:25 user nova-compute[75066]:   </devices>
Dec 01 19:23:25 user nova-compute[75066]: </domain>
Dec 01 19:23:25 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:23:25 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Instance destroyed successfully.
Dec 01 19:23:25 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:23:25 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:23:25 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] No VIF found with MAC fa:16:3e:ed:e9:7c, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:23:25 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:26 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:26 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:26 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:27 user nova-compute[75066]: DEBUG nova.compute.manager [req-d6a1a558-354c-4c14-a0f4-8be52f418d6f req-4cc924ab-91d3-416a-886c-d2c1561b2505 service nova] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Received event network-vif-plugged-6c41fc1e-7ed5-490d-a375-0db34c7ae40b {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:23:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d6a1a558-354c-4c14-a0f4-8be52f418d6f req-4cc924ab-91d3-416a-886c-d2c1561b2505 service nova] Acquiring lock "905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:23:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d6a1a558-354c-4c14-a0f4-8be52f418d6f req-4cc924ab-91d3-416a-886c-d2c1561b2505 service nova] Lock "905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:23:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d6a1a558-354c-4c14-a0f4-8be52f418d6f req-4cc924ab-91d3-416a-886c-d2c1561b2505 service nova] Lock "905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:23:27 user nova-compute[75066]: DEBUG nova.compute.manager [req-d6a1a558-354c-4c14-a0f4-8be52f418d6f req-4cc924ab-91d3-416a-886c-d2c1561b2505 service nova] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] No waiting events found dispatching network-vif-plugged-6c41fc1e-7ed5-490d-a375-0db34c7ae40b {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:23:27 user nova-compute[75066]: WARNING nova.compute.manager [req-d6a1a558-354c-4c14-a0f4-8be52f418d6f req-4cc924ab-91d3-416a-886c-d2c1561b2505 service nova] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Received unexpected event network-vif-plugged-6c41fc1e-7ed5-490d-a375-0db34c7ae40b for instance with vm_state active and task_state rescuing.
Dec 01 19:23:27 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:27 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:29 user nova-compute[75066]: DEBUG nova.compute.manager [None req-d1a99fb3-3493-4983-8074-e4f0c2c315a5 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:23:29 user nova-compute[75066]: DEBUG nova.compute.manager [req-0c5ce457-ddb8-4ca3-ad13-b5ce125ccb12 req-756c5719-0678-4dc7-b826-c2270ced981a service nova] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Received event network-vif-plugged-6c41fc1e-7ed5-490d-a375-0db34c7ae40b {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:23:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-0c5ce457-ddb8-4ca3-ad13-b5ce125ccb12 req-756c5719-0678-4dc7-b826-c2270ced981a service nova] Acquiring lock "905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:23:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-0c5ce457-ddb8-4ca3-ad13-b5ce125ccb12 req-756c5719-0678-4dc7-b826-c2270ced981a service nova] Lock "905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:23:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-0c5ce457-ddb8-4ca3-ad13-b5ce125ccb12 req-756c5719-0678-4dc7-b826-c2270ced981a service nova] Lock "905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:23:29 user nova-compute[75066]: DEBUG nova.compute.manager [req-0c5ce457-ddb8-4ca3-ad13-b5ce125ccb12 req-756c5719-0678-4dc7-b826-c2270ced981a service nova] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] No waiting events found dispatching network-vif-plugged-6c41fc1e-7ed5-490d-a375-0db34c7ae40b {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:23:29 user nova-compute[75066]: WARNING nova.compute.manager [req-0c5ce457-ddb8-4ca3-ad13-b5ce125ccb12 req-756c5719-0678-4dc7-b826-c2270ced981a service nova] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Received unexpected event network-vif-plugged-6c41fc1e-7ed5-490d-a375-0db34c7ae40b for instance with vm_state active and task_state rescuing.
Dec 01 19:23:29 user nova-compute[75066]: DEBUG nova.compute.manager [None req-03efbe89-95a6-440d-816b-8b2b48771540 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:23:29 user nova-compute[75066]: INFO nova.compute.manager [None req-03efbe89-95a6-440d-816b-8b2b48771540 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] instance snapshotting
Dec 01 19:23:29 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-03efbe89-95a6-440d-816b-8b2b48771540 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Beginning live snapshot process
Dec 01 19:23:29 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-03efbe89-95a6-440d-816b-8b2b48771540 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a553e030-0d69-4725-9f84-6c0c63556ed4/disk --force-share --output=json -f qcow2 {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:29 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-03efbe89-95a6-440d-816b-8b2b48771540 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a553e030-0d69-4725-9f84-6c0c63556ed4/disk --force-share --output=json -f qcow2" returned: 0 in 0.214s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:29 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-03efbe89-95a6-440d-816b-8b2b48771540 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a553e030-0d69-4725-9f84-6c0c63556ed4/disk --force-share --output=json -f qcow2 {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:29 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-03efbe89-95a6-440d-816b-8b2b48771540 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a553e030-0d69-4725-9f84-6c0c63556ed4/disk --force-share --output=json -f qcow2" returned: 0 in 0.217s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:29 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-03efbe89-95a6-440d-816b-8b2b48771540 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-03efbe89-95a6-440d-816b-8b2b48771540 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.271s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-03efbe89-95a6-440d-816b-8b2b48771540 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp8blwuona/78b95437e06b49cc9bcef909ff1e58e0.delta 1073741824 {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-03efbe89-95a6-440d-816b-8b2b48771540 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp8blwuona/78b95437e06b49cc9bcef909ff1e58e0.delta 1073741824" returned: 0 in 0.055s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:30 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-03efbe89-95a6-440d-816b-8b2b48771540 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Quiescing instance not available: QEMU guest agent is not enabled.
Dec 01 19:23:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:31 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-03efbe89-95a6-440d-816b-8b2b48771540 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75066) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 19:23:31 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-03efbe89-95a6-440d-816b-8b2b48771540 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75066) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 19:23:31 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-03efbe89-95a6-440d-816b-8b2b48771540 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Skipping quiescing instance: QEMU guest agent is not enabled.
Dec 01 19:23:31 user nova-compute[75066]: DEBUG nova.privsep.utils [None req-03efbe89-95a6-440d-816b-8b2b48771540 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75066) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 01 19:23:31 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-03efbe89-95a6-440d-816b-8b2b48771540 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp8blwuona/78b95437e06b49cc9bcef909ff1e58e0.delta /opt/stack/data/nova/instances/snapshots/tmp8blwuona/78b95437e06b49cc9bcef909ff1e58e0 {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:31 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-03efbe89-95a6-440d-816b-8b2b48771540 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp8blwuona/78b95437e06b49cc9bcef909ff1e58e0.delta /opt/stack/data/nova/instances/snapshots/tmp8blwuona/78b95437e06b49cc9bcef909ff1e58e0" returned: 0 in 0.326s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:31 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-03efbe89-95a6-440d-816b-8b2b48771540 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Snapshot extracted, beginning image upload
Dec 01 19:23:34 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-03efbe89-95a6-440d-816b-8b2b48771540 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Snapshot image upload complete
Dec 01 19:23:34 user nova-compute[75066]: INFO nova.compute.manager [None req-03efbe89-95a6-440d-816b-8b2b48771540 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Took 5.62 seconds to snapshot the instance on the hypervisor.
Dec 01 19:23:35 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:23:35 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e03e684a-fe38-440e-a1d2-0462b9075e80 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Acquiring lock "998daa1d-fd6a-4663-8df3-0683a9dbe142" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:23:35 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e03e684a-fe38-440e-a1d2-0462b9075e80 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Lock "998daa1d-fd6a-4663-8df3-0683a9dbe142" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:23:35 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e03e684a-fe38-440e-a1d2-0462b9075e80 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Acquiring lock "998daa1d-fd6a-4663-8df3-0683a9dbe142-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:23:35 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e03e684a-fe38-440e-a1d2-0462b9075e80 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Lock "998daa1d-fd6a-4663-8df3-0683a9dbe142-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:23:35 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e03e684a-fe38-440e-a1d2-0462b9075e80 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Lock "998daa1d-fd6a-4663-8df3-0683a9dbe142-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:23:35 user nova-compute[75066]: INFO nova.compute.manager [None req-e03e684a-fe38-440e-a1d2-0462b9075e80 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Terminating instance
Dec 01 19:23:35 user nova-compute[75066]: DEBUG nova.compute.manager [None req-e03e684a-fe38-440e-a1d2-0462b9075e80 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Start destroying the instance on the hypervisor. {{(pid=75066) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 19:23:35 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:35 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:35 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:35 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:35 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:36 user nova-compute[75066]: DEBUG nova.compute.manager [req-f2691648-18b9-4079-907e-0e4579ed7fb3 req-05e8ffee-faa6-4f4b-acb1-b9e79f8bdd4f service nova] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Received event network-vif-unplugged-2cf25213-8eec-4d19-bad6-b8e2fd905b3c {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:23:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-f2691648-18b9-4079-907e-0e4579ed7fb3 req-05e8ffee-faa6-4f4b-acb1-b9e79f8bdd4f service nova] Acquiring lock "998daa1d-fd6a-4663-8df3-0683a9dbe142-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:23:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-f2691648-18b9-4079-907e-0e4579ed7fb3 req-05e8ffee-faa6-4f4b-acb1-b9e79f8bdd4f service nova] Lock "998daa1d-fd6a-4663-8df3-0683a9dbe142-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:23:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-f2691648-18b9-4079-907e-0e4579ed7fb3 req-05e8ffee-faa6-4f4b-acb1-b9e79f8bdd4f service nova] Lock "998daa1d-fd6a-4663-8df3-0683a9dbe142-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:23:36 user nova-compute[75066]: DEBUG nova.compute.manager [req-f2691648-18b9-4079-907e-0e4579ed7fb3 req-05e8ffee-faa6-4f4b-acb1-b9e79f8bdd4f service nova] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] No waiting events found dispatching network-vif-unplugged-2cf25213-8eec-4d19-bad6-b8e2fd905b3c {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:23:36 user nova-compute[75066]: DEBUG nova.compute.manager [req-f2691648-18b9-4079-907e-0e4579ed7fb3 req-05e8ffee-faa6-4f4b-acb1-b9e79f8bdd4f service nova] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Received event network-vif-unplugged-2cf25213-8eec-4d19-bad6-b8e2fd905b3c for instance with task_state deleting. {{(pid=75066) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 19:23:36 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Instance destroyed successfully.
Dec 01 19:23:36 user nova-compute[75066]: DEBUG nova.objects.instance [None req-e03e684a-fe38-440e-a1d2-0462b9075e80 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Lazy-loading 'resources' on Instance uuid 998daa1d-fd6a-4663-8df3-0683a9dbe142 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:23:36 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-e03e684a-fe38-440e-a1d2-0462b9075e80 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T19:20:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-431772117',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-431772117',id=17,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDioMIKkD17rbLefUs+CoCe2YAF5MJyWmdGP5njQ+aDOavBc08qUchmFEEnBOz9qWRNoNrJTyhIak33m8ykbjamBmaBpbrxUKAYbxyiEVNdIL8zvksuJtx/Xi7sbDuD1AA==',key_name='tempest-keypair-1571650457',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:20:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0be461a2ee174f25bdbb451e49512e75',ramdisk_id='',reservation_id='r-ymwza3b4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-687574292',owner_user_name='tempest-TaggedAttachmentsTest-687574292-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:20:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8ae99d82b8bb499595aae2098059f478',uuid=998daa1d-fd6a-4663-8df3-0683a9dbe142,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2cf25213-8eec-4d19-bad6-b8e2fd905b3c", "address": "fa:16:3e:10:62:79", "network": {"id": "13655709-cc3e-4378-850f-1eb7bc944811", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1907265443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0be461a2ee174f25bdbb451e49512e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf25213-8e", "ovs_interfaceid": "2cf25213-8eec-4d19-bad6-b8e2fd905b3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:23:36 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-e03e684a-fe38-440e-a1d2-0462b9075e80 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Converting VIF {"id": "2cf25213-8eec-4d19-bad6-b8e2fd905b3c", "address": "fa:16:3e:10:62:79", "network": {"id": "13655709-cc3e-4378-850f-1eb7bc944811", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1907265443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0be461a2ee174f25bdbb451e49512e75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2cf25213-8e", "ovs_interfaceid": "2cf25213-8eec-4d19-bad6-b8e2fd905b3c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:23:36 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-e03e684a-fe38-440e-a1d2-0462b9075e80 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:10:62:79,bridge_name='br-int',has_traffic_filtering=True,id=2cf25213-8eec-4d19-bad6-b8e2fd905b3c,network=Network(13655709-cc3e-4378-850f-1eb7bc944811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cf25213-8e') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:23:36 user nova-compute[75066]: DEBUG os_vif [None req-e03e684a-fe38-440e-a1d2-0462b9075e80 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:62:79,bridge_name='br-int',has_traffic_filtering=True,id=2cf25213-8eec-4d19-bad6-b8e2fd905b3c,network=Network(13655709-cc3e-4378-850f-1eb7bc944811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cf25213-8e') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:23:36 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:36 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2cf25213-8e, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:23:36 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:36 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:23:36 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:36 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:36 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=eabe9044-5a35-4b8d-a43a-590f599f8383) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:23:36 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:36 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:23:36 user nova-compute[75066]: INFO os_vif [None req-e03e684a-fe38-440e-a1d2-0462b9075e80 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:10:62:79,bridge_name='br-int',has_traffic_filtering=True,id=2cf25213-8eec-4d19-bad6-b8e2fd905b3c,network=Network(13655709-cc3e-4378-850f-1eb7bc944811),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2cf25213-8e')
Dec 01 19:23:36 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-e03e684a-fe38-440e-a1d2-0462b9075e80 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Deleting instance files /opt/stack/data/nova/instances/998daa1d-fd6a-4663-8df3-0683a9dbe142_del
Dec 01 19:23:36 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-e03e684a-fe38-440e-a1d2-0462b9075e80 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Deletion of /opt/stack/data/nova/instances/998daa1d-fd6a-4663-8df3-0683a9dbe142_del complete
Dec 01 19:23:36 user nova-compute[75066]: INFO nova.compute.manager [None req-e03e684a-fe38-440e-a1d2-0462b9075e80 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Took 1.07 seconds to destroy the instance on the hypervisor.
Dec 01 19:23:36 user nova-compute[75066]: DEBUG oslo.service.loopingcall [None req-e03e684a-fe38-440e-a1d2-0462b9075e80 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75066) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 19:23:36 user nova-compute[75066]: DEBUG nova.compute.manager [-] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Deallocating network for instance {{(pid=75066) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 19:23:36 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] deallocate_for_instance() {{(pid=75066) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 19:23:37 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Acquiring lock "ecc194b4-b8b9-49c8-9d34-4213c4dc15b8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:23:37 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lock "ecc194b4-b8b9-49c8-9d34-4213c4dc15b8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:23:37 user nova-compute[75066]: DEBUG nova.compute.manager [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Starting instance... {{(pid=75066) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 19:23:37 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:23:37 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:23:37 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75066) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 19:23:37 user nova-compute[75066]: INFO nova.compute.claims [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Claim successful on node user
Dec 01 19:23:37 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:23:37 user nova-compute[75066]: DEBUG nova.compute.manager [req-3065fffa-6629-488f-bb43-5d0bc35aa953 req-6b7db7ee-74a7-486a-a587-b3b9eda20cfc service nova] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Received event network-vif-deleted-2cf25213-8eec-4d19-bad6-b8e2fd905b3c {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:23:37 user nova-compute[75066]: INFO nova.compute.manager [req-3065fffa-6629-488f-bb43-5d0bc35aa953 req-6b7db7ee-74a7-486a-a587-b3b9eda20cfc service nova] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Neutron deleted interface 2cf25213-8eec-4d19-bad6-b8e2fd905b3c; detaching it from the instance and deleting it from the info cache
Dec 01 19:23:37 user nova-compute[75066]: DEBUG nova.network.neutron [req-3065fffa-6629-488f-bb43-5d0bc35aa953 req-6b7db7ee-74a7-486a-a587-b3b9eda20cfc service nova] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:23:37 user nova-compute[75066]: INFO nova.compute.manager [-] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Took 1.15 seconds to deallocate network for instance.
Dec 01 19:23:37 user nova-compute[75066]: DEBUG nova.compute.manager [req-3065fffa-6629-488f-bb43-5d0bc35aa953 req-6b7db7ee-74a7-486a-a587-b3b9eda20cfc service nova] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Detach interface failed, port_id=2cf25213-8eec-4d19-bad6-b8e2fd905b3c, reason: Instance 998daa1d-fd6a-4663-8df3-0683a9dbe142 could not be found. {{(pid=75066) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 01 19:23:38 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e03e684a-fe38-440e-a1d2-0462b9075e80 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:23:38 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:23:38 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:23:38 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.729s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:23:38 user nova-compute[75066]: DEBUG nova.compute.manager [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Start building networks asynchronously for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 19:23:38 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e03e684a-fe38-440e-a1d2-0462b9075e80 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.135s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:23:38 user nova-compute[75066]: DEBUG nova.compute.manager [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Allocating IP information in the background. {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 19:23:38 user nova-compute[75066]: DEBUG nova.network.neutron [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] allocate_for_instance() {{(pid=75066) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 19:23:38 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 19:23:38 user nova-compute[75066]: DEBUG nova.compute.manager [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Start building block device mappings for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 19:23:38 user nova-compute[75066]: DEBUG nova.policy [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7c1a5012f94b43e38161f8c823173f7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9caae5967744641b7490e1aa91973c0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75066) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 19:23:38 user nova-compute[75066]: DEBUG nova.compute.manager [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Start spawning the instance on the hypervisor. {{(pid=75066) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 19:23:38 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Creating instance directory {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 19:23:38 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Creating image(s)
Dec 01 19:23:38 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Acquiring lock "/opt/stack/data/nova/instances/ecc194b4-b8b9-49c8-9d34-4213c4dc15b8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:23:38 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lock "/opt/stack/data/nova/instances/ecc194b4-b8b9-49c8-9d34-4213c4dc15b8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:23:38 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lock "/opt/stack/data/nova/instances/ecc194b4-b8b9-49c8-9d34-4213c4dc15b8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:23:38 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Acquiring lock "71fb97c518f628e05f502c58238b0d7731d049ab" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:23:38 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lock "71fb97c518f628e05f502c58238b0d7731d049ab" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:23:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71fb97c518f628e05f502c58238b0d7731d049ab.part --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:39 user nova-compute[75066]: DEBUG nova.network.neutron [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Successfully created port: 2d26e49a-f1a5-4922-b26f-2eb8c3d59368 {{(pid=75066) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 19:23:39 user nova-compute[75066]: DEBUG nova.compute.manager [req-29501090-93c8-487d-9856-3261157181b3 req-485836ea-b49b-4743-9e3d-991f385381e8 service nova] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Received event network-vif-plugged-2cf25213-8eec-4d19-bad6-b8e2fd905b3c {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:23:39 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-29501090-93c8-487d-9856-3261157181b3 req-485836ea-b49b-4743-9e3d-991f385381e8 service nova] Acquiring lock "998daa1d-fd6a-4663-8df3-0683a9dbe142-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:23:39 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-29501090-93c8-487d-9856-3261157181b3 req-485836ea-b49b-4743-9e3d-991f385381e8 service nova] Lock "998daa1d-fd6a-4663-8df3-0683a9dbe142-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:23:39 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-29501090-93c8-487d-9856-3261157181b3 req-485836ea-b49b-4743-9e3d-991f385381e8 service nova] Lock "998daa1d-fd6a-4663-8df3-0683a9dbe142-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:23:39 user nova-compute[75066]: DEBUG nova.compute.manager [req-29501090-93c8-487d-9856-3261157181b3 req-485836ea-b49b-4743-9e3d-991f385381e8 service nova] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] No waiting events found dispatching network-vif-plugged-2cf25213-8eec-4d19-bad6-b8e2fd905b3c {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:23:39 user nova-compute[75066]: WARNING nova.compute.manager [req-29501090-93c8-487d-9856-3261157181b3 req-485836ea-b49b-4743-9e3d-991f385381e8 service nova] [instance: 998daa1d-fd6a-4663-8df3-0683a9dbe142] Received unexpected event network-vif-plugged-2cf25213-8eec-4d19-bad6-b8e2fd905b3c for instance with vm_state deleted and task_state None.
Dec 01 19:23:39 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-e03e684a-fe38-440e-a1d2-0462b9075e80 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:23:39 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-e03e684a-fe38-440e-a1d2-0462b9075e80 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:23:39 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e03e684a-fe38-440e-a1d2-0462b9075e80 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.338s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:23:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71fb97c518f628e05f502c58238b0d7731d049ab.part --force-share --output=json" returned: 0 in 0.205s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:39 user nova-compute[75066]: DEBUG nova.virt.images [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] 9b4172c9-9407-4727-a1fe-156908bea909 was qcow2, converting to raw {{(pid=75066) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 01 19:23:39 user nova-compute[75066]: DEBUG nova.privsep.utils [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75066) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 01 19:23:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/71fb97c518f628e05f502c58238b0d7731d049ab.part /opt/stack/data/nova/instances/_base/71fb97c518f628e05f502c58238b0d7731d049ab.converted {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:39 user nova-compute[75066]: INFO nova.scheduler.client.report [None req-e03e684a-fe38-440e-a1d2-0462b9075e80 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Deleted allocations for instance 998daa1d-fd6a-4663-8df3-0683a9dbe142
Dec 01 19:23:39 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e03e684a-fe38-440e-a1d2-0462b9075e80 tempest-TaggedAttachmentsTest-687574292 tempest-TaggedAttachmentsTest-687574292-project-member] Lock "998daa1d-fd6a-4663-8df3-0683a9dbe142" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.952s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:23:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/71fb97c518f628e05f502c58238b0d7731d049ab.part /opt/stack/data/nova/instances/_base/71fb97c518f628e05f502c58238b0d7731d049ab.converted" returned: 0 in 0.186s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71fb97c518f628e05f502c58238b0d7731d049ab.converted --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71fb97c518f628e05f502c58238b0d7731d049ab.converted --force-share --output=json" returned: 0 in 0.229s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:39 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lock "71fb97c518f628e05f502c58238b0d7731d049ab" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.516s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:23:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71fb97c518f628e05f502c58238b0d7731d049ab --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71fb97c518f628e05f502c58238b0d7731d049ab --force-share --output=json" returned: 0 in 0.193s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:40 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Acquiring lock "71fb97c518f628e05f502c58238b0d7731d049ab" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:23:40 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lock "71fb97c518f628e05f502c58238b0d7731d049ab" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:23:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71fb97c518f628e05f502c58238b0d7731d049ab --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71fb97c518f628e05f502c58238b0d7731d049ab --force-share --output=json" returned: 0 in 0.191s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71fb97c518f628e05f502c58238b0d7731d049ab,backing_fmt=raw /opt/stack/data/nova/instances/ecc194b4-b8b9-49c8-9d34-4213c4dc15b8/disk 1073741824 {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:40 user nova-compute[75066]: DEBUG nova.network.neutron [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Successfully updated port: 2d26e49a-f1a5-4922-b26f-2eb8c3d59368 {{(pid=75066) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 19:23:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/71fb97c518f628e05f502c58238b0d7731d049ab,backing_fmt=raw /opt/stack/data/nova/instances/ecc194b4-b8b9-49c8-9d34-4213c4dc15b8/disk 1073741824" returned: 0 in 0.057s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:40 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lock "71fb97c518f628e05f502c58238b0d7731d049ab" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:23:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71fb97c518f628e05f502c58238b0d7731d049ab --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:40 user nova-compute[75066]: DEBUG nova.compute.manager [req-2700a7cf-ce42-48f5-982c-fc2bd2a47e7d req-4408194d-db6c-4067-ac89-09b21266a509 service nova] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Received event network-changed-2d26e49a-f1a5-4922-b26f-2eb8c3d59368 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:23:40 user nova-compute[75066]: DEBUG nova.compute.manager [req-2700a7cf-ce42-48f5-982c-fc2bd2a47e7d req-4408194d-db6c-4067-ac89-09b21266a509 service nova] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Refreshing instance network info cache due to event network-changed-2d26e49a-f1a5-4922-b26f-2eb8c3d59368. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:23:40 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-2700a7cf-ce42-48f5-982c-fc2bd2a47e7d req-4408194d-db6c-4067-ac89-09b21266a509 service nova] Acquiring lock "refresh_cache-ecc194b4-b8b9-49c8-9d34-4213c4dc15b8" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:23:40 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-2700a7cf-ce42-48f5-982c-fc2bd2a47e7d req-4408194d-db6c-4067-ac89-09b21266a509 service nova] Acquired lock "refresh_cache-ecc194b4-b8b9-49c8-9d34-4213c4dc15b8" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:23:40 user nova-compute[75066]: DEBUG nova.network.neutron [req-2700a7cf-ce42-48f5-982c-fc2bd2a47e7d req-4408194d-db6c-4067-ac89-09b21266a509 service nova] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Refreshing network info cache for port 2d26e49a-f1a5-4922-b26f-2eb8c3d59368 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:23:40 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Acquiring lock "refresh_cache-ecc194b4-b8b9-49c8-9d34-4213c4dc15b8" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:23:40 user nova-compute[75066]: DEBUG nova.network.neutron [req-2700a7cf-ce42-48f5-982c-fc2bd2a47e7d req-4408194d-db6c-4067-ac89-09b21266a509 service nova] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:23:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/71fb97c518f628e05f502c58238b0d7731d049ab --force-share --output=json" returned: 0 in 0.185s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:40 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Created local disks {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 19:23:40 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Ensure instance console log exists: /opt/stack/data/nova/instances/ecc194b4-b8b9-49c8-9d34-4213c4dc15b8/console.log {{(pid=75066) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 19:23:40 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:23:40 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:23:40 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:23:40 user nova-compute[75066]: DEBUG nova.network.neutron [req-2700a7cf-ce42-48f5-982c-fc2bd2a47e7d req-4408194d-db6c-4067-ac89-09b21266a509 service nova] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:23:40 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-2700a7cf-ce42-48f5-982c-fc2bd2a47e7d req-4408194d-db6c-4067-ac89-09b21266a509 service nova] Releasing lock "refresh_cache-ecc194b4-b8b9-49c8-9d34-4213c4dc15b8" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:23:40 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Acquired lock "refresh_cache-ecc194b4-b8b9-49c8-9d34-4213c4dc15b8" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:23:40 user nova-compute[75066]: DEBUG nova.network.neutron [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:23:40 user nova-compute[75066]: DEBUG nova.network.neutron [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:23:41 user nova-compute[75066]: DEBUG nova.network.neutron [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Updating instance_info_cache with network_info: [{"id": "2d26e49a-f1a5-4922-b26f-2eb8c3d59368", "address": "fa:16:3e:f8:79:92", "network": {"id": "191f13ce-a864-4c09-8ca5-e8a106e24d37", "bridge": "br-int", "label": "tempest-TestStampPattern-1604601756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9caae5967744641b7490e1aa91973c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d26e49a-f1", "ovs_interfaceid": "2d26e49a-f1a5-4922-b26f-2eb8c3d59368", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:23:41 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Releasing lock "refresh_cache-ecc194b4-b8b9-49c8-9d34-4213c4dc15b8" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:23:41 user nova-compute[75066]: DEBUG nova.compute.manager [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Instance network_info: |[{"id": "2d26e49a-f1a5-4922-b26f-2eb8c3d59368", "address": "fa:16:3e:f8:79:92", "network": {"id": "191f13ce-a864-4c09-8ca5-e8a106e24d37", "bridge": "br-int", "label": "tempest-TestStampPattern-1604601756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9caae5967744641b7490e1aa91973c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d26e49a-f1", "ovs_interfaceid": "2d26e49a-f1a5-4922-b26f-2eb8c3d59368", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 19:23:41 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Start _get_guest_xml network_info=[{"id": "2d26e49a-f1a5-4922-b26f-2eb8c3d59368", "address": "fa:16:3e:f8:79:92", "network": {"id": "191f13ce-a864-4c09-8ca5-e8a106e24d37", "bridge": "br-int", "label": "tempest-TestStampPattern-1604601756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9caae5967744641b7490e1aa91973c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d26e49a-f1", "ovs_interfaceid": "2d26e49a-f1a5-4922-b26f-2eb8c3d59368", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='72ad2851c15bfe543e0a6dd84827bf81',container_format='bare',created_at=2023-12-01T19:23:29Z,direct_url=<?>,disk_format='qcow2',id=9b4172c9-9407-4727-a1fe-156908bea909,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1441712210',owner='c9caae5967744641b7490e1aa91973c0',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-12-01T19:23:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'image_id': '9b4172c9-9407-4727-a1fe-156908bea909'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:23:41 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:23:41 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:23:41 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:23:41 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:23:41 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:23:41 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:23:41 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:23:41 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='72ad2851c15bfe543e0a6dd84827bf81',container_format='bare',created_at=2023-12-01T19:23:29Z,direct_url=<?>,disk_format='qcow2',id=9b4172c9-9407-4727-a1fe-156908bea909,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1441712210',owner='c9caae5967744641b7490e1aa91973c0',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-12-01T19:23:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:23:41 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:23:41 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:23:41 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:23:41 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:23:41 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:23:41 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:23:41 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:23:41 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:23:41 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:23:41 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:23:41 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:23:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-386572996',display_name='tempest-TestStampPattern-server-386572996',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-386572996',id=22,image_ref='9b4172c9-9407-4727-a1fe-156908bea909',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLSWelIBdKpY5tDhTVMPXRfCvQwvHNWZhGDeDhkjt6+GDQnshog1py5tqU+qYJowL71BLCNBO5cYXwkrz8pBEBbdzILknRNr0r/SkH7MZtJef4QVznd62i44CV3XthbMbQ==',key_name='tempest-TestStampPattern-1467755075',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9caae5967744641b7490e1aa91973c0',ramdisk_id='',reservation_id='r-yz5ok5sr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='a553e030-0d69-4725-9f84-6c0c63556ed4',image_min_disk='1',image_min_ram='0',image_owner_id='c9caae5967744641b7490e1aa91973c0',image_owner_project_name='tempest-TestStampPattern-859706400',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-859706400-project-member',image_user_id='7c1a5012f94b43e38161f8c823173f7f',network_allocated='True',owner_project_name='tempest-TestStampPattern-859706400',owner_user_name='tempest-TestStampPattern-859706400-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:23:38Z,user_data=None,user_id='7c1a5012f94b43e38161f8c823173f7f',uuid=ecc194b4-b8b9-49c8-9d34-4213c4dc15b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d26e49a-f1a5-4922-b26f-2eb8c3d59368", "address": "fa:16:3e:f8:79:92", "network": {"id": "191f13ce-a864-4c09-8ca5-e8a106e24d37", "bridge": "br-int", "label": "tempest-TestStampPattern-1604601756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9caae5967744641b7490e1aa91973c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d26e49a-f1", "ovs_interfaceid": "2d26e49a-f1a5-4922-b26f-2eb8c3d59368", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:23:41 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Converting VIF {"id": "2d26e49a-f1a5-4922-b26f-2eb8c3d59368", "address": "fa:16:3e:f8:79:92", "network": {"id": "191f13ce-a864-4c09-8ca5-e8a106e24d37", "bridge": "br-int", "label": "tempest-TestStampPattern-1604601756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9caae5967744641b7490e1aa91973c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d26e49a-f1", "ovs_interfaceid": "2d26e49a-f1a5-4922-b26f-2eb8c3d59368", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:23:41 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:79:92,bridge_name='br-int',has_traffic_filtering=True,id=2d26e49a-f1a5-4922-b26f-2eb8c3d59368,network=Network(191f13ce-a864-4c09-8ca5-e8a106e24d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d26e49a-f1') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:23:41 user nova-compute[75066]: DEBUG nova.objects.instance [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lazy-loading 'pci_devices' on Instance uuid ecc194b4-b8b9-49c8-9d34-4213c4dc15b8 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:23:41 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:23:41 user nova-compute[75066]:   <uuid>ecc194b4-b8b9-49c8-9d34-4213c4dc15b8</uuid>
Dec 01 19:23:41 user nova-compute[75066]:   <name>instance-00000016</name>
Dec 01 19:23:41 user nova-compute[75066]:   <memory>524288</memory>
Dec 01 19:23:41 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:23:41 user nova-compute[75066]:   <metadata>
Dec 01 19:23:41 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:23:41 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:23:41 user nova-compute[75066]:       <nova:name>tempest-TestStampPattern-server-386572996</nova:name>
Dec 01 19:23:41 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:23:41</nova:creationTime>
Dec 01 19:23:41 user nova-compute[75066]:       <nova:flavor name="m1.tiny">
Dec 01 19:23:41 user nova-compute[75066]:         <nova:memory>512</nova:memory>
Dec 01 19:23:41 user nova-compute[75066]:         <nova:disk>1</nova:disk>
Dec 01 19:23:41 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:23:41 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:23:41 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:23:41 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:23:41 user nova-compute[75066]:       <nova:owner>
Dec 01 19:23:41 user nova-compute[75066]:         <nova:user uuid="7c1a5012f94b43e38161f8c823173f7f">tempest-TestStampPattern-859706400-project-member</nova:user>
Dec 01 19:23:41 user nova-compute[75066]:         <nova:project uuid="c9caae5967744641b7490e1aa91973c0">tempest-TestStampPattern-859706400</nova:project>
Dec 01 19:23:41 user nova-compute[75066]:       </nova:owner>
Dec 01 19:23:41 user nova-compute[75066]:       <nova:root type="image" uuid="9b4172c9-9407-4727-a1fe-156908bea909"/>
Dec 01 19:23:41 user nova-compute[75066]:       <nova:ports>
Dec 01 19:23:41 user nova-compute[75066]:         <nova:port uuid="2d26e49a-f1a5-4922-b26f-2eb8c3d59368">
Dec 01 19:23:41 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Dec 01 19:23:41 user nova-compute[75066]:         </nova:port>
Dec 01 19:23:41 user nova-compute[75066]:       </nova:ports>
Dec 01 19:23:41 user nova-compute[75066]:     </nova:instance>
Dec 01 19:23:41 user nova-compute[75066]:   </metadata>
Dec 01 19:23:41 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:23:41 user nova-compute[75066]:     <system>
Dec 01 19:23:41 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:23:41 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:23:41 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:23:41 user nova-compute[75066]:       <entry name="serial">ecc194b4-b8b9-49c8-9d34-4213c4dc15b8</entry>
Dec 01 19:23:41 user nova-compute[75066]:       <entry name="uuid">ecc194b4-b8b9-49c8-9d34-4213c4dc15b8</entry>
Dec 01 19:23:41 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:23:41 user nova-compute[75066]:     </system>
Dec 01 19:23:41 user nova-compute[75066]:   </sysinfo>
Dec 01 19:23:41 user nova-compute[75066]:   <os>
Dec 01 19:23:41 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:23:41 user nova-compute[75066]:     <boot dev="hd"/>
Dec 01 19:23:41 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:23:41 user nova-compute[75066]:   </os>
Dec 01 19:23:41 user nova-compute[75066]:   <features>
Dec 01 19:23:41 user nova-compute[75066]:     <acpi/>
Dec 01 19:23:41 user nova-compute[75066]:     <apic/>
Dec 01 19:23:41 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:23:41 user nova-compute[75066]:   </features>
Dec 01 19:23:41 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:23:41 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:23:41 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:23:41 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:23:41 user nova-compute[75066]:   </clock>
Dec 01 19:23:41 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:23:41 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:23:41 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:23:41 user nova-compute[75066]:   </cpu>
Dec 01 19:23:41 user nova-compute[75066]:   <devices>
Dec 01 19:23:41 user nova-compute[75066]:     <disk type="file" device="disk">
Dec 01 19:23:41 user nova-compute[75066]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 19:23:41 user nova-compute[75066]:       <source file="/opt/stack/data/nova/instances/ecc194b4-b8b9-49c8-9d34-4213c4dc15b8/disk"/>
Dec 01 19:23:41 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:23:41 user nova-compute[75066]:     </disk>
Dec 01 19:23:41 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:23:41 user nova-compute[75066]:       <mac address="fa:16:3e:f8:79:92"/>
Dec 01 19:23:41 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:23:41 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:23:41 user nova-compute[75066]:       <target dev="tap2d26e49a-f1"/>
Dec 01 19:23:41 user nova-compute[75066]:     </interface>
Dec 01 19:23:41 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:23:41 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/ecc194b4-b8b9-49c8-9d34-4213c4dc15b8/console.log" append="off"/>
Dec 01 19:23:41 user nova-compute[75066]:     </serial>
Dec 01 19:23:41 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:23:41 user nova-compute[75066]:     <video>
Dec 01 19:23:41 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:23:41 user nova-compute[75066]:     </video>
Dec 01 19:23:41 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:23:41 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:23:41 user nova-compute[75066]:     </rng>
Dec 01 19:23:41 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:23:41 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:23:41 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:23:41 user nova-compute[75066]:     </memballoon>
Dec 01 19:23:41 user nova-compute[75066]:   </devices>
Dec 01 19:23:41 user nova-compute[75066]: </domain>
Dec 01 19:23:41 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:23:41 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:23:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-386572996',display_name='tempest-TestStampPattern-server-386572996',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-386572996',id=22,image_ref='9b4172c9-9407-4727-a1fe-156908bea909',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLSWelIBdKpY5tDhTVMPXRfCvQwvHNWZhGDeDhkjt6+GDQnshog1py5tqU+qYJowL71BLCNBO5cYXwkrz8pBEBbdzILknRNr0r/SkH7MZtJef4QVznd62i44CV3XthbMbQ==',key_name='tempest-TestStampPattern-1467755075',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9caae5967744641b7490e1aa91973c0',ramdisk_id='',reservation_id='r-yz5ok5sr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='a553e030-0d69-4725-9f84-6c0c63556ed4',image_min_disk='1',image_min_ram='0',image_owner_id='c9caae5967744641b7490e1aa91973c0',image_owner_project_name='tempest-TestStampPattern-859706400',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-859706400-project-member',image_user_id='7c1a5012f94b43e38161f8c823173f7f',network_allocated='True',owner_project_name='tempest-TestStampPattern-859706400',owner_user_name='tempest-TestStampPattern-859706400-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:23:38Z,user_data=None,user_id='7c1a5012f94b43e38161f8c823173f7f',uuid=ecc194b4-b8b9-49c8-9d34-4213c4dc15b8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2d26e49a-f1a5-4922-b26f-2eb8c3d59368", "address": "fa:16:3e:f8:79:92", "network": {"id": "191f13ce-a864-4c09-8ca5-e8a106e24d37", "bridge": "br-int", "label": "tempest-TestStampPattern-1604601756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9caae5967744641b7490e1aa91973c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d26e49a-f1", "ovs_interfaceid": "2d26e49a-f1a5-4922-b26f-2eb8c3d59368", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:23:41 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Converting VIF {"id": "2d26e49a-f1a5-4922-b26f-2eb8c3d59368", "address": "fa:16:3e:f8:79:92", "network": {"id": "191f13ce-a864-4c09-8ca5-e8a106e24d37", "bridge": "br-int", "label": "tempest-TestStampPattern-1604601756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9caae5967744641b7490e1aa91973c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d26e49a-f1", "ovs_interfaceid": "2d26e49a-f1a5-4922-b26f-2eb8c3d59368", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:23:41 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:79:92,bridge_name='br-int',has_traffic_filtering=True,id=2d26e49a-f1a5-4922-b26f-2eb8c3d59368,network=Network(191f13ce-a864-4c09-8ca5-e8a106e24d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d26e49a-f1') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:23:41 user nova-compute[75066]: DEBUG os_vif [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:79:92,bridge_name='br-int',has_traffic_filtering=True,id=2d26e49a-f1a5-4922-b26f-2eb8c3d59368,network=Network(191f13ce-a864-4c09-8ca5-e8a106e24d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d26e49a-f1') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:23:41 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:41 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:23:41 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:23:41 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:41 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9ff72cc5-b752-57b9-ac35-8814ec87ade6', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:23:41 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:41 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:23:41 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:41 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2d26e49a-f1, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:23:41 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2d26e49a-f1, col_values=(('qos', UUID('944d7cee-fa54-43a1-97c3-4f56334b106d')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:23:41 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2d26e49a-f1, col_values=(('external_ids', {'iface-id': '2d26e49a-f1a5-4922-b26f-2eb8c3d59368', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:79:92', 'vm-uuid': 'ecc194b4-b8b9-49c8-9d34-4213c4dc15b8'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:23:41 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:41 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:23:41 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:41 user nova-compute[75066]: INFO os_vif [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:79:92,bridge_name='br-int',has_traffic_filtering=True,id=2d26e49a-f1a5-4922-b26f-2eb8c3d59368,network=Network(191f13ce-a864-4c09-8ca5-e8a106e24d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d26e49a-f1')
Dec 01 19:23:41 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:23:41 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] No VIF found with MAC fa:16:3e:f8:79:92, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:23:42 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:42 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:42 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:42 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:43 user nova-compute[75066]: DEBUG nova.compute.manager [req-67694f2d-fab1-4bab-88b2-feecfdd2c589 req-dac685e2-347f-4852-8114-9d006a4fa96a service nova] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Received event network-vif-plugged-2d26e49a-f1a5-4922-b26f-2eb8c3d59368 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:23:43 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-67694f2d-fab1-4bab-88b2-feecfdd2c589 req-dac685e2-347f-4852-8114-9d006a4fa96a service nova] Acquiring lock "ecc194b4-b8b9-49c8-9d34-4213c4dc15b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:23:43 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-67694f2d-fab1-4bab-88b2-feecfdd2c589 req-dac685e2-347f-4852-8114-9d006a4fa96a service nova] Lock "ecc194b4-b8b9-49c8-9d34-4213c4dc15b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:23:43 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-67694f2d-fab1-4bab-88b2-feecfdd2c589 req-dac685e2-347f-4852-8114-9d006a4fa96a service nova] Lock "ecc194b4-b8b9-49c8-9d34-4213c4dc15b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:23:43 user nova-compute[75066]: DEBUG nova.compute.manager [req-67694f2d-fab1-4bab-88b2-feecfdd2c589 req-dac685e2-347f-4852-8114-9d006a4fa96a service nova] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] No waiting events found dispatching network-vif-plugged-2d26e49a-f1a5-4922-b26f-2eb8c3d59368 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:23:43 user nova-compute[75066]: WARNING nova.compute.manager [req-67694f2d-fab1-4bab-88b2-feecfdd2c589 req-dac685e2-347f-4852-8114-9d006a4fa96a service nova] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Received unexpected event network-vif-plugged-2d26e49a-f1a5-4922-b26f-2eb8c3d59368 for instance with vm_state building and task_state spawning.
Dec 01 19:23:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:45 user nova-compute[75066]: DEBUG nova.compute.manager [req-62121aee-7c8b-4ec1-ae19-65affbb712fa req-ef4d0e81-9e24-47bf-8028-28d41df491fb service nova] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Received event network-vif-plugged-2d26e49a-f1a5-4922-b26f-2eb8c3d59368 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:23:45 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-62121aee-7c8b-4ec1-ae19-65affbb712fa req-ef4d0e81-9e24-47bf-8028-28d41df491fb service nova] Acquiring lock "ecc194b4-b8b9-49c8-9d34-4213c4dc15b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:23:45 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-62121aee-7c8b-4ec1-ae19-65affbb712fa req-ef4d0e81-9e24-47bf-8028-28d41df491fb service nova] Lock "ecc194b4-b8b9-49c8-9d34-4213c4dc15b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:23:45 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-62121aee-7c8b-4ec1-ae19-65affbb712fa req-ef4d0e81-9e24-47bf-8028-28d41df491fb service nova] Lock "ecc194b4-b8b9-49c8-9d34-4213c4dc15b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:23:45 user nova-compute[75066]: DEBUG nova.compute.manager [req-62121aee-7c8b-4ec1-ae19-65affbb712fa req-ef4d0e81-9e24-47bf-8028-28d41df491fb service nova] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] No waiting events found dispatching network-vif-plugged-2d26e49a-f1a5-4922-b26f-2eb8c3d59368 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:23:45 user nova-compute[75066]: WARNING nova.compute.manager [req-62121aee-7c8b-4ec1-ae19-65affbb712fa req-ef4d0e81-9e24-47bf-8028-28d41df491fb service nova] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Received unexpected event network-vif-plugged-2d26e49a-f1a5-4922-b26f-2eb8c3d59368 for instance with vm_state building and task_state spawning.
Dec 01 19:23:45 user nova-compute[75066]: DEBUG nova.compute.manager [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Instance event wait completed in 0 seconds for  {{(pid=75066) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 19:23:45 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Guest created on hypervisor {{(pid=75066) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 19:23:45 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Instance spawned successfully.
Dec 01 19:23:45 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 19:23:45 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Found default for hw_input_bus of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:23:45 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Found default for hw_pointer_model of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:23:45 user nova-compute[75066]: INFO nova.compute.manager [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Took 6.82 seconds to spawn the instance on the hypervisor.
Dec 01 19:23:45 user nova-compute[75066]: DEBUG nova.compute.manager [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:23:45 user nova-compute[75066]: INFO nova.compute.manager [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Took 7.96 seconds to build instance.
Dec 01 19:23:45 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-69d36b92-344c-4f12-80e0-85b8d78ac05e tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lock "ecc194b4-b8b9-49c8-9d34-4213c4dc15b8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.083s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:23:46 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:47 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:47 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:49 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:52 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-120099dc-e755-461e-b137-3f6905abbfa1 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Acquiring lock "3d340166-c58b-4213-b8d3-5036ade48d2d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:23:52 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-120099dc-e755-461e-b137-3f6905abbfa1 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "3d340166-c58b-4213-b8d3-5036ade48d2d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:23:52 user nova-compute[75066]: INFO nova.compute.manager [None req-120099dc-e755-461e-b137-3f6905abbfa1 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Detaching volume 60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc
Dec 01 19:23:52 user nova-compute[75066]: INFO nova.virt.block_device [None req-120099dc-e755-461e-b137-3f6905abbfa1 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Attempting to driver detach volume 60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc from mountpoint /dev/vdb
Dec 01 19:23:52 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-120099dc-e755-461e-b137-3f6905abbfa1 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Attempting to detach device vdb from instance 3d340166-c58b-4213-b8d3-5036ade48d2d from the persistent domain config. {{(pid=75066) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 19:23:52 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-120099dc-e755-461e-b137-3f6905abbfa1 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 19:23:52 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:23:52 user nova-compute[75066]:   <source dev="/dev/sdb"/>
Dec 01 19:23:52 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:23:52 user nova-compute[75066]:   <serial>60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc</serial>
Dec 01 19:23:52 user nova-compute[75066]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 01 19:23:52 user nova-compute[75066]: </disk>
Dec 01 19:23:52 user nova-compute[75066]:  {{(pid=75066) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 19:23:52 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-120099dc-e755-461e-b137-3f6905abbfa1 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Successfully detached device vdb from instance 3d340166-c58b-4213-b8d3-5036ade48d2d from the persistent domain config.
Dec 01 19:23:52 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-120099dc-e755-461e-b137-3f6905abbfa1 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3d340166-c58b-4213-b8d3-5036ade48d2d from the live domain config. {{(pid=75066) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 19:23:52 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-120099dc-e755-461e-b137-3f6905abbfa1 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 19:23:52 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:23:52 user nova-compute[75066]:   <source dev="/dev/sdb"/>
Dec 01 19:23:52 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:23:52 user nova-compute[75066]:   <serial>60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc</serial>
Dec 01 19:23:52 user nova-compute[75066]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 01 19:23:52 user nova-compute[75066]: </disk>
Dec 01 19:23:52 user nova-compute[75066]:  {{(pid=75066) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 19:23:53 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-120099dc-e755-461e-b137-3f6905abbfa1 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3d340166-c58b-4213-b8d3-5036ade48d2d {{(pid=75066) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 19:23:53 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-07d16a89-19da-40a8-9541-917facce604a tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Acquiring lock "933210b1-5c5e-421a-9b63-4595fc5f5f25" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:23:53 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-07d16a89-19da-40a8-9541-917facce604a tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lock "933210b1-5c5e-421a-9b63-4595fc5f5f25" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:23:53 user nova-compute[75066]: INFO nova.compute.manager [None req-07d16a89-19da-40a8-9541-917facce604a tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Detaching volume 54688856-5adb-495a-91ae-7e593169bf98
Dec 01 19:23:53 user nova-compute[75066]: INFO nova.virt.block_device [None req-07d16a89-19da-40a8-9541-917facce604a tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Attempting to driver detach volume 54688856-5adb-495a-91ae-7e593169bf98 from mountpoint /dev/vdb
Dec 01 19:23:53 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-07d16a89-19da-40a8-9541-917facce604a tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Attempting to detach device vdb from instance 933210b1-5c5e-421a-9b63-4595fc5f5f25 from the persistent domain config. {{(pid=75066) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 19:23:53 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-07d16a89-19da-40a8-9541-917facce604a tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 19:23:53 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:23:53 user nova-compute[75066]:   <source dev="/dev/sdc"/>
Dec 01 19:23:53 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:23:53 user nova-compute[75066]:   <serial>54688856-5adb-495a-91ae-7e593169bf98</serial>
Dec 01 19:23:53 user nova-compute[75066]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 19:23:53 user nova-compute[75066]: </disk>
Dec 01 19:23:53 user nova-compute[75066]:  {{(pid=75066) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 19:23:53 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-07d16a89-19da-40a8-9541-917facce604a tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Successfully detached device vdb from instance 933210b1-5c5e-421a-9b63-4595fc5f5f25 from the persistent domain config.
Dec 01 19:23:53 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-07d16a89-19da-40a8-9541-917facce604a tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 933210b1-5c5e-421a-9b63-4595fc5f5f25 from the live domain config. {{(pid=75066) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 19:23:53 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-07d16a89-19da-40a8-9541-917facce604a tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 19:23:53 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:23:53 user nova-compute[75066]:   <source dev="/dev/sdc"/>
Dec 01 19:23:53 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:23:53 user nova-compute[75066]:   <serial>54688856-5adb-495a-91ae-7e593169bf98</serial>
Dec 01 19:23:53 user nova-compute[75066]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 19:23:53 user nova-compute[75066]: </disk>
Dec 01 19:23:53 user nova-compute[75066]:  {{(pid=75066) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 19:23:53 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:53 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-cda7830e-dd4e-4014-a830-69540ba24119 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Acquiring lock "933210b1-5c5e-421a-9b63-4595fc5f5f25" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:23:53 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-07d16a89-19da-40a8-9541-917facce604a tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 933210b1-5c5e-421a-9b63-4595fc5f5f25 {{(pid=75066) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 19:23:55 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:56 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:57 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dfecfd1c-a34d-41c9-af4e-8706dd7ba62b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Acquiring lock "dd546862-fcd5-4b69-8ea3-a8fa4859a489" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:23:57 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dfecfd1c-a34d-41c9-af4e-8706dd7ba62b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Lock "dd546862-fcd5-4b69-8ea3-a8fa4859a489" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:23:57 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dfecfd1c-a34d-41c9-af4e-8706dd7ba62b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Acquiring lock "dd546862-fcd5-4b69-8ea3-a8fa4859a489-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:23:57 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dfecfd1c-a34d-41c9-af4e-8706dd7ba62b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Lock "dd546862-fcd5-4b69-8ea3-a8fa4859a489-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:23:57 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dfecfd1c-a34d-41c9-af4e-8706dd7ba62b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Lock "dd546862-fcd5-4b69-8ea3-a8fa4859a489-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:23:57 user nova-compute[75066]: INFO nova.compute.manager [None req-dfecfd1c-a34d-41c9-af4e-8706dd7ba62b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Terminating instance
Dec 01 19:23:57 user nova-compute[75066]: DEBUG nova.compute.manager [None req-dfecfd1c-a34d-41c9-af4e-8706dd7ba62b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Start destroying the instance on the hypervisor. {{(pid=75066) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 19:23:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:58 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Instance destroyed successfully.
Dec 01 19:23:58 user nova-compute[75066]: DEBUG nova.objects.instance [None req-dfecfd1c-a34d-41c9-af4e-8706dd7ba62b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Lazy-loading 'resources' on Instance uuid dd546862-fcd5-4b69-8ea3-a8fa4859a489 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:23:58 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-dfecfd1c-a34d-41c9-af4e-8706dd7ba62b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:15:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-360735581',display_name='tempest-ServerActionsTestOtherB-server-360735581',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-360735581',id=5,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOGqD/77ZPXT6+uFjy9YkzZfO6BpJHbV+zzx/mIYY08bckUat50Cdx1l30v4s1jcybtm106xn+eO4W484wI5lg1LoXDJHliGvHVijdeGBF2TMVA7/KP/EGT4mweXKritFQ==',key_name='tempest-keypair-842148615',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:21:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2830de7697db4d5e8b9c358dab7f4368',ramdisk_id='',reservation_id='r-tl7vmif9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-2122210178',owner_user_name='tempest-ServerActionsTestOtherB-2122210178-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:21:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e363b559098f48d4bc5478c657d7de6a',uuid=dd546862-fcd5-4b69-8ea3-a8fa4859a489,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "478e7aea-9546-4659-bdac-09213bd9cb82", "address": "fa:16:3e:9a:26:f6", "network": {"id": "d182d3d1-113a-4bf5-b325-f073247f0547", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-325272674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2830de7697db4d5e8b9c358dab7f4368", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap478e7aea-95", "ovs_interfaceid": "478e7aea-9546-4659-bdac-09213bd9cb82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:23:58 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-dfecfd1c-a34d-41c9-af4e-8706dd7ba62b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Converting VIF {"id": "478e7aea-9546-4659-bdac-09213bd9cb82", "address": "fa:16:3e:9a:26:f6", "network": {"id": "d182d3d1-113a-4bf5-b325-f073247f0547", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-325272674-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2830de7697db4d5e8b9c358dab7f4368", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap478e7aea-95", "ovs_interfaceid": "478e7aea-9546-4659-bdac-09213bd9cb82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:23:58 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-dfecfd1c-a34d-41c9-af4e-8706dd7ba62b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:26:f6,bridge_name='br-int',has_traffic_filtering=True,id=478e7aea-9546-4659-bdac-09213bd9cb82,network=Network(d182d3d1-113a-4bf5-b325-f073247f0547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap478e7aea-95') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:23:58 user nova-compute[75066]: DEBUG os_vif [None req-dfecfd1c-a34d-41c9-af4e-8706dd7ba62b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:26:f6,bridge_name='br-int',has_traffic_filtering=True,id=478e7aea-9546-4659-bdac-09213bd9cb82,network=Network(d182d3d1-113a-4bf5-b325-f073247f0547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap478e7aea-95') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:23:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap478e7aea-95, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:23:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b94b9379-6a1e-40b6-bf78-df2a0171d5d5) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:23:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:23:58 user nova-compute[75066]: INFO os_vif [None req-dfecfd1c-a34d-41c9-af4e-8706dd7ba62b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:26:f6,bridge_name='br-int',has_traffic_filtering=True,id=478e7aea-9546-4659-bdac-09213bd9cb82,network=Network(d182d3d1-113a-4bf5-b325-f073247f0547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap478e7aea-95')
Dec 01 19:23:58 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfecfd1c-a34d-41c9-af4e-8706dd7ba62b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] calling os-brick to detach iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 19:23:58 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfecfd1c-a34d-41c9-af4e-8706dd7ba62b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, {'target_iqn': 'iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gUkyhEaX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:23:58 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-dfecfd1c-a34d-41c9-af4e-8706dd7ba62b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:23:58 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-dfecfd1c-a34d-41c9-af4e-8706dd7ba62b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:23:58 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-dfecfd1c-a34d-41c9-af4e-8706dd7ba62b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:23:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:58 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e47f30-5f68-44c1-9578-5231cc81c609]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:23:58 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfecfd1c-a34d-41c9-af4e-8706dd7ba62b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 19:23:58 user nova-compute[75066]: No targets found.
Dec 01 19:23:58 user nova-compute[75066]: iSNS:
Dec 01 19:23:58 user nova-compute[75066]: No targets found.
Dec 01 19:23:58 user nova-compute[75066]: STATIC:
Dec 01 19:23:58 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98
Dec 01 19:23:58 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:23:58 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:23:58 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2
Dec 01 19:23:58 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:23:58 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:23:58 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c
Dec 01 19:23:58 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:23:58 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:23:58 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc
Dec 01 19:23:58 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:23:58 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:23:58 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb
Dec 01 19:23:58 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:23:58 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:23:58 user nova-compute[75066]: FIRMWARE:
Dec 01 19:23:58 user nova-compute[75066]: No targets found.
Dec 01 19:23:58 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:23:58 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfecfd1c-a34d-41c9-af4e-8706dd7ba62b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 19:23:58 user nova-compute[75066]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 19:23:58 user nova-compute[75066]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75066) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 19:23:58 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfecfd1c-a34d-41c9-af4e-8706dd7ba62b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2', 0)] {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 19:23:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:58 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae6d155-6975-454b-9a39-1dd914556105]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:23:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:58 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[8096b851-0f08-4762-a2fd-12a8966f2f63]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:23:58 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfecfd1c-a34d-41c9-af4e-8706dd7ba62b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)
Dec 01 19:23:58 user nova-compute[75066]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)
Dec 01 19:23:58 user nova-compute[75066]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:23:58 user nova-compute[75066]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)
Dec 01 19:23:58 user nova-compute[75066]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98 (non-flash)
Dec 01 19:23:58 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:23:58 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfecfd1c-a34d-41c9-af4e-8706dd7ba62b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)
Dec 01 19:23:58 user nova-compute[75066]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 (non-flash)
Dec 01 19:23:58 user nova-compute[75066]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:23:58 user nova-compute[75066]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)
Dec 01 19:23:58 user nova-compute[75066]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98 (non-flash)
Dec 01 19:23:58 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:23:58 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfecfd1c-a34d-41c9-af4e-8706dd7ba62b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f919016be20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2'): ({'sdd'}, set())}) {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 19:23:58 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-dfecfd1c-a34d-41c9-af4e-8706dd7ba62b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Removing single pathed devices sdd {{(pid=75066) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 19:23:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:58 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c307979-4ea3-42bf-b645-837d2566b031]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:23:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:58 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[015fee26-9c75-433b-b3cf-12fa29dcffbe]: (4, ('ok\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:23:58 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-dfecfd1c-a34d-41c9-af4e-8706dd7ba62b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Flushing IO for device /dev/sdd {{(pid=75066) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 19:23:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:58 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a69ad0-eca6-4438-a24e-4d5fb4468a73]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:23:58 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-dfecfd1c-a34d-41c9-af4e-8706dd7ba62b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75066) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 19:23:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:58 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[b211ca09-2d06-481b-a113-e3ed39628da1]: (4, ('1', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:23:58 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-dfecfd1c-a34d-41c9-af4e-8706dd7ba62b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 19:23:58 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-dfecfd1c-a34d-41c9-af4e-8706dd7ba62b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] SCSI volumes sdd have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 19:23:58 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfecfd1c-a34d-41c9-af4e-8706dd7ba62b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2')] {{(pid=75066) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 19:23:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:58 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f57694-c6f4-4e14-bc2b-c78c795002a8]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:23:58 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfecfd1c-a34d-41c9-af4e-8706dd7ba62b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:23:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 -p 172.16.0.220:3260 --logout {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:58 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[016827cf-964f-481a-989a-7e25354ba2ac]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:23:58 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfecfd1c-a34d-41c9-af4e-8706dd7ba62b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2, portal: 172.16.0.220,3260]
Dec 01 19:23:58 user nova-compute[75066]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2, portal: 172.16.0.220,3260] successful.
Dec 01 19:23:58 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:23:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 -p 172.16.0.220:3260 --op delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:23:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6e9e54d-57f4-4413-9c76-50da506906d2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:23:58 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb9e560-2a3b-4944-8e43-0a816981b936]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:23:58 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfecfd1c-a34d-41c9-af4e-8706dd7ba62b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:23:58 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-dfecfd1c-a34d-41c9-af4e-8706dd7ba62b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:23:58 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dfecfd1c-a34d-41c9-af4e-8706dd7ba62b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] <== disconnect_volume: return (325ms) None {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:23:58 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dfecfd1c-a34d-41c9-af4e-8706dd7ba62b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Disconnected iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 19:23:58 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-dfecfd1c-a34d-41c9-af4e-8706dd7ba62b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Deleting instance files /opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489_del
Dec 01 19:23:58 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-dfecfd1c-a34d-41c9-af4e-8706dd7ba62b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Deletion of /opt/stack/data/nova/instances/dd546862-fcd5-4b69-8ea3-a8fa4859a489_del complete
Dec 01 19:23:58 user nova-compute[75066]: INFO nova.compute.manager [None req-dfecfd1c-a34d-41c9-af4e-8706dd7ba62b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Took 1.27 seconds to destroy the instance on the hypervisor.
Dec 01 19:23:58 user nova-compute[75066]: DEBUG oslo.service.loopingcall [None req-dfecfd1c-a34d-41c9-af4e-8706dd7ba62b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75066) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 19:23:58 user nova-compute[75066]: DEBUG nova.compute.manager [-] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Deallocating network for instance {{(pid=75066) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 19:23:58 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] deallocate_for_instance() {{(pid=75066) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 19:23:59 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:23:59 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:23:59 user nova-compute[75066]: DEBUG nova.compute.manager [req-00448ed2-dd0e-492d-9b60-e4bf304c2297 req-a7c12275-bb8d-4d05-9f72-c6296a0b53f3 service nova] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Received event network-vif-deleted-478e7aea-9546-4659-bdac-09213bd9cb82 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:23:59 user nova-compute[75066]: INFO nova.compute.manager [req-00448ed2-dd0e-492d-9b60-e4bf304c2297 req-a7c12275-bb8d-4d05-9f72-c6296a0b53f3 service nova] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Neutron deleted interface 478e7aea-9546-4659-bdac-09213bd9cb82; detaching it from the instance and deleting it from the info cache
Dec 01 19:23:59 user nova-compute[75066]: DEBUG nova.network.neutron [req-00448ed2-dd0e-492d-9b60-e4bf304c2297 req-a7c12275-bb8d-4d05-9f72-c6296a0b53f3 service nova] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:23:59 user nova-compute[75066]: INFO nova.compute.manager [-] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Took 0.84 seconds to deallocate network for instance.
Dec 01 19:23:59 user nova-compute[75066]: DEBUG nova.compute.manager [req-00448ed2-dd0e-492d-9b60-e4bf304c2297 req-a7c12275-bb8d-4d05-9f72-c6296a0b53f3 service nova] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Detach interface failed, port_id=478e7aea-9546-4659-bdac-09213bd9cb82, reason: Instance dd546862-fcd5-4b69-8ea3-a8fa4859a489 could not be found. {{(pid=75066) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 01 19:23:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Acquiring lock "23e17727-40b4-48f7-9155-abc8ffa9f619" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:23:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "23e17727-40b4-48f7-9155-abc8ffa9f619" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:23:59 user nova-compute[75066]: DEBUG nova.compute.manager [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Starting instance... {{(pid=75066) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 19:23:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:23:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:23:59 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75066) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 19:23:59 user nova-compute[75066]: INFO nova.compute.claims [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Claim successful on node user
Dec 01 19:24:00 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:24:00 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:24:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.546s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:24:00 user nova-compute[75066]: DEBUG nova.compute.manager [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Start building networks asynchronously for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 19:24:00 user nova-compute[75066]: DEBUG nova.compute.manager [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Allocating IP information in the background. {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 19:24:00 user nova-compute[75066]: DEBUG nova.network.neutron [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] allocate_for_instance() {{(pid=75066) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 19:24:00 user nova-compute[75066]: INFO nova.compute.manager [None req-dfecfd1c-a34d-41c9-af4e-8706dd7ba62b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] [instance: dd546862-fcd5-4b69-8ea3-a8fa4859a489] Took 0.81 seconds to detach 1 volumes for instance.
Dec 01 19:24:00 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 19:24:00 user nova-compute[75066]: DEBUG nova.compute.manager [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Start building block device mappings for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 19:24:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dfecfd1c-a34d-41c9-af4e-8706dd7ba62b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:24:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dfecfd1c-a34d-41c9-af4e-8706dd7ba62b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:24:00 user nova-compute[75066]: DEBUG nova.policy [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eeb6ade6e91541b5b737150a67b6bd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5326c00d464e008337e0dc8577fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75066) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 19:24:00 user nova-compute[75066]: DEBUG nova.compute.manager [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Start spawning the instance on the hypervisor. {{(pid=75066) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 19:24:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Creating instance directory {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 19:24:00 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Creating image(s)
Dec 01 19:24:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Acquiring lock "/opt/stack/data/nova/instances/23e17727-40b4-48f7-9155-abc8ffa9f619/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:24:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "/opt/stack/data/nova/instances/23e17727-40b4-48f7-9155-abc8ffa9f619/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:24:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "/opt/stack/data/nova/instances/23e17727-40b4-48f7-9155-abc8ffa9f619/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:24:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Acquiring lock "d355c9206e88c86648ac73e02c0c25330d3bfb1c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:24:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "d355c9206e88c86648ac73e02c0c25330d3bfb1c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:24:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d355c9206e88c86648ac73e02c0c25330d3bfb1c.part --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d355c9206e88c86648ac73e02c0c25330d3bfb1c.part --force-share --output=json" returned: 0 in 0.266s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:00 user nova-compute[75066]: DEBUG nova.virt.images [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] 5632f29c-8b44-432c-88c6-02567939cb91 was qcow2, converting to raw {{(pid=75066) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 01 19:24:00 user nova-compute[75066]: DEBUG nova.privsep.utils [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75066) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 01 19:24:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d355c9206e88c86648ac73e02c0c25330d3bfb1c.part /opt/stack/data/nova/instances/_base/d355c9206e88c86648ac73e02c0c25330d3bfb1c.converted {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:01 user nova-compute[75066]: DEBUG nova.network.neutron [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Successfully created port: 902b1013-6c79-4a5a-ab19-782ac8dc715b {{(pid=75066) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 19:24:01 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-dfecfd1c-a34d-41c9-af4e-8706dd7ba62b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:24:01 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-dfecfd1c-a34d-41c9-af4e-8706dd7ba62b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:24:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d355c9206e88c86648ac73e02c0c25330d3bfb1c.part /opt/stack/data/nova/instances/_base/d355c9206e88c86648ac73e02c0c25330d3bfb1c.converted" returned: 0 in 0.161s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d355c9206e88c86648ac73e02c0c25330d3bfb1c.converted --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dfecfd1c-a34d-41c9-af4e-8706dd7ba62b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.983s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:24:01 user nova-compute[75066]: INFO nova.scheduler.client.report [None req-dfecfd1c-a34d-41c9-af4e-8706dd7ba62b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Deleted allocations for instance dd546862-fcd5-4b69-8ea3-a8fa4859a489
Dec 01 19:24:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dfecfd1c-a34d-41c9-af4e-8706dd7ba62b tempest-ServerActionsTestOtherB-2122210178 tempest-ServerActionsTestOtherB-2122210178-project-member] Lock "dd546862-fcd5-4b69-8ea3-a8fa4859a489" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.108s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:24:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d355c9206e88c86648ac73e02c0c25330d3bfb1c.converted --force-share --output=json" returned: 0 in 0.220s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "d355c9206e88c86648ac73e02c0c25330d3bfb1c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.066s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:24:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d355c9206e88c86648ac73e02c0c25330d3bfb1c --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d355c9206e88c86648ac73e02c0c25330d3bfb1c --force-share --output=json" returned: 0 in 0.188s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Acquiring lock "d355c9206e88c86648ac73e02c0c25330d3bfb1c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:24:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "d355c9206e88c86648ac73e02c0c25330d3bfb1c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:24:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d355c9206e88c86648ac73e02c0c25330d3bfb1c --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:01 user nova-compute[75066]: DEBUG nova.network.neutron [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Successfully updated port: 902b1013-6c79-4a5a-ab19-782ac8dc715b {{(pid=75066) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 19:24:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Acquiring lock "refresh_cache-23e17727-40b4-48f7-9155-abc8ffa9f619" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:24:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Acquired lock "refresh_cache-23e17727-40b4-48f7-9155-abc8ffa9f619" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:24:01 user nova-compute[75066]: DEBUG nova.network.neutron [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:24:01 user nova-compute[75066]: DEBUG nova.compute.manager [req-7e5430bd-cb5d-4eb9-9470-a4a43ac78b99 req-a6e2c24b-f19d-4fc5-a75f-65ad6fdb22af service nova] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Received event network-changed-902b1013-6c79-4a5a-ab19-782ac8dc715b {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:24:01 user nova-compute[75066]: DEBUG nova.compute.manager [req-7e5430bd-cb5d-4eb9-9470-a4a43ac78b99 req-a6e2c24b-f19d-4fc5-a75f-65ad6fdb22af service nova] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Refreshing instance network info cache due to event network-changed-902b1013-6c79-4a5a-ab19-782ac8dc715b. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:24:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-7e5430bd-cb5d-4eb9-9470-a4a43ac78b99 req-a6e2c24b-f19d-4fc5-a75f-65ad6fdb22af service nova] Acquiring lock "refresh_cache-23e17727-40b4-48f7-9155-abc8ffa9f619" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:24:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d355c9206e88c86648ac73e02c0c25330d3bfb1c --force-share --output=json" returned: 0 in 0.173s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d355c9206e88c86648ac73e02c0c25330d3bfb1c,backing_fmt=raw /opt/stack/data/nova/instances/23e17727-40b4-48f7-9155-abc8ffa9f619/disk 1073741824 {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:01 user nova-compute[75066]: DEBUG nova.network.neutron [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:24:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d355c9206e88c86648ac73e02c0c25330d3bfb1c,backing_fmt=raw /opt/stack/data/nova/instances/23e17727-40b4-48f7-9155-abc8ffa9f619/disk 1073741824" returned: 0 in 0.046s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "d355c9206e88c86648ac73e02c0c25330d3bfb1c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.222s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:24:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d355c9206e88c86648ac73e02c0c25330d3bfb1c --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d355c9206e88c86648ac73e02c0c25330d3bfb1c --force-share --output=json" returned: 0 in 0.182s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:01 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Checking if we can resize image /opt/stack/data/nova/instances/23e17727-40b4-48f7-9155-abc8ffa9f619/disk. size=1073741824 {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 19:24:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23e17727-40b4-48f7-9155-abc8ffa9f619/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:02 user nova-compute[75066]: DEBUG nova.network.neutron [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Updating instance_info_cache with network_info: [{"id": "902b1013-6c79-4a5a-ab19-782ac8dc715b", "address": "fa:16:3e:fe:93:cc", "network": {"id": "4fe4d56e-afe2-42a6-984a-9af8bc5377a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126385357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5326c00d464e008337e0dc8577fc2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap902b1013-6c", "ovs_interfaceid": "902b1013-6c79-4a5a-ab19-782ac8dc715b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:24:02 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Releasing lock "refresh_cache-23e17727-40b4-48f7-9155-abc8ffa9f619" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:24:02 user nova-compute[75066]: DEBUG nova.compute.manager [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Instance network_info: |[{"id": "902b1013-6c79-4a5a-ab19-782ac8dc715b", "address": "fa:16:3e:fe:93:cc", "network": {"id": "4fe4d56e-afe2-42a6-984a-9af8bc5377a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126385357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5326c00d464e008337e0dc8577fc2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap902b1013-6c", "ovs_interfaceid": "902b1013-6c79-4a5a-ab19-782ac8dc715b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 19:24:02 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-7e5430bd-cb5d-4eb9-9470-a4a43ac78b99 req-a6e2c24b-f19d-4fc5-a75f-65ad6fdb22af service nova] Acquired lock "refresh_cache-23e17727-40b4-48f7-9155-abc8ffa9f619" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:24:02 user nova-compute[75066]: DEBUG nova.network.neutron [req-7e5430bd-cb5d-4eb9-9470-a4a43ac78b99 req-a6e2c24b-f19d-4fc5-a75f-65ad6fdb22af service nova] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Refreshing network info cache for port 902b1013-6c79-4a5a-ab19-782ac8dc715b {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:24:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23e17727-40b4-48f7-9155-abc8ffa9f619/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:02 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Cannot resize image /opt/stack/data/nova/instances/23e17727-40b4-48f7-9155-abc8ffa9f619/disk to a smaller size. {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 19:24:02 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Created local disks {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 19:24:02 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Ensure instance console log exists: /opt/stack/data/nova/instances/23e17727-40b4-48f7-9155-abc8ffa9f619/console.log {{(pid=75066) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 19:24:02 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:24:02 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:24:02 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:24:02 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Start _get_guest_xml network_info=[{"id": "902b1013-6c79-4a5a-ab19-782ac8dc715b", "address": "fa:16:3e:fe:93:cc", "network": {"id": "4fe4d56e-afe2-42a6-984a-9af8bc5377a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126385357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5326c00d464e008337e0dc8577fc2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap902b1013-6c", "ovs_interfaceid": "902b1013-6c79-4a5a-ab19-782ac8dc715b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:23:57Z,direct_url=<?>,disk_format='qcow2',id=5632f29c-8b44-432c-88c6-02567939cb91,min_disk=0,min_ram=0,name='tempest-scenario-img--1907005140',owner='1d5326c00d464e008337e0dc8577fc2d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:23:58Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'image_id': '5632f29c-8b44-432c-88c6-02567939cb91'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:24:02 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:24:02 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:24:02 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:24:02 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:24:02 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:24:02 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:24:02 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:24:02 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:23:57Z,direct_url=<?>,disk_format='qcow2',id=5632f29c-8b44-432c-88c6-02567939cb91,min_disk=0,min_ram=0,name='tempest-scenario-img--1907005140',owner='1d5326c00d464e008337e0dc8577fc2d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:23:58Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:24:02 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:24:02 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:24:02 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:24:02 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:24:02 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:24:02 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:24:02 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:24:02 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:24:02 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:24:02 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:24:02 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:23:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1401953060',display_name='tempest-TestMinimumBasicScenario-server-1401953060',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1401953060',id=23,image_ref='5632f29c-8b44-432c-88c6-02567939cb91',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQs/30B1+efn0s6ylAyaZU6Z3hXoydPhUb7ZPkYfCAu2HdecYo2d432waybQvON1UMMmv9wZKmPPC/QNvONmacAOntBzffLTnAROursLsedELFAEGhWq1DVqf4nlmD2xw==',key_name='tempest-TestMinimumBasicScenario-1507068812',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d5326c00d464e008337e0dc8577fc2d',ramdisk_id='',reservation_id='r-ytr9w0in',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5632f29c-8b44-432c-88c6-02567939cb91',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-555382044',owner_user_name='tempest-TestMinimumBasicScenario-555382044-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:24:00Z,user_data=None,user_id='eeb6ade6e91541b5b737150a67b6bd39',uuid=23e17727-40b4-48f7-9155-abc8ffa9f619,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "902b1013-6c79-4a5a-ab19-782ac8dc715b", "address": "fa:16:3e:fe:93:cc", "network": {"id": "4fe4d56e-afe2-42a6-984a-9af8bc5377a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126385357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5326c00d464e008337e0dc8577fc2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap902b1013-6c", "ovs_interfaceid": "902b1013-6c79-4a5a-ab19-782ac8dc715b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:24:02 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Converting VIF {"id": "902b1013-6c79-4a5a-ab19-782ac8dc715b", "address": "fa:16:3e:fe:93:cc", "network": {"id": "4fe4d56e-afe2-42a6-984a-9af8bc5377a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126385357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5326c00d464e008337e0dc8577fc2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap902b1013-6c", "ovs_interfaceid": "902b1013-6c79-4a5a-ab19-782ac8dc715b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:24:02 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:93:cc,bridge_name='br-int',has_traffic_filtering=True,id=902b1013-6c79-4a5a-ab19-782ac8dc715b,network=Network(4fe4d56e-afe2-42a6-984a-9af8bc5377a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap902b1013-6c') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:24:02 user nova-compute[75066]: DEBUG nova.objects.instance [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lazy-loading 'pci_devices' on Instance uuid 23e17727-40b4-48f7-9155-abc8ffa9f619 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:24:02 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:24:02 user nova-compute[75066]:   <uuid>23e17727-40b4-48f7-9155-abc8ffa9f619</uuid>
Dec 01 19:24:02 user nova-compute[75066]:   <name>instance-00000017</name>
Dec 01 19:24:02 user nova-compute[75066]:   <memory>524288</memory>
Dec 01 19:24:02 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:24:02 user nova-compute[75066]:   <metadata>
Dec 01 19:24:02 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:24:02 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:24:02 user nova-compute[75066]:       <nova:name>tempest-TestMinimumBasicScenario-server-1401953060</nova:name>
Dec 01 19:24:02 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:24:02</nova:creationTime>
Dec 01 19:24:02 user nova-compute[75066]:       <nova:flavor name="m1.tiny">
Dec 01 19:24:02 user nova-compute[75066]:         <nova:memory>512</nova:memory>
Dec 01 19:24:02 user nova-compute[75066]:         <nova:disk>1</nova:disk>
Dec 01 19:24:02 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:24:02 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:24:02 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:24:02 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:24:02 user nova-compute[75066]:       <nova:owner>
Dec 01 19:24:02 user nova-compute[75066]:         <nova:user uuid="eeb6ade6e91541b5b737150a67b6bd39">tempest-TestMinimumBasicScenario-555382044-project-member</nova:user>
Dec 01 19:24:02 user nova-compute[75066]:         <nova:project uuid="1d5326c00d464e008337e0dc8577fc2d">tempest-TestMinimumBasicScenario-555382044</nova:project>
Dec 01 19:24:02 user nova-compute[75066]:       </nova:owner>
Dec 01 19:24:02 user nova-compute[75066]:       <nova:root type="image" uuid="5632f29c-8b44-432c-88c6-02567939cb91"/>
Dec 01 19:24:02 user nova-compute[75066]:       <nova:ports>
Dec 01 19:24:02 user nova-compute[75066]:         <nova:port uuid="902b1013-6c79-4a5a-ab19-782ac8dc715b">
Dec 01 19:24:02 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 01 19:24:02 user nova-compute[75066]:         </nova:port>
Dec 01 19:24:02 user nova-compute[75066]:       </nova:ports>
Dec 01 19:24:02 user nova-compute[75066]:     </nova:instance>
Dec 01 19:24:02 user nova-compute[75066]:   </metadata>
Dec 01 19:24:02 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:24:02 user nova-compute[75066]:     <system>
Dec 01 19:24:02 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:24:02 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:24:02 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:24:02 user nova-compute[75066]:       <entry name="serial">23e17727-40b4-48f7-9155-abc8ffa9f619</entry>
Dec 01 19:24:02 user nova-compute[75066]:       <entry name="uuid">23e17727-40b4-48f7-9155-abc8ffa9f619</entry>
Dec 01 19:24:02 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:24:02 user nova-compute[75066]:     </system>
Dec 01 19:24:02 user nova-compute[75066]:   </sysinfo>
Dec 01 19:24:02 user nova-compute[75066]:   <os>
Dec 01 19:24:02 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:24:02 user nova-compute[75066]:     <boot dev="hd"/>
Dec 01 19:24:02 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:24:02 user nova-compute[75066]:   </os>
Dec 01 19:24:02 user nova-compute[75066]:   <features>
Dec 01 19:24:02 user nova-compute[75066]:     <acpi/>
Dec 01 19:24:02 user nova-compute[75066]:     <apic/>
Dec 01 19:24:02 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:24:02 user nova-compute[75066]:   </features>
Dec 01 19:24:02 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:24:02 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:24:02 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:24:02 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:24:02 user nova-compute[75066]:   </clock>
Dec 01 19:24:02 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:24:02 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:24:02 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:24:02 user nova-compute[75066]:   </cpu>
Dec 01 19:24:02 user nova-compute[75066]:   <devices>
Dec 01 19:24:02 user nova-compute[75066]:     <disk type="file" device="disk">
Dec 01 19:24:02 user nova-compute[75066]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 19:24:02 user nova-compute[75066]:       <source file="/opt/stack/data/nova/instances/23e17727-40b4-48f7-9155-abc8ffa9f619/disk"/>
Dec 01 19:24:02 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:24:02 user nova-compute[75066]:     </disk>
Dec 01 19:24:02 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:24:02 user nova-compute[75066]:       <mac address="fa:16:3e:fe:93:cc"/>
Dec 01 19:24:02 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:24:02 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:24:02 user nova-compute[75066]:       <target dev="tap902b1013-6c"/>
Dec 01 19:24:02 user nova-compute[75066]:     </interface>
Dec 01 19:24:02 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:24:02 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/23e17727-40b4-48f7-9155-abc8ffa9f619/console.log" append="off"/>
Dec 01 19:24:02 user nova-compute[75066]:     </serial>
Dec 01 19:24:02 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:24:02 user nova-compute[75066]:     <video>
Dec 01 19:24:02 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:24:02 user nova-compute[75066]:     </video>
Dec 01 19:24:02 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:24:02 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:24:02 user nova-compute[75066]:     </rng>
Dec 01 19:24:02 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:24:02 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:24:02 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:24:02 user nova-compute[75066]:     </memballoon>
Dec 01 19:24:02 user nova-compute[75066]:   </devices>
Dec 01 19:24:02 user nova-compute[75066]: </domain>
Dec 01 19:24:02 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:24:02 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:23:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1401953060',display_name='tempest-TestMinimumBasicScenario-server-1401953060',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1401953060',id=23,image_ref='5632f29c-8b44-432c-88c6-02567939cb91',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQs/30B1+efn0s6ylAyaZU6Z3hXoydPhUb7ZPkYfCAu2HdecYo2d432waybQvON1UMMmv9wZKmPPC/QNvONmacAOntBzffLTnAROursLsedELFAEGhWq1DVqf4nlmD2xw==',key_name='tempest-TestMinimumBasicScenario-1507068812',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d5326c00d464e008337e0dc8577fc2d',ramdisk_id='',reservation_id='r-ytr9w0in',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5632f29c-8b44-432c-88c6-02567939cb91',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-555382044',owner_user_name='tempest-TestMinimumBasicScenario-555382044-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:24:00Z,user_data=None,user_id='eeb6ade6e91541b5b737150a67b6bd39',uuid=23e17727-40b4-48f7-9155-abc8ffa9f619,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "902b1013-6c79-4a5a-ab19-782ac8dc715b", "address": "fa:16:3e:fe:93:cc", "network": {"id": "4fe4d56e-afe2-42a6-984a-9af8bc5377a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126385357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5326c00d464e008337e0dc8577fc2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap902b1013-6c", "ovs_interfaceid": "902b1013-6c79-4a5a-ab19-782ac8dc715b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:24:02 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Converting VIF {"id": "902b1013-6c79-4a5a-ab19-782ac8dc715b", "address": "fa:16:3e:fe:93:cc", "network": {"id": "4fe4d56e-afe2-42a6-984a-9af8bc5377a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126385357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5326c00d464e008337e0dc8577fc2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap902b1013-6c", "ovs_interfaceid": "902b1013-6c79-4a5a-ab19-782ac8dc715b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:24:02 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:93:cc,bridge_name='br-int',has_traffic_filtering=True,id=902b1013-6c79-4a5a-ab19-782ac8dc715b,network=Network(4fe4d56e-afe2-42a6-984a-9af8bc5377a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap902b1013-6c') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:24:02 user nova-compute[75066]: DEBUG os_vif [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:93:cc,bridge_name='br-int',has_traffic_filtering=True,id=902b1013-6c79-4a5a-ab19-782ac8dc715b,network=Network(4fe4d56e-afe2-42a6-984a-9af8bc5377a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap902b1013-6c') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:24:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:24:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:24:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0a0cf5c7-17c6-5893-a3ed-e09086a43b9e', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:24:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:24:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap902b1013-6c, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:24:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap902b1013-6c, col_values=(('qos', UUID('c09b5059-f6e8-44cd-b7c4-a9b90faee778')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:24:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap902b1013-6c, col_values=(('external_ids', {'iface-id': '902b1013-6c79-4a5a-ab19-782ac8dc715b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:93:cc', 'vm-uuid': '23e17727-40b4-48f7-9155-abc8ffa9f619'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:24:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:24:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:02 user nova-compute[75066]: INFO os_vif [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:93:cc,bridge_name='br-int',has_traffic_filtering=True,id=902b1013-6c79-4a5a-ab19-782ac8dc715b,network=Network(4fe4d56e-afe2-42a6-984a-9af8bc5377a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap902b1013-6c')
Dec 01 19:24:02 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:24:02 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] No VIF found with MAC fa:16:3e:fe:93:cc, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:24:02 user nova-compute[75066]: DEBUG nova.network.neutron [req-7e5430bd-cb5d-4eb9-9470-a4a43ac78b99 req-a6e2c24b-f19d-4fc5-a75f-65ad6fdb22af service nova] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Updated VIF entry in instance network info cache for port 902b1013-6c79-4a5a-ab19-782ac8dc715b. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:24:02 user nova-compute[75066]: DEBUG nova.network.neutron [req-7e5430bd-cb5d-4eb9-9470-a4a43ac78b99 req-a6e2c24b-f19d-4fc5-a75f-65ad6fdb22af service nova] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Updating instance_info_cache with network_info: [{"id": "902b1013-6c79-4a5a-ab19-782ac8dc715b", "address": "fa:16:3e:fe:93:cc", "network": {"id": "4fe4d56e-afe2-42a6-984a-9af8bc5377a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126385357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5326c00d464e008337e0dc8577fc2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap902b1013-6c", "ovs_interfaceid": "902b1013-6c79-4a5a-ab19-782ac8dc715b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:24:02 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-7e5430bd-cb5d-4eb9-9470-a4a43ac78b99 req-a6e2c24b-f19d-4fc5-a75f-65ad6fdb22af service nova] Releasing lock "refresh_cache-23e17727-40b4-48f7-9155-abc8ffa9f619" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:24:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:03 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:24:03 user nova-compute[75066]: DEBUG nova.compute.manager [req-859d5766-7c7f-4fd5-8c55-5e7c5460e040 req-7d28b0c8-9dfa-409c-8925-18a2f24ce73d service nova] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Received event network-changed-d51d7391-af1b-4160-b3bb-c77d0507a0e0 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:24:03 user nova-compute[75066]: DEBUG nova.compute.manager [req-859d5766-7c7f-4fd5-8c55-5e7c5460e040 req-7d28b0c8-9dfa-409c-8925-18a2f24ce73d service nova] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Refreshing instance network info cache due to event network-changed-d51d7391-af1b-4160-b3bb-c77d0507a0e0. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:24:03 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-859d5766-7c7f-4fd5-8c55-5e7c5460e040 req-7d28b0c8-9dfa-409c-8925-18a2f24ce73d service nova] Acquiring lock "refresh_cache-10fc72fa-64a3-4704-ad91-2e3ae88d5424" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:24:03 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-859d5766-7c7f-4fd5-8c55-5e7c5460e040 req-7d28b0c8-9dfa-409c-8925-18a2f24ce73d service nova] Acquired lock "refresh_cache-10fc72fa-64a3-4704-ad91-2e3ae88d5424" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:24:03 user nova-compute[75066]: DEBUG nova.network.neutron [req-859d5766-7c7f-4fd5-8c55-5e7c5460e040 req-7d28b0c8-9dfa-409c-8925-18a2f24ce73d service nova] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Refreshing network info cache for port d51d7391-af1b-4160-b3bb-c77d0507a0e0 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:24:03 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-496441cf-eaa4-4e42-9911-662f5a87afc8 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Acquiring lock "10fc72fa-64a3-4704-ad91-2e3ae88d5424" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:24:03 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-496441cf-eaa4-4e42-9911-662f5a87afc8 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Lock "10fc72fa-64a3-4704-ad91-2e3ae88d5424" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:24:03 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-496441cf-eaa4-4e42-9911-662f5a87afc8 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Acquiring lock "10fc72fa-64a3-4704-ad91-2e3ae88d5424-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:24:03 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-496441cf-eaa4-4e42-9911-662f5a87afc8 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Lock "10fc72fa-64a3-4704-ad91-2e3ae88d5424-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:24:03 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-496441cf-eaa4-4e42-9911-662f5a87afc8 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Lock "10fc72fa-64a3-4704-ad91-2e3ae88d5424-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:24:03 user nova-compute[75066]: INFO nova.compute.manager [None req-496441cf-eaa4-4e42-9911-662f5a87afc8 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Terminating instance
Dec 01 19:24:03 user nova-compute[75066]: DEBUG nova.compute.manager [None req-496441cf-eaa4-4e42-9911-662f5a87afc8 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Start destroying the instance on the hypervisor. {{(pid=75066) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 19:24:03 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:03 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:03 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:03 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG nova.network.neutron [req-859d5766-7c7f-4fd5-8c55-5e7c5460e040 req-7d28b0c8-9dfa-409c-8925-18a2f24ce73d service nova] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Updated VIF entry in instance network info cache for port d51d7391-af1b-4160-b3bb-c77d0507a0e0. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG nova.network.neutron [req-859d5766-7c7f-4fd5-8c55-5e7c5460e040 req-7d28b0c8-9dfa-409c-8925-18a2f24ce73d service nova] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Updating instance_info_cache with network_info: [{"id": "d51d7391-af1b-4160-b3bb-c77d0507a0e0", "address": "fa:16:3e:e9:da:9e", "network": {"id": "4b17d46f-fdbc-4cd7-991c-ca6981e0f20f", "bridge": "br-int", "label": "tempest-TestShelveInstance-2081974203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5b79591b18f4d35bdd99365c816b55c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd51d7391-af", "ovs_interfaceid": "d51d7391-af1b-4160-b3bb-c77d0507a0e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-859d5766-7c7f-4fd5-8c55-5e7c5460e040 req-7d28b0c8-9dfa-409c-8925-18a2f24ce73d service nova] Releasing lock "refresh_cache-10fc72fa-64a3-4704-ad91-2e3ae88d5424" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:24:04 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Instance destroyed successfully.
Dec 01 19:24:04 user nova-compute[75066]: DEBUG nova.objects.instance [None req-496441cf-eaa4-4e42-9911-662f5a87afc8 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Lazy-loading 'resources' on Instance uuid 10fc72fa-64a3-4704-ad91-2e3ae88d5424 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-496441cf-eaa4-4e42-9911-662f5a87afc8 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-01T19:18:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-599780298',display_name='tempest-TestShelveInstance-server-599780298',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-599780298',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOYMosdOMr3YsggFBWlatcebyefVvtCf4/e1UEHGdqfc/vbH6hEB++iXmGS2/+7YSOkIMjPRUBdmwX9FH/UkGY12pJtMicJWhONuHwVC52MSXXi4pg9ytKnzTre4nG3Ezg==',key_name='tempest-TestShelveInstance-1519500384',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:22:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f5b79591b18f4d35bdd99365c816b55c',ramdisk_id='',reservation_id='r-qdcti0kh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1574356427',owner_user_name='tempest-TestShelveInstance-1574356427-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:22:30Z,user_data=None,user_id='f1f8fb37cb13473b84de443c51815b1d',uuid=10fc72fa-64a3-4704-ad91-2e3ae88d5424,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d51d7391-af1b-4160-b3bb-c77d0507a0e0", "address": "fa:16:3e:e9:da:9e", "network": {"id": "4b17d46f-fdbc-4cd7-991c-ca6981e0f20f", "bridge": "br-int", "label": "tempest-TestShelveInstance-2081974203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5b79591b18f4d35bdd99365c816b55c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd51d7391-af", "ovs_interfaceid": "d51d7391-af1b-4160-b3bb-c77d0507a0e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-496441cf-eaa4-4e42-9911-662f5a87afc8 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Converting VIF {"id": "d51d7391-af1b-4160-b3bb-c77d0507a0e0", "address": "fa:16:3e:e9:da:9e", "network": {"id": "4b17d46f-fdbc-4cd7-991c-ca6981e0f20f", "bridge": "br-int", "label": "tempest-TestShelveInstance-2081974203-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.128", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f5b79591b18f4d35bdd99365c816b55c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd51d7391-af", "ovs_interfaceid": "d51d7391-af1b-4160-b3bb-c77d0507a0e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-496441cf-eaa4-4e42-9911-662f5a87afc8 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:da:9e,bridge_name='br-int',has_traffic_filtering=True,id=d51d7391-af1b-4160-b3bb-c77d0507a0e0,network=Network(4b17d46f-fdbc-4cd7-991c-ca6981e0f20f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd51d7391-af') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG os_vif [None req-496441cf-eaa4-4e42-9911-662f5a87afc8 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:da:9e,bridge_name='br-int',has_traffic_filtering=True,id=d51d7391-af1b-4160-b3bb-c77d0507a0e0,network=Network(4b17d46f-fdbc-4cd7-991c-ca6981e0f20f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd51d7391-af') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd51d7391-af, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0e4647dc-d763-4e95-b07c-6b7cd96b7494) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:24:04 user nova-compute[75066]: INFO os_vif [None req-496441cf-eaa4-4e42-9911-662f5a87afc8 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:da:9e,bridge_name='br-int',has_traffic_filtering=True,id=d51d7391-af1b-4160-b3bb-c77d0507a0e0,network=Network(4b17d46f-fdbc-4cd7-991c-ca6981e0f20f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd51d7391-af')
Dec 01 19:24:04 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-496441cf-eaa4-4e42-9911-662f5a87afc8 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] calling os-brick to detach iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-496441cf-eaa4-4e42-9911-662f5a87afc8 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, {'target_iqn': 'iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wmuOJlqG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:24:04 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-496441cf-eaa4-4e42-9911-662f5a87afc8 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:24:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-496441cf-eaa4-4e42-9911-662f5a87afc8 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-496441cf-eaa4-4e42-9911-662f5a87afc8 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG nova.compute.manager [req-80c48ee9-b0bb-42c4-95f9-55053498c2be req-5ecf7e67-bbf0-4eae-8f21-99d541d96b34 service nova] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Received event network-vif-unplugged-d51d7391-af1b-4160-b3bb-c77d0507a0e0 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-80c48ee9-b0bb-42c4-95f9-55053498c2be req-5ecf7e67-bbf0-4eae-8f21-99d541d96b34 service nova] Acquiring lock "10fc72fa-64a3-4704-ad91-2e3ae88d5424-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-80c48ee9-b0bb-42c4-95f9-55053498c2be req-5ecf7e67-bbf0-4eae-8f21-99d541d96b34 service nova] Lock "10fc72fa-64a3-4704-ad91-2e3ae88d5424-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-80c48ee9-b0bb-42c4-95f9-55053498c2be req-5ecf7e67-bbf0-4eae-8f21-99d541d96b34 service nova] Lock "10fc72fa-64a3-4704-ad91-2e3ae88d5424-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG nova.compute.manager [req-80c48ee9-b0bb-42c4-95f9-55053498c2be req-5ecf7e67-bbf0-4eae-8f21-99d541d96b34 service nova] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] No waiting events found dispatching network-vif-unplugged-d51d7391-af1b-4160-b3bb-c77d0507a0e0 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG nova.compute.manager [req-80c48ee9-b0bb-42c4-95f9-55053498c2be req-5ecf7e67-bbf0-4eae-8f21-99d541d96b34 service nova] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Received event network-vif-unplugged-d51d7391-af1b-4160-b3bb-c77d0507a0e0 for instance with task_state deleting. {{(pid=75066) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6821a37-f9d8-448e-a30c-7480af9a3c89]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-496441cf-eaa4-4e42-9911-662f5a87afc8 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 19:24:04 user nova-compute[75066]: No targets found.
Dec 01 19:24:04 user nova-compute[75066]: iSNS:
Dec 01 19:24:04 user nova-compute[75066]: No targets found.
Dec 01 19:24:04 user nova-compute[75066]: STATIC:
Dec 01 19:24:04 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98
Dec 01 19:24:04 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:24:04 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:24:04 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c
Dec 01 19:24:04 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:24:04 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:24:04 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc
Dec 01 19:24:04 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:24:04 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:24:04 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb
Dec 01 19:24:04 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:24:04 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:24:04 user nova-compute[75066]: FIRMWARE:
Dec 01 19:24:04 user nova-compute[75066]: No targets found.
Dec 01 19:24:04 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-496441cf-eaa4-4e42-9911-662f5a87afc8 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 19:24:04 user nova-compute[75066]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 19:24:04 user nova-compute[75066]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75066) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-496441cf-eaa4-4e42-9911-662f5a87afc8 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c', 0)] {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff1752c-d412-4b77-b55e-faabc8802d15]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7063f6-8d1d-47b5-ae92-f325e6618857]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-496441cf-eaa4-4e42-9911-662f5a87afc8 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)
Dec 01 19:24:04 user nova-compute[75066]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:24:04 user nova-compute[75066]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)
Dec 01 19:24:04 user nova-compute[75066]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98 (non-flash)
Dec 01 19:24:04 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-496441cf-eaa4-4e42-9911-662f5a87afc8 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)
Dec 01 19:24:04 user nova-compute[75066]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:24:04 user nova-compute[75066]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c (non-flash)
Dec 01 19:24:04 user nova-compute[75066]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98 (non-flash)
Dec 01 19:24:04 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-496441cf-eaa4-4e42-9911-662f5a87afc8 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91901689d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c'): ({'sde'}, set())}) {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-496441cf-eaa4-4e42-9911-662f5a87afc8 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Removing single pathed devices sde {{(pid=75066) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e35043d-3ac2-4372-aad0-c8963f004e33]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[79984898-ca03-497a-84f1-ab4e68b1665f]: (4, ('ok\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-496441cf-eaa4-4e42-9911-662f5a87afc8 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Flushing IO for device /dev/sde {{(pid=75066) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae47c51-91f4-4de2-8dfe-89fc60d8242b]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-496441cf-eaa4-4e42-9911-662f5a87afc8 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75066) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.052s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f2f1fd-e34e-435b-9ec3-caa74b4a8da4]: (4, ('1', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-496441cf-eaa4-4e42-9911-662f5a87afc8 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-496441cf-eaa4-4e42-9911-662f5a87afc8 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] SCSI volumes sde have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23566316565613133', '/dev/disk/by-id/scsi-1SCST_BIO5799e823-5f1eea13e02d40c0', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_5799e823') {{(pid=86136) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f381eab-71de-4e51-85bf-7301f6bd4f87]: (4, None) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-496441cf-eaa4-4e42-9911-662f5a87afc8 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c')] {{(pid=75066) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd8be91-e947-44a8-bcc0-55e5bc6308ed]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-496441cf-eaa4-4e42-9911-662f5a87afc8 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c -p 172.16.0.220:3260 --logout {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[34148bf3-ac15-4a41-8bf0-ccca9dfaa69c]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-496441cf-eaa4-4e42-9911-662f5a87afc8 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c, portal: 172.16.0.220,3260]
Dec 01 19:24:04 user nova-compute[75066]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c, portal: 172.16.0.220,3260] successful.
Dec 01 19:24:04 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c -p 172.16.0.220:3260 --op delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a0f565ac-cb88-4957-a726-5589e85dfd5c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb106b3-5904-4e2e-aa65-c7e7be493118]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-496441cf-eaa4-4e42-9911-662f5a87afc8 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-496441cf-eaa4-4e42-9911-662f5a87afc8 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-496441cf-eaa4-4e42-9911-662f5a87afc8 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] <== disconnect_volume: return (355ms) None {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-496441cf-eaa4-4e42-9911-662f5a87afc8 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Disconnected iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 19:24:04 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-496441cf-eaa4-4e42-9911-662f5a87afc8 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Deleting instance files /opt/stack/data/nova/instances/10fc72fa-64a3-4704-ad91-2e3ae88d5424_del
Dec 01 19:24:04 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-496441cf-eaa4-4e42-9911-662f5a87afc8 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Deletion of /opt/stack/data/nova/instances/10fc72fa-64a3-4704-ad91-2e3ae88d5424_del complete
Dec 01 19:24:04 user nova-compute[75066]: INFO nova.compute.manager [None req-496441cf-eaa4-4e42-9911-662f5a87afc8 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Took 1.24 seconds to destroy the instance on the hypervisor.
Dec 01 19:24:04 user nova-compute[75066]: DEBUG oslo.service.loopingcall [None req-496441cf-eaa4-4e42-9911-662f5a87afc8 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75066) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG nova.compute.manager [-] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Deallocating network for instance {{(pid=75066) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 19:24:04 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] deallocate_for_instance() {{(pid=75066) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 19:24:05 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:24:05 user nova-compute[75066]: INFO nova.compute.manager [-] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Took 0.44 seconds to deallocate network for instance.
Dec 01 19:24:05 user nova-compute[75066]: DEBUG nova.compute.manager [req-d063b8da-c185-4127-8d0a-5d9f9e41f000 req-66f8e123-68ac-4045-959b-a0c8b07b9a4b service nova] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Received event network-vif-deleted-d51d7391-af1b-4160-b3bb-c77d0507a0e0 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:24:05 user nova-compute[75066]: INFO nova.compute.manager [req-d063b8da-c185-4127-8d0a-5d9f9e41f000 req-66f8e123-68ac-4045-959b-a0c8b07b9a4b service nova] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Neutron deleted interface d51d7391-af1b-4160-b3bb-c77d0507a0e0; detaching it from the instance and deleting it from the info cache
Dec 01 19:24:05 user nova-compute[75066]: DEBUG nova.network.neutron [req-d063b8da-c185-4127-8d0a-5d9f9e41f000 req-66f8e123-68ac-4045-959b-a0c8b07b9a4b service nova] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:24:05 user nova-compute[75066]: DEBUG nova.compute.manager [req-d063b8da-c185-4127-8d0a-5d9f9e41f000 req-66f8e123-68ac-4045-959b-a0c8b07b9a4b service nova] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Detach interface failed, port_id=d51d7391-af1b-4160-b3bb-c77d0507a0e0, reason: Instance 10fc72fa-64a3-4704-ad91-2e3ae88d5424 could not be found. {{(pid=75066) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 01 19:24:05 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:24:05 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:24:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:24:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:24:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:24:05 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75066) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 19:24:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/933210b1-5c5e-421a-9b63-4595fc5f5f25/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:05 user nova-compute[75066]: DEBUG nova.compute.manager [req-126fdf09-ff28-4848-8a4b-5bc67ef99ed5 req-567753f9-521e-473d-a8e6-c490219506be service nova] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Received event network-vif-plugged-902b1013-6c79-4a5a-ab19-782ac8dc715b {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:24:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-126fdf09-ff28-4848-8a4b-5bc67ef99ed5 req-567753f9-521e-473d-a8e6-c490219506be service nova] Acquiring lock "23e17727-40b4-48f7-9155-abc8ffa9f619-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:24:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-126fdf09-ff28-4848-8a4b-5bc67ef99ed5 req-567753f9-521e-473d-a8e6-c490219506be service nova] Lock "23e17727-40b4-48f7-9155-abc8ffa9f619-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:24:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-126fdf09-ff28-4848-8a4b-5bc67ef99ed5 req-567753f9-521e-473d-a8e6-c490219506be service nova] Lock "23e17727-40b4-48f7-9155-abc8ffa9f619-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:24:05 user nova-compute[75066]: DEBUG nova.compute.manager [req-126fdf09-ff28-4848-8a4b-5bc67ef99ed5 req-567753f9-521e-473d-a8e6-c490219506be service nova] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] No waiting events found dispatching network-vif-plugged-902b1013-6c79-4a5a-ab19-782ac8dc715b {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:24:05 user nova-compute[75066]: WARNING nova.compute.manager [req-126fdf09-ff28-4848-8a4b-5bc67ef99ed5 req-567753f9-521e-473d-a8e6-c490219506be service nova] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Received unexpected event network-vif-plugged-902b1013-6c79-4a5a-ab19-782ac8dc715b for instance with vm_state building and task_state spawning.
Dec 01 19:24:05 user nova-compute[75066]: DEBUG nova.compute.manager [req-126fdf09-ff28-4848-8a4b-5bc67ef99ed5 req-567753f9-521e-473d-a8e6-c490219506be service nova] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Received event network-vif-plugged-902b1013-6c79-4a5a-ab19-782ac8dc715b {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:24:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-126fdf09-ff28-4848-8a4b-5bc67ef99ed5 req-567753f9-521e-473d-a8e6-c490219506be service nova] Acquiring lock "23e17727-40b4-48f7-9155-abc8ffa9f619-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:24:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-126fdf09-ff28-4848-8a4b-5bc67ef99ed5 req-567753f9-521e-473d-a8e6-c490219506be service nova] Lock "23e17727-40b4-48f7-9155-abc8ffa9f619-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:24:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-126fdf09-ff28-4848-8a4b-5bc67ef99ed5 req-567753f9-521e-473d-a8e6-c490219506be service nova] Lock "23e17727-40b4-48f7-9155-abc8ffa9f619-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:24:05 user nova-compute[75066]: DEBUG nova.compute.manager [req-126fdf09-ff28-4848-8a4b-5bc67ef99ed5 req-567753f9-521e-473d-a8e6-c490219506be service nova] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] No waiting events found dispatching network-vif-plugged-902b1013-6c79-4a5a-ab19-782ac8dc715b {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:24:05 user nova-compute[75066]: WARNING nova.compute.manager [req-126fdf09-ff28-4848-8a4b-5bc67ef99ed5 req-567753f9-521e-473d-a8e6-c490219506be service nova] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Received unexpected event network-vif-plugged-902b1013-6c79-4a5a-ab19-782ac8dc715b for instance with vm_state building and task_state spawning.
Dec 01 19:24:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/933210b1-5c5e-421a-9b63-4595fc5f5f25/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/933210b1-5c5e-421a-9b63-4595fc5f5f25/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/933210b1-5c5e-421a-9b63-4595fc5f5f25/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a553e030-0d69-4725-9f84-6c0c63556ed4/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a553e030-0d69-4725-9f84-6c0c63556ed4/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a553e030-0d69-4725-9f84-6c0c63556ed4/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:06 user nova-compute[75066]: INFO nova.compute.manager [None req-496441cf-eaa4-4e42-9911-662f5a87afc8 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Took 0.87 seconds to detach 1 volumes for instance.
Dec 01 19:24:06 user nova-compute[75066]: DEBUG nova.compute.manager [None req-496441cf-eaa4-4e42-9911-662f5a87afc8 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Deleting volume: a0f565ac-cb88-4957-a726-5589e85dfd5c {{(pid=75066) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Dec 01 19:24:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a553e030-0d69-4725-9f84-6c0c63556ed4/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-496441cf-eaa4-4e42-9911-662f5a87afc8 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:24:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-496441cf-eaa4-4e42-9911-662f5a87afc8 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:24:06 user nova-compute[75066]: DEBUG nova.compute.manager [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Instance event wait completed in 0 seconds for  {{(pid=75066) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 19:24:06 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Guest created on hypervisor {{(pid=75066) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 19:24:06 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Instance spawned successfully.
Dec 01 19:24:06 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 19:24:06 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Found default for hw_cdrom_bus of ide {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:24:06 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Found default for hw_disk_bus of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:24:06 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Found default for hw_input_bus of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:24:06 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Found default for hw_pointer_model of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:24:06 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Found default for hw_video_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:24:06 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Found default for hw_vif_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:24:06 user nova-compute[75066]: INFO nova.compute.manager [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Took 6.12 seconds to spawn the instance on the hypervisor.
Dec 01 19:24:06 user nova-compute[75066]: DEBUG nova.compute.manager [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:24:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:06 user nova-compute[75066]: DEBUG nova.compute.manager [req-9eb83f27-4613-46c4-a70f-32cc30cda201 req-03e6e7ec-a1b7-44bc-9f32-a44cb5c5da67 service nova] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Received event network-vif-plugged-d51d7391-af1b-4160-b3bb-c77d0507a0e0 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:24:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-9eb83f27-4613-46c4-a70f-32cc30cda201 req-03e6e7ec-a1b7-44bc-9f32-a44cb5c5da67 service nova] Acquiring lock "10fc72fa-64a3-4704-ad91-2e3ae88d5424-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:24:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-9eb83f27-4613-46c4-a70f-32cc30cda201 req-03e6e7ec-a1b7-44bc-9f32-a44cb5c5da67 service nova] Lock "10fc72fa-64a3-4704-ad91-2e3ae88d5424-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:24:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-9eb83f27-4613-46c4-a70f-32cc30cda201 req-03e6e7ec-a1b7-44bc-9f32-a44cb5c5da67 service nova] Lock "10fc72fa-64a3-4704-ad91-2e3ae88d5424-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:24:06 user nova-compute[75066]: DEBUG nova.compute.manager [req-9eb83f27-4613-46c4-a70f-32cc30cda201 req-03e6e7ec-a1b7-44bc-9f32-a44cb5c5da67 service nova] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] No waiting events found dispatching network-vif-plugged-d51d7391-af1b-4160-b3bb-c77d0507a0e0 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:24:06 user nova-compute[75066]: WARNING nova.compute.manager [req-9eb83f27-4613-46c4-a70f-32cc30cda201 req-03e6e7ec-a1b7-44bc-9f32-a44cb5c5da67 service nova] [instance: 10fc72fa-64a3-4704-ad91-2e3ae88d5424] Received unexpected event network-vif-plugged-d51d7391-af1b-4160-b3bb-c77d0507a0e0 for instance with vm_state deleted and task_state None.
Dec 01 19:24:06 user nova-compute[75066]: INFO nova.compute.manager [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Took 7.09 seconds to build instance.
Dec 01 19:24:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e507fa37-59cc-4c48-ad05-0f8be8d82c68 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "23e17727-40b4-48f7-9155-abc8ffa9f619" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.181s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:24:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:06 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:24:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436/disk.rescue --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:06 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-496441cf-eaa4-4e42-9911-662f5a87afc8 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:24:06 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-496441cf-eaa4-4e42-9911-662f5a87afc8 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:24:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436/disk.rescue --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-496441cf-eaa4-4e42-9911-662f5a87afc8 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.606s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:24:06 user nova-compute[75066]: INFO nova.scheduler.client.report [None req-496441cf-eaa4-4e42-9911-662f5a87afc8 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Deleted allocations for instance 10fc72fa-64a3-4704-ad91-2e3ae88d5424
Dec 01 19:24:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-496441cf-eaa4-4e42-9911-662f5a87afc8 tempest-TestShelveInstance-1574356427 tempest-TestShelveInstance-1574356427-project-member] Lock "10fc72fa-64a3-4704-ad91-2e3ae88d5424" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.465s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:24:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecc194b4-b8b9-49c8-9d34-4213c4dc15b8/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecc194b4-b8b9-49c8-9d34-4213c4dc15b8/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecc194b4-b8b9-49c8-9d34-4213c4dc15b8/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecc194b4-b8b9-49c8-9d34-4213c4dc15b8/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:07 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23e17727-40b4-48f7-9155-abc8ffa9f619/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23e17727-40b4-48f7-9155-abc8ffa9f619/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23e17727-40b4-48f7-9155-abc8ffa9f619/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23e17727-40b4-48f7-9155-abc8ffa9f619/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk.rescue --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk.rescue --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:09 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d86a5a-c62e-41f7-9f33-1a0c61af6a49/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d86a5a-c62e-41f7-9f33-1a0c61af6a49/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d86a5a-c62e-41f7-9f33-1a0c61af6a49/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d86a5a-c62e-41f7-9f33-1a0c61af6a49/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d340166-c58b-4213-b8d3-5036ade48d2d/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d340166-c58b-4213-b8d3-5036ade48d2d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d340166-c58b-4213-b8d3-5036ade48d2d/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d340166-c58b-4213-b8d3-5036ade48d2d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08a362a4-9353-4139-afd4-1a24fcfa65a0/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08a362a4-9353-4139-afd4-1a24fcfa65a0/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08a362a4-9353-4139-afd4-1a24fcfa65a0/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/08a362a4-9353-4139-afd4-1a24fcfa65a0/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:11 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:24:11 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:24:11 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Hypervisor/Node resource view: name=user free_ram=7060MB free_disk=24.807762145996094GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75066) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 19:24:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:24:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:24:11 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance c223be70-8b9c-46d4-9b5a-3b83dfc05a17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:24:11 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance c3ceeca4-c16c-4cf5-adfd-7d5a2925f435 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:24:11 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 90c49be6-97aa-45f1-bcbe-b9a3875226a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:24:11 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 3d340166-c58b-4213-b8d3-5036ade48d2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:24:11 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance b7d86a5a-c62e-41f7-9f33-1a0c61af6a49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:24:11 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance d564b128-598b-4ad4-8618-afa4dc8a7347 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:24:11 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 14de9d20-9e66-4517-b904-2967e0a06a97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:24:11 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance a553e030-0d69-4725-9f84-6c0c63556ed4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:24:11 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 933210b1-5c5e-421a-9b63-4595fc5f5f25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:24:11 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:24:11 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 08a362a4-9353-4139-afd4-1a24fcfa65a0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:24:11 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance ecc194b4-b8b9-49c8-9d34-4213c4dc15b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:24:11 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 23e17727-40b4-48f7-9155-abc8ffa9f619 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:24:11 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 19:24:11 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 19:24:11 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:24:12 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:24:12 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Compute_service record updated for user:user {{(pid=75066) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 19:24:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.616s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:24:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:13 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:24:13 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:24:13 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Starting heal instance info cache {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 19:24:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "refresh_cache-c3ceeca4-c16c-4cf5-adfd-7d5a2925f435" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:24:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquired lock "refresh_cache-c3ceeca4-c16c-4cf5-adfd-7d5a2925f435" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:24:13 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Forcefully refreshing network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 19:24:13 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-120099dc-e755-461e-b137-3f6905abbfa1 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3d340166-c58b-4213-b8d3-5036ade48d2d is timed out.
Dec 01 19:24:13 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-120099dc-e755-461e-b137-3f6905abbfa1 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Successfully detached device vdb from instance 3d340166-c58b-4213-b8d3-5036ade48d2d from the live domain config.
Dec 01 19:24:13 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-120099dc-e755-461e-b137-3f6905abbfa1 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] calling os-brick to detach iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 19:24:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-120099dc-e755-461e-b137-3f6905abbfa1 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, {'target_iqn': 'iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dkMvfRXG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:24:13 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-120099dc-e755-461e-b137-3f6905abbfa1 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:24:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-120099dc-e755-461e-b137-3f6905abbfa1 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:24:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-120099dc-e755-461e-b137-3f6905abbfa1 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:24:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:13 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e97ed3-14d1-4ed4-ac2d-eb3f26d23948]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:24:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-120099dc-e755-461e-b137-3f6905abbfa1 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 19:24:13 user nova-compute[75066]: No targets found.
Dec 01 19:24:13 user nova-compute[75066]: iSNS:
Dec 01 19:24:13 user nova-compute[75066]: No targets found.
Dec 01 19:24:13 user nova-compute[75066]: STATIC:
Dec 01 19:24:13 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98
Dec 01 19:24:13 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:24:13 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:24:13 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc
Dec 01 19:24:13 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:24:13 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:24:13 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb
Dec 01 19:24:13 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:24:13 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:24:13 user nova-compute[75066]: FIRMWARE:
Dec 01 19:24:13 user nova-compute[75066]: No targets found.
Dec 01 19:24:13 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:24:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-120099dc-e755-461e-b137-3f6905abbfa1 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 19:24:13 user nova-compute[75066]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 19:24:13 user nova-compute[75066]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75066) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 19:24:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-120099dc-e755-461e-b137-3f6905abbfa1 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc', 0)] {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 19:24:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:13 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[19edff63-094b-47cf-a668-20fba421e8c0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:24:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:13 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[18fcc4f5-6eb1-4a11-b308-5b0da76e1f2b]: (4, ('tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:24:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-120099dc-e755-461e-b137-3f6905abbfa1 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)
Dec 01 19:24:13 user nova-compute[75066]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:24:13 user nova-compute[75066]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98 (non-flash)
Dec 01 19:24:13 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:24:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-120099dc-e755-461e-b137-3f6905abbfa1 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsi session list stdout=tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc (non-flash)
Dec 01 19:24:13 user nova-compute[75066]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:24:13 user nova-compute[75066]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98 (non-flash)
Dec 01 19:24:13 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:24:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-120099dc-e755-461e-b137-3f6905abbfa1 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9190176320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc'): ({'sdb'}, set())}) {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 19:24:13 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-120099dc-e755-461e-b137-3f6905abbfa1 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Removing single pathed devices sdb {{(pid=75066) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 19:24:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:13 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6d7202-727c-433e-b12f-4c4d730bde52]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:24:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:13 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[328bd638-d6db-47e4-af18-0740b3c16485]: (4, ('ok\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:24:13 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-120099dc-e755-461e-b137-3f6905abbfa1 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Flushing IO for device /dev/sdb {{(pid=75066) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 19:24:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:13 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e816fa-9a5b-4164-a8ab-db844ef75e17]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:24:13 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-120099dc-e755-461e-b137-3f6905abbfa1 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75066) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 19:24:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:13 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9d76c2-bc27-4a90-b791-439197091b39]: (4, ('1', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:24:13 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-120099dc-e755-461e-b137-3f6905abbfa1 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 19:24:13 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-120099dc-e755-461e-b137-3f6905abbfa1 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] SCSI volumes sdb have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 19:24:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-120099dc-e755-461e-b137-3f6905abbfa1 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc')] {{(pid=75066) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 19:24:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:13 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[526d59a6-efda-4ada-a1fc-fc9255a107b8]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:24:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-120099dc-e755-461e-b137-3f6905abbfa1 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:24:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc -p 172.16.0.220:3260 --logout {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:13 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Updating instance_info_cache with network_info: [{"id": "c9353199-d4a3-488f-857d-b0ebdb31a68f", "address": "fa:16:3e:d4:7c:91", "network": {"id": "4a6c6c26-4d29-486c-b11e-fc53769083ea", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1139388453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "492e0b2da61e4e4f9ea991df15531e24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9353199-d4", "ovs_interfaceid": "c9353199-d4a3-488f-857d-b0ebdb31a68f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:24:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Releasing lock "refresh_cache-c3ceeca4-c16c-4cf5-adfd-7d5a2925f435" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:24:13 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Updated the network info_cache for instance {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 19:24:13 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:24:13 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:24:13 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:24:13 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75066) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 19:24:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:13 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf835c5e-3c86-47d1-a40c-8048f8cd8bdb]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:24:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-120099dc-e755-461e-b137-3f6905abbfa1 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc, portal: 172.16.0.220,3260]
Dec 01 19:24:13 user nova-compute[75066]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc, portal: 172.16.0.220,3260] successful.
Dec 01 19:24:13 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:24:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc -p 172.16.0.220:3260 --op delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60702e9a-cb7f-4fe4-8fc0-8cd62dc3a0dc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:13 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a7d4b7-d187-4b4f-923e-46e6ab13a78d]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:24:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-120099dc-e755-461e-b137-3f6905abbfa1 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:24:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-120099dc-e755-461e-b137-3f6905abbfa1 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:24:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-120099dc-e755-461e-b137-3f6905abbfa1 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] <== disconnect_volume: return (299ms) None {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:24:13 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-120099dc-e755-461e-b137-3f6905abbfa1 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Disconnected iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 19:24:13 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-07d16a89-19da-40a8-9541-917facce604a tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 933210b1-5c5e-421a-9b63-4595fc5f5f25 is timed out.
Dec 01 19:24:13 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-07d16a89-19da-40a8-9541-917facce604a tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Successfully detached device vdb from instance 933210b1-5c5e-421a-9b63-4595fc5f5f25 from the live domain config.
Dec 01 19:24:13 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07d16a89-19da-40a8-9541-917facce604a tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] calling os-brick to detach iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 19:24:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-07d16a89-19da-40a8-9541-917facce604a tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, {'target_iqn': 'iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bciFqMWC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:24:13 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-07d16a89-19da-40a8-9541-917facce604a tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:24:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-07d16a89-19da-40a8-9541-917facce604a tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:24:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-07d16a89-19da-40a8-9541-917facce604a tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:24:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:14 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbdc8ac7-9016-4d95-9c47-c818751ebfba]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:24:14 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-07d16a89-19da-40a8-9541-917facce604a tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 19:24:14 user nova-compute[75066]: No targets found.
Dec 01 19:24:14 user nova-compute[75066]: iSNS:
Dec 01 19:24:14 user nova-compute[75066]: No targets found.
Dec 01 19:24:14 user nova-compute[75066]: STATIC:
Dec 01 19:24:14 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98
Dec 01 19:24:14 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:24:14 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:24:14 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb
Dec 01 19:24:14 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:24:14 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:24:14 user nova-compute[75066]: FIRMWARE:
Dec 01 19:24:14 user nova-compute[75066]: No targets found.
Dec 01 19:24:14 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:24:14 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-07d16a89-19da-40a8-9541-917facce604a tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 19:24:14 user nova-compute[75066]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 19:24:14 user nova-compute[75066]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75066) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 19:24:14 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-07d16a89-19da-40a8-9541-917facce604a tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98', 0)] {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 19:24:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:14 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e373d66-f705-4a4e-bb45-7c416fb27b80]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:24:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:14 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a593df-3cde-41d5-86c9-3f670a8e720f]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:24:14 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-07d16a89-19da-40a8-9541-917facce604a tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:24:14 user nova-compute[75066]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98 (non-flash)
Dec 01 19:24:14 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:24:14 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-07d16a89-19da-40a8-9541-917facce604a tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:24:14 user nova-compute[75066]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98 (non-flash)
Dec 01 19:24:14 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:24:14 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-07d16a89-19da-40a8-9541-917facce604a tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9190161fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98'): ({'sdc'}, set())}) {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 19:24:14 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-07d16a89-19da-40a8-9541-917facce604a tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Removing single pathed devices sdc {{(pid=75066) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 19:24:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:14 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[019a43a9-0e58-4d41-8fb6-c4701ab76f8e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:24:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:14 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[72cb4fad-207c-414c-b9d8-239560a04378]: (4, ('ok\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:24:14 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-07d16a89-19da-40a8-9541-917facce604a tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Flushing IO for device /dev/sdc {{(pid=75066) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 19:24:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:14 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1e1f88-e6a1-4624-9a3f-487f2b85b0e1]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:24:14 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-07d16a89-19da-40a8-9541-917facce604a tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75066) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 19:24:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.032s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:14 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda7612f-c240-4e8f-95a4-c2327be58a32]: (4, ('1', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:24:14 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-07d16a89-19da-40a8-9541-917facce604a tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 19:24:14 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-07d16a89-19da-40a8-9541-917facce604a tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] SCSI volumes sdc have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 19:24:14 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-07d16a89-19da-40a8-9541-917facce604a tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98')] {{(pid=75066) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 19:24:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:14 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[4674cc16-795d-456d-9517-c3d081065966]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:24:14 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-07d16a89-19da-40a8-9541-917facce604a tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:24:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98 -p 172.16.0.220:3260 --logout {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:14 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc4bd6a-9b95-4db8-8717-195f550ad088]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:24:14 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-07d16a89-19da-40a8-9541-917facce604a tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98, portal: 172.16.0.220,3260]
Dec 01 19:24:14 user nova-compute[75066]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98, portal: 172.16.0.220,3260] successful.
Dec 01 19:24:14 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:24:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98 -p 172.16.0.220:3260 --op delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:14 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[80f703cb-114b-45c6-a4b0-1ef9a56ed8b5]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:24:14 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-07d16a89-19da-40a8-9541-917facce604a tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:24:14 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-07d16a89-19da-40a8-9541-917facce604a tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.271s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:24:14 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-07d16a89-19da-40a8-9541-917facce604a tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] <== disconnect_volume: return (274ms) None {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:24:14 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07d16a89-19da-40a8-9541-917facce604a tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Disconnected iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 19:24:14 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:14 user nova-compute[75066]: DEBUG nova.objects.instance [None req-120099dc-e755-461e-b137-3f6905abbfa1 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lazy-loading 'flavor' on Instance uuid 3d340166-c58b-4213-b8d3-5036ade48d2d {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:24:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-120099dc-e755-461e-b137-3f6905abbfa1 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "3d340166-c58b-4213-b8d3-5036ade48d2d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.829s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:24:15 user nova-compute[75066]: DEBUG nova.objects.instance [None req-07d16a89-19da-40a8-9541-917facce604a tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lazy-loading 'flavor' on Instance uuid 933210b1-5c5e-421a-9b63-4595fc5f5f25 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:24:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-07d16a89-19da-40a8-9541-917facce604a tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lock "933210b1-5c5e-421a-9b63-4595fc5f5f25" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.832s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:24:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-cda7830e-dd4e-4014-a830-69540ba24119 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lock "933210b1-5c5e-421a-9b63-4595fc5f5f25" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.686s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:24:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-cda7830e-dd4e-4014-a830-69540ba24119 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Acquiring lock "933210b1-5c5e-421a-9b63-4595fc5f5f25-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:24:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-cda7830e-dd4e-4014-a830-69540ba24119 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lock "933210b1-5c5e-421a-9b63-4595fc5f5f25-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:24:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-cda7830e-dd4e-4014-a830-69540ba24119 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lock "933210b1-5c5e-421a-9b63-4595fc5f5f25-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:24:15 user nova-compute[75066]: INFO nova.compute.manager [None req-cda7830e-dd4e-4014-a830-69540ba24119 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Terminating instance
Dec 01 19:24:15 user nova-compute[75066]: DEBUG nova.compute.manager [None req-cda7830e-dd4e-4014-a830-69540ba24119 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Start destroying the instance on the hypervisor. {{(pid=75066) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 19:24:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:15 user nova-compute[75066]: DEBUG nova.compute.manager [req-008471b2-bf75-4d73-964f-7706f758af1d req-ceaa9b47-c038-46b2-a660-70fb5b24af7d service nova] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Received event network-vif-unplugged-171473a9-1228-4e96-b10f-c3d9a58b91eb {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:24:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-008471b2-bf75-4d73-964f-7706f758af1d req-ceaa9b47-c038-46b2-a660-70fb5b24af7d service nova] Acquiring lock "933210b1-5c5e-421a-9b63-4595fc5f5f25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:24:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-008471b2-bf75-4d73-964f-7706f758af1d req-ceaa9b47-c038-46b2-a660-70fb5b24af7d service nova] Lock "933210b1-5c5e-421a-9b63-4595fc5f5f25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:24:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-008471b2-bf75-4d73-964f-7706f758af1d req-ceaa9b47-c038-46b2-a660-70fb5b24af7d service nova] Lock "933210b1-5c5e-421a-9b63-4595fc5f5f25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:24:15 user nova-compute[75066]: DEBUG nova.compute.manager [req-008471b2-bf75-4d73-964f-7706f758af1d req-ceaa9b47-c038-46b2-a660-70fb5b24af7d service nova] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] No waiting events found dispatching network-vif-unplugged-171473a9-1228-4e96-b10f-c3d9a58b91eb {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:24:15 user nova-compute[75066]: DEBUG nova.compute.manager [req-008471b2-bf75-4d73-964f-7706f758af1d req-ceaa9b47-c038-46b2-a660-70fb5b24af7d service nova] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Received event network-vif-unplugged-171473a9-1228-4e96-b10f-c3d9a58b91eb for instance with task_state deleting. {{(pid=75066) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 19:24:15 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Instance destroyed successfully.
Dec 01 19:24:15 user nova-compute[75066]: DEBUG nova.objects.instance [None req-cda7830e-dd4e-4014-a830-69540ba24119 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lazy-loading 'resources' on Instance uuid 933210b1-5c5e-421a-9b63-4595fc5f5f25 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:24:15 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-cda7830e-dd4e-4014-a830-69540ba24119 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:21:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-300985667',display_name='tempest-VolumesSnapshotTestJSON-instance-300985667',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-300985667',id=19,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJQyCV1/xA765wlFyfrxcdfpjke/xdY+6QVDuYMiSGnqchoHcqlYGTVApz5dBkMx3FH/27lGkGmhnsZfvpusJhg1qzRgF/6fqz3MrJlw84RcijakUYX9319IAJqAP2euig==',key_name='tempest-keypair-773295022',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:21:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6fb5b77e2da142499315e0a96f86d959',ramdisk_id='',reservation_id='r-pxf0e5tl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1069530394',owner_user_name='tempest-VolumesSnapshotTestJSON-1069530394-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:21:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0be767f43744d73a35ed6b7a45c8b95',uuid=933210b1-5c5e-421a-9b63-4595fc5f5f25,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "171473a9-1228-4e96-b10f-c3d9a58b91eb", "address": "fa:16:3e:09:a8:0f", "network": {"id": "195edf10-5722-4eef-b117-7a450e973afa", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2017280124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fb5b77e2da142499315e0a96f86d959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap171473a9-12", "ovs_interfaceid": "171473a9-1228-4e96-b10f-c3d9a58b91eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:24:15 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-cda7830e-dd4e-4014-a830-69540ba24119 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Converting VIF {"id": "171473a9-1228-4e96-b10f-c3d9a58b91eb", "address": "fa:16:3e:09:a8:0f", "network": {"id": "195edf10-5722-4eef-b117-7a450e973afa", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2017280124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fb5b77e2da142499315e0a96f86d959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap171473a9-12", "ovs_interfaceid": "171473a9-1228-4e96-b10f-c3d9a58b91eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:24:15 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-cda7830e-dd4e-4014-a830-69540ba24119 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:09:a8:0f,bridge_name='br-int',has_traffic_filtering=True,id=171473a9-1228-4e96-b10f-c3d9a58b91eb,network=Network(195edf10-5722-4eef-b117-7a450e973afa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap171473a9-12') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:24:15 user nova-compute[75066]: DEBUG os_vif [None req-cda7830e-dd4e-4014-a830-69540ba24119 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:a8:0f,bridge_name='br-int',has_traffic_filtering=True,id=171473a9-1228-4e96-b10f-c3d9a58b91eb,network=Network(195edf10-5722-4eef-b117-7a450e973afa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap171473a9-12') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:24:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap171473a9-12, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:24:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:24:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8aa0299e-ff3b-436f-b28f-45b221ee5629) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:24:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:15 user nova-compute[75066]: INFO os_vif [None req-cda7830e-dd4e-4014-a830-69540ba24119 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:a8:0f,bridge_name='br-int',has_traffic_filtering=True,id=171473a9-1228-4e96-b10f-c3d9a58b91eb,network=Network(195edf10-5722-4eef-b117-7a450e973afa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap171473a9-12')
Dec 01 19:24:15 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cda7830e-dd4e-4014-a830-69540ba24119 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] calling os-brick to detach iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 19:24:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-cda7830e-dd4e-4014-a830-69540ba24119 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, {'target_iqn': 'iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bciFqMWC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:24:15 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-cda7830e-dd4e-4014-a830-69540ba24119 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:24:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-cda7830e-dd4e-4014-a830-69540ba24119 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:24:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-cda7830e-dd4e-4014-a830-69540ba24119 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:24:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:16 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d1d220-71c8-4adf-881c-d38e8e00a840]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:24:16 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-cda7830e-dd4e-4014-a830-69540ba24119 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 19:24:16 user nova-compute[75066]: No targets found.
Dec 01 19:24:16 user nova-compute[75066]: iSNS:
Dec 01 19:24:16 user nova-compute[75066]: No targets found.
Dec 01 19:24:16 user nova-compute[75066]: STATIC:
Dec 01 19:24:16 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb
Dec 01 19:24:16 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:24:16 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:24:16 user nova-compute[75066]: FIRMWARE:
Dec 01 19:24:16 user nova-compute[75066]: No targets found.
Dec 01 19:24:16 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:24:16 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-cda7830e-dd4e-4014-a830-69540ba24119 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 19:24:16 user nova-compute[75066]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 19:24:16 user nova-compute[75066]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75066) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 19:24:16 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-cda7830e-dd4e-4014-a830-69540ba24119 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:54688856-5adb-495a-91ae-7e593169bf98', 0)] {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 19:24:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:16 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e60aa6-27ea-4564-b673-c66a5d4ea8b6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:24:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:16 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d0c458-5982-440e-b45a-6e99a3be301d]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:24:16 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-cda7830e-dd4e-4014-a830-69540ba24119 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:24:16 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:24:16 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-cda7830e-dd4e-4014-a830-69540ba24119 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:24:16 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:24:16 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-cda7830e-dd4e-4014-a830-69540ba24119 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9190517c70>, {}) {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 19:24:16 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-cda7830e-dd4e-4014-a830-69540ba24119 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Disconnecting from: [] {{(pid=75066) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 19:24:16 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-cda7830e-dd4e-4014-a830-69540ba24119 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.065s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:24:16 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-cda7830e-dd4e-4014-a830-69540ba24119 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] <== disconnect_volume: return (66ms) None {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:24:16 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cda7830e-dd4e-4014-a830-69540ba24119 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Disconnected iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 19:24:16 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-cda7830e-dd4e-4014-a830-69540ba24119 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Deleting instance files /opt/stack/data/nova/instances/933210b1-5c5e-421a-9b63-4595fc5f5f25_del
Dec 01 19:24:16 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-cda7830e-dd4e-4014-a830-69540ba24119 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Deletion of /opt/stack/data/nova/instances/933210b1-5c5e-421a-9b63-4595fc5f5f25_del complete
Dec 01 19:24:16 user nova-compute[75066]: INFO nova.compute.manager [None req-cda7830e-dd4e-4014-a830-69540ba24119 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Took 0.90 seconds to destroy the instance on the hypervisor.
Dec 01 19:24:16 user nova-compute[75066]: DEBUG oslo.service.loopingcall [None req-cda7830e-dd4e-4014-a830-69540ba24119 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75066) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 19:24:16 user nova-compute[75066]: DEBUG nova.compute.manager [-] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Deallocating network for instance {{(pid=75066) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 19:24:16 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] deallocate_for_instance() {{(pid=75066) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 19:24:16 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:24:16 user nova-compute[75066]: INFO nova.compute.manager [-] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Took 0.77 seconds to deallocate network for instance.
Dec 01 19:24:16 user nova-compute[75066]: DEBUG nova.compute.manager [req-7b8e384c-b1bc-48c2-a5da-7d39d8b7b2bc req-05373a7d-57d1-46bb-9ec4-76b523968d6c service nova] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Received event network-vif-deleted-171473a9-1228-4e96-b10f-c3d9a58b91eb {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:24:16 user nova-compute[75066]: INFO nova.compute.manager [req-7b8e384c-b1bc-48c2-a5da-7d39d8b7b2bc req-05373a7d-57d1-46bb-9ec4-76b523968d6c service nova] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Neutron deleted interface 171473a9-1228-4e96-b10f-c3d9a58b91eb; detaching it from the instance and deleting it from the info cache
Dec 01 19:24:16 user nova-compute[75066]: DEBUG nova.network.neutron [req-7b8e384c-b1bc-48c2-a5da-7d39d8b7b2bc req-05373a7d-57d1-46bb-9ec4-76b523968d6c service nova] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:24:16 user nova-compute[75066]: WARNING nova.volume.cinder [None req-cda7830e-dd4e-4014-a830-69540ba24119 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Attachment ddc86fca-fb5c-4372-a307-dc0e0d2eddca does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = ddc86fca-fb5c-4372-a307-dc0e0d2eddca. (HTTP 404) (Request-ID: req-2636f996-f923-4b2e-975a-157586f005c9)
Dec 01 19:24:16 user nova-compute[75066]: INFO nova.compute.manager [None req-cda7830e-dd4e-4014-a830-69540ba24119 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Took 0.02 seconds to detach 1 volumes for instance.
Dec 01 19:24:16 user nova-compute[75066]: DEBUG nova.compute.manager [req-7b8e384c-b1bc-48c2-a5da-7d39d8b7b2bc req-05373a7d-57d1-46bb-9ec4-76b523968d6c service nova] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Detach interface failed, port_id=171473a9-1228-4e96-b10f-c3d9a58b91eb, reason: Instance 933210b1-5c5e-421a-9b63-4595fc5f5f25 could not be found. {{(pid=75066) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 01 19:24:16 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-cda7830e-dd4e-4014-a830-69540ba24119 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:24:16 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-cda7830e-dd4e-4014-a830-69540ba24119 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:24:17 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-cda7830e-dd4e-4014-a830-69540ba24119 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:24:17 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-cda7830e-dd4e-4014-a830-69540ba24119 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:24:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-cda7830e-dd4e-4014-a830-69540ba24119 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.374s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:24:17 user nova-compute[75066]: INFO nova.scheduler.client.report [None req-cda7830e-dd4e-4014-a830-69540ba24119 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Deleted allocations for instance 933210b1-5c5e-421a-9b63-4595fc5f5f25
Dec 01 19:24:17 user nova-compute[75066]: DEBUG nova.compute.manager [req-66179250-9b99-484d-a166-eb25b1ff5e1b req-93c7bdad-9a05-4354-9363-18e8440cdd7f service nova] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Received event network-vif-plugged-171473a9-1228-4e96-b10f-c3d9a58b91eb {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:24:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-66179250-9b99-484d-a166-eb25b1ff5e1b req-93c7bdad-9a05-4354-9363-18e8440cdd7f service nova] Acquiring lock "933210b1-5c5e-421a-9b63-4595fc5f5f25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:24:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-66179250-9b99-484d-a166-eb25b1ff5e1b req-93c7bdad-9a05-4354-9363-18e8440cdd7f service nova] Lock "933210b1-5c5e-421a-9b63-4595fc5f5f25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:24:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-66179250-9b99-484d-a166-eb25b1ff5e1b req-93c7bdad-9a05-4354-9363-18e8440cdd7f service nova] Lock "933210b1-5c5e-421a-9b63-4595fc5f5f25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:24:17 user nova-compute[75066]: DEBUG nova.compute.manager [req-66179250-9b99-484d-a166-eb25b1ff5e1b req-93c7bdad-9a05-4354-9363-18e8440cdd7f service nova] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] No waiting events found dispatching network-vif-plugged-171473a9-1228-4e96-b10f-c3d9a58b91eb {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:24:17 user nova-compute[75066]: WARNING nova.compute.manager [req-66179250-9b99-484d-a166-eb25b1ff5e1b req-93c7bdad-9a05-4354-9363-18e8440cdd7f service nova] [instance: 933210b1-5c5e-421a-9b63-4595fc5f5f25] Received unexpected event network-vif-plugged-171473a9-1228-4e96-b10f-c3d9a58b91eb for instance with vm_state deleted and task_state None.
Dec 01 19:24:17 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-cda7830e-dd4e-4014-a830-69540ba24119 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lock "933210b1-5c5e-421a-9b63-4595fc5f5f25" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.452s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:24:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:22 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:25 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:27 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:32 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-9a95ee33-1951-4219-8ba7-f98b9a88bcfc tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Acquiring lock "08a362a4-9353-4139-afd4-1a24fcfa65a0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:24:32 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-9a95ee33-1951-4219-8ba7-f98b9a88bcfc tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Lock "08a362a4-9353-4139-afd4-1a24fcfa65a0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:24:32 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-9a95ee33-1951-4219-8ba7-f98b9a88bcfc tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Acquiring lock "08a362a4-9353-4139-afd4-1a24fcfa65a0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:24:32 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-9a95ee33-1951-4219-8ba7-f98b9a88bcfc tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Lock "08a362a4-9353-4139-afd4-1a24fcfa65a0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:24:32 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-9a95ee33-1951-4219-8ba7-f98b9a88bcfc tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Lock "08a362a4-9353-4139-afd4-1a24fcfa65a0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:24:32 user nova-compute[75066]: INFO nova.compute.manager [None req-9a95ee33-1951-4219-8ba7-f98b9a88bcfc tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: 08a362a4-9353-4139-afd4-1a24fcfa65a0] Terminating instance
Dec 01 19:24:32 user nova-compute[75066]: DEBUG nova.compute.manager [None req-9a95ee33-1951-4219-8ba7-f98b9a88bcfc tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: 08a362a4-9353-4139-afd4-1a24fcfa65a0] Start destroying the instance on the hypervisor. {{(pid=75066) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 19:24:32 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:32 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:32 user nova-compute[75066]: DEBUG nova.compute.manager [req-278e1f69-dd92-4d6e-b05c-dc3abf773742 req-10c0e4b6-5177-40f1-b47a-6fa76e925250 service nova] [instance: 08a362a4-9353-4139-afd4-1a24fcfa65a0] Received event network-vif-unplugged-e828e2c4-e88f-4494-815b-854289833466 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:24:32 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-278e1f69-dd92-4d6e-b05c-dc3abf773742 req-10c0e4b6-5177-40f1-b47a-6fa76e925250 service nova] Acquiring lock "08a362a4-9353-4139-afd4-1a24fcfa65a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:24:32 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-278e1f69-dd92-4d6e-b05c-dc3abf773742 req-10c0e4b6-5177-40f1-b47a-6fa76e925250 service nova] Lock "08a362a4-9353-4139-afd4-1a24fcfa65a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:24:32 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-278e1f69-dd92-4d6e-b05c-dc3abf773742 req-10c0e4b6-5177-40f1-b47a-6fa76e925250 service nova] Lock "08a362a4-9353-4139-afd4-1a24fcfa65a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:24:32 user nova-compute[75066]: DEBUG nova.compute.manager [req-278e1f69-dd92-4d6e-b05c-dc3abf773742 req-10c0e4b6-5177-40f1-b47a-6fa76e925250 service nova] [instance: 08a362a4-9353-4139-afd4-1a24fcfa65a0] No waiting events found dispatching network-vif-unplugged-e828e2c4-e88f-4494-815b-854289833466 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:24:32 user nova-compute[75066]: DEBUG nova.compute.manager [req-278e1f69-dd92-4d6e-b05c-dc3abf773742 req-10c0e4b6-5177-40f1-b47a-6fa76e925250 service nova] [instance: 08a362a4-9353-4139-afd4-1a24fcfa65a0] Received event network-vif-unplugged-e828e2c4-e88f-4494-815b-854289833466 for instance with task_state deleting. {{(pid=75066) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 19:24:32 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:32 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:32 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:32 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:32 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:32 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 08a362a4-9353-4139-afd4-1a24fcfa65a0] Instance destroyed successfully.
Dec 01 19:24:32 user nova-compute[75066]: DEBUG nova.objects.instance [None req-9a95ee33-1951-4219-8ba7-f98b9a88bcfc tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Lazy-loading 'resources' on Instance uuid 08a362a4-9353-4139-afd4-1a24fcfa65a0 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:24:32 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-9a95ee33-1951-4219-8ba7-f98b9a88bcfc tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:22:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1277895667',display_name='tempest-VolumesAdminNegativeTest-server-1277895667',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1277895667',id=21,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:22:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6ec09f9e9cee4b46a5adda7a2811e991',ramdisk_id='',reservation_id='r-s0a9aahm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1973855036',owner_user_name='tempest-VolumesAdminNegativeTest-1973855036-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:22:41Z,user_data=None,user_id='8f807bcec6a5479cb3a97c85d7110afe',uuid=08a362a4-9353-4139-afd4-1a24fcfa65a0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e828e2c4-e88f-4494-815b-854289833466", "address": "fa:16:3e:24:bb:3e", "network": {"id": "5380ccc0-6aee-42e3-a3e7-b2219a2eb53a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-952289001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ec09f9e9cee4b46a5adda7a2811e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape828e2c4-e8", "ovs_interfaceid": "e828e2c4-e88f-4494-815b-854289833466", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:24:32 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-9a95ee33-1951-4219-8ba7-f98b9a88bcfc tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Converting VIF {"id": "e828e2c4-e88f-4494-815b-854289833466", "address": "fa:16:3e:24:bb:3e", "network": {"id": "5380ccc0-6aee-42e3-a3e7-b2219a2eb53a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-952289001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ec09f9e9cee4b46a5adda7a2811e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape828e2c4-e8", "ovs_interfaceid": "e828e2c4-e88f-4494-815b-854289833466", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:24:32 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-9a95ee33-1951-4219-8ba7-f98b9a88bcfc tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:bb:3e,bridge_name='br-int',has_traffic_filtering=True,id=e828e2c4-e88f-4494-815b-854289833466,network=Network(5380ccc0-6aee-42e3-a3e7-b2219a2eb53a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape828e2c4-e8') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:24:32 user nova-compute[75066]: DEBUG os_vif [None req-9a95ee33-1951-4219-8ba7-f98b9a88bcfc tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:bb:3e,bridge_name='br-int',has_traffic_filtering=True,id=e828e2c4-e88f-4494-815b-854289833466,network=Network(5380ccc0-6aee-42e3-a3e7-b2219a2eb53a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape828e2c4-e8') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:24:32 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:32 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape828e2c4-e8, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:24:32 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:32 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:24:32 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:32 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=80d2a6f9-2b91-450d-b2ea-da2d9a9eb97d) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:24:32 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:32 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:32 user nova-compute[75066]: INFO os_vif [None req-9a95ee33-1951-4219-8ba7-f98b9a88bcfc tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:bb:3e,bridge_name='br-int',has_traffic_filtering=True,id=e828e2c4-e88f-4494-815b-854289833466,network=Network(5380ccc0-6aee-42e3-a3e7-b2219a2eb53a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape828e2c4-e8')
Dec 01 19:24:32 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-9a95ee33-1951-4219-8ba7-f98b9a88bcfc tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: 08a362a4-9353-4139-afd4-1a24fcfa65a0] Deleting instance files /opt/stack/data/nova/instances/08a362a4-9353-4139-afd4-1a24fcfa65a0_del
Dec 01 19:24:32 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-9a95ee33-1951-4219-8ba7-f98b9a88bcfc tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: 08a362a4-9353-4139-afd4-1a24fcfa65a0] Deletion of /opt/stack/data/nova/instances/08a362a4-9353-4139-afd4-1a24fcfa65a0_del complete
Dec 01 19:24:33 user nova-compute[75066]: INFO nova.compute.manager [None req-9a95ee33-1951-4219-8ba7-f98b9a88bcfc tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: 08a362a4-9353-4139-afd4-1a24fcfa65a0] Took 0.88 seconds to destroy the instance on the hypervisor.
Dec 01 19:24:33 user nova-compute[75066]: DEBUG oslo.service.loopingcall [None req-9a95ee33-1951-4219-8ba7-f98b9a88bcfc tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75066) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 19:24:33 user nova-compute[75066]: DEBUG nova.compute.manager [-] [instance: 08a362a4-9353-4139-afd4-1a24fcfa65a0] Deallocating network for instance {{(pid=75066) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 19:24:33 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: 08a362a4-9353-4139-afd4-1a24fcfa65a0] deallocate_for_instance() {{(pid=75066) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 19:24:33 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: 08a362a4-9353-4139-afd4-1a24fcfa65a0] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:24:33 user nova-compute[75066]: INFO nova.compute.manager [-] [instance: 08a362a4-9353-4139-afd4-1a24fcfa65a0] Took 0.44 seconds to deallocate network for instance.
Dec 01 19:24:33 user nova-compute[75066]: DEBUG nova.compute.manager [req-cd51982e-b40c-482d-a42c-1347ccf1fb47 req-19f76614-c122-49d7-8d43-06dc08c42c53 service nova] [instance: 08a362a4-9353-4139-afd4-1a24fcfa65a0] Received event network-vif-deleted-e828e2c4-e88f-4494-815b-854289833466 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:24:33 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-9a95ee33-1951-4219-8ba7-f98b9a88bcfc tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:24:33 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-9a95ee33-1951-4219-8ba7-f98b9a88bcfc tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:24:33 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-9a95ee33-1951-4219-8ba7-f98b9a88bcfc tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:24:33 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-9a95ee33-1951-4219-8ba7-f98b9a88bcfc tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:24:33 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-9a95ee33-1951-4219-8ba7-f98b9a88bcfc tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.399s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:24:33 user nova-compute[75066]: INFO nova.scheduler.client.report [None req-9a95ee33-1951-4219-8ba7-f98b9a88bcfc tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Deleted allocations for instance 08a362a4-9353-4139-afd4-1a24fcfa65a0
Dec 01 19:24:34 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-9a95ee33-1951-4219-8ba7-f98b9a88bcfc tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Lock "08a362a4-9353-4139-afd4-1a24fcfa65a0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.910s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:24:34 user nova-compute[75066]: DEBUG nova.compute.manager [req-99f88341-23cd-4d06-836b-2108d9dd8688 req-e35c8ab0-08da-4e0c-8566-38113003b66d service nova] [instance: 08a362a4-9353-4139-afd4-1a24fcfa65a0] Received event network-vif-plugged-e828e2c4-e88f-4494-815b-854289833466 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:24:34 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-99f88341-23cd-4d06-836b-2108d9dd8688 req-e35c8ab0-08da-4e0c-8566-38113003b66d service nova] Acquiring lock "08a362a4-9353-4139-afd4-1a24fcfa65a0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:24:34 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-99f88341-23cd-4d06-836b-2108d9dd8688 req-e35c8ab0-08da-4e0c-8566-38113003b66d service nova] Lock "08a362a4-9353-4139-afd4-1a24fcfa65a0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:24:34 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-99f88341-23cd-4d06-836b-2108d9dd8688 req-e35c8ab0-08da-4e0c-8566-38113003b66d service nova] Lock "08a362a4-9353-4139-afd4-1a24fcfa65a0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:24:34 user nova-compute[75066]: DEBUG nova.compute.manager [req-99f88341-23cd-4d06-836b-2108d9dd8688 req-e35c8ab0-08da-4e0c-8566-38113003b66d service nova] [instance: 08a362a4-9353-4139-afd4-1a24fcfa65a0] No waiting events found dispatching network-vif-plugged-e828e2c4-e88f-4494-815b-854289833466 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:24:34 user nova-compute[75066]: WARNING nova.compute.manager [req-99f88341-23cd-4d06-836b-2108d9dd8688 req-e35c8ab0-08da-4e0c-8566-38113003b66d service nova] [instance: 08a362a4-9353-4139-afd4-1a24fcfa65a0] Received unexpected event network-vif-plugged-e828e2c4-e88f-4494-815b-854289833466 for instance with vm_state deleted and task_state None.
Dec 01 19:24:36 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:36 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:36 user nova-compute[75066]: INFO nova.compute.manager [None req-357ac2d8-6e4a-4962-bd7c-1c967e8f0c02 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Rescuing
Dec 01 19:24:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-357ac2d8-6e4a-4962-bd7c-1c967e8f0c02 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Acquiring lock "refresh_cache-d564b128-598b-4ad4-8618-afa4dc8a7347" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:24:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-357ac2d8-6e4a-4962-bd7c-1c967e8f0c02 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Acquired lock "refresh_cache-d564b128-598b-4ad4-8618-afa4dc8a7347" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:24:36 user nova-compute[75066]: DEBUG nova.network.neutron [None req-357ac2d8-6e4a-4962-bd7c-1c967e8f0c02 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:24:37 user nova-compute[75066]: DEBUG nova.network.neutron [None req-357ac2d8-6e4a-4962-bd7c-1c967e8f0c02 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Updating instance_info_cache with network_info: [{"id": "4850dc75-0d93-4536-abc1-a981dd385d96", "address": "fa:16:3e:fc:d1:96", "network": {"id": "47c850ae-6dcb-4977-a02a-e32cd3df4749", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-475363603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "943324a514a84cb4947dbab93abc4f6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4850dc75-0d", "ovs_interfaceid": "4850dc75-0d93-4536-abc1-a981dd385d96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:24:37 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-357ac2d8-6e4a-4962-bd7c-1c967e8f0c02 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Releasing lock "refresh_cache-d564b128-598b-4ad4-8618-afa4dc8a7347" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:24:37 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:37 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:37 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:37 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:37 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:37 user nova-compute[75066]: DEBUG nova.compute.manager [req-be2105d2-f737-4852-9c29-6a3dad164c99 req-b147558a-fdf5-47cb-a7c0-589646732c3e service nova] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Received event network-vif-unplugged-4850dc75-0d93-4536-abc1-a981dd385d96 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:24:37 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-be2105d2-f737-4852-9c29-6a3dad164c99 req-b147558a-fdf5-47cb-a7c0-589646732c3e service nova] Acquiring lock "d564b128-598b-4ad4-8618-afa4dc8a7347-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:24:37 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-be2105d2-f737-4852-9c29-6a3dad164c99 req-b147558a-fdf5-47cb-a7c0-589646732c3e service nova] Lock "d564b128-598b-4ad4-8618-afa4dc8a7347-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:24:37 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-be2105d2-f737-4852-9c29-6a3dad164c99 req-b147558a-fdf5-47cb-a7c0-589646732c3e service nova] Lock "d564b128-598b-4ad4-8618-afa4dc8a7347-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:24:37 user nova-compute[75066]: DEBUG nova.compute.manager [req-be2105d2-f737-4852-9c29-6a3dad164c99 req-b147558a-fdf5-47cb-a7c0-589646732c3e service nova] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] No waiting events found dispatching network-vif-unplugged-4850dc75-0d93-4536-abc1-a981dd385d96 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:24:37 user nova-compute[75066]: WARNING nova.compute.manager [req-be2105d2-f737-4852-9c29-6a3dad164c99 req-b147558a-fdf5-47cb-a7c0-589646732c3e service nova] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Received unexpected event network-vif-unplugged-4850dc75-0d93-4536-abc1-a981dd385d96 for instance with vm_state active and task_state rescuing.
Dec 01 19:24:37 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:38 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Instance destroyed successfully.
Dec 01 19:24:38 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-357ac2d8-6e4a-4962-bd7c-1c967e8f0c02 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Attempting rescue
Dec 01 19:24:38 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-357ac2d8-6e4a-4962-bd7c-1c967e8f0c02 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75066) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4314}}
Dec 01 19:24:38 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-357ac2d8-6e4a-4962-bd7c-1c967e8f0c02 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Instance directory exists: not creating {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4719}}
Dec 01 19:24:38 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-357ac2d8-6e4a-4962-bd7c-1c967e8f0c02 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Creating image(s)
Dec 01 19:24:38 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-357ac2d8-6e4a-4962-bd7c-1c967e8f0c02 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Acquiring lock "/opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:24:38 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-357ac2d8-6e4a-4962-bd7c-1c967e8f0c02 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "/opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:24:38 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-357ac2d8-6e4a-4962-bd7c-1c967e8f0c02 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "/opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:24:38 user nova-compute[75066]: DEBUG nova.objects.instance [None req-357ac2d8-6e4a-4962-bd7c-1c967e8f0c02 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lazy-loading 'trusted_certs' on Instance uuid d564b128-598b-4ad4-8618-afa4dc8a7347 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:24:38 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-357ac2d8-6e4a-4962-bd7c-1c967e8f0c02 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Acquiring lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:24:38 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-357ac2d8-6e4a-4962-bd7c-1c967e8f0c02 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:24:38 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-357ac2d8-6e4a-4962-bd7c-1c967e8f0c02 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:38 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-357ac2d8-6e4a-4962-bd7c-1c967e8f0c02 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.169s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:38 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-357ac2d8-6e4a-4962-bd7c-1c967e8f0c02 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk.rescue {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:38 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-357ac2d8-6e4a-4962-bd7c-1c967e8f0c02 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk.rescue" returned: 0 in 0.050s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:38 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-357ac2d8-6e4a-4962-bd7c-1c967e8f0c02 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:24:38 user nova-compute[75066]: DEBUG nova.objects.instance [None req-357ac2d8-6e4a-4962-bd7c-1c967e8f0c02 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lazy-loading 'migration_context' on Instance uuid d564b128-598b-4ad4-8618-afa4dc8a7347 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:24:38 user nova-compute[75066]: DEBUG nova.objects.base [None req-357ac2d8-6e4a-4962-bd7c-1c967e8f0c02 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Object Instance<d564b128-598b-4ad4-8618-afa4dc8a7347> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75066) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 19:24:38 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-357ac2d8-6e4a-4962-bd7c-1c967e8f0c02 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Created local disks {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 19:24:38 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-357ac2d8-6e4a-4962-bd7c-1c967e8f0c02 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Start _get_guest_xml network_info=[{"id": "4850dc75-0d93-4536-abc1-a981dd385d96", "address": "fa:16:3e:fc:d1:96", "network": {"id": "47c850ae-6dcb-4977-a02a-e32cd3df4749", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-475363603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-475363603-network", "vif_mac": "fa:16:3e:fc:d1:96"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "943324a514a84cb4947dbab93abc4f6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4850dc75-0d", "ovs_interfaceid": "4850dc75-0d93-4536-abc1-a981dd385d96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '900b237b-e99c-4fdd-a44f-dcb7a08baa86', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:24:38 user nova-compute[75066]: DEBUG nova.objects.instance [None req-357ac2d8-6e4a-4962-bd7c-1c967e8f0c02 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lazy-loading 'resources' on Instance uuid d564b128-598b-4ad4-8618-afa4dc8a7347 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:24:38 user nova-compute[75066]: DEBUG nova.objects.base [None req-357ac2d8-6e4a-4962-bd7c-1c967e8f0c02 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Object Instance<d564b128-598b-4ad4-8618-afa4dc8a7347> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75066) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 19:24:38 user nova-compute[75066]: DEBUG nova.objects.instance [None req-357ac2d8-6e4a-4962-bd7c-1c967e8f0c02 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lazy-loading 'numa_topology' on Instance uuid d564b128-598b-4ad4-8618-afa4dc8a7347 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:24:38 user nova-compute[75066]: DEBUG nova.objects.base [None req-357ac2d8-6e4a-4962-bd7c-1c967e8f0c02 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Object Instance<d564b128-598b-4ad4-8618-afa4dc8a7347> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75066) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 19:24:38 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-357ac2d8-6e4a-4962-bd7c-1c967e8f0c02 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:24:38 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-357ac2d8-6e4a-4962-bd7c-1c967e8f0c02 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:24:38 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-357ac2d8-6e4a-4962-bd7c-1c967e8f0c02 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:24:38 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-357ac2d8-6e4a-4962-bd7c-1c967e8f0c02 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:24:38 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-357ac2d8-6e4a-4962-bd7c-1c967e8f0c02 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:24:38 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-357ac2d8-6e4a-4962-bd7c-1c967e8f0c02 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:24:38 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-357ac2d8-6e4a-4962-bd7c-1c967e8f0c02 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:24:38 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-357ac2d8-6e4a-4962-bd7c-1c967e8f0c02 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:24:38 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-357ac2d8-6e4a-4962-bd7c-1c967e8f0c02 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:24:38 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-357ac2d8-6e4a-4962-bd7c-1c967e8f0c02 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:24:38 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-357ac2d8-6e4a-4962-bd7c-1c967e8f0c02 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:24:38 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-357ac2d8-6e4a-4962-bd7c-1c967e8f0c02 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:24:38 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-357ac2d8-6e4a-4962-bd7c-1c967e8f0c02 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:24:38 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-357ac2d8-6e4a-4962-bd7c-1c967e8f0c02 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:24:38 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-357ac2d8-6e4a-4962-bd7c-1c967e8f0c02 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:24:38 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-357ac2d8-6e4a-4962-bd7c-1c967e8f0c02 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:24:38 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-357ac2d8-6e4a-4962-bd7c-1c967e8f0c02 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:24:38 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-357ac2d8-6e4a-4962-bd7c-1c967e8f0c02 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:24:38 user nova-compute[75066]: DEBUG nova.objects.instance [None req-357ac2d8-6e4a-4962-bd7c-1c967e8f0c02 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lazy-loading 'vcpu_model' on Instance uuid d564b128-598b-4ad4-8618-afa4dc8a7347 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:24:38 user nova-compute[75066]: DEBUG nova.objects.base [None req-357ac2d8-6e4a-4962-bd7c-1c967e8f0c02 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Object Instance<d564b128-598b-4ad4-8618-afa4dc8a7347> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75066) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 19:24:38 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-357ac2d8-6e4a-4962-bd7c-1c967e8f0c02 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:19:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1777670164',display_name='tempest-ServerRescueNegativeTestJSON-server-1777670164',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1777670164',id=15,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:20:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='943324a514a84cb4947dbab93abc4f6c',ramdisk_id='',reservation_id='r-nreed1q4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-146516797',owner_user_name='tempest-ServerRescueNegativeTestJSON-146516797-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:20:02Z,user_data=None,user_id='e6ee9ed4a8d8418082a59be8db20cf2e',uuid=d564b128-598b-4ad4-8618-afa4dc8a7347,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4850dc75-0d93-4536-abc1-a981dd385d96", "address": "fa:16:3e:fc:d1:96", "network": {"id": "47c850ae-6dcb-4977-a02a-e32cd3df4749", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-475363603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-475363603-network", "vif_mac": "fa:16:3e:fc:d1:96"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "943324a514a84cb4947dbab93abc4f6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4850dc75-0d", "ovs_interfaceid": "4850dc75-0d93-4536-abc1-a981dd385d96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:24:38 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-357ac2d8-6e4a-4962-bd7c-1c967e8f0c02 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Converting VIF {"id": "4850dc75-0d93-4536-abc1-a981dd385d96", "address": "fa:16:3e:fc:d1:96", "network": {"id": "47c850ae-6dcb-4977-a02a-e32cd3df4749", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-475363603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-475363603-network", "vif_mac": "fa:16:3e:fc:d1:96"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "943324a514a84cb4947dbab93abc4f6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4850dc75-0d", "ovs_interfaceid": "4850dc75-0d93-4536-abc1-a981dd385d96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:24:38 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-357ac2d8-6e4a-4962-bd7c-1c967e8f0c02 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:d1:96,bridge_name='br-int',has_traffic_filtering=True,id=4850dc75-0d93-4536-abc1-a981dd385d96,network=Network(47c850ae-6dcb-4977-a02a-e32cd3df4749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4850dc75-0d') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:24:38 user nova-compute[75066]: DEBUG nova.objects.instance [None req-357ac2d8-6e4a-4962-bd7c-1c967e8f0c02 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lazy-loading 'pci_devices' on Instance uuid d564b128-598b-4ad4-8618-afa4dc8a7347 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:24:38 user nova-compute[75066]: DEBUG nova.objects.base [None req-357ac2d8-6e4a-4962-bd7c-1c967e8f0c02 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Object Instance<d564b128-598b-4ad4-8618-afa4dc8a7347> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75066) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 19:24:38 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-357ac2d8-6e4a-4962-bd7c-1c967e8f0c02 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:24:38 user nova-compute[75066]:   <uuid>d564b128-598b-4ad4-8618-afa4dc8a7347</uuid>
Dec 01 19:24:38 user nova-compute[75066]:   <name>instance-0000000f</name>
Dec 01 19:24:38 user nova-compute[75066]:   <memory>524288</memory>
Dec 01 19:24:38 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:24:38 user nova-compute[75066]:   <metadata>
Dec 01 19:24:38 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:24:38 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:24:38 user nova-compute[75066]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1777670164</nova:name>
Dec 01 19:24:38 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:24:38</nova:creationTime>
Dec 01 19:24:38 user nova-compute[75066]:       <nova:flavor name="m1.tiny">
Dec 01 19:24:38 user nova-compute[75066]:         <nova:memory>512</nova:memory>
Dec 01 19:24:38 user nova-compute[75066]:         <nova:disk>1</nova:disk>
Dec 01 19:24:38 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:24:38 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:24:38 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:24:38 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:24:38 user nova-compute[75066]:       <nova:owner>
Dec 01 19:24:38 user nova-compute[75066]:         <nova:user uuid="e6ee9ed4a8d8418082a59be8db20cf2e">tempest-ServerRescueNegativeTestJSON-146516797-project-member</nova:user>
Dec 01 19:24:38 user nova-compute[75066]:         <nova:project uuid="943324a514a84cb4947dbab93abc4f6c">tempest-ServerRescueNegativeTestJSON-146516797</nova:project>
Dec 01 19:24:38 user nova-compute[75066]:       </nova:owner>
Dec 01 19:24:38 user nova-compute[75066]:       <nova:root type="image" uuid="900b237b-e99c-4fdd-a44f-dcb7a08baa86"/>
Dec 01 19:24:38 user nova-compute[75066]:       <nova:ports>
Dec 01 19:24:38 user nova-compute[75066]:         <nova:port uuid="4850dc75-0d93-4536-abc1-a981dd385d96">
Dec 01 19:24:38 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Dec 01 19:24:38 user nova-compute[75066]:         </nova:port>
Dec 01 19:24:38 user nova-compute[75066]:       </nova:ports>
Dec 01 19:24:38 user nova-compute[75066]:     </nova:instance>
Dec 01 19:24:38 user nova-compute[75066]:   </metadata>
Dec 01 19:24:38 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:24:38 user nova-compute[75066]:     <system>
Dec 01 19:24:38 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:24:38 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:24:38 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:24:38 user nova-compute[75066]:       <entry name="serial">d564b128-598b-4ad4-8618-afa4dc8a7347</entry>
Dec 01 19:24:38 user nova-compute[75066]:       <entry name="uuid">d564b128-598b-4ad4-8618-afa4dc8a7347</entry>
Dec 01 19:24:38 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:24:38 user nova-compute[75066]:     </system>
Dec 01 19:24:38 user nova-compute[75066]:   </sysinfo>
Dec 01 19:24:38 user nova-compute[75066]:   <os>
Dec 01 19:24:38 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:24:38 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:24:38 user nova-compute[75066]:   </os>
Dec 01 19:24:38 user nova-compute[75066]:   <features>
Dec 01 19:24:38 user nova-compute[75066]:     <acpi/>
Dec 01 19:24:38 user nova-compute[75066]:     <apic/>
Dec 01 19:24:38 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:24:38 user nova-compute[75066]:   </features>
Dec 01 19:24:38 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:24:38 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:24:38 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:24:38 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:24:38 user nova-compute[75066]:   </clock>
Dec 01 19:24:38 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:24:38 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:24:38 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:24:38 user nova-compute[75066]:   </cpu>
Dec 01 19:24:38 user nova-compute[75066]:   <devices>
Dec 01 19:24:38 user nova-compute[75066]:     <disk type="file" device="disk">
Dec 01 19:24:38 user nova-compute[75066]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 19:24:38 user nova-compute[75066]:       <source file="/opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk.rescue"/>
Dec 01 19:24:38 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:24:38 user nova-compute[75066]:     </disk>
Dec 01 19:24:38 user nova-compute[75066]:     <disk type="file" device="disk">
Dec 01 19:24:38 user nova-compute[75066]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 19:24:38 user nova-compute[75066]:       <source file="/opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk"/>
Dec 01 19:24:38 user nova-compute[75066]:       <target dev="vdb" bus="virtio"/>
Dec 01 19:24:38 user nova-compute[75066]:     </disk>
Dec 01 19:24:38 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:24:38 user nova-compute[75066]:       <mac address="fa:16:3e:fc:d1:96"/>
Dec 01 19:24:38 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:24:38 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:24:38 user nova-compute[75066]:       <target dev="tap4850dc75-0d"/>
Dec 01 19:24:38 user nova-compute[75066]:     </interface>
Dec 01 19:24:38 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:24:38 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/console.log" append="off"/>
Dec 01 19:24:38 user nova-compute[75066]:     </serial>
Dec 01 19:24:38 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:24:38 user nova-compute[75066]:     <video>
Dec 01 19:24:38 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:24:38 user nova-compute[75066]:     </video>
Dec 01 19:24:38 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:24:38 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:24:38 user nova-compute[75066]:     </rng>
Dec 01 19:24:38 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:24:38 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:24:38 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:24:38 user nova-compute[75066]:     </memballoon>
Dec 01 19:24:38 user nova-compute[75066]:   </devices>
Dec 01 19:24:38 user nova-compute[75066]: </domain>
Dec 01 19:24:38 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:24:38 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Instance destroyed successfully.
Dec 01 19:24:38 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-357ac2d8-6e4a-4962-bd7c-1c967e8f0c02 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:24:38 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-357ac2d8-6e4a-4962-bd7c-1c967e8f0c02 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:24:38 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-357ac2d8-6e4a-4962-bd7c-1c967e8f0c02 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] No VIF found with MAC fa:16:3e:fc:d1:96, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:24:39 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:40 user nova-compute[75066]: DEBUG nova.compute.manager [req-464f1be7-9ffd-43af-8fe8-594196f39c5f req-a1886985-b381-4d99-bad2-078f989385d3 service nova] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Received event network-vif-plugged-4850dc75-0d93-4536-abc1-a981dd385d96 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:24:40 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-464f1be7-9ffd-43af-8fe8-594196f39c5f req-a1886985-b381-4d99-bad2-078f989385d3 service nova] Acquiring lock "d564b128-598b-4ad4-8618-afa4dc8a7347-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:24:40 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-464f1be7-9ffd-43af-8fe8-594196f39c5f req-a1886985-b381-4d99-bad2-078f989385d3 service nova] Lock "d564b128-598b-4ad4-8618-afa4dc8a7347-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:24:40 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-464f1be7-9ffd-43af-8fe8-594196f39c5f req-a1886985-b381-4d99-bad2-078f989385d3 service nova] Lock "d564b128-598b-4ad4-8618-afa4dc8a7347-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:24:40 user nova-compute[75066]: DEBUG nova.compute.manager [req-464f1be7-9ffd-43af-8fe8-594196f39c5f req-a1886985-b381-4d99-bad2-078f989385d3 service nova] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] No waiting events found dispatching network-vif-plugged-4850dc75-0d93-4536-abc1-a981dd385d96 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:24:40 user nova-compute[75066]: WARNING nova.compute.manager [req-464f1be7-9ffd-43af-8fe8-594196f39c5f req-a1886985-b381-4d99-bad2-078f989385d3 service nova] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Received unexpected event network-vif-plugged-4850dc75-0d93-4536-abc1-a981dd385d96 for instance with vm_state active and task_state rescuing.
Dec 01 19:24:40 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:40 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:40 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:40 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:40 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:40 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:42 user nova-compute[75066]: DEBUG nova.compute.manager [req-58c3c59b-7680-4368-a29f-b57b42d1eb39 req-5ae1a96f-4876-4a25-bd92-b8f4c97ba101 service nova] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Received event network-vif-plugged-4850dc75-0d93-4536-abc1-a981dd385d96 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:24:42 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-58c3c59b-7680-4368-a29f-b57b42d1eb39 req-5ae1a96f-4876-4a25-bd92-b8f4c97ba101 service nova] Acquiring lock "d564b128-598b-4ad4-8618-afa4dc8a7347-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:24:42 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-58c3c59b-7680-4368-a29f-b57b42d1eb39 req-5ae1a96f-4876-4a25-bd92-b8f4c97ba101 service nova] Lock "d564b128-598b-4ad4-8618-afa4dc8a7347-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:24:42 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-58c3c59b-7680-4368-a29f-b57b42d1eb39 req-5ae1a96f-4876-4a25-bd92-b8f4c97ba101 service nova] Lock "d564b128-598b-4ad4-8618-afa4dc8a7347-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:24:42 user nova-compute[75066]: DEBUG nova.compute.manager [req-58c3c59b-7680-4368-a29f-b57b42d1eb39 req-5ae1a96f-4876-4a25-bd92-b8f4c97ba101 service nova] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] No waiting events found dispatching network-vif-plugged-4850dc75-0d93-4536-abc1-a981dd385d96 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:24:42 user nova-compute[75066]: WARNING nova.compute.manager [req-58c3c59b-7680-4368-a29f-b57b42d1eb39 req-5ae1a96f-4876-4a25-bd92-b8f4c97ba101 service nova] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Received unexpected event network-vif-plugged-4850dc75-0d93-4536-abc1-a981dd385d96 for instance with vm_state active and task_state rescuing.
Dec 01 19:24:42 user nova-compute[75066]: DEBUG nova.compute.manager [req-58c3c59b-7680-4368-a29f-b57b42d1eb39 req-5ae1a96f-4876-4a25-bd92-b8f4c97ba101 service nova] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Received event network-vif-plugged-4850dc75-0d93-4536-abc1-a981dd385d96 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:24:42 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-58c3c59b-7680-4368-a29f-b57b42d1eb39 req-5ae1a96f-4876-4a25-bd92-b8f4c97ba101 service nova] Acquiring lock "d564b128-598b-4ad4-8618-afa4dc8a7347-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:24:42 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-58c3c59b-7680-4368-a29f-b57b42d1eb39 req-5ae1a96f-4876-4a25-bd92-b8f4c97ba101 service nova] Lock "d564b128-598b-4ad4-8618-afa4dc8a7347-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:24:42 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-58c3c59b-7680-4368-a29f-b57b42d1eb39 req-5ae1a96f-4876-4a25-bd92-b8f4c97ba101 service nova] Lock "d564b128-598b-4ad4-8618-afa4dc8a7347-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:24:42 user nova-compute[75066]: DEBUG nova.compute.manager [req-58c3c59b-7680-4368-a29f-b57b42d1eb39 req-5ae1a96f-4876-4a25-bd92-b8f4c97ba101 service nova] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] No waiting events found dispatching network-vif-plugged-4850dc75-0d93-4536-abc1-a981dd385d96 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:24:42 user nova-compute[75066]: WARNING nova.compute.manager [req-58c3c59b-7680-4368-a29f-b57b42d1eb39 req-5ae1a96f-4876-4a25-bd92-b8f4c97ba101 service nova] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Received unexpected event network-vif-plugged-4850dc75-0d93-4536-abc1-a981dd385d96 for instance with vm_state active and task_state rescuing.
Dec 01 19:24:42 user nova-compute[75066]: DEBUG nova.compute.manager [None req-357ac2d8-6e4a-4962-bd7c-1c967e8f0c02 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:24:42 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:42 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:43 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-44fed59d-e890-4351-9882-6cd985dc45a4 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Acquiring lock "3d340166-c58b-4213-b8d3-5036ade48d2d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:24:43 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-44fed59d-e890-4351-9882-6cd985dc45a4 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "3d340166-c58b-4213-b8d3-5036ade48d2d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:24:43 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-44fed59d-e890-4351-9882-6cd985dc45a4 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Acquiring lock "3d340166-c58b-4213-b8d3-5036ade48d2d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:24:43 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-44fed59d-e890-4351-9882-6cd985dc45a4 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "3d340166-c58b-4213-b8d3-5036ade48d2d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:24:43 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-44fed59d-e890-4351-9882-6cd985dc45a4 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "3d340166-c58b-4213-b8d3-5036ade48d2d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:24:43 user nova-compute[75066]: INFO nova.compute.manager [None req-44fed59d-e890-4351-9882-6cd985dc45a4 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Terminating instance
Dec 01 19:24:43 user nova-compute[75066]: DEBUG nova.compute.manager [None req-44fed59d-e890-4351-9882-6cd985dc45a4 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Start destroying the instance on the hypervisor. {{(pid=75066) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 19:24:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:43 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Instance destroyed successfully.
Dec 01 19:24:43 user nova-compute[75066]: DEBUG nova.objects.instance [None req-44fed59d-e890-4351-9882-6cd985dc45a4 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lazy-loading 'resources' on Instance uuid 3d340166-c58b-4213-b8d3-5036ade48d2d {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:24:43 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-44fed59d-e890-4351-9882-6cd985dc45a4 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-01T19:18:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-88799949',display_name='tempest-ServerActionsTestOtherA-server-59047600',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-88799949',id=13,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPeOjka3O2yOSG7PgvQxwfceH9ScZixOK/oKEDoZu88X4E6S58dhbFi5q4+c/guiL9cBe6OBGVWUQ58KJXvXMJo6fjs42odNZigfHcTvBLGpR1adq29cPDQW/Rp9UoL0ag==',key_name='tempest-keypair-202509697',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:21:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fb0f7516d1db4dd5bc7d77a0bd1d44d7',ramdisk_id='',reservation_id='r-dyxm9b0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1700253921',owner_user_name='tempest-ServerActionsTestOtherA-1700253921-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:21:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfb3e7b4b0444223af282b16da9bd919',uuid=3d340166-c58b-4213-b8d3-5036ade48d2d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01c08ead-7eed-4e1a-839a-234fce1ba605", "address": "fa:16:3e:6e:53:26", "network": {"id": "9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-696310557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0f7516d1db4dd5bc7d77a0bd1d44d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01c08ead-7e", "ovs_interfaceid": "01c08ead-7eed-4e1a-839a-234fce1ba605", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:24:43 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-44fed59d-e890-4351-9882-6cd985dc45a4 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Converting VIF {"id": "01c08ead-7eed-4e1a-839a-234fce1ba605", "address": "fa:16:3e:6e:53:26", "network": {"id": "9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-696310557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.139", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0f7516d1db4dd5bc7d77a0bd1d44d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01c08ead-7e", "ovs_interfaceid": "01c08ead-7eed-4e1a-839a-234fce1ba605", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:24:43 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-44fed59d-e890-4351-9882-6cd985dc45a4 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:53:26,bridge_name='br-int',has_traffic_filtering=True,id=01c08ead-7eed-4e1a-839a-234fce1ba605,network=Network(9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01c08ead-7e') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:24:43 user nova-compute[75066]: DEBUG os_vif [None req-44fed59d-e890-4351-9882-6cd985dc45a4 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:53:26,bridge_name='br-int',has_traffic_filtering=True,id=01c08ead-7eed-4e1a-839a-234fce1ba605,network=Network(9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01c08ead-7e') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:24:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap01c08ead-7e, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:24:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:24:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b80767b5-6dea-4949-8760-f71ab4205b52) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:24:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:43 user nova-compute[75066]: INFO os_vif [None req-44fed59d-e890-4351-9882-6cd985dc45a4 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:53:26,bridge_name='br-int',has_traffic_filtering=True,id=01c08ead-7eed-4e1a-839a-234fce1ba605,network=Network(9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01c08ead-7e')
Dec 01 19:24:43 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-44fed59d-e890-4351-9882-6cd985dc45a4 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Deleting instance files /opt/stack/data/nova/instances/3d340166-c58b-4213-b8d3-5036ade48d2d_del
Dec 01 19:24:43 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-44fed59d-e890-4351-9882-6cd985dc45a4 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Deletion of /opt/stack/data/nova/instances/3d340166-c58b-4213-b8d3-5036ade48d2d_del complete
Dec 01 19:24:43 user nova-compute[75066]: INFO nova.compute.manager [None req-44fed59d-e890-4351-9882-6cd985dc45a4 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Took 0.88 seconds to destroy the instance on the hypervisor.
Dec 01 19:24:43 user nova-compute[75066]: DEBUG oslo.service.loopingcall [None req-44fed59d-e890-4351-9882-6cd985dc45a4 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75066) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 19:24:43 user nova-compute[75066]: DEBUG nova.compute.manager [-] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Deallocating network for instance {{(pid=75066) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 19:24:43 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] deallocate_for_instance() {{(pid=75066) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 19:24:44 user nova-compute[75066]: DEBUG nova.compute.manager [req-841ed0b5-d7ef-4d7d-a220-366c59afc099 req-c9726fb7-c6be-4a5d-aba9-cb1cab6018c1 service nova] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Received event network-vif-unplugged-01c08ead-7eed-4e1a-839a-234fce1ba605 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:24:44 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-841ed0b5-d7ef-4d7d-a220-366c59afc099 req-c9726fb7-c6be-4a5d-aba9-cb1cab6018c1 service nova] Acquiring lock "3d340166-c58b-4213-b8d3-5036ade48d2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:24:44 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-841ed0b5-d7ef-4d7d-a220-366c59afc099 req-c9726fb7-c6be-4a5d-aba9-cb1cab6018c1 service nova] Lock "3d340166-c58b-4213-b8d3-5036ade48d2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:24:44 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-841ed0b5-d7ef-4d7d-a220-366c59afc099 req-c9726fb7-c6be-4a5d-aba9-cb1cab6018c1 service nova] Lock "3d340166-c58b-4213-b8d3-5036ade48d2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:24:44 user nova-compute[75066]: DEBUG nova.compute.manager [req-841ed0b5-d7ef-4d7d-a220-366c59afc099 req-c9726fb7-c6be-4a5d-aba9-cb1cab6018c1 service nova] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] No waiting events found dispatching network-vif-unplugged-01c08ead-7eed-4e1a-839a-234fce1ba605 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:24:44 user nova-compute[75066]: DEBUG nova.compute.manager [req-841ed0b5-d7ef-4d7d-a220-366c59afc099 req-c9726fb7-c6be-4a5d-aba9-cb1cab6018c1 service nova] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Received event network-vif-unplugged-01c08ead-7eed-4e1a-839a-234fce1ba605 for instance with task_state deleting. {{(pid=75066) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 19:24:44 user nova-compute[75066]: DEBUG nova.compute.manager [req-841ed0b5-d7ef-4d7d-a220-366c59afc099 req-c9726fb7-c6be-4a5d-aba9-cb1cab6018c1 service nova] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Received event network-vif-plugged-01c08ead-7eed-4e1a-839a-234fce1ba605 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:24:44 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-841ed0b5-d7ef-4d7d-a220-366c59afc099 req-c9726fb7-c6be-4a5d-aba9-cb1cab6018c1 service nova] Acquiring lock "3d340166-c58b-4213-b8d3-5036ade48d2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:24:44 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-841ed0b5-d7ef-4d7d-a220-366c59afc099 req-c9726fb7-c6be-4a5d-aba9-cb1cab6018c1 service nova] Lock "3d340166-c58b-4213-b8d3-5036ade48d2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:24:44 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-841ed0b5-d7ef-4d7d-a220-366c59afc099 req-c9726fb7-c6be-4a5d-aba9-cb1cab6018c1 service nova] Lock "3d340166-c58b-4213-b8d3-5036ade48d2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:24:44 user nova-compute[75066]: DEBUG nova.compute.manager [req-841ed0b5-d7ef-4d7d-a220-366c59afc099 req-c9726fb7-c6be-4a5d-aba9-cb1cab6018c1 service nova] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] No waiting events found dispatching network-vif-plugged-01c08ead-7eed-4e1a-839a-234fce1ba605 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:24:44 user nova-compute[75066]: WARNING nova.compute.manager [req-841ed0b5-d7ef-4d7d-a220-366c59afc099 req-c9726fb7-c6be-4a5d-aba9-cb1cab6018c1 service nova] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Received unexpected event network-vif-plugged-01c08ead-7eed-4e1a-839a-234fce1ba605 for instance with vm_state active and task_state deleting.
Dec 01 19:24:44 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:24:44 user nova-compute[75066]: INFO nova.compute.manager [-] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Took 0.70 seconds to deallocate network for instance.
Dec 01 19:24:44 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-44fed59d-e890-4351-9882-6cd985dc45a4 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:24:44 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-44fed59d-e890-4351-9882-6cd985dc45a4 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:24:45 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-44fed59d-e890-4351-9882-6cd985dc45a4 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:24:45 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-44fed59d-e890-4351-9882-6cd985dc45a4 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:24:45 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-44fed59d-e890-4351-9882-6cd985dc45a4 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.378s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:24:45 user nova-compute[75066]: INFO nova.scheduler.client.report [None req-44fed59d-e890-4351-9882-6cd985dc45a4 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Deleted allocations for instance 3d340166-c58b-4213-b8d3-5036ade48d2d
Dec 01 19:24:45 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-44fed59d-e890-4351-9882-6cd985dc45a4 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "3d340166-c58b-4213-b8d3-5036ade48d2d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.171s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:24:45 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:46 user nova-compute[75066]: DEBUG nova.compute.manager [req-1988a725-d6a5-4e06-871c-93851193c75d req-65da5892-fdb2-47b9-9c2a-d3c8d767927c service nova] [instance: 3d340166-c58b-4213-b8d3-5036ade48d2d] Received event network-vif-deleted-01c08ead-7eed-4e1a-839a-234fce1ba605 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:24:47 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:47 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:48 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Acquiring lock "e84b8c28-e79e-4945-8f3c-dddd7184a166" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:24:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "e84b8c28-e79e-4945-8f3c-dddd7184a166" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:24:51 user nova-compute[75066]: DEBUG nova.compute.manager [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Starting instance... {{(pid=75066) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 19:24:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:24:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:24:51 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75066) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 19:24:51 user nova-compute[75066]: INFO nova.compute.claims [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Claim successful on node user
Dec 01 19:24:51 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:24:51 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:24:52 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.494s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:24:52 user nova-compute[75066]: DEBUG nova.compute.manager [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Start building networks asynchronously for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 19:24:52 user nova-compute[75066]: DEBUG nova.compute.manager [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Allocating IP information in the background. {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 19:24:52 user nova-compute[75066]: DEBUG nova.network.neutron [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] allocate_for_instance() {{(pid=75066) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 19:24:52 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 19:24:52 user nova-compute[75066]: DEBUG nova.compute.manager [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Start building block device mappings for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 19:24:52 user nova-compute[75066]: DEBUG nova.policy [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '90e207044c0741e99c4a83b2c4746cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879678dca7054c178839f56e66a6e0ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75066) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 19:24:52 user nova-compute[75066]: DEBUG nova.compute.manager [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Start spawning the instance on the hypervisor. {{(pid=75066) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 19:24:52 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Creating instance directory {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 19:24:52 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Creating image(s)
Dec 01 19:24:52 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Acquiring lock "/opt/stack/data/nova/instances/e84b8c28-e79e-4945-8f3c-dddd7184a166/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:24:52 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "/opt/stack/data/nova/instances/e84b8c28-e79e-4945-8f3c-dddd7184a166/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:24:52 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "/opt/stack/data/nova/instances/e84b8c28-e79e-4945-8f3c-dddd7184a166/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:24:52 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:52 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.204s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:52 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Acquiring lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:24:52 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:24:52 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:52 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.187s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:52 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/e84b8c28-e79e-4945-8f3c-dddd7184a166/disk 1073741824 {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:52 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/e84b8c28-e79e-4945-8f3c-dddd7184a166/disk 1073741824" returned: 0 in 0.049s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:52 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:24:52 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:52 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.175s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:52 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e84b8c28-e79e-4945-8f3c-dddd7184a166/disk. size=1073741824 {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 19:24:52 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84b8c28-e79e-4945-8f3c-dddd7184a166/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:24:53 user nova-compute[75066]: DEBUG nova.network.neutron [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Successfully created port: abe9d4d1-5a93-4071-bb76-8723bf6ec62c {{(pid=75066) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 19:24:53 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84b8c28-e79e-4945-8f3c-dddd7184a166/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:24:53 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Cannot resize image /opt/stack/data/nova/instances/e84b8c28-e79e-4945-8f3c-dddd7184a166/disk to a smaller size. {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 19:24:53 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Created local disks {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 19:24:53 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Ensure instance console log exists: /opt/stack/data/nova/instances/e84b8c28-e79e-4945-8f3c-dddd7184a166/console.log {{(pid=75066) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 19:24:53 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:24:53 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:24:53 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:24:53 user nova-compute[75066]: DEBUG nova.network.neutron [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Successfully updated port: abe9d4d1-5a93-4071-bb76-8723bf6ec62c {{(pid=75066) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 19:24:53 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Acquiring lock "refresh_cache-e84b8c28-e79e-4945-8f3c-dddd7184a166" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:24:53 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Acquired lock "refresh_cache-e84b8c28-e79e-4945-8f3c-dddd7184a166" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:24:53 user nova-compute[75066]: DEBUG nova.network.neutron [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:24:53 user nova-compute[75066]: DEBUG nova.compute.manager [req-a5822ef7-96e5-4c53-85a6-4fde6642c3ac req-1bc62f61-b1a1-47e9-bcd4-7a4974290714 service nova] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Received event network-changed-abe9d4d1-5a93-4071-bb76-8723bf6ec62c {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:24:53 user nova-compute[75066]: DEBUG nova.compute.manager [req-a5822ef7-96e5-4c53-85a6-4fde6642c3ac req-1bc62f61-b1a1-47e9-bcd4-7a4974290714 service nova] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Refreshing instance network info cache due to event network-changed-abe9d4d1-5a93-4071-bb76-8723bf6ec62c. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:24:53 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a5822ef7-96e5-4c53-85a6-4fde6642c3ac req-1bc62f61-b1a1-47e9-bcd4-7a4974290714 service nova] Acquiring lock "refresh_cache-e84b8c28-e79e-4945-8f3c-dddd7184a166" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:24:53 user nova-compute[75066]: DEBUG nova.network.neutron [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:24:53 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:54 user nova-compute[75066]: DEBUG nova.network.neutron [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Updating instance_info_cache with network_info: [{"id": "abe9d4d1-5a93-4071-bb76-8723bf6ec62c", "address": "fa:16:3e:8c:32:99", "network": {"id": "49dd72ae-ec07-46a6-8463-e38bdfe1eba0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-738739404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879678dca7054c178839f56e66a6e0ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabe9d4d1-5a", "ovs_interfaceid": "abe9d4d1-5a93-4071-bb76-8723bf6ec62c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:24:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Releasing lock "refresh_cache-e84b8c28-e79e-4945-8f3c-dddd7184a166" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:24:54 user nova-compute[75066]: DEBUG nova.compute.manager [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Instance network_info: |[{"id": "abe9d4d1-5a93-4071-bb76-8723bf6ec62c", "address": "fa:16:3e:8c:32:99", "network": {"id": "49dd72ae-ec07-46a6-8463-e38bdfe1eba0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-738739404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879678dca7054c178839f56e66a6e0ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabe9d4d1-5a", "ovs_interfaceid": "abe9d4d1-5a93-4071-bb76-8723bf6ec62c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 19:24:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a5822ef7-96e5-4c53-85a6-4fde6642c3ac req-1bc62f61-b1a1-47e9-bcd4-7a4974290714 service nova] Acquired lock "refresh_cache-e84b8c28-e79e-4945-8f3c-dddd7184a166" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:24:54 user nova-compute[75066]: DEBUG nova.network.neutron [req-a5822ef7-96e5-4c53-85a6-4fde6642c3ac req-1bc62f61-b1a1-47e9-bcd4-7a4974290714 service nova] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Refreshing network info cache for port abe9d4d1-5a93-4071-bb76-8723bf6ec62c {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:24:54 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Start _get_guest_xml network_info=[{"id": "abe9d4d1-5a93-4071-bb76-8723bf6ec62c", "address": "fa:16:3e:8c:32:99", "network": {"id": "49dd72ae-ec07-46a6-8463-e38bdfe1eba0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-738739404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879678dca7054c178839f56e66a6e0ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabe9d4d1-5a", "ovs_interfaceid": "abe9d4d1-5a93-4071-bb76-8723bf6ec62c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'image_id': '900b237b-e99c-4fdd-a44f-dcb7a08baa86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:24:54 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:24:54 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:24:54 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:24:54 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:24:54 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:24:54 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:24:54 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:24:54 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:24:54 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:24:54 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:24:54 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:24:54 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:24:54 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:24:54 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:24:54 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:24:54 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:24:54 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:24:54 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:24:54 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:24:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-496690915',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-496690915',id=24,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFm2fFTSILfeIc9T3aY6YY8ccEuM6T+EqbJVd9fDG+xmK7EqkqBSUEppgYTvwk5yuAt9kwnhrxfnKArtNsaxvKGjkXi1W9s0Vf9iTjlWyxyXjkzBg/S3rJKLyO34An9Qw==',key_name='tempest-keypair-20573267',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='879678dca7054c178839f56e66a6e0ce',ramdisk_id='',reservation_id='r-frzqz3qo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1680443764',owner_user_name='tempest-AttachVolumeShelveTestJSON-1680443764-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:24:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90e207044c0741e99c4a83b2c4746cd3',uuid=e84b8c28-e79e-4945-8f3c-dddd7184a166,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "abe9d4d1-5a93-4071-bb76-8723bf6ec62c", "address": "fa:16:3e:8c:32:99", "network": {"id": "49dd72ae-ec07-46a6-8463-e38bdfe1eba0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-738739404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879678dca7054c178839f56e66a6e0ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabe9d4d1-5a", "ovs_interfaceid": "abe9d4d1-5a93-4071-bb76-8723bf6ec62c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:24:54 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Converting VIF {"id": "abe9d4d1-5a93-4071-bb76-8723bf6ec62c", "address": "fa:16:3e:8c:32:99", "network": {"id": "49dd72ae-ec07-46a6-8463-e38bdfe1eba0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-738739404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879678dca7054c178839f56e66a6e0ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabe9d4d1-5a", "ovs_interfaceid": "abe9d4d1-5a93-4071-bb76-8723bf6ec62c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:24:54 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:32:99,bridge_name='br-int',has_traffic_filtering=True,id=abe9d4d1-5a93-4071-bb76-8723bf6ec62c,network=Network(49dd72ae-ec07-46a6-8463-e38bdfe1eba0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabe9d4d1-5a') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:24:54 user nova-compute[75066]: DEBUG nova.objects.instance [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lazy-loading 'pci_devices' on Instance uuid e84b8c28-e79e-4945-8f3c-dddd7184a166 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:24:54 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:24:54 user nova-compute[75066]:   <uuid>e84b8c28-e79e-4945-8f3c-dddd7184a166</uuid>
Dec 01 19:24:54 user nova-compute[75066]:   <name>instance-00000018</name>
Dec 01 19:24:54 user nova-compute[75066]:   <memory>524288</memory>
Dec 01 19:24:54 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:24:54 user nova-compute[75066]:   <metadata>
Dec 01 19:24:54 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:24:54 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:24:54 user nova-compute[75066]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-496690915</nova:name>
Dec 01 19:24:54 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:24:54</nova:creationTime>
Dec 01 19:24:54 user nova-compute[75066]:       <nova:flavor name="m1.tiny">
Dec 01 19:24:54 user nova-compute[75066]:         <nova:memory>512</nova:memory>
Dec 01 19:24:54 user nova-compute[75066]:         <nova:disk>1</nova:disk>
Dec 01 19:24:54 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:24:54 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:24:54 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:24:54 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:24:54 user nova-compute[75066]:       <nova:owner>
Dec 01 19:24:54 user nova-compute[75066]:         <nova:user uuid="90e207044c0741e99c4a83b2c4746cd3">tempest-AttachVolumeShelveTestJSON-1680443764-project-member</nova:user>
Dec 01 19:24:54 user nova-compute[75066]:         <nova:project uuid="879678dca7054c178839f56e66a6e0ce">tempest-AttachVolumeShelveTestJSON-1680443764</nova:project>
Dec 01 19:24:54 user nova-compute[75066]:       </nova:owner>
Dec 01 19:24:54 user nova-compute[75066]:       <nova:root type="image" uuid="900b237b-e99c-4fdd-a44f-dcb7a08baa86"/>
Dec 01 19:24:54 user nova-compute[75066]:       <nova:ports>
Dec 01 19:24:54 user nova-compute[75066]:         <nova:port uuid="abe9d4d1-5a93-4071-bb76-8723bf6ec62c">
Dec 01 19:24:54 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Dec 01 19:24:54 user nova-compute[75066]:         </nova:port>
Dec 01 19:24:54 user nova-compute[75066]:       </nova:ports>
Dec 01 19:24:54 user nova-compute[75066]:     </nova:instance>
Dec 01 19:24:54 user nova-compute[75066]:   </metadata>
Dec 01 19:24:54 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:24:54 user nova-compute[75066]:     <system>
Dec 01 19:24:54 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:24:54 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:24:54 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:24:54 user nova-compute[75066]:       <entry name="serial">e84b8c28-e79e-4945-8f3c-dddd7184a166</entry>
Dec 01 19:24:54 user nova-compute[75066]:       <entry name="uuid">e84b8c28-e79e-4945-8f3c-dddd7184a166</entry>
Dec 01 19:24:54 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:24:54 user nova-compute[75066]:     </system>
Dec 01 19:24:54 user nova-compute[75066]:   </sysinfo>
Dec 01 19:24:54 user nova-compute[75066]:   <os>
Dec 01 19:24:54 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:24:54 user nova-compute[75066]:     <boot dev="hd"/>
Dec 01 19:24:54 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:24:54 user nova-compute[75066]:   </os>
Dec 01 19:24:54 user nova-compute[75066]:   <features>
Dec 01 19:24:54 user nova-compute[75066]:     <acpi/>
Dec 01 19:24:54 user nova-compute[75066]:     <apic/>
Dec 01 19:24:54 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:24:54 user nova-compute[75066]:   </features>
Dec 01 19:24:54 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:24:54 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:24:54 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:24:54 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:24:54 user nova-compute[75066]:   </clock>
Dec 01 19:24:54 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:24:54 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:24:54 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:24:54 user nova-compute[75066]:   </cpu>
Dec 01 19:24:54 user nova-compute[75066]:   <devices>
Dec 01 19:24:54 user nova-compute[75066]:     <disk type="file" device="disk">
Dec 01 19:24:54 user nova-compute[75066]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 19:24:54 user nova-compute[75066]:       <source file="/opt/stack/data/nova/instances/e84b8c28-e79e-4945-8f3c-dddd7184a166/disk"/>
Dec 01 19:24:54 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:24:54 user nova-compute[75066]:     </disk>
Dec 01 19:24:54 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:24:54 user nova-compute[75066]:       <mac address="fa:16:3e:8c:32:99"/>
Dec 01 19:24:54 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:24:54 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:24:54 user nova-compute[75066]:       <target dev="tapabe9d4d1-5a"/>
Dec 01 19:24:54 user nova-compute[75066]:     </interface>
Dec 01 19:24:54 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:24:54 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/e84b8c28-e79e-4945-8f3c-dddd7184a166/console.log" append="off"/>
Dec 01 19:24:54 user nova-compute[75066]:     </serial>
Dec 01 19:24:54 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:24:54 user nova-compute[75066]:     <video>
Dec 01 19:24:54 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:24:54 user nova-compute[75066]:     </video>
Dec 01 19:24:54 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:24:54 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:24:54 user nova-compute[75066]:     </rng>
Dec 01 19:24:54 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:24:54 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:24:54 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:24:54 user nova-compute[75066]:     </memballoon>
Dec 01 19:24:54 user nova-compute[75066]:   </devices>
Dec 01 19:24:54 user nova-compute[75066]: </domain>
Dec 01 19:24:54 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:24:54 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:24:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-496690915',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-496690915',id=24,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFm2fFTSILfeIc9T3aY6YY8ccEuM6T+EqbJVd9fDG+xmK7EqkqBSUEppgYTvwk5yuAt9kwnhrxfnKArtNsaxvKGjkXi1W9s0Vf9iTjlWyxyXjkzBg/S3rJKLyO34An9Qw==',key_name='tempest-keypair-20573267',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='879678dca7054c178839f56e66a6e0ce',ramdisk_id='',reservation_id='r-frzqz3qo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1680443764',owner_user_name='tempest-AttachVolumeShelveTestJSON-1680443764-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:24:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90e207044c0741e99c4a83b2c4746cd3',uuid=e84b8c28-e79e-4945-8f3c-dddd7184a166,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "abe9d4d1-5a93-4071-bb76-8723bf6ec62c", "address": "fa:16:3e:8c:32:99", "network": {"id": "49dd72ae-ec07-46a6-8463-e38bdfe1eba0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-738739404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879678dca7054c178839f56e66a6e0ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabe9d4d1-5a", "ovs_interfaceid": "abe9d4d1-5a93-4071-bb76-8723bf6ec62c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:24:54 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Converting VIF {"id": "abe9d4d1-5a93-4071-bb76-8723bf6ec62c", "address": "fa:16:3e:8c:32:99", "network": {"id": "49dd72ae-ec07-46a6-8463-e38bdfe1eba0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-738739404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879678dca7054c178839f56e66a6e0ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabe9d4d1-5a", "ovs_interfaceid": "abe9d4d1-5a93-4071-bb76-8723bf6ec62c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:24:54 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:32:99,bridge_name='br-int',has_traffic_filtering=True,id=abe9d4d1-5a93-4071-bb76-8723bf6ec62c,network=Network(49dd72ae-ec07-46a6-8463-e38bdfe1eba0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabe9d4d1-5a') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:24:54 user nova-compute[75066]: DEBUG os_vif [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:32:99,bridge_name='br-int',has_traffic_filtering=True,id=abe9d4d1-5a93-4071-bb76-8723bf6ec62c,network=Network(49dd72ae-ec07-46a6-8463-e38bdfe1eba0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabe9d4d1-5a') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:24:54 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:54 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:24:54 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:24:54 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:54 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1ea35bf2-775c-5405-9a90-742f82448b48', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:24:54 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:54 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:24:54 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:54 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapabe9d4d1-5a, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:24:54 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapabe9d4d1-5a, col_values=(('qos', UUID('006d0032-36a7-484c-92cb-524e38dbe98c')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:24:54 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapabe9d4d1-5a, col_values=(('external_ids', {'iface-id': 'abe9d4d1-5a93-4071-bb76-8723bf6ec62c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:32:99', 'vm-uuid': 'e84b8c28-e79e-4945-8f3c-dddd7184a166'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:24:54 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:54 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:24:54 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:54 user nova-compute[75066]: INFO os_vif [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:32:99,bridge_name='br-int',has_traffic_filtering=True,id=abe9d4d1-5a93-4071-bb76-8723bf6ec62c,network=Network(49dd72ae-ec07-46a6-8463-e38bdfe1eba0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabe9d4d1-5a')
Dec 01 19:24:54 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:24:54 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] No VIF found with MAC fa:16:3e:8c:32:99, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:24:55 user nova-compute[75066]: DEBUG nova.network.neutron [req-a5822ef7-96e5-4c53-85a6-4fde6642c3ac req-1bc62f61-b1a1-47e9-bcd4-7a4974290714 service nova] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Updated VIF entry in instance network info cache for port abe9d4d1-5a93-4071-bb76-8723bf6ec62c. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:24:55 user nova-compute[75066]: DEBUG nova.network.neutron [req-a5822ef7-96e5-4c53-85a6-4fde6642c3ac req-1bc62f61-b1a1-47e9-bcd4-7a4974290714 service nova] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Updating instance_info_cache with network_info: [{"id": "abe9d4d1-5a93-4071-bb76-8723bf6ec62c", "address": "fa:16:3e:8c:32:99", "network": {"id": "49dd72ae-ec07-46a6-8463-e38bdfe1eba0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-738739404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879678dca7054c178839f56e66a6e0ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabe9d4d1-5a", "ovs_interfaceid": "abe9d4d1-5a93-4071-bb76-8723bf6ec62c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:24:55 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a5822ef7-96e5-4c53-85a6-4fde6642c3ac req-1bc62f61-b1a1-47e9-bcd4-7a4974290714 service nova] Releasing lock "refresh_cache-e84b8c28-e79e-4945-8f3c-dddd7184a166" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:24:55 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:55 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:55 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:55 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:56 user nova-compute[75066]: DEBUG nova.compute.manager [req-1c1d1aba-c14e-4ebd-9631-4212b2a961b4 req-7a99c169-073c-4b87-80b5-6847ae58637c service nova] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Received event network-vif-plugged-abe9d4d1-5a93-4071-bb76-8723bf6ec62c {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:24:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-1c1d1aba-c14e-4ebd-9631-4212b2a961b4 req-7a99c169-073c-4b87-80b5-6847ae58637c service nova] Acquiring lock "e84b8c28-e79e-4945-8f3c-dddd7184a166-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:24:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-1c1d1aba-c14e-4ebd-9631-4212b2a961b4 req-7a99c169-073c-4b87-80b5-6847ae58637c service nova] Lock "e84b8c28-e79e-4945-8f3c-dddd7184a166-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:24:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-1c1d1aba-c14e-4ebd-9631-4212b2a961b4 req-7a99c169-073c-4b87-80b5-6847ae58637c service nova] Lock "e84b8c28-e79e-4945-8f3c-dddd7184a166-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:24:56 user nova-compute[75066]: DEBUG nova.compute.manager [req-1c1d1aba-c14e-4ebd-9631-4212b2a961b4 req-7a99c169-073c-4b87-80b5-6847ae58637c service nova] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] No waiting events found dispatching network-vif-plugged-abe9d4d1-5a93-4071-bb76-8723bf6ec62c {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:24:56 user nova-compute[75066]: WARNING nova.compute.manager [req-1c1d1aba-c14e-4ebd-9631-4212b2a961b4 req-7a99c169-073c-4b87-80b5-6847ae58637c service nova] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Received unexpected event network-vif-plugged-abe9d4d1-5a93-4071-bb76-8723bf6ec62c for instance with vm_state building and task_state spawning.
Dec 01 19:24:56 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:56 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:56 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:57 user nova-compute[75066]: DEBUG nova.compute.manager [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Instance event wait completed in 0 seconds for  {{(pid=75066) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 19:24:57 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Guest created on hypervisor {{(pid=75066) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 19:24:57 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Instance spawned successfully.
Dec 01 19:24:57 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 19:24:57 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Found default for hw_cdrom_bus of ide {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:24:57 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Found default for hw_disk_bus of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:24:57 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Found default for hw_input_bus of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:24:57 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Found default for hw_pointer_model of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:24:57 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Found default for hw_video_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:24:57 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Found default for hw_vif_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:24:58 user nova-compute[75066]: INFO nova.compute.manager [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Took 5.78 seconds to spawn the instance on the hypervisor.
Dec 01 19:24:58 user nova-compute[75066]: DEBUG nova.compute.manager [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:24:58 user nova-compute[75066]: INFO nova.compute.manager [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Took 6.65 seconds to build instance.
Dec 01 19:24:58 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b649527e-f685-4498-a6c5-30cfb73f2c72 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "e84b8c28-e79e-4945-8f3c-dddd7184a166" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.782s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:24:58 user nova-compute[75066]: DEBUG nova.compute.manager [req-735db3a5-a9b4-4adf-9ebb-aa0297be95e7 req-696cb319-6fec-4b5f-81ab-20b985d60298 service nova] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Received event network-vif-plugged-abe9d4d1-5a93-4071-bb76-8723bf6ec62c {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:24:58 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-735db3a5-a9b4-4adf-9ebb-aa0297be95e7 req-696cb319-6fec-4b5f-81ab-20b985d60298 service nova] Acquiring lock "e84b8c28-e79e-4945-8f3c-dddd7184a166-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:24:58 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-735db3a5-a9b4-4adf-9ebb-aa0297be95e7 req-696cb319-6fec-4b5f-81ab-20b985d60298 service nova] Lock "e84b8c28-e79e-4945-8f3c-dddd7184a166-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:24:58 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-735db3a5-a9b4-4adf-9ebb-aa0297be95e7 req-696cb319-6fec-4b5f-81ab-20b985d60298 service nova] Lock "e84b8c28-e79e-4945-8f3c-dddd7184a166-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:24:58 user nova-compute[75066]: DEBUG nova.compute.manager [req-735db3a5-a9b4-4adf-9ebb-aa0297be95e7 req-696cb319-6fec-4b5f-81ab-20b985d60298 service nova] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] No waiting events found dispatching network-vif-plugged-abe9d4d1-5a93-4071-bb76-8723bf6ec62c {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:24:58 user nova-compute[75066]: WARNING nova.compute.manager [req-735db3a5-a9b4-4adf-9ebb-aa0297be95e7 req-696cb319-6fec-4b5f-81ab-20b985d60298 service nova] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Received unexpected event network-vif-plugged-abe9d4d1-5a93-4071-bb76-8723bf6ec62c for instance with vm_state active and task_state None.
Dec 01 19:24:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:24:59 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:00 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:25:02 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:25:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:04 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:04 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:04 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:25:05 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:25:05 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:25:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:25:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:25:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:25:05 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75066) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 19:25:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a553e030-0d69-4725-9f84-6c0c63556ed4/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a553e030-0d69-4725-9f84-6c0c63556ed4/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:25:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a553e030-0d69-4725-9f84-6c0c63556ed4/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a553e030-0d69-4725-9f84-6c0c63556ed4/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:25:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:25:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:06 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:25:06 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:25:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436/disk.rescue --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:25:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436/disk.rescue --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:25:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecc194b4-b8b9-49c8-9d34-4213c4dc15b8/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecc194b4-b8b9-49c8-9d34-4213c4dc15b8/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:25:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecc194b4-b8b9-49c8-9d34-4213c4dc15b8/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecc194b4-b8b9-49c8-9d34-4213c4dc15b8/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:25:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:25:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:07 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Acquiring lock "e32ba192-38b9-46f0-b164-1652a43cf3d2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:25:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lock "e32ba192-38b9-46f0-b164-1652a43cf3d2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:25:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:25:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23e17727-40b4-48f7-9155-abc8ffa9f619/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:07 user nova-compute[75066]: DEBUG nova.compute.manager [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Starting instance... {{(pid=75066) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 19:25:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:25:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:25:07 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75066) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 19:25:07 user nova-compute[75066]: INFO nova.compute.claims [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Claim successful on node user
Dec 01 19:25:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23e17727-40b4-48f7-9155-abc8ffa9f619/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:25:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23e17727-40b4-48f7-9155-abc8ffa9f619/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23e17727-40b4-48f7-9155-abc8ffa9f619/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:25:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:25:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:08 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:25:08 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:25:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:25:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk.rescue --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:08 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.699s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:25:08 user nova-compute[75066]: DEBUG nova.compute.manager [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Start building networks asynchronously for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 19:25:08 user nova-compute[75066]: DEBUG nova.compute.manager [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Allocating IP information in the background. {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 19:25:08 user nova-compute[75066]: DEBUG nova.network.neutron [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] allocate_for_instance() {{(pid=75066) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 19:25:08 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 19:25:08 user nova-compute[75066]: DEBUG nova.compute.manager [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Start building block device mappings for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 19:25:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:25:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk.rescue --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:08 user nova-compute[75066]: DEBUG nova.compute.manager [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Start spawning the instance on the hypervisor. {{(pid=75066) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 19:25:08 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Creating instance directory {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 19:25:08 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Creating image(s)
Dec 01 19:25:08 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Acquiring lock "/opt/stack/data/nova/instances/e32ba192-38b9-46f0-b164-1652a43cf3d2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:25:08 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lock "/opt/stack/data/nova/instances/e32ba192-38b9-46f0-b164-1652a43cf3d2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:25:08 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lock "/opt/stack/data/nova/instances/e32ba192-38b9-46f0-b164-1652a43cf3d2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:25:08 user nova-compute[75066]: DEBUG nova.policy [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a0be767f43744d73a35ed6b7a45c8b95', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fb5b77e2da142499315e0a96f86d959', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75066) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 19:25:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:25:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.234s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:25:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Acquiring lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:25:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:25:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:25:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:09 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.186s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:25:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/e32ba192-38b9-46f0-b164-1652a43cf3d2/disk 1073741824 {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:25:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/e32ba192-38b9-46f0-b164-1652a43cf3d2/disk 1073741824" returned: 0 in 0.055s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:25:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:25:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk.rescue --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:09 user nova-compute[75066]: DEBUG nova.network.neutron [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Successfully created port: bc61a5e3-0188-4f8e-8d3e-29954e60ea4c {{(pid=75066) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 19:25:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.209s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:25:09 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e32ba192-38b9-46f0-b164-1652a43cf3d2/disk. size=1073741824 {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 19:25:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e32ba192-38b9-46f0-b164-1652a43cf3d2/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:25:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk.rescue --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e32ba192-38b9-46f0-b164-1652a43cf3d2/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:25:09 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Cannot resize image /opt/stack/data/nova/instances/e32ba192-38b9-46f0-b164-1652a43cf3d2/disk to a smaller size. {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 19:25:09 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Created local disks {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 19:25:09 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Ensure instance console log exists: /opt/stack/data/nova/instances/e32ba192-38b9-46f0-b164-1652a43cf3d2/console.log {{(pid=75066) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 19:25:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:25:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:25:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:25:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:25:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:25:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:25:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d86a5a-c62e-41f7-9f33-1a0c61af6a49/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:10 user nova-compute[75066]: DEBUG nova.network.neutron [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Successfully updated port: bc61a5e3-0188-4f8e-8d3e-29954e60ea4c {{(pid=75066) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 19:25:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Acquiring lock "refresh_cache-e32ba192-38b9-46f0-b164-1652a43cf3d2" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:25:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Acquired lock "refresh_cache-e32ba192-38b9-46f0-b164-1652a43cf3d2" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:25:10 user nova-compute[75066]: DEBUG nova.network.neutron [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:25:10 user nova-compute[75066]: DEBUG nova.compute.manager [req-8ab546a5-7e3c-438c-88b2-87e58533592e req-09f7520e-d8aa-45c1-ae3d-bd8131e7f1a6 service nova] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Received event network-changed-bc61a5e3-0188-4f8e-8d3e-29954e60ea4c {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:25:10 user nova-compute[75066]: DEBUG nova.compute.manager [req-8ab546a5-7e3c-438c-88b2-87e58533592e req-09f7520e-d8aa-45c1-ae3d-bd8131e7f1a6 service nova] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Refreshing instance network info cache due to event network-changed-bc61a5e3-0188-4f8e-8d3e-29954e60ea4c. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:25:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-8ab546a5-7e3c-438c-88b2-87e58533592e req-09f7520e-d8aa-45c1-ae3d-bd8131e7f1a6 service nova] Acquiring lock "refresh_cache-e32ba192-38b9-46f0-b164-1652a43cf3d2" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:25:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-01eeb87e-9f18-49a6-b774-997e0d2d84e8 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Acquiring lock "c3ceeca4-c16c-4cf5-adfd-7d5a2925f435" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:25:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-01eeb87e-9f18-49a6-b774-997e0d2d84e8 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "c3ceeca4-c16c-4cf5-adfd-7d5a2925f435" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:25:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-01eeb87e-9f18-49a6-b774-997e0d2d84e8 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Acquiring lock "c3ceeca4-c16c-4cf5-adfd-7d5a2925f435-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:25:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-01eeb87e-9f18-49a6-b774-997e0d2d84e8 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "c3ceeca4-c16c-4cf5-adfd-7d5a2925f435-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:25:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-01eeb87e-9f18-49a6-b774-997e0d2d84e8 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "c3ceeca4-c16c-4cf5-adfd-7d5a2925f435-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:25:10 user nova-compute[75066]: INFO nova.compute.manager [None req-01eeb87e-9f18-49a6-b774-997e0d2d84e8 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Terminating instance
Dec 01 19:25:10 user nova-compute[75066]: DEBUG nova.compute.manager [None req-01eeb87e-9f18-49a6-b774-997e0d2d84e8 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Start destroying the instance on the hypervisor. {{(pid=75066) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 19:25:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d86a5a-c62e-41f7-9f33-1a0c61af6a49/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:25:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d86a5a-c62e-41f7-9f33-1a0c61af6a49/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7d86a5a-c62e-41f7-9f33-1a0c61af6a49/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:25:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84b8c28-e79e-4945-8f3c-dddd7184a166/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:10 user nova-compute[75066]: DEBUG nova.network.neutron [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:25:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84b8c28-e79e-4945-8f3c-dddd7184a166/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:25:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84b8c28-e79e-4945-8f3c-dddd7184a166/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84b8c28-e79e-4945-8f3c-dddd7184a166/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:25:11 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Instance destroyed successfully.
Dec 01 19:25:11 user nova-compute[75066]: DEBUG nova.objects.instance [None req-01eeb87e-9f18-49a6-b774-997e0d2d84e8 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lazy-loading 'resources' on Instance uuid c3ceeca4-c16c-4cf5-adfd-7d5a2925f435 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-01eeb87e-9f18-49a6-b774-997e0d2d84e8 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:15:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-24114443',display_name='tempest-AttachVolumeTestJSON-server-24114443',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-24114443',id=4,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGLScdrbjNBUKzk1xw2/kR+RAsIU9zFWMcYM+4wt8kIDoD28bEQj/IZzhB52jLd7ItVSKAdt9hCSnaKdaqoB8QmfEIsszcxk4SoK4okQhg235yQ27ClCZrLdhVk+g2LNPw==',key_name='tempest-keypair-1548189004',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:15:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='492e0b2da61e4e4f9ea991df15531e24',ramdisk_id='',reservation_id='r-f8zkyh7r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1914192398',owner_user_name='tempest-AttachVolumeTestJSON-1914192398-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:23:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e047112719c414d900ccb2adccf963a',uuid=c3ceeca4-c16c-4cf5-adfd-7d5a2925f435,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c9353199-d4a3-488f-857d-b0ebdb31a68f", "address": "fa:16:3e:d4:7c:91", "network": {"id": "4a6c6c26-4d29-486c-b11e-fc53769083ea", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1139388453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "492e0b2da61e4e4f9ea991df15531e24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9353199-d4", "ovs_interfaceid": "c9353199-d4a3-488f-857d-b0ebdb31a68f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-01eeb87e-9f18-49a6-b774-997e0d2d84e8 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Converting VIF {"id": "c9353199-d4a3-488f-857d-b0ebdb31a68f", "address": "fa:16:3e:d4:7c:91", "network": {"id": "4a6c6c26-4d29-486c-b11e-fc53769083ea", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1139388453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "492e0b2da61e4e4f9ea991df15531e24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9353199-d4", "ovs_interfaceid": "c9353199-d4a3-488f-857d-b0ebdb31a68f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-01eeb87e-9f18-49a6-b774-997e0d2d84e8 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d4:7c:91,bridge_name='br-int',has_traffic_filtering=True,id=c9353199-d4a3-488f-857d-b0ebdb31a68f,network=Network(4a6c6c26-4d29-486c-b11e-fc53769083ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9353199-d4') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG os_vif [None req-01eeb87e-9f18-49a6-b774-997e0d2d84e8 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:7c:91,bridge_name='br-int',has_traffic_filtering=True,id=c9353199-d4a3-488f-857d-b0ebdb31a68f,network=Network(4a6c6c26-4d29-486c-b11e-fc53769083ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9353199-d4') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc9353199-d4, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1707aec9-e665-4473-bc71-c65fb9f00063) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:25:11 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:25:11 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:25:11 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Hypervisor/Node resource view: name=user free_ram=7322MB free_disk=24.840476989746094GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75066) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:25:11 user nova-compute[75066]: INFO os_vif [None req-01eeb87e-9f18-49a6-b774-997e0d2d84e8 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:7c:91,bridge_name='br-int',has_traffic_filtering=True,id=c9353199-d4a3-488f-857d-b0ebdb31a68f,network=Network(4a6c6c26-4d29-486c-b11e-fc53769083ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9353199-d4')
Dec 01 19:25:11 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-01eeb87e-9f18-49a6-b774-997e0d2d84e8 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Deleting instance files /opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435_del
Dec 01 19:25:11 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-01eeb87e-9f18-49a6-b774-997e0d2d84e8 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Deletion of /opt/stack/data/nova/instances/c3ceeca4-c16c-4cf5-adfd-7d5a2925f435_del complete
Dec 01 19:25:11 user nova-compute[75066]: DEBUG nova.network.neutron [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Updating instance_info_cache with network_info: [{"id": "bc61a5e3-0188-4f8e-8d3e-29954e60ea4c", "address": "fa:16:3e:27:e2:3b", "network": {"id": "195edf10-5722-4eef-b117-7a450e973afa", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2017280124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fb5b77e2da142499315e0a96f86d959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc61a5e3-01", "ovs_interfaceid": "bc61a5e3-0188-4f8e-8d3e-29954e60ea4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Releasing lock "refresh_cache-e32ba192-38b9-46f0-b164-1652a43cf3d2" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG nova.compute.manager [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Instance network_info: |[{"id": "bc61a5e3-0188-4f8e-8d3e-29954e60ea4c", "address": "fa:16:3e:27:e2:3b", "network": {"id": "195edf10-5722-4eef-b117-7a450e973afa", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2017280124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fb5b77e2da142499315e0a96f86d959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc61a5e3-01", "ovs_interfaceid": "bc61a5e3-0188-4f8e-8d3e-29954e60ea4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-8ab546a5-7e3c-438c-88b2-87e58533592e req-09f7520e-d8aa-45c1-ae3d-bd8131e7f1a6 service nova] Acquired lock "refresh_cache-e32ba192-38b9-46f0-b164-1652a43cf3d2" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG nova.network.neutron [req-8ab546a5-7e3c-438c-88b2-87e58533592e req-09f7520e-d8aa-45c1-ae3d-bd8131e7f1a6 service nova] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Refreshing network info cache for port bc61a5e3-0188-4f8e-8d3e-29954e60ea4c {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Start _get_guest_xml network_info=[{"id": "bc61a5e3-0188-4f8e-8d3e-29954e60ea4c", "address": "fa:16:3e:27:e2:3b", "network": {"id": "195edf10-5722-4eef-b117-7a450e973afa", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2017280124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fb5b77e2da142499315e0a96f86d959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc61a5e3-01", "ovs_interfaceid": "bc61a5e3-0188-4f8e-8d3e-29954e60ea4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'image_id': '900b237b-e99c-4fdd-a44f-dcb7a08baa86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:25:11 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:25:11 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:25:11 user nova-compute[75066]: INFO nova.compute.manager [None req-01eeb87e-9f18-49a6-b774-997e0d2d84e8 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Took 1.23 seconds to destroy the instance on the hypervisor.
Dec 01 19:25:11 user nova-compute[75066]: DEBUG oslo.service.loopingcall [None req-01eeb87e-9f18-49a6-b774-997e0d2d84e8 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75066) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG nova.compute.manager [-] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Deallocating network for instance {{(pid=75066) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] deallocate_for_instance() {{(pid=75066) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:25:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-456080780',display_name='tempest-VolumesSnapshotTestJSON-instance-456080780',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-456080780',id=25,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4EC0MO4UJsa5au5uhrtmvhSY+F58Kn228qfpqumBg4aaDl1mgE0V6yWTbB37jyyif6C7rIAAZGRtzZ5RdzEmhW2nNFxWtuCt5QkVwAdQBuHd6OXMX2oOypGsj7/biznw==',key_name='tempest-keypair-201555204',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6fb5b77e2da142499315e0a96f86d959',ramdisk_id='',reservation_id='r-gpo4b460',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1069530394',owner_user_name='tempest-VolumesSnapshotTestJSON-1069530394-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:25:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0be767f43744d73a35ed6b7a45c8b95',uuid=e32ba192-38b9-46f0-b164-1652a43cf3d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc61a5e3-0188-4f8e-8d3e-29954e60ea4c", "address": "fa:16:3e:27:e2:3b", "network": {"id": "195edf10-5722-4eef-b117-7a450e973afa", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2017280124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fb5b77e2da142499315e0a96f86d959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc61a5e3-01", "ovs_interfaceid": "bc61a5e3-0188-4f8e-8d3e-29954e60ea4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Converting VIF {"id": "bc61a5e3-0188-4f8e-8d3e-29954e60ea4c", "address": "fa:16:3e:27:e2:3b", "network": {"id": "195edf10-5722-4eef-b117-7a450e973afa", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2017280124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fb5b77e2da142499315e0a96f86d959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc61a5e3-01", "ovs_interfaceid": "bc61a5e3-0188-4f8e-8d3e-29954e60ea4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:e2:3b,bridge_name='br-int',has_traffic_filtering=True,id=bc61a5e3-0188-4f8e-8d3e-29954e60ea4c,network=Network(195edf10-5722-4eef-b117-7a450e973afa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc61a5e3-01') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG nova.objects.instance [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lazy-loading 'pci_devices' on Instance uuid e32ba192-38b9-46f0-b164-1652a43cf3d2 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:25:11 user nova-compute[75066]:   <uuid>e32ba192-38b9-46f0-b164-1652a43cf3d2</uuid>
Dec 01 19:25:11 user nova-compute[75066]:   <name>instance-00000019</name>
Dec 01 19:25:11 user nova-compute[75066]:   <memory>524288</memory>
Dec 01 19:25:11 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:25:11 user nova-compute[75066]:   <metadata>
Dec 01 19:25:11 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:25:11 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:25:11 user nova-compute[75066]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-456080780</nova:name>
Dec 01 19:25:11 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:25:11</nova:creationTime>
Dec 01 19:25:11 user nova-compute[75066]:       <nova:flavor name="m1.tiny">
Dec 01 19:25:11 user nova-compute[75066]:         <nova:memory>512</nova:memory>
Dec 01 19:25:11 user nova-compute[75066]:         <nova:disk>1</nova:disk>
Dec 01 19:25:11 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:25:11 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:25:11 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:25:11 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:25:11 user nova-compute[75066]:       <nova:owner>
Dec 01 19:25:11 user nova-compute[75066]:         <nova:user uuid="a0be767f43744d73a35ed6b7a45c8b95">tempest-VolumesSnapshotTestJSON-1069530394-project-member</nova:user>
Dec 01 19:25:11 user nova-compute[75066]:         <nova:project uuid="6fb5b77e2da142499315e0a96f86d959">tempest-VolumesSnapshotTestJSON-1069530394</nova:project>
Dec 01 19:25:11 user nova-compute[75066]:       </nova:owner>
Dec 01 19:25:11 user nova-compute[75066]:       <nova:root type="image" uuid="900b237b-e99c-4fdd-a44f-dcb7a08baa86"/>
Dec 01 19:25:11 user nova-compute[75066]:       <nova:ports>
Dec 01 19:25:11 user nova-compute[75066]:         <nova:port uuid="bc61a5e3-0188-4f8e-8d3e-29954e60ea4c">
Dec 01 19:25:11 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Dec 01 19:25:11 user nova-compute[75066]:         </nova:port>
Dec 01 19:25:11 user nova-compute[75066]:       </nova:ports>
Dec 01 19:25:11 user nova-compute[75066]:     </nova:instance>
Dec 01 19:25:11 user nova-compute[75066]:   </metadata>
Dec 01 19:25:11 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:25:11 user nova-compute[75066]:     <system>
Dec 01 19:25:11 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:25:11 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:25:11 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:25:11 user nova-compute[75066]:       <entry name="serial">e32ba192-38b9-46f0-b164-1652a43cf3d2</entry>
Dec 01 19:25:11 user nova-compute[75066]:       <entry name="uuid">e32ba192-38b9-46f0-b164-1652a43cf3d2</entry>
Dec 01 19:25:11 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:25:11 user nova-compute[75066]:     </system>
Dec 01 19:25:11 user nova-compute[75066]:   </sysinfo>
Dec 01 19:25:11 user nova-compute[75066]:   <os>
Dec 01 19:25:11 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:25:11 user nova-compute[75066]:     <boot dev="hd"/>
Dec 01 19:25:11 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:25:11 user nova-compute[75066]:   </os>
Dec 01 19:25:11 user nova-compute[75066]:   <features>
Dec 01 19:25:11 user nova-compute[75066]:     <acpi/>
Dec 01 19:25:11 user nova-compute[75066]:     <apic/>
Dec 01 19:25:11 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:25:11 user nova-compute[75066]:   </features>
Dec 01 19:25:11 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:25:11 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:25:11 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:25:11 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:25:11 user nova-compute[75066]:   </clock>
Dec 01 19:25:11 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:25:11 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:25:11 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:25:11 user nova-compute[75066]:   </cpu>
Dec 01 19:25:11 user nova-compute[75066]:   <devices>
Dec 01 19:25:11 user nova-compute[75066]:     <disk type="file" device="disk">
Dec 01 19:25:11 user nova-compute[75066]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 19:25:11 user nova-compute[75066]:       <source file="/opt/stack/data/nova/instances/e32ba192-38b9-46f0-b164-1652a43cf3d2/disk"/>
Dec 01 19:25:11 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:25:11 user nova-compute[75066]:     </disk>
Dec 01 19:25:11 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:25:11 user nova-compute[75066]:       <mac address="fa:16:3e:27:e2:3b"/>
Dec 01 19:25:11 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:25:11 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:25:11 user nova-compute[75066]:       <target dev="tapbc61a5e3-01"/>
Dec 01 19:25:11 user nova-compute[75066]:     </interface>
Dec 01 19:25:11 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:25:11 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/e32ba192-38b9-46f0-b164-1652a43cf3d2/console.log" append="off"/>
Dec 01 19:25:11 user nova-compute[75066]:     </serial>
Dec 01 19:25:11 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:25:11 user nova-compute[75066]:     <video>
Dec 01 19:25:11 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:25:11 user nova-compute[75066]:     </video>
Dec 01 19:25:11 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:25:11 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:25:11 user nova-compute[75066]:     </rng>
Dec 01 19:25:11 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:25:11 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:25:11 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:25:11 user nova-compute[75066]:     </memballoon>
Dec 01 19:25:11 user nova-compute[75066]:   </devices>
Dec 01 19:25:11 user nova-compute[75066]: </domain>
Dec 01 19:25:11 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:25:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-456080780',display_name='tempest-VolumesSnapshotTestJSON-instance-456080780',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-456080780',id=25,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4EC0MO4UJsa5au5uhrtmvhSY+F58Kn228qfpqumBg4aaDl1mgE0V6yWTbB37jyyif6C7rIAAZGRtzZ5RdzEmhW2nNFxWtuCt5QkVwAdQBuHd6OXMX2oOypGsj7/biznw==',key_name='tempest-keypair-201555204',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6fb5b77e2da142499315e0a96f86d959',ramdisk_id='',reservation_id='r-gpo4b460',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1069530394',owner_user_name='tempest-VolumesSnapshotTestJSON-1069530394-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:25:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0be767f43744d73a35ed6b7a45c8b95',uuid=e32ba192-38b9-46f0-b164-1652a43cf3d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc61a5e3-0188-4f8e-8d3e-29954e60ea4c", "address": "fa:16:3e:27:e2:3b", "network": {"id": "195edf10-5722-4eef-b117-7a450e973afa", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2017280124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fb5b77e2da142499315e0a96f86d959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc61a5e3-01", "ovs_interfaceid": "bc61a5e3-0188-4f8e-8d3e-29954e60ea4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Converting VIF {"id": "bc61a5e3-0188-4f8e-8d3e-29954e60ea4c", "address": "fa:16:3e:27:e2:3b", "network": {"id": "195edf10-5722-4eef-b117-7a450e973afa", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2017280124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fb5b77e2da142499315e0a96f86d959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc61a5e3-01", "ovs_interfaceid": "bc61a5e3-0188-4f8e-8d3e-29954e60ea4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:e2:3b,bridge_name='br-int',has_traffic_filtering=True,id=bc61a5e3-0188-4f8e-8d3e-29954e60ea4c,network=Network(195edf10-5722-4eef-b117-7a450e973afa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc61a5e3-01') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG os_vif [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:e2:3b,bridge_name='br-int',has_traffic_filtering=True,id=bc61a5e3-0188-4f8e-8d3e-29954e60ea4c,network=Network(195edf10-5722-4eef-b117-7a450e973afa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc61a5e3-01') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4138ecd2-529e-5510-853b-e82ff0df3b84', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbc61a5e3-01, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbc61a5e3-01, col_values=(('qos', UUID('05add985-7232-496c-bb1b-68e9d4721579')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbc61a5e3-01, col_values=(('external_ids', {'iface-id': 'bc61a5e3-0188-4f8e-8d3e-29954e60ea4c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:e2:3b', 'vm-uuid': 'e32ba192-38b9-46f0-b164-1652a43cf3d2'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance c223be70-8b9c-46d4-9b5a-3b83dfc05a17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance c3ceeca4-c16c-4cf5-adfd-7d5a2925f435 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 90c49be6-97aa-45f1-bcbe-b9a3875226a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance b7d86a5a-c62e-41f7-9f33-1a0c61af6a49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance d564b128-598b-4ad4-8618-afa4dc8a7347 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 14de9d20-9e66-4517-b904-2967e0a06a97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance a553e030-0d69-4725-9f84-6c0c63556ed4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance ecc194b4-b8b9-49c8-9d34-4213c4dc15b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 23e17727-40b4-48f7-9155-abc8ffa9f619 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance e84b8c28-e79e-4945-8f3c-dddd7184a166 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance e32ba192-38b9-46f0-b164-1652a43cf3d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:25:11 user nova-compute[75066]: INFO os_vif [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:e2:3b,bridge_name='br-int',has_traffic_filtering=True,id=bc61a5e3-0188-4f8e-8d3e-29954e60ea4c,network=Network(195edf10-5722-4eef-b117-7a450e973afa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc61a5e3-01')
Dec 01 19:25:11 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:25:11 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] No VIF found with MAC fa:16:3e:27:e2:3b, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:25:12 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:25:12 user nova-compute[75066]: DEBUG nova.network.neutron [req-8ab546a5-7e3c-438c-88b2-87e58533592e req-09f7520e-d8aa-45c1-ae3d-bd8131e7f1a6 service nova] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Updated VIF entry in instance network info cache for port bc61a5e3-0188-4f8e-8d3e-29954e60ea4c. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:25:12 user nova-compute[75066]: DEBUG nova.network.neutron [req-8ab546a5-7e3c-438c-88b2-87e58533592e req-09f7520e-d8aa-45c1-ae3d-bd8131e7f1a6 service nova] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Updating instance_info_cache with network_info: [{"id": "bc61a5e3-0188-4f8e-8d3e-29954e60ea4c", "address": "fa:16:3e:27:e2:3b", "network": {"id": "195edf10-5722-4eef-b117-7a450e973afa", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2017280124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fb5b77e2da142499315e0a96f86d959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc61a5e3-01", "ovs_interfaceid": "bc61a5e3-0188-4f8e-8d3e-29954e60ea4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:25:12 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:25:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-8ab546a5-7e3c-438c-88b2-87e58533592e req-09f7520e-d8aa-45c1-ae3d-bd8131e7f1a6 service nova] Releasing lock "refresh_cache-e32ba192-38b9-46f0-b164-1652a43cf3d2" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:25:12 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Compute_service record updated for user:user {{(pid=75066) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 19:25:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.872s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:25:12 user nova-compute[75066]: DEBUG nova.compute.manager [req-ceb35fb1-fe74-47d5-8c5c-3a49ecc9c6d5 req-a472c33c-1e16-4cb9-a413-9a436a5050f7 service nova] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Received event network-vif-unplugged-c9353199-d4a3-488f-857d-b0ebdb31a68f {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:25:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-ceb35fb1-fe74-47d5-8c5c-3a49ecc9c6d5 req-a472c33c-1e16-4cb9-a413-9a436a5050f7 service nova] Acquiring lock "c3ceeca4-c16c-4cf5-adfd-7d5a2925f435-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:25:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-ceb35fb1-fe74-47d5-8c5c-3a49ecc9c6d5 req-a472c33c-1e16-4cb9-a413-9a436a5050f7 service nova] Lock "c3ceeca4-c16c-4cf5-adfd-7d5a2925f435-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:25:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-ceb35fb1-fe74-47d5-8c5c-3a49ecc9c6d5 req-a472c33c-1e16-4cb9-a413-9a436a5050f7 service nova] Lock "c3ceeca4-c16c-4cf5-adfd-7d5a2925f435-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:25:12 user nova-compute[75066]: DEBUG nova.compute.manager [req-ceb35fb1-fe74-47d5-8c5c-3a49ecc9c6d5 req-a472c33c-1e16-4cb9-a413-9a436a5050f7 service nova] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] No waiting events found dispatching network-vif-unplugged-c9353199-d4a3-488f-857d-b0ebdb31a68f {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:25:12 user nova-compute[75066]: DEBUG nova.compute.manager [req-ceb35fb1-fe74-47d5-8c5c-3a49ecc9c6d5 req-a472c33c-1e16-4cb9-a413-9a436a5050f7 service nova] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Received event network-vif-unplugged-c9353199-d4a3-488f-857d-b0ebdb31a68f for instance with task_state deleting. {{(pid=75066) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 19:25:12 user nova-compute[75066]: DEBUG nova.compute.manager [req-ceb35fb1-fe74-47d5-8c5c-3a49ecc9c6d5 req-a472c33c-1e16-4cb9-a413-9a436a5050f7 service nova] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Received event network-vif-plugged-c9353199-d4a3-488f-857d-b0ebdb31a68f {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:25:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-ceb35fb1-fe74-47d5-8c5c-3a49ecc9c6d5 req-a472c33c-1e16-4cb9-a413-9a436a5050f7 service nova] Acquiring lock "c3ceeca4-c16c-4cf5-adfd-7d5a2925f435-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:25:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-ceb35fb1-fe74-47d5-8c5c-3a49ecc9c6d5 req-a472c33c-1e16-4cb9-a413-9a436a5050f7 service nova] Lock "c3ceeca4-c16c-4cf5-adfd-7d5a2925f435-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:25:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-ceb35fb1-fe74-47d5-8c5c-3a49ecc9c6d5 req-a472c33c-1e16-4cb9-a413-9a436a5050f7 service nova] Lock "c3ceeca4-c16c-4cf5-adfd-7d5a2925f435-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:25:12 user nova-compute[75066]: DEBUG nova.compute.manager [req-ceb35fb1-fe74-47d5-8c5c-3a49ecc9c6d5 req-a472c33c-1e16-4cb9-a413-9a436a5050f7 service nova] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] No waiting events found dispatching network-vif-plugged-c9353199-d4a3-488f-857d-b0ebdb31a68f {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:25:12 user nova-compute[75066]: WARNING nova.compute.manager [req-ceb35fb1-fe74-47d5-8c5c-3a49ecc9c6d5 req-a472c33c-1e16-4cb9-a413-9a436a5050f7 service nova] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Received unexpected event network-vif-plugged-c9353199-d4a3-488f-857d-b0ebdb31a68f for instance with vm_state active and task_state deleting.
Dec 01 19:25:12 user nova-compute[75066]: INFO nova.compute.manager [None req-794398f7-a5c0-4fe0-9a81-72ff43ac0850 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Unrescuing
Dec 01 19:25:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-794398f7-a5c0-4fe0-9a81-72ff43ac0850 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Acquiring lock "refresh_cache-905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:25:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-794398f7-a5c0-4fe0-9a81-72ff43ac0850 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Acquired lock "refresh_cache-905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:25:12 user nova-compute[75066]: DEBUG nova.network.neutron [None req-794398f7-a5c0-4fe0-9a81-72ff43ac0850 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:25:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:12 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:25:12 user nova-compute[75066]: INFO nova.compute.manager [-] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Took 1.31 seconds to deallocate network for instance.
Dec 01 19:25:12 user nova-compute[75066]: DEBUG nova.compute.manager [req-f5d784a8-1184-4ffa-82a5-bd2284b3a2f1 req-2270c325-6ea7-45ea-b43f-435194a6b7a2 service nova] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Received event network-vif-deleted-c9353199-d4a3-488f-857d-b0ebdb31a68f {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:25:12 user nova-compute[75066]: INFO nova.compute.manager [req-f5d784a8-1184-4ffa-82a5-bd2284b3a2f1 req-2270c325-6ea7-45ea-b43f-435194a6b7a2 service nova] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Neutron deleted interface c9353199-d4a3-488f-857d-b0ebdb31a68f; detaching it from the instance and deleting it from the info cache
Dec 01 19:25:12 user nova-compute[75066]: DEBUG nova.network.neutron [req-f5d784a8-1184-4ffa-82a5-bd2284b3a2f1 req-2270c325-6ea7-45ea-b43f-435194a6b7a2 service nova] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:25:12 user nova-compute[75066]: DEBUG nova.compute.manager [req-f5d784a8-1184-4ffa-82a5-bd2284b3a2f1 req-2270c325-6ea7-45ea-b43f-435194a6b7a2 service nova] [instance: c3ceeca4-c16c-4cf5-adfd-7d5a2925f435] Detach interface failed, port_id=c9353199-d4a3-488f-857d-b0ebdb31a68f, reason: Instance c3ceeca4-c16c-4cf5-adfd-7d5a2925f435 could not be found. {{(pid=75066) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 01 19:25:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-01eeb87e-9f18-49a6-b774-997e0d2d84e8 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:25:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-01eeb87e-9f18-49a6-b774-997e0d2d84e8 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:25:13 user nova-compute[75066]: DEBUG nova.network.neutron [None req-794398f7-a5c0-4fe0-9a81-72ff43ac0850 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Updating instance_info_cache with network_info: [{"id": "6c41fc1e-7ed5-490d-a375-0db34c7ae40b", "address": "fa:16:3e:ed:e9:7c", "network": {"id": "6b0f48b7-3db2-49b2-a238-8fd811b52d62", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1688127634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e000d89bca44cd8acba504256d8d1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c41fc1e-7e", "ovs_interfaceid": "6c41fc1e-7ed5-490d-a375-0db34c7ae40b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:25:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-794398f7-a5c0-4fe0-9a81-72ff43ac0850 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Releasing lock "refresh_cache-905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:25:13 user nova-compute[75066]: DEBUG nova.objects.instance [None req-794398f7-a5c0-4fe0-9a81-72ff43ac0850 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lazy-loading 'flavor' on Instance uuid 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:25:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:13 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-01eeb87e-9f18-49a6-b774-997e0d2d84e8 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:25:13 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:25:13 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:25:13 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Starting heal instance info cache {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 19:25:13 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-01eeb87e-9f18-49a6-b774-997e0d2d84e8 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:25:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-01eeb87e-9f18-49a6-b774-997e0d2d84e8 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.427s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:25:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:13 user nova-compute[75066]: INFO nova.scheduler.client.report [None req-01eeb87e-9f18-49a6-b774-997e0d2d84e8 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Deleted allocations for instance c3ceeca4-c16c-4cf5-adfd-7d5a2925f435
Dec 01 19:25:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "refresh_cache-90c49be6-97aa-45f1-bcbe-b9a3875226a7" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:25:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquired lock "refresh_cache-90c49be6-97aa-45f1-bcbe-b9a3875226a7" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:25:13 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Forcefully refreshing network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 19:25:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-01eeb87e-9f18-49a6-b774-997e0d2d84e8 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "c3ceeca4-c16c-4cf5-adfd-7d5a2925f435" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.224s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:25:14 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Updating instance_info_cache with network_info: [{"id": "5ccc5509-ab48-4e15-96b2-5757927fa168", "address": "fa:16:3e:eb:66:d7", "network": {"id": "6b0f48b7-3db2-49b2-a238-8fd811b52d62", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1688127634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e000d89bca44cd8acba504256d8d1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccc5509-ab", "ovs_interfaceid": "5ccc5509-ab48-4e15-96b2-5757927fa168", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:25:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Releasing lock "refresh_cache-90c49be6-97aa-45f1-bcbe-b9a3875226a7" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:25:14 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Updated the network info_cache for instance {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 19:25:14 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:25:14 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:25:14 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:25:14 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75066) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 19:25:14 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Instance destroyed successfully.
Dec 01 19:25:14 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:14 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:14 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:14 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:14 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:15 user nova-compute[75066]: DEBUG nova.compute.manager [req-910b7462-e5c8-4f81-8d2e-73b41dbf8dc1 req-3073dc25-303e-4e5e-b750-3ef218a83b23 service nova] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Received event network-vif-unplugged-6c41fc1e-7ed5-490d-a375-0db34c7ae40b {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:25:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-910b7462-e5c8-4f81-8d2e-73b41dbf8dc1 req-3073dc25-303e-4e5e-b750-3ef218a83b23 service nova] Acquiring lock "905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:25:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-910b7462-e5c8-4f81-8d2e-73b41dbf8dc1 req-3073dc25-303e-4e5e-b750-3ef218a83b23 service nova] Lock "905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:25:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-910b7462-e5c8-4f81-8d2e-73b41dbf8dc1 req-3073dc25-303e-4e5e-b750-3ef218a83b23 service nova] Lock "905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:25:15 user nova-compute[75066]: DEBUG nova.compute.manager [req-910b7462-e5c8-4f81-8d2e-73b41dbf8dc1 req-3073dc25-303e-4e5e-b750-3ef218a83b23 service nova] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] No waiting events found dispatching network-vif-unplugged-6c41fc1e-7ed5-490d-a375-0db34c7ae40b {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:25:15 user nova-compute[75066]: WARNING nova.compute.manager [req-910b7462-e5c8-4f81-8d2e-73b41dbf8dc1 req-3073dc25-303e-4e5e-b750-3ef218a83b23 service nova] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Received unexpected event network-vif-unplugged-6c41fc1e-7ed5-490d-a375-0db34c7ae40b for instance with vm_state rescued and task_state unrescuing.
Dec 01 19:25:15 user nova-compute[75066]: DEBUG nova.compute.manager [req-910b7462-e5c8-4f81-8d2e-73b41dbf8dc1 req-3073dc25-303e-4e5e-b750-3ef218a83b23 service nova] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Received event network-vif-plugged-6c41fc1e-7ed5-490d-a375-0db34c7ae40b {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:25:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-910b7462-e5c8-4f81-8d2e-73b41dbf8dc1 req-3073dc25-303e-4e5e-b750-3ef218a83b23 service nova] Acquiring lock "905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:25:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-910b7462-e5c8-4f81-8d2e-73b41dbf8dc1 req-3073dc25-303e-4e5e-b750-3ef218a83b23 service nova] Lock "905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:25:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-910b7462-e5c8-4f81-8d2e-73b41dbf8dc1 req-3073dc25-303e-4e5e-b750-3ef218a83b23 service nova] Lock "905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:25:15 user nova-compute[75066]: DEBUG nova.compute.manager [req-910b7462-e5c8-4f81-8d2e-73b41dbf8dc1 req-3073dc25-303e-4e5e-b750-3ef218a83b23 service nova] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] No waiting events found dispatching network-vif-plugged-6c41fc1e-7ed5-490d-a375-0db34c7ae40b {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:25:15 user nova-compute[75066]: WARNING nova.compute.manager [req-910b7462-e5c8-4f81-8d2e-73b41dbf8dc1 req-3073dc25-303e-4e5e-b750-3ef218a83b23 service nova] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Received unexpected event network-vif-plugged-6c41fc1e-7ed5-490d-a375-0db34c7ae40b for instance with vm_state rescued and task_state unrescuing.
Dec 01 19:25:15 user nova-compute[75066]: DEBUG nova.compute.manager [req-910b7462-e5c8-4f81-8d2e-73b41dbf8dc1 req-3073dc25-303e-4e5e-b750-3ef218a83b23 service nova] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Received event network-vif-plugged-bc61a5e3-0188-4f8e-8d3e-29954e60ea4c {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:25:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-910b7462-e5c8-4f81-8d2e-73b41dbf8dc1 req-3073dc25-303e-4e5e-b750-3ef218a83b23 service nova] Acquiring lock "e32ba192-38b9-46f0-b164-1652a43cf3d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:25:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-910b7462-e5c8-4f81-8d2e-73b41dbf8dc1 req-3073dc25-303e-4e5e-b750-3ef218a83b23 service nova] Lock "e32ba192-38b9-46f0-b164-1652a43cf3d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:25:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-910b7462-e5c8-4f81-8d2e-73b41dbf8dc1 req-3073dc25-303e-4e5e-b750-3ef218a83b23 service nova] Lock "e32ba192-38b9-46f0-b164-1652a43cf3d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:25:15 user nova-compute[75066]: DEBUG nova.compute.manager [req-910b7462-e5c8-4f81-8d2e-73b41dbf8dc1 req-3073dc25-303e-4e5e-b750-3ef218a83b23 service nova] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] No waiting events found dispatching network-vif-plugged-bc61a5e3-0188-4f8e-8d3e-29954e60ea4c {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:25:15 user nova-compute[75066]: WARNING nova.compute.manager [req-910b7462-e5c8-4f81-8d2e-73b41dbf8dc1 req-3073dc25-303e-4e5e-b750-3ef218a83b23 service nova] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Received unexpected event network-vif-plugged-bc61a5e3-0188-4f8e-8d3e-29954e60ea4c for instance with vm_state building and task_state spawning.
Dec 01 19:25:15 user nova-compute[75066]: DEBUG nova.compute.manager [req-910b7462-e5c8-4f81-8d2e-73b41dbf8dc1 req-3073dc25-303e-4e5e-b750-3ef218a83b23 service nova] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Received event network-vif-plugged-bc61a5e3-0188-4f8e-8d3e-29954e60ea4c {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:25:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-910b7462-e5c8-4f81-8d2e-73b41dbf8dc1 req-3073dc25-303e-4e5e-b750-3ef218a83b23 service nova] Acquiring lock "e32ba192-38b9-46f0-b164-1652a43cf3d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:25:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-910b7462-e5c8-4f81-8d2e-73b41dbf8dc1 req-3073dc25-303e-4e5e-b750-3ef218a83b23 service nova] Lock "e32ba192-38b9-46f0-b164-1652a43cf3d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:25:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-910b7462-e5c8-4f81-8d2e-73b41dbf8dc1 req-3073dc25-303e-4e5e-b750-3ef218a83b23 service nova] Lock "e32ba192-38b9-46f0-b164-1652a43cf3d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:25:15 user nova-compute[75066]: DEBUG nova.compute.manager [req-910b7462-e5c8-4f81-8d2e-73b41dbf8dc1 req-3073dc25-303e-4e5e-b750-3ef218a83b23 service nova] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] No waiting events found dispatching network-vif-plugged-bc61a5e3-0188-4f8e-8d3e-29954e60ea4c {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:25:15 user nova-compute[75066]: WARNING nova.compute.manager [req-910b7462-e5c8-4f81-8d2e-73b41dbf8dc1 req-3073dc25-303e-4e5e-b750-3ef218a83b23 service nova] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Received unexpected event network-vif-plugged-bc61a5e3-0188-4f8e-8d3e-29954e60ea4c for instance with vm_state building and task_state spawning.
Dec 01 19:25:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:16 user nova-compute[75066]: DEBUG nova.compute.manager [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Instance event wait completed in 0 seconds for  {{(pid=75066) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 19:25:16 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Guest created on hypervisor {{(pid=75066) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 19:25:16 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Instance spawned successfully.
Dec 01 19:25:16 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 19:25:16 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Found default for hw_cdrom_bus of ide {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:25:16 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Found default for hw_disk_bus of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:25:16 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Found default for hw_input_bus of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:25:16 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Found default for hw_pointer_model of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:25:16 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Found default for hw_video_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:25:16 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Found default for hw_vif_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:25:16 user nova-compute[75066]: INFO nova.compute.manager [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Took 7.44 seconds to spawn the instance on the hypervisor.
Dec 01 19:25:16 user nova-compute[75066]: DEBUG nova.compute.manager [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:25:16 user nova-compute[75066]: INFO nova.compute.manager [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Took 8.52 seconds to build instance.
Dec 01 19:25:16 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5e0ba814-9665-49c0-b9ec-934a559e3674 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lock "e32ba192-38b9-46f0-b164-1652a43cf3d2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.676s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:25:16 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Acquiring lock "391945f6-fe47-4969-a497-bd320d66cfa3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:25:16 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Lock "391945f6-fe47-4969-a497-bd320d66cfa3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:25:16 user nova-compute[75066]: DEBUG nova.compute.manager [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Starting instance... {{(pid=75066) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 19:25:16 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:25:16 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:25:16 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75066) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 19:25:16 user nova-compute[75066]: INFO nova.compute.claims [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Claim successful on node user
Dec 01 19:25:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:17 user nova-compute[75066]: DEBUG nova.compute.manager [req-aa8992b3-eaed-4014-bd1e-2d82fd1082d8 req-a4c0ef67-eff8-472f-89e5-b0e02612f5e5 service nova] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Received event network-vif-plugged-6c41fc1e-7ed5-490d-a375-0db34c7ae40b {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:25:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-aa8992b3-eaed-4014-bd1e-2d82fd1082d8 req-a4c0ef67-eff8-472f-89e5-b0e02612f5e5 service nova] Acquiring lock "905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:25:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-aa8992b3-eaed-4014-bd1e-2d82fd1082d8 req-a4c0ef67-eff8-472f-89e5-b0e02612f5e5 service nova] Lock "905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:25:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-aa8992b3-eaed-4014-bd1e-2d82fd1082d8 req-a4c0ef67-eff8-472f-89e5-b0e02612f5e5 service nova] Lock "905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:25:17 user nova-compute[75066]: DEBUG nova.compute.manager [req-aa8992b3-eaed-4014-bd1e-2d82fd1082d8 req-a4c0ef67-eff8-472f-89e5-b0e02612f5e5 service nova] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] No waiting events found dispatching network-vif-plugged-6c41fc1e-7ed5-490d-a375-0db34c7ae40b {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:25:17 user nova-compute[75066]: WARNING nova.compute.manager [req-aa8992b3-eaed-4014-bd1e-2d82fd1082d8 req-a4c0ef67-eff8-472f-89e5-b0e02612f5e5 service nova] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Received unexpected event network-vif-plugged-6c41fc1e-7ed5-490d-a375-0db34c7ae40b for instance with vm_state rescued and task_state unrescuing.
Dec 01 19:25:17 user nova-compute[75066]: DEBUG nova.compute.manager [req-aa8992b3-eaed-4014-bd1e-2d82fd1082d8 req-a4c0ef67-eff8-472f-89e5-b0e02612f5e5 service nova] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Received event network-vif-plugged-6c41fc1e-7ed5-490d-a375-0db34c7ae40b {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:25:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-aa8992b3-eaed-4014-bd1e-2d82fd1082d8 req-a4c0ef67-eff8-472f-89e5-b0e02612f5e5 service nova] Acquiring lock "905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:25:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-aa8992b3-eaed-4014-bd1e-2d82fd1082d8 req-a4c0ef67-eff8-472f-89e5-b0e02612f5e5 service nova] Lock "905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:25:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-aa8992b3-eaed-4014-bd1e-2d82fd1082d8 req-a4c0ef67-eff8-472f-89e5-b0e02612f5e5 service nova] Lock "905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:25:17 user nova-compute[75066]: DEBUG nova.compute.manager [req-aa8992b3-eaed-4014-bd1e-2d82fd1082d8 req-a4c0ef67-eff8-472f-89e5-b0e02612f5e5 service nova] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] No waiting events found dispatching network-vif-plugged-6c41fc1e-7ed5-490d-a375-0db34c7ae40b {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:25:17 user nova-compute[75066]: WARNING nova.compute.manager [req-aa8992b3-eaed-4014-bd1e-2d82fd1082d8 req-a4c0ef67-eff8-472f-89e5-b0e02612f5e5 service nova] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Received unexpected event network-vif-plugged-6c41fc1e-7ed5-490d-a375-0db34c7ae40b for instance with vm_state rescued and task_state unrescuing.
Dec 01 19:25:17 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:25:17 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:25:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.528s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:25:17 user nova-compute[75066]: DEBUG nova.compute.manager [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Start building networks asynchronously for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 19:25:17 user nova-compute[75066]: DEBUG nova.compute.manager [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Allocating IP information in the background. {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 19:25:17 user nova-compute[75066]: DEBUG nova.network.neutron [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] allocate_for_instance() {{(pid=75066) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 19:25:17 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 19:25:17 user nova-compute[75066]: DEBUG nova.compute.manager [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Start building block device mappings for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 19:25:17 user nova-compute[75066]: INFO nova.virt.block_device [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Booting with volume 8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 at /dev/vda
Dec 01 19:25:17 user nova-compute[75066]: DEBUG nova.policy [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cf5efdf2a7324c96b8b9b2370dc7e31c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83c5f90337e64829893181e7e8140b8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75066) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 19:25:17 user nova-compute[75066]: DEBUG os_brick.utils [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:25:17 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:17 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:25:17 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a46a583-0fe5-427d-aa26-e080ad650912]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1959854982f\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:25:17 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:17 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:25:17 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4dfdc5-b382-4649-a57b-153345dcb884]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:25:17 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:17 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:25:17 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8e5313-5b6a-4ad1-92cf-138cf10ab111]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:25:17 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8e4c09-8371-4180-bb92-92e2af1fa7f5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:25:17 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Running cmd (subprocess): nvme version {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:17 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] 'nvme version' failed. Not Retrying. {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:25:17 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] nvme not present on system {{(pid=75066) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 19:25:17 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:17 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:25:17 user nova-compute[75066]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 19:25:17 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[df979bb5-c65a-46e1-a6d2-1e7db1cac15d]: (4, '') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:25:17 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75066) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 19:25:17 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 19:25:17 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] LIGHTOS: no hostnqn found. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 19:25:17 user nova-compute[75066]: DEBUG os_brick.utils [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1959854982f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:25:17 user nova-compute[75066]: DEBUG nova.virt.block_device [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Updating existing volume attachment record: 0a97cdef-b655-4885-a8c4-34c4736aebc4 {{(pid=75066) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 19:25:17 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:17 user nova-compute[75066]: DEBUG nova.compute.manager [None req-794398f7-a5c0-4fe0-9a81-72ff43ac0850 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:25:18 user nova-compute[75066]: DEBUG nova.network.neutron [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Successfully created port: e5f3728a-541f-4b95-9feb-6119687f2eba {{(pid=75066) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 19:25:18 user nova-compute[75066]: DEBUG nova.network.neutron [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Successfully updated port: e5f3728a-541f-4b95-9feb-6119687f2eba {{(pid=75066) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 19:25:18 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Acquiring lock "refresh_cache-391945f6-fe47-4969-a497-bd320d66cfa3" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:25:18 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Acquired lock "refresh_cache-391945f6-fe47-4969-a497-bd320d66cfa3" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:25:18 user nova-compute[75066]: DEBUG nova.network.neutron [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:25:18 user nova-compute[75066]: DEBUG nova.compute.manager [req-a5f48a8d-3e53-4aa7-9de0-62216ec6013b req-ff84ee67-1384-4b3a-8633-4087c7808c12 service nova] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Received event network-changed-e5f3728a-541f-4b95-9feb-6119687f2eba {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:25:18 user nova-compute[75066]: DEBUG nova.compute.manager [req-a5f48a8d-3e53-4aa7-9de0-62216ec6013b req-ff84ee67-1384-4b3a-8633-4087c7808c12 service nova] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Refreshing instance network info cache due to event network-changed-e5f3728a-541f-4b95-9feb-6119687f2eba. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:25:18 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a5f48a8d-3e53-4aa7-9de0-62216ec6013b req-ff84ee67-1384-4b3a-8633-4087c7808c12 service nova] Acquiring lock "refresh_cache-391945f6-fe47-4969-a497-bd320d66cfa3" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:25:18 user nova-compute[75066]: DEBUG nova.network.neutron [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:25:19 user nova-compute[75066]: DEBUG nova.network.neutron [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Updating instance_info_cache with network_info: [{"id": "e5f3728a-541f-4b95-9feb-6119687f2eba", "address": "fa:16:3e:9c:60:12", "network": {"id": "3e44df49-3c9c-4812-aafc-ce3f4795874b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-826204178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83c5f90337e64829893181e7e8140b8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5f3728a-54", "ovs_interfaceid": "e5f3728a-541f-4b95-9feb-6119687f2eba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:25:19 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Releasing lock "refresh_cache-391945f6-fe47-4969-a497-bd320d66cfa3" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:25:19 user nova-compute[75066]: DEBUG nova.compute.manager [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Instance network_info: |[{"id": "e5f3728a-541f-4b95-9feb-6119687f2eba", "address": "fa:16:3e:9c:60:12", "network": {"id": "3e44df49-3c9c-4812-aafc-ce3f4795874b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-826204178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83c5f90337e64829893181e7e8140b8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5f3728a-54", "ovs_interfaceid": "e5f3728a-541f-4b95-9feb-6119687f2eba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 19:25:19 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a5f48a8d-3e53-4aa7-9de0-62216ec6013b req-ff84ee67-1384-4b3a-8633-4087c7808c12 service nova] Acquired lock "refresh_cache-391945f6-fe47-4969-a497-bd320d66cfa3" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:25:19 user nova-compute[75066]: DEBUG nova.network.neutron [req-a5f48a8d-3e53-4aa7-9de0-62216ec6013b req-ff84ee67-1384-4b3a-8633-4087c7808c12 service nova] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Refreshing network info cache for port e5f3728a-541f-4b95-9feb-6119687f2eba {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:25:19 user nova-compute[75066]: DEBUG nova.network.neutron [req-a5f48a8d-3e53-4aa7-9de0-62216ec6013b req-ff84ee67-1384-4b3a-8633-4087c7808c12 service nova] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Updated VIF entry in instance network info cache for port e5f3728a-541f-4b95-9feb-6119687f2eba. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:25:19 user nova-compute[75066]: DEBUG nova.network.neutron [req-a5f48a8d-3e53-4aa7-9de0-62216ec6013b req-ff84ee67-1384-4b3a-8633-4087c7808c12 service nova] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Updating instance_info_cache with network_info: [{"id": "e5f3728a-541f-4b95-9feb-6119687f2eba", "address": "fa:16:3e:9c:60:12", "network": {"id": "3e44df49-3c9c-4812-aafc-ce3f4795874b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-826204178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83c5f90337e64829893181e7e8140b8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5f3728a-54", "ovs_interfaceid": "e5f3728a-541f-4b95-9feb-6119687f2eba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:25:19 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a5f48a8d-3e53-4aa7-9de0-62216ec6013b req-ff84ee67-1384-4b3a-8633-4087c7808c12 service nova] Releasing lock "refresh_cache-391945f6-fe47-4969-a497-bd320d66cfa3" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:25:21 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:22 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:26 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG nova.compute.manager [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Start spawning the instance on the hypervisor. {{(pid=75066) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Creating instance directory {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 19:25:27 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Creating image(s)
Dec 01 19:25:27 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Did not create local disks {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Ensure instance console log exists: /opt/stack/data/nova/instances/391945f6-fe47-4969-a497-bd320d66cfa3/console.log {{(pid=75066) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Start _get_guest_xml network_info=[{"id": "e5f3728a-541f-4b95-9feb-6119687f2eba", "address": "fa:16:3e:9c:60:12", "network": {"id": "3e44df49-3c9c-4812-aafc-ce3f4795874b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-826204178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83c5f90337e64829893181e7e8140b8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5f3728a-54", "ovs_interfaceid": "e5f3728a-541f-4b95-9feb-6119687f2eba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': True, 'attachment_id': '0a97cdef-b655-4885-a8c4-34c4736aebc4', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xUAEeuip', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '391945f6-fe47-4969-a497-bd320d66cfa3', 'attached_at': '', 'detached_at': '', 'volume_id': '8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0', 'serial': '8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:25:27 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:25:27 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:25:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-fe693c01-42bf-4ecd-9469-2c1de537ad86 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Acquiring lock "b7d86a5a-c62e-41f7-9f33-1a0c61af6a49" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-fe693c01-42bf-4ecd-9469-2c1de537ad86 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Lock "b7d86a5a-c62e-41f7-9f33-1a0c61af6a49" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-fe693c01-42bf-4ecd-9469-2c1de537ad86 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Acquiring lock "b7d86a5a-c62e-41f7-9f33-1a0c61af6a49-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-fe693c01-42bf-4ecd-9469-2c1de537ad86 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Lock "b7d86a5a-c62e-41f7-9f33-1a0c61af6a49-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-fe693c01-42bf-4ecd-9469-2c1de537ad86 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Lock "b7d86a5a-c62e-41f7-9f33-1a0c61af6a49-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:25:27 user nova-compute[75066]: INFO nova.compute.manager [None req-fe693c01-42bf-4ecd-9469-2c1de537ad86 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] Terminating instance
Dec 01 19:25:27 user nova-compute[75066]: DEBUG nova.compute.manager [None req-fe693c01-42bf-4ecd-9469-2c1de537ad86 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] Start destroying the instance on the hypervisor. {{(pid=75066) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Calling os-brick to attach iSCSI Volume {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xUAEeuip', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:25:27 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:25:27 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:25:27 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:25:27 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:25:27 user nova-compute[75066]: INFO os_brick.initiator.connectors.iscsi [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 19:25:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 -p 172.16.0.220:3260 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff797a6-3a88-4edd-a015-72e90942179d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 19:25:27 user nova-compute[75066]:  {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c2861d-c396-49b1-94fb-245da90878d5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0] added\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0] added
Dec 01 19:25:27 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30aa1da-fb5e-4ffc-9f11-e3d34d4ad0ad]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d072c86-d9a7-4760-bd61-7e440def2c04]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xUAEeuip {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xUAEeuip" returned: 0 in 0.027s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e35284-36b7-4548-acec-20325845bf9a]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xUAEeuip'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06b9742-5feb-4919-b7f4-c55743076e65]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[e031d5e4-2798-4bf6-b5de-7bce07c5e7bb]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:25:27 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:25:27 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 -p 172.16.0.220:3260 --login {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d84a371-c083-4cd8-8325-0457c994741f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0, portal: 172.16.0.220,3260]
Dec 01 19:25:27 user nova-compute[75066]: Login to [iface: default, target: iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0, portal: 172.16.0.220,3260] successful.
Dec 01 19:25:27 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c2c8a8-f23d-4230-a2b1-f297da92a861]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51df7bc-638a-4a75-8c36-1d1dbe26acdf]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:25:27 user nova-compute[75066]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)
Dec 01 19:25:27 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:25:27 user nova-compute[75066]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)
Dec 01 19:25:27 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.355s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Connected to 172.16.0.220:3260 {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] HCTL ('33', '-', '-', 0) found on session 26 with lun 0 {{(pid=75066) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75066) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.028s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d31550-9a8d-43ef-9c25-4b63b32fecc4]: (4, ('- - 0', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Searching for a device in session 26 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xUAEeuip', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG nova.compute.manager [req-6cc924e8-04ad-40dd-ba93-60cd195f4485 req-7b9fab08-f7cc-44bf-bd1d-c6d5ec96d3b7 service nova] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] Received event network-vif-unplugged-6c3db9c1-34b1-4671-9553-c3d71eeacb3d {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-6cc924e8-04ad-40dd-ba93-60cd195f4485 req-7b9fab08-f7cc-44bf-bd1d-c6d5ec96d3b7 service nova] Acquiring lock "b7d86a5a-c62e-41f7-9f33-1a0c61af6a49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-6cc924e8-04ad-40dd-ba93-60cd195f4485 req-7b9fab08-f7cc-44bf-bd1d-c6d5ec96d3b7 service nova] Lock "b7d86a5a-c62e-41f7-9f33-1a0c61af6a49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-6cc924e8-04ad-40dd-ba93-60cd195f4485 req-7b9fab08-f7cc-44bf-bd1d-c6d5ec96d3b7 service nova] Lock "b7d86a5a-c62e-41f7-9f33-1a0c61af6a49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG nova.compute.manager [req-6cc924e8-04ad-40dd-ba93-60cd195f4485 req-7b9fab08-f7cc-44bf-bd1d-c6d5ec96d3b7 service nova] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] No waiting events found dispatching network-vif-unplugged-6c3db9c1-34b1-4671-9553-c3d71eeacb3d {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:25:27 user nova-compute[75066]: DEBUG nova.compute.manager [req-6cc924e8-04ad-40dd-ba93-60cd195f4485 req-7b9fab08-f7cc-44bf-bd1d-c6d5ec96d3b7 service nova] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] Received event network-vif-unplugged-6c3db9c1-34b1-4671-9553-c3d71eeacb3d for instance with task_state deleting. {{(pid=75066) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 19:25:28 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] Instance destroyed successfully.
Dec 01 19:25:28 user nova-compute[75066]: DEBUG nova.objects.instance [None req-fe693c01-42bf-4ecd-9469-2c1de537ad86 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Lazy-loading 'resources' on Instance uuid b7d86a5a-c62e-41f7-9f33-1a0c61af6a49 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:25:28 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-fe693c01-42bf-4ecd-9469-2c1de537ad86 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:19:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-225298201',display_name='tempest-VolumesAdminNegativeTest-server-225298201',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-225298201',id=14,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJYa7lspaHF6uGyOjLtn1sci2/tw0fthGU4QB8aTV/Oz9I+myxZ7AViioQ/JCBrcj1D0b10pOk5q+re4WYghaItiL9DtxD1+MNlLQrROAPT///nBrH4M4hUUiJdjanAwbg==',key_name='tempest-keypair-339063041',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:19:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6ec09f9e9cee4b46a5adda7a2811e991',ramdisk_id='',reservation_id='r-d5ea3q8g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1973855036',owner_user_name='tempest-VolumesAdminNegativeTest-1973855036-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:19:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8f807bcec6a5479cb3a97c85d7110afe',uuid=b7d86a5a-c62e-41f7-9f33-1a0c61af6a49,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6c3db9c1-34b1-4671-9553-c3d71eeacb3d", "address": "fa:16:3e:14:52:b4", "network": {"id": "5380ccc0-6aee-42e3-a3e7-b2219a2eb53a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-952289001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ec09f9e9cee4b46a5adda7a2811e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c3db9c1-34", "ovs_interfaceid": "6c3db9c1-34b1-4671-9553-c3d71eeacb3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:25:28 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-fe693c01-42bf-4ecd-9469-2c1de537ad86 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Converting VIF {"id": "6c3db9c1-34b1-4671-9553-c3d71eeacb3d", "address": "fa:16:3e:14:52:b4", "network": {"id": "5380ccc0-6aee-42e3-a3e7-b2219a2eb53a", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-952289001-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ec09f9e9cee4b46a5adda7a2811e991", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c3db9c1-34", "ovs_interfaceid": "6c3db9c1-34b1-4671-9553-c3d71eeacb3d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:25:28 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-fe693c01-42bf-4ecd-9469-2c1de537ad86 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:14:52:b4,bridge_name='br-int',has_traffic_filtering=True,id=6c3db9c1-34b1-4671-9553-c3d71eeacb3d,network=Network(5380ccc0-6aee-42e3-a3e7-b2219a2eb53a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c3db9c1-34') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:25:28 user nova-compute[75066]: DEBUG os_vif [None req-fe693c01-42bf-4ecd-9469-2c1de537ad86 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:52:b4,bridge_name='br-int',has_traffic_filtering=True,id=6c3db9c1-34b1-4671-9553-c3d71eeacb3d,network=Network(5380ccc0-6aee-42e3-a3e7-b2219a2eb53a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c3db9c1-34') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:25:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6c3db9c1-34, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:25:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f39c6dc9-a6b7-4fbe-8670-780093b17dde) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:25:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:25:28 user nova-compute[75066]: INFO os_vif [None req-fe693c01-42bf-4ecd-9469-2c1de537ad86 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:14:52:b4,bridge_name='br-int',has_traffic_filtering=True,id=6c3db9c1-34b1-4671-9553-c3d71eeacb3d,network=Network(5380ccc0-6aee-42e3-a3e7-b2219a2eb53a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c3db9c1-34')
Dec 01 19:25:28 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-fe693c01-42bf-4ecd-9469-2c1de537ad86 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] Deleting instance files /opt/stack/data/nova/instances/b7d86a5a-c62e-41f7-9f33-1a0c61af6a49_del
Dec 01 19:25:28 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-fe693c01-42bf-4ecd-9469-2c1de537ad86 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] Deletion of /opt/stack/data/nova/instances/b7d86a5a-c62e-41f7-9f33-1a0c61af6a49_del complete
Dec 01 19:25:28 user nova-compute[75066]: INFO nova.compute.manager [None req-fe693c01-42bf-4ecd-9469-2c1de537ad86 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] Took 0.91 seconds to destroy the instance on the hypervisor.
Dec 01 19:25:28 user nova-compute[75066]: DEBUG oslo.service.loopingcall [None req-fe693c01-42bf-4ecd-9469-2c1de537ad86 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75066) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 19:25:28 user nova-compute[75066]: DEBUG nova.compute.manager [-] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] Deallocating network for instance {{(pid=75066) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 19:25:28 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] deallocate_for_instance() {{(pid=75066) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 19:25:28 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.400s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:25:28 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] <== connect_volume: return (1402ms) {'type': 'block', 'scsi_wwn': '23635323134333263', 'path': '/dev/sdb'} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:25:28 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23635323134333263', 'path': '/dev/sdb'} {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 19:25:28 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:25:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1159128139',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1159128139',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUt3tvMqWzGNICVgVAPv+5OiL/y2ghL11denluyj9f24y9bvqoYMGhme0+yc1T6ysCdcqg+PZ0E7hkYE+/Fk0+ZZK5gReWc3DTB+0QPq1QAoZu4IKNKVmZ4OKW/6iZMNA==',key_name='tempest-keypair-1648212708',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83c5f90337e64829893181e7e8140b8c',ramdisk_id='',reservation_id='r-fz70ky08',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1592554729',owner_user_name='tempest-ServerActionsV293TestJSON-1592554729-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:25:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf5efdf2a7324c96b8b9b2370dc7e31c',uuid=391945f6-fe47-4969-a497-bd320d66cfa3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e5f3728a-541f-4b95-9feb-6119687f2eba", "address": "fa:16:3e:9c:60:12", "network": {"id": "3e44df49-3c9c-4812-aafc-ce3f4795874b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-826204178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83c5f90337e64829893181e7e8140b8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5f3728a-54", "ovs_interfaceid": "e5f3728a-541f-4b95-9feb-6119687f2eba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:25:28 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Converting VIF {"id": "e5f3728a-541f-4b95-9feb-6119687f2eba", "address": "fa:16:3e:9c:60:12", "network": {"id": "3e44df49-3c9c-4812-aafc-ce3f4795874b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-826204178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83c5f90337e64829893181e7e8140b8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5f3728a-54", "ovs_interfaceid": "e5f3728a-541f-4b95-9feb-6119687f2eba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:25:28 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:60:12,bridge_name='br-int',has_traffic_filtering=True,id=e5f3728a-541f-4b95-9feb-6119687f2eba,network=Network(3e44df49-3c9c-4812-aafc-ce3f4795874b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5f3728a-54') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:25:28 user nova-compute[75066]: DEBUG nova.objects.instance [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Lazy-loading 'pci_devices' on Instance uuid 391945f6-fe47-4969-a497-bd320d66cfa3 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:25:28 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:25:28 user nova-compute[75066]:   <uuid>391945f6-fe47-4969-a497-bd320d66cfa3</uuid>
Dec 01 19:25:28 user nova-compute[75066]:   <name>instance-0000001a</name>
Dec 01 19:25:28 user nova-compute[75066]:   <memory>524288</memory>
Dec 01 19:25:28 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:25:28 user nova-compute[75066]:   <metadata>
Dec 01 19:25:28 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:25:28 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:25:28 user nova-compute[75066]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1159128139</nova:name>
Dec 01 19:25:28 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:25:27</nova:creationTime>
Dec 01 19:25:28 user nova-compute[75066]:       <nova:flavor name="m1.tiny">
Dec 01 19:25:28 user nova-compute[75066]:         <nova:memory>512</nova:memory>
Dec 01 19:25:28 user nova-compute[75066]:         <nova:disk>1</nova:disk>
Dec 01 19:25:28 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:25:28 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:25:28 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:25:28 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:25:28 user nova-compute[75066]:       <nova:owner>
Dec 01 19:25:28 user nova-compute[75066]:         <nova:user uuid="cf5efdf2a7324c96b8b9b2370dc7e31c">tempest-ServerActionsV293TestJSON-1592554729-project-member</nova:user>
Dec 01 19:25:28 user nova-compute[75066]:         <nova:project uuid="83c5f90337e64829893181e7e8140b8c">tempest-ServerActionsV293TestJSON-1592554729</nova:project>
Dec 01 19:25:28 user nova-compute[75066]:       </nova:owner>
Dec 01 19:25:28 user nova-compute[75066]:       <nova:ports>
Dec 01 19:25:28 user nova-compute[75066]:         <nova:port uuid="e5f3728a-541f-4b95-9feb-6119687f2eba">
Dec 01 19:25:28 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Dec 01 19:25:28 user nova-compute[75066]:         </nova:port>
Dec 01 19:25:28 user nova-compute[75066]:       </nova:ports>
Dec 01 19:25:28 user nova-compute[75066]:     </nova:instance>
Dec 01 19:25:28 user nova-compute[75066]:   </metadata>
Dec 01 19:25:28 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:25:28 user nova-compute[75066]:     <system>
Dec 01 19:25:28 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:25:28 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:25:28 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:25:28 user nova-compute[75066]:       <entry name="serial">391945f6-fe47-4969-a497-bd320d66cfa3</entry>
Dec 01 19:25:28 user nova-compute[75066]:       <entry name="uuid">391945f6-fe47-4969-a497-bd320d66cfa3</entry>
Dec 01 19:25:28 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:25:28 user nova-compute[75066]:     </system>
Dec 01 19:25:28 user nova-compute[75066]:   </sysinfo>
Dec 01 19:25:28 user nova-compute[75066]:   <os>
Dec 01 19:25:28 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:25:28 user nova-compute[75066]:     <boot dev="hd"/>
Dec 01 19:25:28 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:25:28 user nova-compute[75066]:   </os>
Dec 01 19:25:28 user nova-compute[75066]:   <features>
Dec 01 19:25:28 user nova-compute[75066]:     <acpi/>
Dec 01 19:25:28 user nova-compute[75066]:     <apic/>
Dec 01 19:25:28 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:25:28 user nova-compute[75066]:   </features>
Dec 01 19:25:28 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:25:28 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:25:28 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:25:28 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:25:28 user nova-compute[75066]:   </clock>
Dec 01 19:25:28 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:25:28 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:25:28 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:25:28 user nova-compute[75066]:   </cpu>
Dec 01 19:25:28 user nova-compute[75066]:   <devices>
Dec 01 19:25:28 user nova-compute[75066]:     <disk type="block" device="disk">
Dec 01 19:25:28 user nova-compute[75066]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:25:28 user nova-compute[75066]:       <source dev="/dev/sdb"/>
Dec 01 19:25:28 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:25:28 user nova-compute[75066]:       <serial>8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0</serial>
Dec 01 19:25:28 user nova-compute[75066]:     </disk>
Dec 01 19:25:28 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:25:28 user nova-compute[75066]:       <mac address="fa:16:3e:9c:60:12"/>
Dec 01 19:25:28 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:25:28 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:25:28 user nova-compute[75066]:       <target dev="tape5f3728a-54"/>
Dec 01 19:25:28 user nova-compute[75066]:     </interface>
Dec 01 19:25:28 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:25:28 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/391945f6-fe47-4969-a497-bd320d66cfa3/console.log" append="off"/>
Dec 01 19:25:28 user nova-compute[75066]:     </serial>
Dec 01 19:25:28 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:25:28 user nova-compute[75066]:     <video>
Dec 01 19:25:28 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:25:28 user nova-compute[75066]:     </video>
Dec 01 19:25:28 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:25:28 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:25:28 user nova-compute[75066]:     </rng>
Dec 01 19:25:28 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:25:28 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:25:28 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:25:28 user nova-compute[75066]:     </memballoon>
Dec 01 19:25:28 user nova-compute[75066]:   </devices>
Dec 01 19:25:28 user nova-compute[75066]: </domain>
Dec 01 19:25:28 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:25:28 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:25:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1159128139',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1159128139',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUt3tvMqWzGNICVgVAPv+5OiL/y2ghL11denluyj9f24y9bvqoYMGhme0+yc1T6ysCdcqg+PZ0E7hkYE+/Fk0+ZZK5gReWc3DTB+0QPq1QAoZu4IKNKVmZ4OKW/6iZMNA==',key_name='tempest-keypair-1648212708',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83c5f90337e64829893181e7e8140b8c',ramdisk_id='',reservation_id='r-fz70ky08',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1592554729',owner_user_name='tempest-ServerActionsV293TestJSON-1592554729-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:25:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf5efdf2a7324c96b8b9b2370dc7e31c',uuid=391945f6-fe47-4969-a497-bd320d66cfa3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e5f3728a-541f-4b95-9feb-6119687f2eba", "address": "fa:16:3e:9c:60:12", "network": {"id": "3e44df49-3c9c-4812-aafc-ce3f4795874b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-826204178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83c5f90337e64829893181e7e8140b8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5f3728a-54", "ovs_interfaceid": "e5f3728a-541f-4b95-9feb-6119687f2eba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:25:28 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Converting VIF {"id": "e5f3728a-541f-4b95-9feb-6119687f2eba", "address": "fa:16:3e:9c:60:12", "network": {"id": "3e44df49-3c9c-4812-aafc-ce3f4795874b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-826204178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83c5f90337e64829893181e7e8140b8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5f3728a-54", "ovs_interfaceid": "e5f3728a-541f-4b95-9feb-6119687f2eba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:25:28 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:60:12,bridge_name='br-int',has_traffic_filtering=True,id=e5f3728a-541f-4b95-9feb-6119687f2eba,network=Network(3e44df49-3c9c-4812-aafc-ce3f4795874b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5f3728a-54') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:25:28 user nova-compute[75066]: DEBUG os_vif [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:60:12,bridge_name='br-int',has_traffic_filtering=True,id=e5f3728a-541f-4b95-9feb-6119687f2eba,network=Network(3e44df49-3c9c-4812-aafc-ce3f4795874b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5f3728a-54') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:25:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:25:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:25:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '732e3b7f-b0bf-5290-9bd3-0c5f41a640e5', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:25:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:25:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape5f3728a-54, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:25:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape5f3728a-54, col_values=(('qos', UUID('b1e4f1cf-562e-4f04-8b57-60e8571c0977')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:25:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape5f3728a-54, col_values=(('external_ids', {'iface-id': 'e5f3728a-541f-4b95-9feb-6119687f2eba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:60:12', 'vm-uuid': '391945f6-fe47-4969-a497-bd320d66cfa3'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:25:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:25:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:28 user nova-compute[75066]: INFO os_vif [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:60:12,bridge_name='br-int',has_traffic_filtering=True,id=e5f3728a-541f-4b95-9feb-6119687f2eba,network=Network(3e44df49-3c9c-4812-aafc-ce3f4795874b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5f3728a-54')
Dec 01 19:25:28 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:25:28 user nova-compute[75066]: INFO nova.compute.manager [-] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] Took 0.69 seconds to deallocate network for instance.
Dec 01 19:25:28 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:25:28 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] No VIF found with MAC fa:16:3e:9c:60:12, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:25:28 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-fe693c01-42bf-4ecd-9469-2c1de537ad86 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:25:28 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-fe693c01-42bf-4ecd-9469-2c1de537ad86 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:25:28 user nova-compute[75066]: DEBUG nova.compute.manager [req-e7fb1a42-82a1-4f0c-b633-113026cfd625 req-297bb694-e9bd-4a25-bce0-1901fed0027c service nova] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] Received event network-vif-deleted-6c3db9c1-34b1-4671-9553-c3d71eeacb3d {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:25:29 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-fe693c01-42bf-4ecd-9469-2c1de537ad86 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:25:29 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-fe693c01-42bf-4ecd-9469-2c1de537ad86 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:25:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-fe693c01-42bf-4ecd-9469-2c1de537ad86 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.469s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:25:29 user nova-compute[75066]: INFO nova.scheduler.client.report [None req-fe693c01-42bf-4ecd-9469-2c1de537ad86 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Deleted allocations for instance b7d86a5a-c62e-41f7-9f33-1a0c61af6a49
Dec 01 19:25:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-fe693c01-42bf-4ecd-9469-2c1de537ad86 tempest-VolumesAdminNegativeTest-1973855036 tempest-VolumesAdminNegativeTest-1973855036-project-member] Lock "b7d86a5a-c62e-41f7-9f33-1a0c61af6a49" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.323s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:25:29 user nova-compute[75066]: DEBUG nova.compute.manager [req-6e120f2c-d478-489d-8d09-efa92350b3d2 req-9a157256-00ce-4023-bf81-c9c2c96e0471 service nova] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] Received event network-vif-plugged-6c3db9c1-34b1-4671-9553-c3d71eeacb3d {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:25:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-6e120f2c-d478-489d-8d09-efa92350b3d2 req-9a157256-00ce-4023-bf81-c9c2c96e0471 service nova] Acquiring lock "b7d86a5a-c62e-41f7-9f33-1a0c61af6a49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:25:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-6e120f2c-d478-489d-8d09-efa92350b3d2 req-9a157256-00ce-4023-bf81-c9c2c96e0471 service nova] Lock "b7d86a5a-c62e-41f7-9f33-1a0c61af6a49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:25:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-6e120f2c-d478-489d-8d09-efa92350b3d2 req-9a157256-00ce-4023-bf81-c9c2c96e0471 service nova] Lock "b7d86a5a-c62e-41f7-9f33-1a0c61af6a49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:25:29 user nova-compute[75066]: DEBUG nova.compute.manager [req-6e120f2c-d478-489d-8d09-efa92350b3d2 req-9a157256-00ce-4023-bf81-c9c2c96e0471 service nova] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] No waiting events found dispatching network-vif-plugged-6c3db9c1-34b1-4671-9553-c3d71eeacb3d {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:25:29 user nova-compute[75066]: WARNING nova.compute.manager [req-6e120f2c-d478-489d-8d09-efa92350b3d2 req-9a157256-00ce-4023-bf81-c9c2c96e0471 service nova] [instance: b7d86a5a-c62e-41f7-9f33-1a0c61af6a49] Received unexpected event network-vif-plugged-6c3db9c1-34b1-4671-9553-c3d71eeacb3d for instance with vm_state deleted and task_state None.
Dec 01 19:25:29 user nova-compute[75066]: DEBUG nova.compute.manager [req-6e120f2c-d478-489d-8d09-efa92350b3d2 req-9a157256-00ce-4023-bf81-c9c2c96e0471 service nova] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Received event network-changed-2d26e49a-f1a5-4922-b26f-2eb8c3d59368 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:25:29 user nova-compute[75066]: DEBUG nova.compute.manager [req-6e120f2c-d478-489d-8d09-efa92350b3d2 req-9a157256-00ce-4023-bf81-c9c2c96e0471 service nova] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Refreshing instance network info cache due to event network-changed-2d26e49a-f1a5-4922-b26f-2eb8c3d59368. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:25:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-6e120f2c-d478-489d-8d09-efa92350b3d2 req-9a157256-00ce-4023-bf81-c9c2c96e0471 service nova] Acquiring lock "refresh_cache-ecc194b4-b8b9-49c8-9d34-4213c4dc15b8" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:25:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-6e120f2c-d478-489d-8d09-efa92350b3d2 req-9a157256-00ce-4023-bf81-c9c2c96e0471 service nova] Acquired lock "refresh_cache-ecc194b4-b8b9-49c8-9d34-4213c4dc15b8" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:25:29 user nova-compute[75066]: DEBUG nova.network.neutron [req-6e120f2c-d478-489d-8d09-efa92350b3d2 req-9a157256-00ce-4023-bf81-c9c2c96e0471 service nova] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Refreshing network info cache for port 2d26e49a-f1a5-4922-b26f-2eb8c3d59368 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:25:30 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-74ddb5b2-1ab5-4d50-8237-c7e081df4f10 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Acquiring lock "ecc194b4-b8b9-49c8-9d34-4213c4dc15b8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:25:30 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-74ddb5b2-1ab5-4d50-8237-c7e081df4f10 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lock "ecc194b4-b8b9-49c8-9d34-4213c4dc15b8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:25:30 user nova-compute[75066]: DEBUG nova.objects.instance [None req-74ddb5b2-1ab5-4d50-8237-c7e081df4f10 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lazy-loading 'flavor' on Instance uuid ecc194b4-b8b9-49c8-9d34-4213c4dc15b8 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:25:30 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-74ddb5b2-1ab5-4d50-8237-c7e081df4f10 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lock "ecc194b4-b8b9-49c8-9d34-4213c4dc15b8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.121s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:25:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:30 user nova-compute[75066]: DEBUG nova.network.neutron [req-6e120f2c-d478-489d-8d09-efa92350b3d2 req-9a157256-00ce-4023-bf81-c9c2c96e0471 service nova] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Updated VIF entry in instance network info cache for port 2d26e49a-f1a5-4922-b26f-2eb8c3d59368. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:25:30 user nova-compute[75066]: DEBUG nova.network.neutron [req-6e120f2c-d478-489d-8d09-efa92350b3d2 req-9a157256-00ce-4023-bf81-c9c2c96e0471 service nova] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Updating instance_info_cache with network_info: [{"id": "2d26e49a-f1a5-4922-b26f-2eb8c3d59368", "address": "fa:16:3e:f8:79:92", "network": {"id": "191f13ce-a864-4c09-8ca5-e8a106e24d37", "bridge": "br-int", "label": "tempest-TestStampPattern-1604601756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9caae5967744641b7490e1aa91973c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d26e49a-f1", "ovs_interfaceid": "2d26e49a-f1a5-4922-b26f-2eb8c3d59368", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:25:30 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-6e120f2c-d478-489d-8d09-efa92350b3d2 req-9a157256-00ce-4023-bf81-c9c2c96e0471 service nova] Releasing lock "refresh_cache-ecc194b4-b8b9-49c8-9d34-4213c4dc15b8" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:25:30 user nova-compute[75066]: DEBUG nova.compute.manager [req-127e2c92-8f3f-4ed8-99b4-f06f8a077afb req-b653b637-3c69-4327-9dcd-7bb2e48cda44 service nova] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Received event network-vif-plugged-e5f3728a-541f-4b95-9feb-6119687f2eba {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:25:30 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-127e2c92-8f3f-4ed8-99b4-f06f8a077afb req-b653b637-3c69-4327-9dcd-7bb2e48cda44 service nova] Acquiring lock "391945f6-fe47-4969-a497-bd320d66cfa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:25:30 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-127e2c92-8f3f-4ed8-99b4-f06f8a077afb req-b653b637-3c69-4327-9dcd-7bb2e48cda44 service nova] Lock "391945f6-fe47-4969-a497-bd320d66cfa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:25:30 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-127e2c92-8f3f-4ed8-99b4-f06f8a077afb req-b653b637-3c69-4327-9dcd-7bb2e48cda44 service nova] Lock "391945f6-fe47-4969-a497-bd320d66cfa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:25:30 user nova-compute[75066]: DEBUG nova.compute.manager [req-127e2c92-8f3f-4ed8-99b4-f06f8a077afb req-b653b637-3c69-4327-9dcd-7bb2e48cda44 service nova] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] No waiting events found dispatching network-vif-plugged-e5f3728a-541f-4b95-9feb-6119687f2eba {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:25:30 user nova-compute[75066]: WARNING nova.compute.manager [req-127e2c92-8f3f-4ed8-99b4-f06f8a077afb req-b653b637-3c69-4327-9dcd-7bb2e48cda44 service nova] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Received unexpected event network-vif-plugged-e5f3728a-541f-4b95-9feb-6119687f2eba for instance with vm_state building and task_state spawning.
Dec 01 19:25:30 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-74ddb5b2-1ab5-4d50-8237-c7e081df4f10 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Acquiring lock "ecc194b4-b8b9-49c8-9d34-4213c4dc15b8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:25:30 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-74ddb5b2-1ab5-4d50-8237-c7e081df4f10 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lock "ecc194b4-b8b9-49c8-9d34-4213c4dc15b8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:25:30 user nova-compute[75066]: INFO nova.compute.manager [None req-74ddb5b2-1ab5-4d50-8237-c7e081df4f10 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Attaching volume a92743d8-a8b8-440f-af8f-03cd472feb7b to /dev/vdb
Dec 01 19:25:30 user nova-compute[75066]: DEBUG os_brick.utils [None req-74ddb5b2-1ab5-4d50-8237-c7e081df4f10 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:25:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:25:30 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1243039-5994-4dbb-9984-c49ef8d357e3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1959854982f\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:25:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:25:30 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[7183b782-e906-4b4a-979b-07afc7c593ff]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:25:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:25:30 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[1156cf5c-44f7-4710-ba8f-ddebf51edcc2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:25:30 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97d2618-b733-42c0-abca-24d0dfd4a028]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:25:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-74ddb5b2-1ab5-4d50-8237-c7e081df4f10 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Running cmd (subprocess): nvme version {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-74ddb5b2-1ab5-4d50-8237-c7e081df4f10 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] 'nvme version' failed. Not Retrying. {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:25:30 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.nvmeof [None req-74ddb5b2-1ab5-4d50-8237-c7e081df4f10 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] nvme not present on system {{(pid=75066) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 19:25:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:25:30 user nova-compute[75066]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 19:25:30 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbac7eca-c3c6-4ea8-8b01-b01b30e042ee]: (4, '') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:25:30 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-74ddb5b2-1ab5-4d50-8237-c7e081df4f10 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75066) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 19:25:30 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-74ddb5b2-1ab5-4d50-8237-c7e081df4f10 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 19:25:30 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-74ddb5b2-1ab5-4d50-8237-c7e081df4f10 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] LIGHTOS: no hostnqn found. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 19:25:30 user nova-compute[75066]: DEBUG os_brick.utils [None req-74ddb5b2-1ab5-4d50-8237-c7e081df4f10 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1959854982f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:25:30 user nova-compute[75066]: DEBUG nova.virt.block_device [None req-74ddb5b2-1ab5-4d50-8237-c7e081df4f10 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Updating existing volume attachment record: d7a66c44-ecce-4a7c-a00c-ffba3a3525c4 {{(pid=75066) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 19:25:31 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:31 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:32 user nova-compute[75066]: DEBUG nova.compute.manager [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Instance event wait completed in 0 seconds for  {{(pid=75066) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 19:25:32 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Guest created on hypervisor {{(pid=75066) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 19:25:32 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Instance spawned successfully.
Dec 01 19:25:32 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 19:25:32 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Found default for hw_cdrom_bus of ide {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:25:32 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Found default for hw_disk_bus of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:25:32 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Found default for hw_input_bus of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:25:32 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Found default for hw_pointer_model of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:25:32 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Found default for hw_video_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:25:32 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Found default for hw_vif_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:25:32 user nova-compute[75066]: INFO nova.compute.manager [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Took 5.34 seconds to spawn the instance on the hypervisor.
Dec 01 19:25:32 user nova-compute[75066]: DEBUG nova.compute.manager [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:25:32 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:32 user nova-compute[75066]: INFO nova.compute.manager [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Took 16.06 seconds to build instance.
Dec 01 19:25:32 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c0c5c6d6-94ad-4c6b-82a1-a968c140ec4a tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Lock "391945f6-fe47-4969-a497-bd320d66cfa3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.160s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:25:32 user nova-compute[75066]: DEBUG nova.compute.manager [req-239f8980-a0e0-41dd-8d7d-5766c6a79545 req-3c00e62d-f34d-439e-a0ab-648d25575655 service nova] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Received event network-vif-plugged-e5f3728a-541f-4b95-9feb-6119687f2eba {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:25:32 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-239f8980-a0e0-41dd-8d7d-5766c6a79545 req-3c00e62d-f34d-439e-a0ab-648d25575655 service nova] Acquiring lock "391945f6-fe47-4969-a497-bd320d66cfa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:25:32 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-239f8980-a0e0-41dd-8d7d-5766c6a79545 req-3c00e62d-f34d-439e-a0ab-648d25575655 service nova] Lock "391945f6-fe47-4969-a497-bd320d66cfa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:25:32 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-239f8980-a0e0-41dd-8d7d-5766c6a79545 req-3c00e62d-f34d-439e-a0ab-648d25575655 service nova] Lock "391945f6-fe47-4969-a497-bd320d66cfa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:25:32 user nova-compute[75066]: DEBUG nova.compute.manager [req-239f8980-a0e0-41dd-8d7d-5766c6a79545 req-3c00e62d-f34d-439e-a0ab-648d25575655 service nova] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] No waiting events found dispatching network-vif-plugged-e5f3728a-541f-4b95-9feb-6119687f2eba {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:25:32 user nova-compute[75066]: WARNING nova.compute.manager [req-239f8980-a0e0-41dd-8d7d-5766c6a79545 req-3c00e62d-f34d-439e-a0ab-648d25575655 service nova] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Received unexpected event network-vif-plugged-e5f3728a-541f-4b95-9feb-6119687f2eba for instance with vm_state active and task_state None.
Dec 01 19:25:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:37 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:40 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74ddb5b2-1ab5-4d50-8237-c7e081df4f10 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Calling os-brick to attach iSCSI Volume {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 19:25:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ddb5b2-1ab5-4d50-8237-c7e081df4f10 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a92743d8-a8b8-440f-af8f-03cd472feb7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'avKiuBgm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:25:40 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-74ddb5b2-1ab5-4d50-8237-c7e081df4f10 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:25:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-74ddb5b2-1ab5-4d50-8237-c7e081df4f10 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:25:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-74ddb5b2-1ab5-4d50-8237-c7e081df4f10 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:25:40 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-74ddb5b2-1ab5-4d50-8237-c7e081df4f10 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:25:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-74ddb5b2-1ab5-4d50-8237-c7e081df4f10 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a92743d8-a8b8-440f-af8f-03cd472feb7b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:25:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-74ddb5b2-1ab5-4d50-8237-c7e081df4f10 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a92743d8-a8b8-440f-af8f-03cd472feb7b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:25:40 user nova-compute[75066]: INFO os_brick.initiator.connectors.iscsi [None req-74ddb5b2-1ab5-4d50-8237-c7e081df4f10 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 19:25:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a92743d8-a8b8-440f-af8f-03cd472feb7b -p 172.16.0.220:3260 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a92743d8-a8b8-440f-af8f-03cd472feb7b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:25:40 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7ed77c-f378-4322-837c-914f5a90d0c2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:25:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ddb5b2-1ab5-4d50-8237-c7e081df4f10 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 19:25:40 user nova-compute[75066]:  {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:25:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a92743d8-a8b8-440f-af8f-03cd472feb7b -p 172.16.0.220:3260 --interface default --op new {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a92743d8-a8b8-440f-af8f-03cd472feb7b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:25:40 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d16bc4c-c866-41c1-ab0b-204756e5083f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a92743d8-a8b8-440f-af8f-03cd472feb7b] added\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:25:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ddb5b2-1ab5-4d50-8237-c7e081df4f10 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a92743d8-a8b8-440f-af8f-03cd472feb7b] added
Dec 01 19:25:40 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:25:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a92743d8-a8b8-440f-af8f-03cd472feb7b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a92743d8-a8b8-440f-af8f-03cd472feb7b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:25:40 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91af061-73b2-4634-b85c-da7988574341]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:25:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ddb5b2-1ab5-4d50-8237-c7e081df4f10 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:25:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a92743d8-a8b8-440f-af8f-03cd472feb7b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a92743d8-a8b8-440f-af8f-03cd472feb7b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:25:40 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[228178c7-d4f7-42e3-9405-7821d1e9faaf]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:25:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ddb5b2-1ab5-4d50-8237-c7e081df4f10 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:25:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a92743d8-a8b8-440f-af8f-03cd472feb7b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v avKiuBgm {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a92743d8-a8b8-440f-af8f-03cd472feb7b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v avKiuBgm" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:25:40 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb4ccf59-6da0-485e-abe1-b1b9b6543886]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:25:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ddb5b2-1ab5-4d50-8237-c7e081df4f10 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'avKiuBgm'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:25:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a92743d8-a8b8-440f-af8f-03cd472feb7b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a92743d8-a8b8-440f-af8f-03cd472feb7b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:25:40 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf5ca93-fd7f-47ec-b562-064da3385d42]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:25:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ddb5b2-1ab5-4d50-8237-c7e081df4f10 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:25:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:25:40 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b99758-a4a0-4b3f-be12-281eeb4ec340]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:25:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ddb5b2-1ab5-4d50-8237-c7e081df4f10 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:25:40 user nova-compute[75066]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)
Dec 01 19:25:40 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:25:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ddb5b2-1ab5-4d50-8237-c7e081df4f10 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:25:40 user nova-compute[75066]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)
Dec 01 19:25:40 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:25:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a92743d8-a8b8-440f-af8f-03cd472feb7b -p 172.16.0.220:3260 --login {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a92743d8-a8b8-440f-af8f-03cd472feb7b -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:25:40 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[736baea2-83a9-4c8f-ab7b-91a08859cc04]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a92743d8-a8b8-440f-af8f-03cd472feb7b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a92743d8-a8b8-440f-af8f-03cd472feb7b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:25:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ddb5b2-1ab5-4d50-8237-c7e081df4f10 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a92743d8-a8b8-440f-af8f-03cd472feb7b, portal: 172.16.0.220,3260]
Dec 01 19:25:40 user nova-compute[75066]: Login to [iface: default, target: iqn.2010-10.org.openstack:a92743d8-a8b8-440f-af8f-03cd472feb7b, portal: 172.16.0.220,3260] successful.
Dec 01 19:25:40 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:25:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a92743d8-a8b8-440f-af8f-03cd472feb7b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a92743d8-a8b8-440f-af8f-03cd472feb7b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:25:40 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5de47c-45e5-4511-8b4e-c7aec7dd170b]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:25:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ddb5b2-1ab5-4d50-8237-c7e081df4f10 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:25:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:25:40 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d4aae7-112b-4628-b295-19c26d851252]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a92743d8-a8b8-440f-af8f-03cd472feb7b (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:25:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ddb5b2-1ab5-4d50-8237-c7e081df4f10 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:25:40 user nova-compute[75066]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)
Dec 01 19:25:40 user nova-compute[75066]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a92743d8-a8b8-440f-af8f-03cd472feb7b (non-flash)
Dec 01 19:25:40 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:25:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ddb5b2-1ab5-4d50-8237-c7e081df4f10 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:25:40 user nova-compute[75066]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)
Dec 01 19:25:40 user nova-compute[75066]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a92743d8-a8b8-440f-af8f-03cd472feb7b (non-flash)
Dec 01 19:25:40 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:25:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-74ddb5b2-1ab5-4d50-8237-c7e081df4f10 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a92743d8-a8b8-440f-af8f-03cd472feb7b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:25:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ddb5b2-1ab5-4d50-8237-c7e081df4f10 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Connected to 172.16.0.220:3260 {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 19:25:40 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-74ddb5b2-1ab5-4d50-8237-c7e081df4f10 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] HCTL ('34', '-', '-', 0) found on session 27 with lun 0 {{(pid=75066) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 19:25:40 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-74ddb5b2-1ab5-4d50-8237-c7e081df4f10 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75066) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 19:25:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:25:40 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba43e4b-e105-475e-8c0d-9563026663dd]: (4, ('- - 0', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:25:40 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-74ddb5b2-1ab5-4d50-8237-c7e081df4f10 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: None {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:25:41 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-74ddb5b2-1ab5-4d50-8237-c7e081df4f10 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:25:41 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ddb5b2-1ab5-4d50-8237-c7e081df4f10 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a92743d8-a8b8-440f-af8f-03cd472feb7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'avKiuBgm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 19:25:41 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-74ddb5b2-1ab5-4d50-8237-c7e081df4f10 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:25:41 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-74ddb5b2-1ab5-4d50-8237-c7e081df4f10 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '23735373137646562', 'path': '/dev/sdc'} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:25:41 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74ddb5b2-1ab5-4d50-8237-c7e081df4f10 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23735373137646562', 'path': '/dev/sdc'} {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 19:25:41 user nova-compute[75066]: DEBUG nova.objects.instance [None req-74ddb5b2-1ab5-4d50-8237-c7e081df4f10 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lazy-loading 'flavor' on Instance uuid ecc194b4-b8b9-49c8-9d34-4213c4dc15b8 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:25:41 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-74ddb5b2-1ab5-4d50-8237-c7e081df4f10 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 19:25:41 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:25:41 user nova-compute[75066]:   <source dev="/dev/sdc"/>
Dec 01 19:25:41 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:25:41 user nova-compute[75066]:   <serial>a92743d8-a8b8-440f-af8f-03cd472feb7b</serial>
Dec 01 19:25:41 user nova-compute[75066]: </disk>
Dec 01 19:25:41 user nova-compute[75066]:  {{(pid=75066) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 19:25:41 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-74ddb5b2-1ab5-4d50-8237-c7e081df4f10 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:25:41 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-74ddb5b2-1ab5-4d50-8237-c7e081df4f10 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:25:41 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-74ddb5b2-1ab5-4d50-8237-c7e081df4f10 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] No VIF found with MAC fa:16:3e:f8:79:92, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:25:42 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-74ddb5b2-1ab5-4d50-8237-c7e081df4f10 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lock "ecc194b4-b8b9-49c8-9d34-4213c4dc15b8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.378s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:25:42 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:43 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-386ceeab-9183-4290-8901-b3f6cce03dc1 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Acquiring lock "ecc194b4-b8b9-49c8-9d34-4213c4dc15b8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:25:43 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-386ceeab-9183-4290-8901-b3f6cce03dc1 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lock "ecc194b4-b8b9-49c8-9d34-4213c4dc15b8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:25:43 user nova-compute[75066]: INFO nova.compute.manager [None req-386ceeab-9183-4290-8901-b3f6cce03dc1 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Detaching volume a92743d8-a8b8-440f-af8f-03cd472feb7b
Dec 01 19:25:43 user nova-compute[75066]: INFO nova.virt.block_device [None req-386ceeab-9183-4290-8901-b3f6cce03dc1 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Attempting to driver detach volume a92743d8-a8b8-440f-af8f-03cd472feb7b from mountpoint /dev/vdb
Dec 01 19:25:43 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-386ceeab-9183-4290-8901-b3f6cce03dc1 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Attempting to detach device vdb from instance ecc194b4-b8b9-49c8-9d34-4213c4dc15b8 from the persistent domain config. {{(pid=75066) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 19:25:43 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-386ceeab-9183-4290-8901-b3f6cce03dc1 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 19:25:43 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:25:43 user nova-compute[75066]:   <source dev="/dev/sdc"/>
Dec 01 19:25:43 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:25:43 user nova-compute[75066]:   <serial>a92743d8-a8b8-440f-af8f-03cd472feb7b</serial>
Dec 01 19:25:43 user nova-compute[75066]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 19:25:43 user nova-compute[75066]: </disk>
Dec 01 19:25:43 user nova-compute[75066]:  {{(pid=75066) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 19:25:43 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-386ceeab-9183-4290-8901-b3f6cce03dc1 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Successfully detached device vdb from instance ecc194b4-b8b9-49c8-9d34-4213c4dc15b8 from the persistent domain config.
Dec 01 19:25:43 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-386ceeab-9183-4290-8901-b3f6cce03dc1 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ecc194b4-b8b9-49c8-9d34-4213c4dc15b8 from the live domain config. {{(pid=75066) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 19:25:43 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-386ceeab-9183-4290-8901-b3f6cce03dc1 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 19:25:43 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:25:43 user nova-compute[75066]:   <source dev="/dev/sdc"/>
Dec 01 19:25:43 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:25:43 user nova-compute[75066]:   <serial>a92743d8-a8b8-440f-af8f-03cd472feb7b</serial>
Dec 01 19:25:43 user nova-compute[75066]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 19:25:43 user nova-compute[75066]: </disk>
Dec 01 19:25:43 user nova-compute[75066]:  {{(pid=75066) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 19:25:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:44 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-386ceeab-9183-4290-8901-b3f6cce03dc1 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ecc194b4-b8b9-49c8-9d34-4213c4dc15b8 {{(pid=75066) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 19:25:47 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:48 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:52 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-049f094f-7bd7-4981-9c67-c2f4db637de6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Acquiring lock "23e17727-40b4-48f7-9155-abc8ffa9f619" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:25:52 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-049f094f-7bd7-4981-9c67-c2f4db637de6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "23e17727-40b4-48f7-9155-abc8ffa9f619" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:25:52 user nova-compute[75066]: DEBUG nova.objects.instance [None req-049f094f-7bd7-4981-9c67-c2f4db637de6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lazy-loading 'flavor' on Instance uuid 23e17727-40b4-48f7-9155-abc8ffa9f619 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:25:52 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-049f094f-7bd7-4981-9c67-c2f4db637de6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "23e17727-40b4-48f7-9155-abc8ffa9f619" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:25:52 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-049f094f-7bd7-4981-9c67-c2f4db637de6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Acquiring lock "23e17727-40b4-48f7-9155-abc8ffa9f619" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:25:52 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-049f094f-7bd7-4981-9c67-c2f4db637de6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "23e17727-40b4-48f7-9155-abc8ffa9f619" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:25:52 user nova-compute[75066]: INFO nova.compute.manager [None req-049f094f-7bd7-4981-9c67-c2f4db637de6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Attaching volume 70247d7d-96cf-4e91-9969-caa1b67610fd to /dev/vdb
Dec 01 19:25:52 user nova-compute[75066]: DEBUG os_brick.utils [None req-049f094f-7bd7-4981-9c67-c2f4db637de6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:25:52 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:52 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:25:52 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[dacff080-c322-49c2-b182-dcc76a313d0b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1959854982f\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:25:52 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:52 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:25:52 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02ede1b-4c6c-4156-8530-a071ece340a2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:25:52 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:53 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:25:53 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[151b5a5b-9745-4d1d-b034-5869ffba99a8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:25:53 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ac9556-6c5a-4738-a096-58866411152f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:25:53 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-049f094f-7bd7-4981-9c67-c2f4db637de6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Running cmd (subprocess): nvme version {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:53 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-049f094f-7bd7-4981-9c67-c2f4db637de6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] 'nvme version' failed. Not Retrying. {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:25:53 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.nvmeof [None req-049f094f-7bd7-4981-9c67-c2f4db637de6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] nvme not present on system {{(pid=75066) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 19:25:53 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:25:53 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:25:53 user nova-compute[75066]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 19:25:53 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[850f2d98-02be-45b7-82ce-4c3ba5b7443a]: (4, '') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:25:53 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-049f094f-7bd7-4981-9c67-c2f4db637de6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75066) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 19:25:53 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-049f094f-7bd7-4981-9c67-c2f4db637de6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 19:25:53 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-049f094f-7bd7-4981-9c67-c2f4db637de6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] LIGHTOS: no hostnqn found. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 19:25:53 user nova-compute[75066]: DEBUG os_brick.utils [None req-049f094f-7bd7-4981-9c67-c2f4db637de6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1959854982f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:25:53 user nova-compute[75066]: DEBUG nova.virt.block_device [None req-049f094f-7bd7-4981-9c67-c2f4db637de6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Updating existing volume attachment record: 0d3c2603-acf6-4273-bf62-21f2b06d0cf8 {{(pid=75066) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 19:25:53 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:25:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:00 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:26:00 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:02 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-049f094f-7bd7-4981-9c67-c2f4db637de6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Calling os-brick to attach iSCSI Volume {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 19:26:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-049f094f-7bd7-4981-9c67-c2f4db637de6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xAPSKUhw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:26:02 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-049f094f-7bd7-4981-9c67-c2f4db637de6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:26:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-049f094f-7bd7-4981-9c67-c2f4db637de6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:26:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-049f094f-7bd7-4981-9c67-c2f4db637de6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:26:02 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-049f094f-7bd7-4981-9c67-c2f4db637de6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:26:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-049f094f-7bd7-4981-9c67-c2f4db637de6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:26:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-049f094f-7bd7-4981-9c67-c2f4db637de6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.006s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:26:02 user nova-compute[75066]: INFO os_brick.initiator.connectors.iscsi [None req-049f094f-7bd7-4981-9c67-c2f4db637de6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 19:26:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd -p 172.16.0.220:3260 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:02 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f79c53-4088-4229-bca9-2131ab63d9ae]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:26:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-049f094f-7bd7-4981-9c67-c2f4db637de6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 19:26:02 user nova-compute[75066]:  {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:26:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd -p 172.16.0.220:3260 --interface default --op new {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:02 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[13627dfa-5ad9-42db-9e94-c23371aa8afd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd] added\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:26:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-049f094f-7bd7-4981-9c67-c2f4db637de6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd] added
Dec 01 19:26:02 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:26:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:02 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[0257e91c-d37a-45db-817c-b7514abe30d4]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:26:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-049f094f-7bd7-4981-9c67-c2f4db637de6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:26:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:02 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a56398-6bd5-4fa8-8de5-6b39083f73d1]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:26:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-049f094f-7bd7-4981-9c67-c2f4db637de6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:26:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xAPSKUhw {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xAPSKUhw" returned: 0 in 0.022s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:02 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb46dcc2-9a24-4ea4-bdd3-e59355cb47fb]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:26:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-049f094f-7bd7-4981-9c67-c2f4db637de6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xAPSKUhw'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:26:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:02 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[732a0af9-84bb-4bd2-a38a-fa2a4c992f46]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:26:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-049f094f-7bd7-4981-9c67-c2f4db637de6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:26:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:02 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65976ff-594a-42d0-84e3-b9b42cd08b47]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a92743d8-a8b8-440f-af8f-03cd472feb7b (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:26:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-049f094f-7bd7-4981-9c67-c2f4db637de6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:26:02 user nova-compute[75066]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)
Dec 01 19:26:02 user nova-compute[75066]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a92743d8-a8b8-440f-af8f-03cd472feb7b (non-flash)
Dec 01 19:26:02 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:26:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-049f094f-7bd7-4981-9c67-c2f4db637de6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:26:02 user nova-compute[75066]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)
Dec 01 19:26:02 user nova-compute[75066]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a92743d8-a8b8-440f-af8f-03cd472feb7b (non-flash)
Dec 01 19:26:02 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:26:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd -p 172.16.0.220:3260 --login {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:02 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[146179eb-9bd9-4640-b200-27df0c28da23]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:26:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-049f094f-7bd7-4981-9c67-c2f4db637de6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd, portal: 172.16.0.220,3260]
Dec 01 19:26:02 user nova-compute[75066]: Login to [iface: default, target: iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd, portal: 172.16.0.220,3260] successful.
Dec 01 19:26:02 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:26:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:02 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[109bcf58-923e-4081-b874-7f7ca7e47149]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:26:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-049f094f-7bd7-4981-9c67-c2f4db637de6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:26:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:02 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ba73a2-9d92-4a2d-8990-5d19ffddcbaf]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a92743d8-a8b8-440f-af8f-03cd472feb7b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:26:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-049f094f-7bd7-4981-9c67-c2f4db637de6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:26:02 user nova-compute[75066]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)
Dec 01 19:26:02 user nova-compute[75066]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a92743d8-a8b8-440f-af8f-03cd472feb7b (non-flash)
Dec 01 19:26:02 user nova-compute[75066]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd (non-flash)
Dec 01 19:26:02 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:26:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-049f094f-7bd7-4981-9c67-c2f4db637de6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:26:02 user nova-compute[75066]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)
Dec 01 19:26:02 user nova-compute[75066]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a92743d8-a8b8-440f-af8f-03cd472feb7b (non-flash)
Dec 01 19:26:02 user nova-compute[75066]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd (non-flash)
Dec 01 19:26:02 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:26:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-049f094f-7bd7-4981-9c67-c2f4db637de6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:26:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-049f094f-7bd7-4981-9c67-c2f4db637de6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Connected to 172.16.0.220:3260 {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 19:26:02 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-049f094f-7bd7-4981-9c67-c2f4db637de6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] HCTL ('35', '-', '-', 0) found on session 28 with lun 0 {{(pid=75066) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 19:26:02 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-049f094f-7bd7-4981-9c67-c2f4db637de6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75066) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 19:26:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:02 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[3417d579-3250-4371-aa1c-90909e77be33]: (4, ('- - 0', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:26:02 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-049f094f-7bd7-4981-9c67-c2f4db637de6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Searching for a device in session 28 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:26:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-049f094f-7bd7-4981-9c67-c2f4db637de6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xAPSKUhw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 19:26:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:03 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:26:03 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75066) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 01 19:26:03 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-049f094f-7bd7-4981-9c67-c2f4db637de6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:26:03 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-049f094f-7bd7-4981-9c67-c2f4db637de6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '23433353335323966', 'path': '/dev/sdd'} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:26:03 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-049f094f-7bd7-4981-9c67-c2f4db637de6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23433353335323966', 'path': '/dev/sdd'} {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 19:26:03 user nova-compute[75066]: DEBUG nova.objects.instance [None req-049f094f-7bd7-4981-9c67-c2f4db637de6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lazy-loading 'flavor' on Instance uuid 23e17727-40b4-48f7-9155-abc8ffa9f619 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:26:03 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-049f094f-7bd7-4981-9c67-c2f4db637de6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 19:26:03 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:26:03 user nova-compute[75066]:   <source dev="/dev/sdd"/>
Dec 01 19:26:03 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:26:03 user nova-compute[75066]:   <serial>70247d7d-96cf-4e91-9969-caa1b67610fd</serial>
Dec 01 19:26:03 user nova-compute[75066]: </disk>
Dec 01 19:26:03 user nova-compute[75066]:  {{(pid=75066) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 19:26:03 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Acquiring lock "3b355778-bd25-42f6-8026-110668920d8b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:26:03 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "3b355778-bd25-42f6-8026-110668920d8b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:26:03 user nova-compute[75066]: DEBUG nova.compute.manager [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Starting instance... {{(pid=75066) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 19:26:03 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:26:03 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:26:03 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75066) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 19:26:03 user nova-compute[75066]: INFO nova.compute.claims [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Claim successful on node user
Dec 01 19:26:03 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:03 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-049f094f-7bd7-4981-9c67-c2f4db637de6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:26:03 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-049f094f-7bd7-4981-9c67-c2f4db637de6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:26:03 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-049f094f-7bd7-4981-9c67-c2f4db637de6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] No VIF found with MAC fa:16:3e:fe:93:cc, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-049f094f-7bd7-4981-9c67-c2f4db637de6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "23e17727-40b4-48f7-9155-abc8ffa9f619" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.156s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:26:04 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-386ceeab-9183-4290-8901-b3f6cce03dc1 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ecc194b4-b8b9-49c8-9d34-4213c4dc15b8 is timed out.
Dec 01 19:26:04 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-386ceeab-9183-4290-8901-b3f6cce03dc1 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Successfully detached device vdb from instance ecc194b4-b8b9-49c8-9d34-4213c4dc15b8 from the live domain config.
Dec 01 19:26:04 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-386ceeab-9183-4290-8901-b3f6cce03dc1 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] calling os-brick to detach iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-386ceeab-9183-4290-8901-b3f6cce03dc1 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, {'target_iqn': 'iqn.2010-10.org.openstack:a92743d8-a8b8-440f-af8f-03cd472feb7b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'avKiuBgm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:26:04 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-386ceeab-9183-4290-8901-b3f6cce03dc1 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:26:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-386ceeab-9183-4290-8901-b3f6cce03dc1 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-386ceeab-9183-4290-8901-b3f6cce03dc1 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.466s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG nova.compute.manager [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Start building networks asynchronously for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[e667881b-65d0-42cb-8677-d983542565bb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a92743d8-a8b8-440f-af8f-03cd472feb7b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-386ceeab-9183-4290-8901-b3f6cce03dc1 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 19:26:04 user nova-compute[75066]: No targets found.
Dec 01 19:26:04 user nova-compute[75066]: iSNS:
Dec 01 19:26:04 user nova-compute[75066]: No targets found.
Dec 01 19:26:04 user nova-compute[75066]: STATIC:
Dec 01 19:26:04 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0
Dec 01 19:26:04 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:26:04 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:26:04 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd
Dec 01 19:26:04 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:26:04 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:26:04 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb
Dec 01 19:26:04 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:26:04 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:26:04 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:a92743d8-a8b8-440f-af8f-03cd472feb7b
Dec 01 19:26:04 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:26:04 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:26:04 user nova-compute[75066]: FIRMWARE:
Dec 01 19:26:04 user nova-compute[75066]: No targets found.
Dec 01 19:26:04 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-386ceeab-9183-4290-8901-b3f6cce03dc1 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 19:26:04 user nova-compute[75066]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 19:26:04 user nova-compute[75066]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75066) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-386ceeab-9183-4290-8901-b3f6cce03dc1 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a92743d8-a8b8-440f-af8f-03cd472feb7b', 0)] {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0affae-6243-477f-8710-c71c14e06735]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a92743d8-a8b8-440f-af8f-03cd472feb7b\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[bccf5e62-3b31-477d-a743-98941ce4ea1c]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a92743d8-a8b8-440f-af8f-03cd472feb7b (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG nova.compute.manager [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Allocating IP information in the background. {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG nova.network.neutron [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: 3b355778-bd25-42f6-8026-110668920d8b] allocate_for_instance() {{(pid=75066) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-386ceeab-9183-4290-8901-b3f6cce03dc1 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:26:04 user nova-compute[75066]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)
Dec 01 19:26:04 user nova-compute[75066]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a92743d8-a8b8-440f-af8f-03cd472feb7b (non-flash)
Dec 01 19:26:04 user nova-compute[75066]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd (non-flash)
Dec 01 19:26:04 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-386ceeab-9183-4290-8901-b3f6cce03dc1 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:26:04 user nova-compute[75066]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)
Dec 01 19:26:04 user nova-compute[75066]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a92743d8-a8b8-440f-af8f-03cd472feb7b (non-flash)
Dec 01 19:26:04 user nova-compute[75066]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd (non-flash)
Dec 01 19:26:04 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-386ceeab-9183-4290-8901-b3f6cce03dc1 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9190163a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a92743d8-a8b8-440f-af8f-03cd472feb7b'): ({'sdc'}, set())}) {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-386ceeab-9183-4290-8901-b3f6cce03dc1 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Removing single pathed devices sdc {{(pid=75066) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:04 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 19:26:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a23380-37d0-4d06-bbc0-8f491bb17f63]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG nova.compute.manager [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Start building block device mappings for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d3d7aa9-4514-45ce-9ef3-1c2e8c19fdd4]: (4, ('ok\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-386ceeab-9183-4290-8901-b3f6cce03dc1 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Flushing IO for device /dev/sdc {{(pid=75066) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde447cd-1406-4bda-a867-407a249fac6f]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-386ceeab-9183-4290-8901-b3f6cce03dc1 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75066) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG nova.policy [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2e047112719c414d900ccb2adccf963a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '492e0b2da61e4e4f9ea991df15531e24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75066) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe477f0-2664-461e-90d8-fa24242057ac]: (4, ('1', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-386ceeab-9183-4290-8901-b3f6cce03dc1 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-386ceeab-9183-4290-8901-b3f6cce03dc1 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] SCSI volumes sdc have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-386ceeab-9183-4290-8901-b3f6cce03dc1 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a92743d8-a8b8-440f-af8f-03cd472feb7b')] {{(pid=75066) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a92743d8-a8b8-440f-af8f-03cd472feb7b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a92743d8-a8b8-440f-af8f-03cd472feb7b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad8e110-b473-44a0-b363-542b54928244]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-386ceeab-9183-4290-8901-b3f6cce03dc1 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a92743d8-a8b8-440f-af8f-03cd472feb7b -p 172.16.0.220:3260 --logout {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG nova.compute.manager [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Start spawning the instance on the hypervisor. {{(pid=75066) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Creating instance directory {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 19:26:04 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Creating image(s)
Dec 01 19:26:04 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Acquiring lock "/opt/stack/data/nova/instances/3b355778-bd25-42f6-8026-110668920d8b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "/opt/stack/data/nova/instances/3b355778-bd25-42f6-8026-110668920d8b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "/opt/stack/data/nova/instances/3b355778-bd25-42f6-8026-110668920d8b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a92743d8-a8b8-440f-af8f-03cd472feb7b -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a29c20-327b-4957-9283-cb831466c010]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:a92743d8-a8b8-440f-af8f-03cd472feb7b, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:a92743d8-a8b8-440f-af8f-03cd472feb7b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-386ceeab-9183-4290-8901-b3f6cce03dc1 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:a92743d8-a8b8-440f-af8f-03cd472feb7b, portal: 172.16.0.220,3260]
Dec 01 19:26:04 user nova-compute[75066]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:a92743d8-a8b8-440f-af8f-03cd472feb7b, portal: 172.16.0.220,3260] successful.
Dec 01 19:26:04 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a92743d8-a8b8-440f-af8f-03cd472feb7b -p 172.16.0.220:3260 --op delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a92743d8-a8b8-440f-af8f-03cd472feb7b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[703cdcb2-7bae-423d-8767-6a24c8dc3d0c]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-386ceeab-9183-4290-8901-b3f6cce03dc1 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-386ceeab-9183-4290-8901-b3f6cce03dc1 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-386ceeab-9183-4290-8901-b3f6cce03dc1 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] <== disconnect_volume: return (305ms) None {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-386ceeab-9183-4290-8901-b3f6cce03dc1 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Disconnected iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.190s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Acquiring lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.183s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/3b355778-bd25-42f6-8026-110668920d8b/disk 1073741824 {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/3b355778-bd25-42f6-8026-110668920d8b/disk 1073741824" returned: 0 in 0.258s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.447s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:26:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:05 user nova-compute[75066]: DEBUG nova.network.neutron [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Successfully created port: 918beedf-26db-4ea9-be7b-5170ca29ee52 {{(pid=75066) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 19:26:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.176s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:05 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3b355778-bd25-42f6-8026-110668920d8b/disk. size=1073741824 {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 19:26:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b355778-bd25-42f6-8026-110668920d8b/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:05 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:26:05 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:26:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:26:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:26:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:26:05 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75066) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 19:26:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b355778-bd25-42f6-8026-110668920d8b/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:05 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Cannot resize image /opt/stack/data/nova/instances/3b355778-bd25-42f6-8026-110668920d8b/disk to a smaller size. {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 19:26:05 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Created local disks {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 19:26:05 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Ensure instance console log exists: /opt/stack/data/nova/instances/3b355778-bd25-42f6-8026-110668920d8b/console.log {{(pid=75066) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 19:26:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:26:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:26:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:26:05 user nova-compute[75066]: DEBUG nova.objects.instance [None req-386ceeab-9183-4290-8901-b3f6cce03dc1 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lazy-loading 'flavor' on Instance uuid ecc194b4-b8b9-49c8-9d34-4213c4dc15b8 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:26:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a553e030-0d69-4725-9f84-6c0c63556ed4/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-386ceeab-9183-4290-8901-b3f6cce03dc1 tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lock "ecc194b4-b8b9-49c8-9d34-4213c4dc15b8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.888s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:26:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a553e030-0d69-4725-9f84-6c0c63556ed4/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a553e030-0d69-4725-9f84-6c0c63556ed4/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a553e030-0d69-4725-9f84-6c0c63556ed4/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e32ba192-38b9-46f0-b164-1652a43cf3d2/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG nova.network.neutron [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Successfully updated port: 918beedf-26db-4ea9-be7b-5170ca29ee52 {{(pid=75066) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Acquiring lock "refresh_cache-3b355778-bd25-42f6-8026-110668920d8b" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Acquired lock "refresh_cache-3b355778-bd25-42f6-8026-110668920d8b" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG nova.network.neutron [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG nova.compute.manager [req-b7e1877f-4d8b-4d26-91e1-57347698c6c5 req-69f7d7ea-9f0c-4ed1-bb1b-98e5c5858088 service nova] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Received event network-changed-918beedf-26db-4ea9-be7b-5170ca29ee52 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG nova.compute.manager [req-b7e1877f-4d8b-4d26-91e1-57347698c6c5 req-69f7d7ea-9f0c-4ed1-bb1b-98e5c5858088 service nova] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Refreshing instance network info cache due to event network-changed-918beedf-26db-4ea9-be7b-5170ca29ee52. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-b7e1877f-4d8b-4d26-91e1-57347698c6c5 req-69f7d7ea-9f0c-4ed1-bb1b-98e5c5858088 service nova] Acquiring lock "refresh_cache-3b355778-bd25-42f6-8026-110668920d8b" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e32ba192-38b9-46f0-b164-1652a43cf3d2/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e32ba192-38b9-46f0-b164-1652a43cf3d2/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG nova.network.neutron [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e32ba192-38b9-46f0-b164-1652a43cf3d2/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecc194b4-b8b9-49c8-9d34-4213c4dc15b8/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG nova.network.neutron [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Updating instance_info_cache with network_info: [{"id": "918beedf-26db-4ea9-be7b-5170ca29ee52", "address": "fa:16:3e:e9:75:23", "network": {"id": "4a6c6c26-4d29-486c-b11e-fc53769083ea", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1139388453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "492e0b2da61e4e4f9ea991df15531e24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap918beedf-26", "ovs_interfaceid": "918beedf-26db-4ea9-be7b-5170ca29ee52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Releasing lock "refresh_cache-3b355778-bd25-42f6-8026-110668920d8b" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG nova.compute.manager [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Instance network_info: |[{"id": "918beedf-26db-4ea9-be7b-5170ca29ee52", "address": "fa:16:3e:e9:75:23", "network": {"id": "4a6c6c26-4d29-486c-b11e-fc53769083ea", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1139388453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "492e0b2da61e4e4f9ea991df15531e24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap918beedf-26", "ovs_interfaceid": "918beedf-26db-4ea9-be7b-5170ca29ee52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-b7e1877f-4d8b-4d26-91e1-57347698c6c5 req-69f7d7ea-9f0c-4ed1-bb1b-98e5c5858088 service nova] Acquired lock "refresh_cache-3b355778-bd25-42f6-8026-110668920d8b" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG nova.network.neutron [req-b7e1877f-4d8b-4d26-91e1-57347698c6c5 req-69f7d7ea-9f0c-4ed1-bb1b-98e5c5858088 service nova] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Refreshing network info cache for port 918beedf-26db-4ea9-be7b-5170ca29ee52 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Start _get_guest_xml network_info=[{"id": "918beedf-26db-4ea9-be7b-5170ca29ee52", "address": "fa:16:3e:e9:75:23", "network": {"id": "4a6c6c26-4d29-486c-b11e-fc53769083ea", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1139388453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "492e0b2da61e4e4f9ea991df15531e24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap918beedf-26", "ovs_interfaceid": "918beedf-26db-4ea9-be7b-5170ca29ee52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'image_id': '900b237b-e99c-4fdd-a44f-dcb7a08baa86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:26:06 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:26:06 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:26:06 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecc194b4-b8b9-49c8-9d34-4213c4dc15b8/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecc194b4-b8b9-49c8-9d34-4213c4dc15b8/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:26:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-557600286',display_name='tempest-AttachVolumeTestJSON-server-557600286',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-557600286',id=27,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdWHJWeGP/AbZ3+1EtOkP8/eRZQqjpXhplJYgQLvS/jvHZ7vDtJCnd+UiVCBh0FxacrsX/W32e4T18M3x1h1aGCAQU31BjWAQ155GKtUM+Z6Z0gELHUmAkZPicLTDxLoQ==',key_name='tempest-keypair-276144069',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='492e0b2da61e4e4f9ea991df15531e24',ramdisk_id='',reservation_id='r-5t5zqdps',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1914192398',owner_user_name='tempest-AttachVolumeTestJSON-1914192398-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:26:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e047112719c414d900ccb2adccf963a',uuid=3b355778-bd25-42f6-8026-110668920d8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "918beedf-26db-4ea9-be7b-5170ca29ee52", "address": "fa:16:3e:e9:75:23", "network": {"id": "4a6c6c26-4d29-486c-b11e-fc53769083ea", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1139388453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "492e0b2da61e4e4f9ea991df15531e24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap918beedf-26", "ovs_interfaceid": "918beedf-26db-4ea9-be7b-5170ca29ee52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Converting VIF {"id": "918beedf-26db-4ea9-be7b-5170ca29ee52", "address": "fa:16:3e:e9:75:23", "network": {"id": "4a6c6c26-4d29-486c-b11e-fc53769083ea", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1139388453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "492e0b2da61e4e4f9ea991df15531e24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap918beedf-26", "ovs_interfaceid": "918beedf-26db-4ea9-be7b-5170ca29ee52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:75:23,bridge_name='br-int',has_traffic_filtering=True,id=918beedf-26db-4ea9-be7b-5170ca29ee52,network=Network(4a6c6c26-4d29-486c-b11e-fc53769083ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap918beedf-26') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG nova.objects.instance [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lazy-loading 'pci_devices' on Instance uuid 3b355778-bd25-42f6-8026-110668920d8b {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: 3b355778-bd25-42f6-8026-110668920d8b] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:26:06 user nova-compute[75066]:   <uuid>3b355778-bd25-42f6-8026-110668920d8b</uuid>
Dec 01 19:26:06 user nova-compute[75066]:   <name>instance-0000001b</name>
Dec 01 19:26:06 user nova-compute[75066]:   <memory>524288</memory>
Dec 01 19:26:06 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:26:06 user nova-compute[75066]:   <metadata>
Dec 01 19:26:06 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:26:06 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:26:06 user nova-compute[75066]:       <nova:name>tempest-AttachVolumeTestJSON-server-557600286</nova:name>
Dec 01 19:26:06 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:26:06</nova:creationTime>
Dec 01 19:26:06 user nova-compute[75066]:       <nova:flavor name="m1.tiny">
Dec 01 19:26:06 user nova-compute[75066]:         <nova:memory>512</nova:memory>
Dec 01 19:26:06 user nova-compute[75066]:         <nova:disk>1</nova:disk>
Dec 01 19:26:06 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:26:06 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:26:06 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:26:06 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:26:06 user nova-compute[75066]:       <nova:owner>
Dec 01 19:26:06 user nova-compute[75066]:         <nova:user uuid="2e047112719c414d900ccb2adccf963a">tempest-AttachVolumeTestJSON-1914192398-project-member</nova:user>
Dec 01 19:26:06 user nova-compute[75066]:         <nova:project uuid="492e0b2da61e4e4f9ea991df15531e24">tempest-AttachVolumeTestJSON-1914192398</nova:project>
Dec 01 19:26:06 user nova-compute[75066]:       </nova:owner>
Dec 01 19:26:06 user nova-compute[75066]:       <nova:root type="image" uuid="900b237b-e99c-4fdd-a44f-dcb7a08baa86"/>
Dec 01 19:26:06 user nova-compute[75066]:       <nova:ports>
Dec 01 19:26:06 user nova-compute[75066]:         <nova:port uuid="918beedf-26db-4ea9-be7b-5170ca29ee52">
Dec 01 19:26:06 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Dec 01 19:26:06 user nova-compute[75066]:         </nova:port>
Dec 01 19:26:06 user nova-compute[75066]:       </nova:ports>
Dec 01 19:26:06 user nova-compute[75066]:     </nova:instance>
Dec 01 19:26:06 user nova-compute[75066]:   </metadata>
Dec 01 19:26:06 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:26:06 user nova-compute[75066]:     <system>
Dec 01 19:26:06 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:26:06 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:26:06 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:26:06 user nova-compute[75066]:       <entry name="serial">3b355778-bd25-42f6-8026-110668920d8b</entry>
Dec 01 19:26:06 user nova-compute[75066]:       <entry name="uuid">3b355778-bd25-42f6-8026-110668920d8b</entry>
Dec 01 19:26:06 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:26:06 user nova-compute[75066]:     </system>
Dec 01 19:26:06 user nova-compute[75066]:   </sysinfo>
Dec 01 19:26:06 user nova-compute[75066]:   <os>
Dec 01 19:26:06 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:26:06 user nova-compute[75066]:     <boot dev="hd"/>
Dec 01 19:26:06 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:26:06 user nova-compute[75066]:   </os>
Dec 01 19:26:06 user nova-compute[75066]:   <features>
Dec 01 19:26:06 user nova-compute[75066]:     <acpi/>
Dec 01 19:26:06 user nova-compute[75066]:     <apic/>
Dec 01 19:26:06 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:26:06 user nova-compute[75066]:   </features>
Dec 01 19:26:06 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:26:06 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:26:06 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:26:06 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:26:06 user nova-compute[75066]:   </clock>
Dec 01 19:26:06 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:26:06 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:26:06 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:26:06 user nova-compute[75066]:   </cpu>
Dec 01 19:26:06 user nova-compute[75066]:   <devices>
Dec 01 19:26:06 user nova-compute[75066]:     <disk type="file" device="disk">
Dec 01 19:26:06 user nova-compute[75066]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 19:26:06 user nova-compute[75066]:       <source file="/opt/stack/data/nova/instances/3b355778-bd25-42f6-8026-110668920d8b/disk"/>
Dec 01 19:26:06 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:26:06 user nova-compute[75066]:     </disk>
Dec 01 19:26:06 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:26:06 user nova-compute[75066]:       <mac address="fa:16:3e:e9:75:23"/>
Dec 01 19:26:06 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:26:06 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:26:06 user nova-compute[75066]:       <target dev="tap918beedf-26"/>
Dec 01 19:26:06 user nova-compute[75066]:     </interface>
Dec 01 19:26:06 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:26:06 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/3b355778-bd25-42f6-8026-110668920d8b/console.log" append="off"/>
Dec 01 19:26:06 user nova-compute[75066]:     </serial>
Dec 01 19:26:06 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:26:06 user nova-compute[75066]:     <video>
Dec 01 19:26:06 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:26:06 user nova-compute[75066]:     </video>
Dec 01 19:26:06 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:26:06 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:26:06 user nova-compute[75066]:     </rng>
Dec 01 19:26:06 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:26:06 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:26:06 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:26:06 user nova-compute[75066]:     </memballoon>
Dec 01 19:26:06 user nova-compute[75066]:   </devices>
Dec 01 19:26:06 user nova-compute[75066]: </domain>
Dec 01 19:26:06 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:26:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-557600286',display_name='tempest-AttachVolumeTestJSON-server-557600286',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-557600286',id=27,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdWHJWeGP/AbZ3+1EtOkP8/eRZQqjpXhplJYgQLvS/jvHZ7vDtJCnd+UiVCBh0FxacrsX/W32e4T18M3x1h1aGCAQU31BjWAQ155GKtUM+Z6Z0gELHUmAkZPicLTDxLoQ==',key_name='tempest-keypair-276144069',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='492e0b2da61e4e4f9ea991df15531e24',ramdisk_id='',reservation_id='r-5t5zqdps',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1914192398',owner_user_name='tempest-AttachVolumeTestJSON-1914192398-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:26:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e047112719c414d900ccb2adccf963a',uuid=3b355778-bd25-42f6-8026-110668920d8b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "918beedf-26db-4ea9-be7b-5170ca29ee52", "address": "fa:16:3e:e9:75:23", "network": {"id": "4a6c6c26-4d29-486c-b11e-fc53769083ea", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1139388453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "492e0b2da61e4e4f9ea991df15531e24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap918beedf-26", "ovs_interfaceid": "918beedf-26db-4ea9-be7b-5170ca29ee52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Converting VIF {"id": "918beedf-26db-4ea9-be7b-5170ca29ee52", "address": "fa:16:3e:e9:75:23", "network": {"id": "4a6c6c26-4d29-486c-b11e-fc53769083ea", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1139388453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "492e0b2da61e4e4f9ea991df15531e24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap918beedf-26", "ovs_interfaceid": "918beedf-26db-4ea9-be7b-5170ca29ee52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e9:75:23,bridge_name='br-int',has_traffic_filtering=True,id=918beedf-26db-4ea9-be7b-5170ca29ee52,network=Network(4a6c6c26-4d29-486c-b11e-fc53769083ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap918beedf-26') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG os_vif [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:75:23,bridge_name='br-int',has_traffic_filtering=True,id=918beedf-26db-4ea9-be7b-5170ca29ee52,network=Network(4a6c6c26-4d29-486c-b11e-fc53769083ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap918beedf-26') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd13fe593-d997-55dc-9426-09698660f056', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap918beedf-26, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap918beedf-26, col_values=(('qos', UUID('b32ef438-f2cd-427a-8dce-a48d069b614a')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap918beedf-26, col_values=(('external_ids', {'iface-id': '918beedf-26db-4ea9-be7b-5170ca29ee52', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e9:75:23', 'vm-uuid': '3b355778-bd25-42f6-8026-110668920d8b'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:06 user nova-compute[75066]: INFO os_vif [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e9:75:23,bridge_name='br-int',has_traffic_filtering=True,id=918beedf-26db-4ea9-be7b-5170ca29ee52,network=Network(4a6c6c26-4d29-486c-b11e-fc53769083ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap918beedf-26')
Dec 01 19:26:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ecc194b4-b8b9-49c8-9d34-4213c4dc15b8/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] No VIF found with MAC fa:16:3e:e9:75:23, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG nova.network.neutron [req-b7e1877f-4d8b-4d26-91e1-57347698c6c5 req-69f7d7ea-9f0c-4ed1-bb1b-98e5c5858088 service nova] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Updated VIF entry in instance network info cache for port 918beedf-26db-4ea9-be7b-5170ca29ee52. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG nova.network.neutron [req-b7e1877f-4d8b-4d26-91e1-57347698c6c5 req-69f7d7ea-9f0c-4ed1-bb1b-98e5c5858088 service nova] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Updating instance_info_cache with network_info: [{"id": "918beedf-26db-4ea9-be7b-5170ca29ee52", "address": "fa:16:3e:e9:75:23", "network": {"id": "4a6c6c26-4d29-486c-b11e-fc53769083ea", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1139388453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "492e0b2da61e4e4f9ea991df15531e24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap918beedf-26", "ovs_interfaceid": "918beedf-26db-4ea9-be7b-5170ca29ee52", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:26:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-b7e1877f-4d8b-4d26-91e1-57347698c6c5 req-69f7d7ea-9f0c-4ed1-bb1b-98e5c5858088 service nova] Releasing lock "refresh_cache-3b355778-bd25-42f6-8026-110668920d8b" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:26:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23e17727-40b4-48f7-9155-abc8ffa9f619/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23e17727-40b4-48f7-9155-abc8ffa9f619/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23e17727-40b4-48f7-9155-abc8ffa9f619/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23e17727-40b4-48f7-9155-abc8ffa9f619/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:07 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:26:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk.rescue --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk.rescue --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:08 user nova-compute[75066]: DEBUG nova.compute.manager [req-d9b473ac-986b-4852-b681-46aad864a97a req-c825d2a9-838b-40dd-807d-0d977c6b32d1 service nova] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Received event network-vif-plugged-918beedf-26db-4ea9-be7b-5170ca29ee52 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:26:08 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d9b473ac-986b-4852-b681-46aad864a97a req-c825d2a9-838b-40dd-807d-0d977c6b32d1 service nova] Acquiring lock "3b355778-bd25-42f6-8026-110668920d8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:26:08 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d9b473ac-986b-4852-b681-46aad864a97a req-c825d2a9-838b-40dd-807d-0d977c6b32d1 service nova] Lock "3b355778-bd25-42f6-8026-110668920d8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:26:08 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d9b473ac-986b-4852-b681-46aad864a97a req-c825d2a9-838b-40dd-807d-0d977c6b32d1 service nova] Lock "3b355778-bd25-42f6-8026-110668920d8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:26:08 user nova-compute[75066]: DEBUG nova.compute.manager [req-d9b473ac-986b-4852-b681-46aad864a97a req-c825d2a9-838b-40dd-807d-0d977c6b32d1 service nova] [instance: 3b355778-bd25-42f6-8026-110668920d8b] No waiting events found dispatching network-vif-plugged-918beedf-26db-4ea9-be7b-5170ca29ee52 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:26:08 user nova-compute[75066]: WARNING nova.compute.manager [req-d9b473ac-986b-4852-b681-46aad864a97a req-c825d2a9-838b-40dd-807d-0d977c6b32d1 service nova] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Received unexpected event network-vif-plugged-918beedf-26db-4ea9-be7b-5170ca29ee52 for instance with vm_state building and task_state spawning.
Dec 01 19:26:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk.rescue --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk.rescue --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:09 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:26:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84b8c28-e79e-4945-8f3c-dddd7184a166/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84b8c28-e79e-4945-8f3c-dddd7184a166/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84b8c28-e79e-4945-8f3c-dddd7184a166/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84b8c28-e79e-4945-8f3c-dddd7184a166/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:10 user nova-compute[75066]: DEBUG nova.compute.manager [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Instance event wait completed in 0 seconds for  {{(pid=75066) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 19:26:10 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Guest created on hypervisor {{(pid=75066) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 19:26:10 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:26:10 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:26:10 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Hypervisor/Node resource view: name=user free_ram=7326MB free_disk=24.836288452148438GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75066) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 19:26:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:26:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:26:10 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Instance spawned successfully.
Dec 01 19:26:10 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 19:26:10 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Found default for hw_cdrom_bus of ide {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:26:10 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Found default for hw_disk_bus of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:26:10 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Found default for hw_input_bus of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:26:10 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Found default for hw_pointer_model of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:26:10 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Found default for hw_video_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:26:10 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Found default for hw_vif_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:26:10 user nova-compute[75066]: INFO nova.compute.manager [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Took 5.87 seconds to spawn the instance on the hypervisor.
Dec 01 19:26:10 user nova-compute[75066]: DEBUG nova.compute.manager [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:26:10 user nova-compute[75066]: DEBUG nova.compute.manager [req-7233441d-9092-4807-aced-02f43da7e5ba req-23a4fee4-ab82-4854-afce-be7ce4046fcf service nova] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Received event network-vif-plugged-918beedf-26db-4ea9-be7b-5170ca29ee52 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:26:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-7233441d-9092-4807-aced-02f43da7e5ba req-23a4fee4-ab82-4854-afce-be7ce4046fcf service nova] Acquiring lock "3b355778-bd25-42f6-8026-110668920d8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:26:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-7233441d-9092-4807-aced-02f43da7e5ba req-23a4fee4-ab82-4854-afce-be7ce4046fcf service nova] Lock "3b355778-bd25-42f6-8026-110668920d8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:26:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-7233441d-9092-4807-aced-02f43da7e5ba req-23a4fee4-ab82-4854-afce-be7ce4046fcf service nova] Lock "3b355778-bd25-42f6-8026-110668920d8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:26:10 user nova-compute[75066]: DEBUG nova.compute.manager [req-7233441d-9092-4807-aced-02f43da7e5ba req-23a4fee4-ab82-4854-afce-be7ce4046fcf service nova] [instance: 3b355778-bd25-42f6-8026-110668920d8b] No waiting events found dispatching network-vif-plugged-918beedf-26db-4ea9-be7b-5170ca29ee52 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:26:10 user nova-compute[75066]: WARNING nova.compute.manager [req-7233441d-9092-4807-aced-02f43da7e5ba req-23a4fee4-ab82-4854-afce-be7ce4046fcf service nova] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Received unexpected event network-vif-plugged-918beedf-26db-4ea9-be7b-5170ca29ee52 for instance with vm_state building and task_state spawning.
Dec 01 19:26:10 user nova-compute[75066]: INFO nova.compute.manager [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Took 6.65 seconds to build instance.
Dec 01 19:26:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-f4fa8f39-7a71-4f13-b185-fe34ea992a52 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "3b355778-bd25-42f6-8026-110668920d8b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.745s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:26:10 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance c223be70-8b9c-46d4-9b5a-3b83dfc05a17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:26:10 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 90c49be6-97aa-45f1-bcbe-b9a3875226a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:26:10 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance d564b128-598b-4ad4-8618-afa4dc8a7347 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:26:10 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 14de9d20-9e66-4517-b904-2967e0a06a97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:26:10 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance a553e030-0d69-4725-9f84-6c0c63556ed4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:26:10 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:26:10 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance ecc194b4-b8b9-49c8-9d34-4213c4dc15b8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:26:10 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 23e17727-40b4-48f7-9155-abc8ffa9f619 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:26:10 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance e84b8c28-e79e-4945-8f3c-dddd7184a166 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:26:10 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance e32ba192-38b9-46f0-b164-1652a43cf3d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:26:10 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 391945f6-fe47-4969-a497-bd320d66cfa3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:26:10 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 3b355778-bd25-42f6-8026-110668920d8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:26:10 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 19:26:10 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 19:26:10 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Refreshing inventories for resource provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 01 19:26:10 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Updating ProviderTree inventory for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 01 19:26:10 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Updating inventory in ProviderTree for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 01 19:26:10 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Refreshing aggregate associations for resource provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62, aggregates: None {{(pid=75066) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 01 19:26:10 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Refreshing trait associations for resource provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62, traits: COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SECURITY_UEFI_SECURE_BOOT {{(pid=75066) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 01 19:26:10 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:26:10 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:26:10 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Compute_service record updated for user:user {{(pid=75066) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 19:26:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.794s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:26:10 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:26:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:12 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:26:12 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:26:12 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Starting heal instance info cache {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 19:26:12 user nova-compute[75066]: DEBUG nova.compute.manager [req-75d99de2-8560-4dca-a2d3-30b3af2c5feb req-5eecdd6f-3636-4605-8dd0-348bcc8d484c service nova] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Received event network-changed-902b1013-6c79-4a5a-ab19-782ac8dc715b {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:26:12 user nova-compute[75066]: DEBUG nova.compute.manager [req-75d99de2-8560-4dca-a2d3-30b3af2c5feb req-5eecdd6f-3636-4605-8dd0-348bcc8d484c service nova] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Refreshing instance network info cache due to event network-changed-902b1013-6c79-4a5a-ab19-782ac8dc715b. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:26:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-75d99de2-8560-4dca-a2d3-30b3af2c5feb req-5eecdd6f-3636-4605-8dd0-348bcc8d484c service nova] Acquiring lock "refresh_cache-23e17727-40b4-48f7-9155-abc8ffa9f619" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:26:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-75d99de2-8560-4dca-a2d3-30b3af2c5feb req-5eecdd6f-3636-4605-8dd0-348bcc8d484c service nova] Acquired lock "refresh_cache-23e17727-40b4-48f7-9155-abc8ffa9f619" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:26:12 user nova-compute[75066]: DEBUG nova.network.neutron [req-75d99de2-8560-4dca-a2d3-30b3af2c5feb req-5eecdd6f-3636-4605-8dd0-348bcc8d484c service nova] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Refreshing network info cache for port 902b1013-6c79-4a5a-ab19-782ac8dc715b {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:26:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "refresh_cache-d564b128-598b-4ad4-8618-afa4dc8a7347" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:26:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquired lock "refresh_cache-d564b128-598b-4ad4-8618-afa4dc8a7347" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:26:12 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Forcefully refreshing network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 19:26:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:12 user nova-compute[75066]: DEBUG nova.network.neutron [req-75d99de2-8560-4dca-a2d3-30b3af2c5feb req-5eecdd6f-3636-4605-8dd0-348bcc8d484c service nova] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Updated VIF entry in instance network info cache for port 902b1013-6c79-4a5a-ab19-782ac8dc715b. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:26:12 user nova-compute[75066]: DEBUG nova.network.neutron [req-75d99de2-8560-4dca-a2d3-30b3af2c5feb req-5eecdd6f-3636-4605-8dd0-348bcc8d484c service nova] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Updating instance_info_cache with network_info: [{"id": "902b1013-6c79-4a5a-ab19-782ac8dc715b", "address": "fa:16:3e:fe:93:cc", "network": {"id": "4fe4d56e-afe2-42a6-984a-9af8bc5377a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126385357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5326c00d464e008337e0dc8577fc2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap902b1013-6c", "ovs_interfaceid": "902b1013-6c79-4a5a-ab19-782ac8dc715b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:26:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-75d99de2-8560-4dca-a2d3-30b3af2c5feb req-5eecdd6f-3636-4605-8dd0-348bcc8d484c service nova] Releasing lock "refresh_cache-23e17727-40b4-48f7-9155-abc8ffa9f619" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:26:12 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Updating instance_info_cache with network_info: [{"id": "4850dc75-0d93-4536-abc1-a981dd385d96", "address": "fa:16:3e:fc:d1:96", "network": {"id": "47c850ae-6dcb-4977-a02a-e32cd3df4749", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-475363603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "943324a514a84cb4947dbab93abc4f6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4850dc75-0d", "ovs_interfaceid": "4850dc75-0d93-4536-abc1-a981dd385d96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:26:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Releasing lock "refresh_cache-d564b128-598b-4ad4-8618-afa4dc8a7347" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:26:12 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Updated the network info_cache for instance {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 19:26:12 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:26:12 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:26:12 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:26:12 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75066) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 19:26:12 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:26:12 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Cleaning up deleted instances {{(pid=75066) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 01 19:26:13 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] There are 0 instances to clean {{(pid=75066) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 01 19:26:14 user nova-compute[75066]: DEBUG nova.compute.manager [req-231b42c6-689b-4b5e-b9bc-6c804cdd343f req-f8b4e7ea-48de-4fc9-9328-48ce4f30d136 service nova] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Received event network-changed-902b1013-6c79-4a5a-ab19-782ac8dc715b {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:26:14 user nova-compute[75066]: DEBUG nova.compute.manager [req-231b42c6-689b-4b5e-b9bc-6c804cdd343f req-f8b4e7ea-48de-4fc9-9328-48ce4f30d136 service nova] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Refreshing instance network info cache due to event network-changed-902b1013-6c79-4a5a-ab19-782ac8dc715b. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:26:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-231b42c6-689b-4b5e-b9bc-6c804cdd343f req-f8b4e7ea-48de-4fc9-9328-48ce4f30d136 service nova] Acquiring lock "refresh_cache-23e17727-40b4-48f7-9155-abc8ffa9f619" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:26:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-231b42c6-689b-4b5e-b9bc-6c804cdd343f req-f8b4e7ea-48de-4fc9-9328-48ce4f30d136 service nova] Acquired lock "refresh_cache-23e17727-40b4-48f7-9155-abc8ffa9f619" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:26:14 user nova-compute[75066]: DEBUG nova.network.neutron [req-231b42c6-689b-4b5e-b9bc-6c804cdd343f req-f8b4e7ea-48de-4fc9-9328-48ce4f30d136 service nova] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Refreshing network info cache for port 902b1013-6c79-4a5a-ab19-782ac8dc715b {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:26:14 user nova-compute[75066]: DEBUG nova.network.neutron [req-231b42c6-689b-4b5e-b9bc-6c804cdd343f req-f8b4e7ea-48de-4fc9-9328-48ce4f30d136 service nova] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Updated VIF entry in instance network info cache for port 902b1013-6c79-4a5a-ab19-782ac8dc715b. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:26:14 user nova-compute[75066]: DEBUG nova.network.neutron [req-231b42c6-689b-4b5e-b9bc-6c804cdd343f req-f8b4e7ea-48de-4fc9-9328-48ce4f30d136 service nova] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Updating instance_info_cache with network_info: [{"id": "902b1013-6c79-4a5a-ab19-782ac8dc715b", "address": "fa:16:3e:fe:93:cc", "network": {"id": "4fe4d56e-afe2-42a6-984a-9af8bc5377a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126385357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5326c00d464e008337e0dc8577fc2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap902b1013-6c", "ovs_interfaceid": "902b1013-6c79-4a5a-ab19-782ac8dc715b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:26:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-231b42c6-689b-4b5e-b9bc-6c804cdd343f req-f8b4e7ea-48de-4fc9-9328-48ce4f30d136 service nova] Releasing lock "refresh_cache-23e17727-40b4-48f7-9155-abc8ffa9f619" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:26:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:17 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:19 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Acquiring lock "23e17727-40b4-48f7-9155-abc8ffa9f619" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:26:19 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "23e17727-40b4-48f7-9155-abc8ffa9f619" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:26:19 user nova-compute[75066]: INFO nova.compute.manager [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Rebooting instance
Dec 01 19:26:19 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Acquiring lock "refresh_cache-23e17727-40b4-48f7-9155-abc8ffa9f619" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:26:19 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Acquired lock "refresh_cache-23e17727-40b4-48f7-9155-abc8ffa9f619" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:26:19 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:26:20 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Updating instance_info_cache with network_info: [{"id": "902b1013-6c79-4a5a-ab19-782ac8dc715b", "address": "fa:16:3e:fe:93:cc", "network": {"id": "4fe4d56e-afe2-42a6-984a-9af8bc5377a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126385357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5326c00d464e008337e0dc8577fc2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap902b1013-6c", "ovs_interfaceid": "902b1013-6c79-4a5a-ab19-782ac8dc715b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:26:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Releasing lock "refresh_cache-23e17727-40b4-48f7-9155-abc8ffa9f619" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:26:20 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:26:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:20 user nova-compute[75066]: DEBUG nova.compute.manager [req-28e65592-819c-4236-9125-77c88c664270 req-887ae3f7-5712-4ff7-9f91-a8a739543a27 service nova] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Received event network-vif-unplugged-902b1013-6c79-4a5a-ab19-782ac8dc715b {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:26:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-28e65592-819c-4236-9125-77c88c664270 req-887ae3f7-5712-4ff7-9f91-a8a739543a27 service nova] Acquiring lock "23e17727-40b4-48f7-9155-abc8ffa9f619-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:26:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-28e65592-819c-4236-9125-77c88c664270 req-887ae3f7-5712-4ff7-9f91-a8a739543a27 service nova] Lock "23e17727-40b4-48f7-9155-abc8ffa9f619-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:26:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-28e65592-819c-4236-9125-77c88c664270 req-887ae3f7-5712-4ff7-9f91-a8a739543a27 service nova] Lock "23e17727-40b4-48f7-9155-abc8ffa9f619-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:26:20 user nova-compute[75066]: DEBUG nova.compute.manager [req-28e65592-819c-4236-9125-77c88c664270 req-887ae3f7-5712-4ff7-9f91-a8a739543a27 service nova] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] No waiting events found dispatching network-vif-unplugged-902b1013-6c79-4a5a-ab19-782ac8dc715b {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:26:20 user nova-compute[75066]: WARNING nova.compute.manager [req-28e65592-819c-4236-9125-77c88c664270 req-887ae3f7-5712-4ff7-9f91-a8a739543a27 service nova] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Received unexpected event network-vif-unplugged-902b1013-6c79-4a5a-ab19-782ac8dc715b for instance with vm_state active and task_state reboot_started_hard.
Dec 01 19:26:21 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Instance destroyed successfully.
Dec 01 19:26:21 user nova-compute[75066]: DEBUG nova.objects.instance [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lazy-loading 'resources' on Instance uuid 23e17727-40b4-48f7-9155-abc8ffa9f619 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:23:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1401953060',display_name='tempest-TestMinimumBasicScenario-server-1401953060',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1401953060',id=23,image_ref='5632f29c-8b44-432c-88c6-02567939cb91',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQs/30B1+efn0s6ylAyaZU6Z3hXoydPhUb7ZPkYfCAu2HdecYo2d432waybQvON1UMMmv9wZKmPPC/QNvONmacAOntBzffLTnAROursLsedELFAEGhWq1DVqf4nlmD2xw==',key_name='tempest-TestMinimumBasicScenario-1507068812',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:24:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1d5326c00d464e008337e0dc8577fc2d',ramdisk_id='',reservation_id='r-ytr9w0in',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5632f29c-8b44-432c-88c6-02567939cb91',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-555382044',owner_user_name='tempest-TestMinimumBasicScenario-555382044-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:26:20Z,user_data=None,user_id='eeb6ade6e91541b5b737150a67b6bd39',uuid=23e17727-40b4-48f7-9155-abc8ffa9f619,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "902b1013-6c79-4a5a-ab19-782ac8dc715b", "address": "fa:16:3e:fe:93:cc", "network": {"id": "4fe4d56e-afe2-42a6-984a-9af8bc5377a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126385357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5326c00d464e008337e0dc8577fc2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap902b1013-6c", "ovs_interfaceid": "902b1013-6c79-4a5a-ab19-782ac8dc715b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Converting VIF {"id": "902b1013-6c79-4a5a-ab19-782ac8dc715b", "address": "fa:16:3e:fe:93:cc", "network": {"id": "4fe4d56e-afe2-42a6-984a-9af8bc5377a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126385357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5326c00d464e008337e0dc8577fc2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap902b1013-6c", "ovs_interfaceid": "902b1013-6c79-4a5a-ab19-782ac8dc715b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:93:cc,bridge_name='br-int',has_traffic_filtering=True,id=902b1013-6c79-4a5a-ab19-782ac8dc715b,network=Network(4fe4d56e-afe2-42a6-984a-9af8bc5377a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap902b1013-6c') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG os_vif [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:93:cc,bridge_name='br-int',has_traffic_filtering=True,id=902b1013-6c79-4a5a-ab19-782ac8dc715b,network=Network(4fe4d56e-afe2-42a6-984a-9af8bc5377a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap902b1013-6c') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap902b1013-6c, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c09b5059-f6e8-44cd-b7c4-a9b90faee778) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:21 user nova-compute[75066]: INFO os_vif [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:93:cc,bridge_name='br-int',has_traffic_filtering=True,id=902b1013-6c79-4a5a-ab19-782ac8dc715b,network=Network(4fe4d56e-afe2-42a6-984a-9af8bc5377a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap902b1013-6c')
Dec 01 19:26:21 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] calling os-brick to detach iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, {'target_iqn': 'iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xAPSKUhw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:26:21 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:26:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[70da1e46-97eb-436c-9ea1-e70f29240ef8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 19:26:21 user nova-compute[75066]: No targets found.
Dec 01 19:26:21 user nova-compute[75066]: iSNS:
Dec 01 19:26:21 user nova-compute[75066]: No targets found.
Dec 01 19:26:21 user nova-compute[75066]: STATIC:
Dec 01 19:26:21 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0
Dec 01 19:26:21 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:26:21 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:26:21 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd
Dec 01 19:26:21 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:26:21 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:26:21 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb
Dec 01 19:26:21 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:26:21 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:26:21 user nova-compute[75066]: FIRMWARE:
Dec 01 19:26:21 user nova-compute[75066]: No targets found.
Dec 01 19:26:21 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 19:26:21 user nova-compute[75066]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 19:26:21 user nova-compute[75066]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75066) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd', 0)] {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f259d1-f63f-4afe-b19f-1a323aa45fed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d8c3ec-f010-4ffe-983f-fb7745b2d82e]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:26:21 user nova-compute[75066]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)
Dec 01 19:26:21 user nova-compute[75066]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd (non-flash)
Dec 01 19:26:21 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:26:21 user nova-compute[75066]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)
Dec 01 19:26:21 user nova-compute[75066]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd (non-flash)
Dec 01 19:26:21 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91707f0040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd'): ({'sdd'}, set())}) {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Removing single pathed devices sdd {{(pid=75066) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[5368bedb-83ac-4830-968d-8419d12c3528]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c864e91-35be-4cc8-9eda-bcc94130ddf4]: (4, ('ok\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Flushing IO for device /dev/sdd {{(pid=75066) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95f9b23-aaad-47ed-9f22-fee95c44be66]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75066) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[102c4f80-13e5-4f0f-acd5-0cc4b49f28b0]: (4, ('1', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] SCSI volumes sdd have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd')] {{(pid=75066) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[28fc2bea-a607-475f-bd09-ef798ce268cf]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd -p 172.16.0.220:3260 --logout {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[302f5423-71b0-42b4-94b4-dea1a5fa712c]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd, portal: 172.16.0.220,3260]
Dec 01 19:26:21 user nova-compute[75066]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd, portal: 172.16.0.220,3260] successful.
Dec 01 19:26:21 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd -p 172.16.0.220:3260 --op delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f6ec19-c08c-47ad-81c9-91d5ababa0dd]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] <== disconnect_volume: return (303ms) None {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Disconnected iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Start _get_guest_xml network_info=[{"id": "902b1013-6c79-4a5a-ab19-782ac8dc715b", "address": "fa:16:3e:fe:93:cc", "network": {"id": "4fe4d56e-afe2-42a6-984a-9af8bc5377a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126385357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5326c00d464e008337e0dc8577fc2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap902b1013-6c", "ovs_interfaceid": "902b1013-6c79-4a5a-ab19-782ac8dc715b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5632f29c-8b44-432c-88c6-02567939cb91,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'image_id': '5632f29c-8b44-432c-88c6-02567939cb91'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'mount_device': '/dev/vdb', 'guest_format': None, 'delete_on_termination': False, 'attachment_id': '0d3c2603-acf6-4273-bf62-21f2b06d0cf8', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xAPSKUhw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '23e17727-40b4-48f7-9155-abc8ffa9f619', 'attached_at': '', 'detached_at': '', 'volume_id': '70247d7d-96cf-4e91-9969-caa1b67610fd', 'serial': '70247d7d-96cf-4e91-9969-caa1b67610fd'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:26:21 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:26:21 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:26:21 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=5632f29c-8b44-432c-88c6-02567939cb91,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG nova.objects.instance [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lazy-loading 'vcpu_model' on Instance uuid 23e17727-40b4-48f7-9155-abc8ffa9f619 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG nova.objects.base [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Object Instance<23e17727-40b4-48f7-9155-abc8ffa9f619> lazy-loaded attributes: resources,vcpu_model {{(pid=75066) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Calling os-brick to attach iSCSI Volume {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xAPSKUhw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:26:21 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:26:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:26:21 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:26:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:26:21 user nova-compute[75066]: INFO os_brick.initiator.connectors.iscsi [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 19:26:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd -p 172.16.0.220:3260 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[23dd45ae-267f-44d7-9940-eaed965aa14d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 19:26:21 user nova-compute[75066]:  {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd -p 172.16.0.220:3260 --interface default --op new {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd7dc458-f871-41e8-ae0d-200d4a2b554b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd] added\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd] added
Dec 01 19:26:21 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd1e971-01bb-4777-9373-a83774b204b6]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf71d95e-6d62-4df9-900d-ed8122bb562a]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xAPSKUhw {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xAPSKUhw" returned: 0 in 0.023s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb24b4f8-5a3f-4409-a65c-60df5760288a]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xAPSKUhw'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1cc8c82-85e7-43a6-b650-9afad7535cc3]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3041e37-849b-41cc-b24c-ffc115916d89]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:26:21 user nova-compute[75066]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)
Dec 01 19:26:21 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:26:21 user nova-compute[75066]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)
Dec 01 19:26:21 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd -p 172.16.0.220:3260 --login {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb897ff-0bca-4a4b-8201-032530684743]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd, portal: 172.16.0.220,3260]
Dec 01 19:26:21 user nova-compute[75066]: Login to [iface: default, target: iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd, portal: 172.16.0.220,3260] successful.
Dec 01 19:26:21 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.038s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[429e5592-e9d6-4535-85ce-f8a7c156e58a]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[10bafc43-01c7-4d6e-aa48-6eda36200a87]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:26:21 user nova-compute[75066]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)
Dec 01 19:26:21 user nova-compute[75066]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd (non-flash)
Dec 01 19:26:21 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:26:21 user nova-compute[75066]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)
Dec 01 19:26:21 user nova-compute[75066]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd (non-flash)
Dec 01 19:26:21 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Connected to 172.16.0.220:3260 {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] HCTL ('34', '-', '-', 0) found on session 29 with lun 0 {{(pid=75066) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75066) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[745c042e-746a-48d3-9a88-e599ecea1473]: (4, ('- - 0', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Searching for a device in session 29 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:26:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xAPSKUhw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 19:26:22 user nova-compute[75066]: DEBUG nova.compute.manager [req-bd061e6a-1072-4e92-848c-01a8bcbcaa80 req-8c2e674b-5b84-4a99-9add-eff2bbe33ba4 service nova] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Received event network-vif-plugged-902b1013-6c79-4a5a-ab19-782ac8dc715b {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:26:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-bd061e6a-1072-4e92-848c-01a8bcbcaa80 req-8c2e674b-5b84-4a99-9add-eff2bbe33ba4 service nova] Acquiring lock "23e17727-40b4-48f7-9155-abc8ffa9f619-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:26:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-bd061e6a-1072-4e92-848c-01a8bcbcaa80 req-8c2e674b-5b84-4a99-9add-eff2bbe33ba4 service nova] Lock "23e17727-40b4-48f7-9155-abc8ffa9f619-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:26:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-bd061e6a-1072-4e92-848c-01a8bcbcaa80 req-8c2e674b-5b84-4a99-9add-eff2bbe33ba4 service nova] Lock "23e17727-40b4-48f7-9155-abc8ffa9f619-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:26:22 user nova-compute[75066]: DEBUG nova.compute.manager [req-bd061e6a-1072-4e92-848c-01a8bcbcaa80 req-8c2e674b-5b84-4a99-9add-eff2bbe33ba4 service nova] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] No waiting events found dispatching network-vif-plugged-902b1013-6c79-4a5a-ab19-782ac8dc715b {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:26:22 user nova-compute[75066]: WARNING nova.compute.manager [req-bd061e6a-1072-4e92-848c-01a8bcbcaa80 req-8c2e674b-5b84-4a99-9add-eff2bbe33ba4 service nova] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Received unexpected event network-vif-plugged-902b1013-6c79-4a5a-ab19-782ac8dc715b for instance with vm_state active and task_state reboot_started_hard.
Dec 01 19:26:22 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:22 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:26:22 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '23433353335323966', 'path': '/dev/sdc'} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:26:22 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23433353335323966', 'path': '/dev/sdc'} {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 19:26:22 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:23:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1401953060',display_name='tempest-TestMinimumBasicScenario-server-1401953060',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1401953060',id=23,image_ref='5632f29c-8b44-432c-88c6-02567939cb91',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQs/30B1+efn0s6ylAyaZU6Z3hXoydPhUb7ZPkYfCAu2HdecYo2d432waybQvON1UMMmv9wZKmPPC/QNvONmacAOntBzffLTnAROursLsedELFAEGhWq1DVqf4nlmD2xw==',key_name='tempest-TestMinimumBasicScenario-1507068812',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:24:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1d5326c00d464e008337e0dc8577fc2d',ramdisk_id='',reservation_id='r-ytr9w0in',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5632f29c-8b44-432c-88c6-02567939cb91',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-555382044',owner_user_name='tempest-TestMinimumBasicScenario-555382044-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:26:20Z,user_data=None,user_id='eeb6ade6e91541b5b737150a67b6bd39',uuid=23e17727-40b4-48f7-9155-abc8ffa9f619,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "902b1013-6c79-4a5a-ab19-782ac8dc715b", "address": "fa:16:3e:fe:93:cc", "network": {"id": "4fe4d56e-afe2-42a6-984a-9af8bc5377a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126385357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5326c00d464e008337e0dc8577fc2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap902b1013-6c", "ovs_interfaceid": "902b1013-6c79-4a5a-ab19-782ac8dc715b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:26:22 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Converting VIF {"id": "902b1013-6c79-4a5a-ab19-782ac8dc715b", "address": "fa:16:3e:fe:93:cc", "network": {"id": "4fe4d56e-afe2-42a6-984a-9af8bc5377a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126385357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5326c00d464e008337e0dc8577fc2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap902b1013-6c", "ovs_interfaceid": "902b1013-6c79-4a5a-ab19-782ac8dc715b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:26:22 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:93:cc,bridge_name='br-int',has_traffic_filtering=True,id=902b1013-6c79-4a5a-ab19-782ac8dc715b,network=Network(4fe4d56e-afe2-42a6-984a-9af8bc5377a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap902b1013-6c') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:26:22 user nova-compute[75066]: DEBUG nova.objects.instance [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lazy-loading 'pci_devices' on Instance uuid 23e17727-40b4-48f7-9155-abc8ffa9f619 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:26:22 user nova-compute[75066]: DEBUG nova.objects.base [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Object Instance<23e17727-40b4-48f7-9155-abc8ffa9f619> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75066) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 19:26:22 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:26:22 user nova-compute[75066]:   <uuid>23e17727-40b4-48f7-9155-abc8ffa9f619</uuid>
Dec 01 19:26:22 user nova-compute[75066]:   <name>instance-00000017</name>
Dec 01 19:26:22 user nova-compute[75066]:   <memory>524288</memory>
Dec 01 19:26:22 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:26:22 user nova-compute[75066]:   <metadata>
Dec 01 19:26:22 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:26:22 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:26:22 user nova-compute[75066]:       <nova:name>tempest-TestMinimumBasicScenario-server-1401953060</nova:name>
Dec 01 19:26:22 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:26:21</nova:creationTime>
Dec 01 19:26:22 user nova-compute[75066]:       <nova:flavor name="m1.tiny">
Dec 01 19:26:22 user nova-compute[75066]:         <nova:memory>512</nova:memory>
Dec 01 19:26:22 user nova-compute[75066]:         <nova:disk>1</nova:disk>
Dec 01 19:26:22 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:26:22 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:26:22 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:26:22 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:26:22 user nova-compute[75066]:       <nova:owner>
Dec 01 19:26:22 user nova-compute[75066]:         <nova:user uuid="eeb6ade6e91541b5b737150a67b6bd39">tempest-TestMinimumBasicScenario-555382044-project-member</nova:user>
Dec 01 19:26:22 user nova-compute[75066]:         <nova:project uuid="1d5326c00d464e008337e0dc8577fc2d">tempest-TestMinimumBasicScenario-555382044</nova:project>
Dec 01 19:26:22 user nova-compute[75066]:       </nova:owner>
Dec 01 19:26:22 user nova-compute[75066]:       <nova:root type="image" uuid="5632f29c-8b44-432c-88c6-02567939cb91"/>
Dec 01 19:26:22 user nova-compute[75066]:       <nova:ports>
Dec 01 19:26:22 user nova-compute[75066]:         <nova:port uuid="902b1013-6c79-4a5a-ab19-782ac8dc715b">
Dec 01 19:26:22 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 01 19:26:22 user nova-compute[75066]:         </nova:port>
Dec 01 19:26:22 user nova-compute[75066]:       </nova:ports>
Dec 01 19:26:22 user nova-compute[75066]:     </nova:instance>
Dec 01 19:26:22 user nova-compute[75066]:   </metadata>
Dec 01 19:26:22 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:26:22 user nova-compute[75066]:     <system>
Dec 01 19:26:22 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:26:22 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:26:22 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:26:22 user nova-compute[75066]:       <entry name="serial">23e17727-40b4-48f7-9155-abc8ffa9f619</entry>
Dec 01 19:26:22 user nova-compute[75066]:       <entry name="uuid">23e17727-40b4-48f7-9155-abc8ffa9f619</entry>
Dec 01 19:26:22 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:26:22 user nova-compute[75066]:     </system>
Dec 01 19:26:22 user nova-compute[75066]:   </sysinfo>
Dec 01 19:26:22 user nova-compute[75066]:   <os>
Dec 01 19:26:22 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:26:22 user nova-compute[75066]:     <boot dev="hd"/>
Dec 01 19:26:22 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:26:22 user nova-compute[75066]:   </os>
Dec 01 19:26:22 user nova-compute[75066]:   <features>
Dec 01 19:26:22 user nova-compute[75066]:     <acpi/>
Dec 01 19:26:22 user nova-compute[75066]:     <apic/>
Dec 01 19:26:22 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:26:22 user nova-compute[75066]:   </features>
Dec 01 19:26:22 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:26:22 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:26:22 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:26:22 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:26:22 user nova-compute[75066]:   </clock>
Dec 01 19:26:22 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:26:22 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:26:22 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:26:22 user nova-compute[75066]:   </cpu>
Dec 01 19:26:22 user nova-compute[75066]:   <devices>
Dec 01 19:26:22 user nova-compute[75066]:     <disk type="file" device="disk">
Dec 01 19:26:22 user nova-compute[75066]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 19:26:22 user nova-compute[75066]:       <source file="/opt/stack/data/nova/instances/23e17727-40b4-48f7-9155-abc8ffa9f619/disk"/>
Dec 01 19:26:22 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:26:22 user nova-compute[75066]:     </disk>
Dec 01 19:26:22 user nova-compute[75066]:     <disk type="block" device="disk">
Dec 01 19:26:22 user nova-compute[75066]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:26:22 user nova-compute[75066]:       <source dev="/dev/sdc"/>
Dec 01 19:26:22 user nova-compute[75066]:       <target dev="vdb" bus="virtio"/>
Dec 01 19:26:22 user nova-compute[75066]:       <serial>70247d7d-96cf-4e91-9969-caa1b67610fd</serial>
Dec 01 19:26:22 user nova-compute[75066]:     </disk>
Dec 01 19:26:22 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:26:22 user nova-compute[75066]:       <mac address="fa:16:3e:fe:93:cc"/>
Dec 01 19:26:22 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:26:22 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:26:22 user nova-compute[75066]:       <target dev="tap902b1013-6c"/>
Dec 01 19:26:22 user nova-compute[75066]:     </interface>
Dec 01 19:26:22 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:26:22 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/23e17727-40b4-48f7-9155-abc8ffa9f619/console.log" append="off"/>
Dec 01 19:26:22 user nova-compute[75066]:     </serial>
Dec 01 19:26:22 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:26:22 user nova-compute[75066]:     <video>
Dec 01 19:26:22 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:26:22 user nova-compute[75066]:     </video>
Dec 01 19:26:22 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:26:22 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:26:22 user nova-compute[75066]:     </rng>
Dec 01 19:26:22 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:26:22 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:26:22 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:26:22 user nova-compute[75066]:     </memballoon>
Dec 01 19:26:22 user nova-compute[75066]:   </devices>
Dec 01 19:26:22 user nova-compute[75066]: </domain>
Dec 01 19:26:22 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:26:22 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23e17727-40b4-48f7-9155-abc8ffa9f619/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:23 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23e17727-40b4-48f7-9155-abc8ffa9f619/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:23 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23e17727-40b4-48f7-9155-abc8ffa9f619/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:23 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23e17727-40b4-48f7-9155-abc8ffa9f619/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:23 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:26:23 user nova-compute[75066]: DEBUG nova.objects.instance [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lazy-loading 'trusted_certs' on Instance uuid 23e17727-40b4-48f7-9155-abc8ffa9f619 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:26:23 user nova-compute[75066]: DEBUG nova.objects.base [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Object Instance<23e17727-40b4-48f7-9155-abc8ffa9f619> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75066) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 19:26:23 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d355c9206e88c86648ac73e02c0c25330d3bfb1c --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:23 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d355c9206e88c86648ac73e02c0c25330d3bfb1c --force-share --output=json" returned: 0 in 0.178s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:23 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Checking if we can resize image /opt/stack/data/nova/instances/23e17727-40b4-48f7-9155-abc8ffa9f619/disk. size=1073741824 {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 19:26:23 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23e17727-40b4-48f7-9155-abc8ffa9f619/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:23 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23e17727-40b4-48f7-9155-abc8ffa9f619/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:23 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Cannot resize image /opt/stack/data/nova/instances/23e17727-40b4-48f7-9155-abc8ffa9f619/disk to a smaller size. {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 19:26:23 user nova-compute[75066]: DEBUG nova.objects.instance [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lazy-loading 'migration_context' on Instance uuid 23e17727-40b4-48f7-9155-abc8ffa9f619 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:26:23 user nova-compute[75066]: DEBUG nova.objects.base [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Object Instance<23e17727-40b4-48f7-9155-abc8ffa9f619> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75066) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 19:26:23 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:23:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1401953060',display_name='tempest-TestMinimumBasicScenario-server-1401953060',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1401953060',id=23,image_ref='5632f29c-8b44-432c-88c6-02567939cb91',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQs/30B1+efn0s6ylAyaZU6Z3hXoydPhUb7ZPkYfCAu2HdecYo2d432waybQvON1UMMmv9wZKmPPC/QNvONmacAOntBzffLTnAROursLsedELFAEGhWq1DVqf4nlmD2xw==',key_name='tempest-TestMinimumBasicScenario-1507068812',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:24:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='1d5326c00d464e008337e0dc8577fc2d',ramdisk_id='',reservation_id='r-ytr9w0in',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5632f29c-8b44-432c-88c6-02567939cb91',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-555382044',owner_user_name='tempest-TestMinimumBasicScenario-555382044-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:26:20Z,user_data=None,user_id='eeb6ade6e91541b5b737150a67b6bd39',uuid=23e17727-40b4-48f7-9155-abc8ffa9f619,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "902b1013-6c79-4a5a-ab19-782ac8dc715b", "address": "fa:16:3e:fe:93:cc", "network": {"id": "4fe4d56e-afe2-42a6-984a-9af8bc5377a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126385357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5326c00d464e008337e0dc8577fc2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap902b1013-6c", "ovs_interfaceid": "902b1013-6c79-4a5a-ab19-782ac8dc715b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:26:23 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Converting VIF {"id": "902b1013-6c79-4a5a-ab19-782ac8dc715b", "address": "fa:16:3e:fe:93:cc", "network": {"id": "4fe4d56e-afe2-42a6-984a-9af8bc5377a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126385357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5326c00d464e008337e0dc8577fc2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap902b1013-6c", "ovs_interfaceid": "902b1013-6c79-4a5a-ab19-782ac8dc715b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:26:23 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:93:cc,bridge_name='br-int',has_traffic_filtering=True,id=902b1013-6c79-4a5a-ab19-782ac8dc715b,network=Network(4fe4d56e-afe2-42a6-984a-9af8bc5377a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap902b1013-6c') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:26:23 user nova-compute[75066]: DEBUG os_vif [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:93:cc,bridge_name='br-int',has_traffic_filtering=True,id=902b1013-6c79-4a5a-ab19-782ac8dc715b,network=Network(4fe4d56e-afe2-42a6-984a-9af8bc5377a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap902b1013-6c') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:26:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:26:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:26:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0a0cf5c7-17c6-5893-a3ed-e09086a43b9e', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:26:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:26:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap902b1013-6c, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:26:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap902b1013-6c, col_values=(('qos', UUID('3c584295-77b9-4f7f-a76c-d9710f416931')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:26:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap902b1013-6c, col_values=(('external_ids', {'iface-id': '902b1013-6c79-4a5a-ab19-782ac8dc715b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:93:cc', 'vm-uuid': '23e17727-40b4-48f7-9155-abc8ffa9f619'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:26:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:26:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:23 user nova-compute[75066]: INFO os_vif [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:93:cc,bridge_name='br-int',has_traffic_filtering=True,id=902b1013-6c79-4a5a-ab19-782ac8dc715b,network=Network(4fe4d56e-afe2-42a6-984a-9af8bc5377a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap902b1013-6c')
Dec 01 19:26:24 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:25 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:25 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:25 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:25 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:25 user nova-compute[75066]: DEBUG nova.compute.manager [req-cf523887-9ee0-4ed5-a272-b641abe9f8e9 req-3a0e3d4a-f852-4d4c-aedd-c363553630e0 service nova] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Received event network-vif-plugged-902b1013-6c79-4a5a-ab19-782ac8dc715b {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:26:25 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-cf523887-9ee0-4ed5-a272-b641abe9f8e9 req-3a0e3d4a-f852-4d4c-aedd-c363553630e0 service nova] Acquiring lock "23e17727-40b4-48f7-9155-abc8ffa9f619-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:26:25 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-cf523887-9ee0-4ed5-a272-b641abe9f8e9 req-3a0e3d4a-f852-4d4c-aedd-c363553630e0 service nova] Lock "23e17727-40b4-48f7-9155-abc8ffa9f619-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:26:25 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-cf523887-9ee0-4ed5-a272-b641abe9f8e9 req-3a0e3d4a-f852-4d4c-aedd-c363553630e0 service nova] Lock "23e17727-40b4-48f7-9155-abc8ffa9f619-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:26:25 user nova-compute[75066]: DEBUG nova.compute.manager [req-cf523887-9ee0-4ed5-a272-b641abe9f8e9 req-3a0e3d4a-f852-4d4c-aedd-c363553630e0 service nova] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] No waiting events found dispatching network-vif-plugged-902b1013-6c79-4a5a-ab19-782ac8dc715b {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:26:25 user nova-compute[75066]: WARNING nova.compute.manager [req-cf523887-9ee0-4ed5-a272-b641abe9f8e9 req-3a0e3d4a-f852-4d4c-aedd-c363553630e0 service nova] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Received unexpected event network-vif-plugged-902b1013-6c79-4a5a-ab19-782ac8dc715b for instance with vm_state active and task_state reboot_started_hard.
Dec 01 19:26:25 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:25 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:27 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Instance event wait completed in 0 seconds for  {{(pid=75066) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 19:26:27 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Instance rebooted successfully.
Dec 01 19:26:27 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:26:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ad19c7cb-a15d-4940-b466-7bd4faa057d6 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "23e17727-40b4-48f7-9155-abc8ffa9f619" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.803s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:26:27 user nova-compute[75066]: DEBUG nova.compute.manager [req-ce83b230-03af-403c-97fd-d9f4fbf9959b req-80e8c56d-f8fa-4a34-9b19-73bad3f6752c service nova] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Received event network-vif-plugged-902b1013-6c79-4a5a-ab19-782ac8dc715b {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:26:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-ce83b230-03af-403c-97fd-d9f4fbf9959b req-80e8c56d-f8fa-4a34-9b19-73bad3f6752c service nova] Acquiring lock "23e17727-40b4-48f7-9155-abc8ffa9f619-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:26:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-ce83b230-03af-403c-97fd-d9f4fbf9959b req-80e8c56d-f8fa-4a34-9b19-73bad3f6752c service nova] Lock "23e17727-40b4-48f7-9155-abc8ffa9f619-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:26:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-ce83b230-03af-403c-97fd-d9f4fbf9959b req-80e8c56d-f8fa-4a34-9b19-73bad3f6752c service nova] Lock "23e17727-40b4-48f7-9155-abc8ffa9f619-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:26:27 user nova-compute[75066]: DEBUG nova.compute.manager [req-ce83b230-03af-403c-97fd-d9f4fbf9959b req-80e8c56d-f8fa-4a34-9b19-73bad3f6752c service nova] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] No waiting events found dispatching network-vif-plugged-902b1013-6c79-4a5a-ab19-782ac8dc715b {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:26:27 user nova-compute[75066]: WARNING nova.compute.manager [req-ce83b230-03af-403c-97fd-d9f4fbf9959b req-80e8c56d-f8fa-4a34-9b19-73bad3f6752c service nova] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Received unexpected event network-vif-plugged-902b1013-6c79-4a5a-ab19-782ac8dc715b for instance with vm_state active and task_state None.
Dec 01 19:26:27 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:27 user nova-compute[75066]: INFO nova.compute.manager [None req-66784fa4-4130-47bf-abb2-4c4f9fae5d01 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Unrescuing
Dec 01 19:26:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-66784fa4-4130-47bf-abb2-4c4f9fae5d01 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Acquiring lock "refresh_cache-d564b128-598b-4ad4-8618-afa4dc8a7347" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:26:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-66784fa4-4130-47bf-abb2-4c4f9fae5d01 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Acquired lock "refresh_cache-d564b128-598b-4ad4-8618-afa4dc8a7347" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:26:27 user nova-compute[75066]: DEBUG nova.network.neutron [None req-66784fa4-4130-47bf-abb2-4c4f9fae5d01 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:26:28 user nova-compute[75066]: DEBUG nova.network.neutron [None req-66784fa4-4130-47bf-abb2-4c4f9fae5d01 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Updating instance_info_cache with network_info: [{"id": "4850dc75-0d93-4536-abc1-a981dd385d96", "address": "fa:16:3e:fc:d1:96", "network": {"id": "47c850ae-6dcb-4977-a02a-e32cd3df4749", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-475363603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "943324a514a84cb4947dbab93abc4f6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4850dc75-0d", "ovs_interfaceid": "4850dc75-0d93-4536-abc1-a981dd385d96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:26:28 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-66784fa4-4130-47bf-abb2-4c4f9fae5d01 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Releasing lock "refresh_cache-d564b128-598b-4ad4-8618-afa4dc8a7347" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:26:28 user nova-compute[75066]: DEBUG nova.objects.instance [None req-66784fa4-4130-47bf-abb2-4c4f9fae5d01 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lazy-loading 'flavor' on Instance uuid d564b128-598b-4ad4-8618-afa4dc8a7347 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:26:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:29 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Instance destroyed successfully.
Dec 01 19:26:29 user nova-compute[75066]: DEBUG nova.compute.manager [req-c182eb4d-1136-4f3d-b971-c6f3832cb4f5 req-658d64fa-1af2-4716-9465-9f016d99e3c6 service nova] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Received event network-vif-unplugged-4850dc75-0d93-4536-abc1-a981dd385d96 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:26:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-c182eb4d-1136-4f3d-b971-c6f3832cb4f5 req-658d64fa-1af2-4716-9465-9f016d99e3c6 service nova] Acquiring lock "d564b128-598b-4ad4-8618-afa4dc8a7347-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:26:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-c182eb4d-1136-4f3d-b971-c6f3832cb4f5 req-658d64fa-1af2-4716-9465-9f016d99e3c6 service nova] Lock "d564b128-598b-4ad4-8618-afa4dc8a7347-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:26:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-c182eb4d-1136-4f3d-b971-c6f3832cb4f5 req-658d64fa-1af2-4716-9465-9f016d99e3c6 service nova] Lock "d564b128-598b-4ad4-8618-afa4dc8a7347-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:26:29 user nova-compute[75066]: DEBUG nova.compute.manager [req-c182eb4d-1136-4f3d-b971-c6f3832cb4f5 req-658d64fa-1af2-4716-9465-9f016d99e3c6 service nova] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] No waiting events found dispatching network-vif-unplugged-4850dc75-0d93-4536-abc1-a981dd385d96 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:26:29 user nova-compute[75066]: WARNING nova.compute.manager [req-c182eb4d-1136-4f3d-b971-c6f3832cb4f5 req-658d64fa-1af2-4716-9465-9f016d99e3c6 service nova] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Received unexpected event network-vif-unplugged-4850dc75-0d93-4536-abc1-a981dd385d96 for instance with vm_state rescued and task_state unrescuing.
Dec 01 19:26:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:31 user nova-compute[75066]: DEBUG nova.compute.manager [req-4d0cc8e1-3d65-4559-8052-72af2019fe56 req-679bf15c-e5b3-4352-8fe6-e02072969bc8 service nova] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Received event network-vif-plugged-4850dc75-0d93-4536-abc1-a981dd385d96 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:26:31 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-4d0cc8e1-3d65-4559-8052-72af2019fe56 req-679bf15c-e5b3-4352-8fe6-e02072969bc8 service nova] Acquiring lock "d564b128-598b-4ad4-8618-afa4dc8a7347-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:26:31 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-4d0cc8e1-3d65-4559-8052-72af2019fe56 req-679bf15c-e5b3-4352-8fe6-e02072969bc8 service nova] Lock "d564b128-598b-4ad4-8618-afa4dc8a7347-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:26:31 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-4d0cc8e1-3d65-4559-8052-72af2019fe56 req-679bf15c-e5b3-4352-8fe6-e02072969bc8 service nova] Lock "d564b128-598b-4ad4-8618-afa4dc8a7347-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:26:31 user nova-compute[75066]: DEBUG nova.compute.manager [req-4d0cc8e1-3d65-4559-8052-72af2019fe56 req-679bf15c-e5b3-4352-8fe6-e02072969bc8 service nova] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] No waiting events found dispatching network-vif-plugged-4850dc75-0d93-4536-abc1-a981dd385d96 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:26:31 user nova-compute[75066]: WARNING nova.compute.manager [req-4d0cc8e1-3d65-4559-8052-72af2019fe56 req-679bf15c-e5b3-4352-8fe6-e02072969bc8 service nova] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Received unexpected event network-vif-plugged-4850dc75-0d93-4536-abc1-a981dd385d96 for instance with vm_state rescued and task_state unrescuing.
Dec 01 19:26:31 user nova-compute[75066]: DEBUG nova.compute.manager [req-4d0cc8e1-3d65-4559-8052-72af2019fe56 req-679bf15c-e5b3-4352-8fe6-e02072969bc8 service nova] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Received event network-vif-plugged-4850dc75-0d93-4536-abc1-a981dd385d96 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:26:31 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-4d0cc8e1-3d65-4559-8052-72af2019fe56 req-679bf15c-e5b3-4352-8fe6-e02072969bc8 service nova] Acquiring lock "d564b128-598b-4ad4-8618-afa4dc8a7347-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:26:31 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-4d0cc8e1-3d65-4559-8052-72af2019fe56 req-679bf15c-e5b3-4352-8fe6-e02072969bc8 service nova] Lock "d564b128-598b-4ad4-8618-afa4dc8a7347-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:26:31 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-4d0cc8e1-3d65-4559-8052-72af2019fe56 req-679bf15c-e5b3-4352-8fe6-e02072969bc8 service nova] Lock "d564b128-598b-4ad4-8618-afa4dc8a7347-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:26:31 user nova-compute[75066]: DEBUG nova.compute.manager [req-4d0cc8e1-3d65-4559-8052-72af2019fe56 req-679bf15c-e5b3-4352-8fe6-e02072969bc8 service nova] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] No waiting events found dispatching network-vif-plugged-4850dc75-0d93-4536-abc1-a981dd385d96 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:26:31 user nova-compute[75066]: WARNING nova.compute.manager [req-4d0cc8e1-3d65-4559-8052-72af2019fe56 req-679bf15c-e5b3-4352-8fe6-e02072969bc8 service nova] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Received unexpected event network-vif-plugged-4850dc75-0d93-4536-abc1-a981dd385d96 for instance with vm_state rescued and task_state unrescuing.
Dec 01 19:26:31 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:32 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:33 user nova-compute[75066]: DEBUG nova.compute.manager [None req-66784fa4-4130-47bf-abb2-4c4f9fae5d01 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:26:33 user nova-compute[75066]: DEBUG nova.compute.manager [req-0be4dbac-61e9-4960-b80b-b6e62d4a0856 req-4c85a535-db03-4c75-9ba3-7548ed05f8b1 service nova] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Received event network-vif-plugged-4850dc75-0d93-4536-abc1-a981dd385d96 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:26:33 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-0be4dbac-61e9-4960-b80b-b6e62d4a0856 req-4c85a535-db03-4c75-9ba3-7548ed05f8b1 service nova] Acquiring lock "d564b128-598b-4ad4-8618-afa4dc8a7347-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:26:33 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-0be4dbac-61e9-4960-b80b-b6e62d4a0856 req-4c85a535-db03-4c75-9ba3-7548ed05f8b1 service nova] Lock "d564b128-598b-4ad4-8618-afa4dc8a7347-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:26:33 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-0be4dbac-61e9-4960-b80b-b6e62d4a0856 req-4c85a535-db03-4c75-9ba3-7548ed05f8b1 service nova] Lock "d564b128-598b-4ad4-8618-afa4dc8a7347-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:26:33 user nova-compute[75066]: DEBUG nova.compute.manager [req-0be4dbac-61e9-4960-b80b-b6e62d4a0856 req-4c85a535-db03-4c75-9ba3-7548ed05f8b1 service nova] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] No waiting events found dispatching network-vif-plugged-4850dc75-0d93-4536-abc1-a981dd385d96 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:26:33 user nova-compute[75066]: WARNING nova.compute.manager [req-0be4dbac-61e9-4960-b80b-b6e62d4a0856 req-4c85a535-db03-4c75-9ba3-7548ed05f8b1 service nova] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Received unexpected event network-vif-plugged-4850dc75-0d93-4536-abc1-a981dd385d96 for instance with vm_state active and task_state None.
Dec 01 19:26:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:34 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-f75d1052-56ac-4dc6-9007-981c3d7ee40a tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Acquiring lock "ecc194b4-b8b9-49c8-9d34-4213c4dc15b8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:26:34 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-f75d1052-56ac-4dc6-9007-981c3d7ee40a tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lock "ecc194b4-b8b9-49c8-9d34-4213c4dc15b8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:26:34 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-f75d1052-56ac-4dc6-9007-981c3d7ee40a tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Acquiring lock "ecc194b4-b8b9-49c8-9d34-4213c4dc15b8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:26:34 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-f75d1052-56ac-4dc6-9007-981c3d7ee40a tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lock "ecc194b4-b8b9-49c8-9d34-4213c4dc15b8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:26:34 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-f75d1052-56ac-4dc6-9007-981c3d7ee40a tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lock "ecc194b4-b8b9-49c8-9d34-4213c4dc15b8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:26:34 user nova-compute[75066]: INFO nova.compute.manager [None req-f75d1052-56ac-4dc6-9007-981c3d7ee40a tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Terminating instance
Dec 01 19:26:34 user nova-compute[75066]: DEBUG nova.compute.manager [None req-f75d1052-56ac-4dc6-9007-981c3d7ee40a tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Start destroying the instance on the hypervisor. {{(pid=75066) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 19:26:34 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:34 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:35 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:35 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:35 user nova-compute[75066]: DEBUG nova.compute.manager [req-7d22c67a-8fec-42ab-814a-f7fe617a93d4 req-30969738-d13b-4280-b276-a43b8ed40caa service nova] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Received event network-changed-2d26e49a-f1a5-4922-b26f-2eb8c3d59368 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:26:35 user nova-compute[75066]: DEBUG nova.compute.manager [req-7d22c67a-8fec-42ab-814a-f7fe617a93d4 req-30969738-d13b-4280-b276-a43b8ed40caa service nova] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Refreshing instance network info cache due to event network-changed-2d26e49a-f1a5-4922-b26f-2eb8c3d59368. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:26:35 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-7d22c67a-8fec-42ab-814a-f7fe617a93d4 req-30969738-d13b-4280-b276-a43b8ed40caa service nova] Acquiring lock "refresh_cache-ecc194b4-b8b9-49c8-9d34-4213c4dc15b8" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:26:35 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-7d22c67a-8fec-42ab-814a-f7fe617a93d4 req-30969738-d13b-4280-b276-a43b8ed40caa service nova] Acquired lock "refresh_cache-ecc194b4-b8b9-49c8-9d34-4213c4dc15b8" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:26:35 user nova-compute[75066]: DEBUG nova.network.neutron [req-7d22c67a-8fec-42ab-814a-f7fe617a93d4 req-30969738-d13b-4280-b276-a43b8ed40caa service nova] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Refreshing network info cache for port 2d26e49a-f1a5-4922-b26f-2eb8c3d59368 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:26:35 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Instance destroyed successfully.
Dec 01 19:26:35 user nova-compute[75066]: DEBUG nova.objects.instance [None req-f75d1052-56ac-4dc6-9007-981c3d7ee40a tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lazy-loading 'resources' on Instance uuid ecc194b4-b8b9-49c8-9d34-4213c4dc15b8 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:26:35 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-f75d1052-56ac-4dc6-9007-981c3d7ee40a tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:23:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-386572996',display_name='tempest-TestStampPattern-server-386572996',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-386572996',id=22,image_ref='9b4172c9-9407-4727-a1fe-156908bea909',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLSWelIBdKpY5tDhTVMPXRfCvQwvHNWZhGDeDhkjt6+GDQnshog1py5tqU+qYJowL71BLCNBO5cYXwkrz8pBEBbdzILknRNr0r/SkH7MZtJef4QVznd62i44CV3XthbMbQ==',key_name='tempest-TestStampPattern-1467755075',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:23:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c9caae5967744641b7490e1aa91973c0',ramdisk_id='',reservation_id='r-yz5ok5sr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='a553e030-0d69-4725-9f84-6c0c63556ed4',image_min_disk='1',image_min_ram='0',image_owner_id='c9caae5967744641b7490e1aa91973c0',image_owner_project_name='tempest-TestStampPattern-859706400',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-859706400-project-member',image_user_id='7c1a5012f94b43e38161f8c823173f7f',owner_project_name='tempest-TestStampPattern-859706400',owner_user_name='tempest-TestStampPattern-859706400-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:23:45Z,user_data=None,user_id='7c1a5012f94b43e38161f8c823173f7f',uuid=ecc194b4-b8b9-49c8-9d34-4213c4dc15b8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2d26e49a-f1a5-4922-b26f-2eb8c3d59368", "address": "fa:16:3e:f8:79:92", "network": {"id": "191f13ce-a864-4c09-8ca5-e8a106e24d37", "bridge": "br-int", "label": "tempest-TestStampPattern-1604601756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9caae5967744641b7490e1aa91973c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d26e49a-f1", "ovs_interfaceid": "2d26e49a-f1a5-4922-b26f-2eb8c3d59368", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:26:35 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-f75d1052-56ac-4dc6-9007-981c3d7ee40a tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Converting VIF {"id": "2d26e49a-f1a5-4922-b26f-2eb8c3d59368", "address": "fa:16:3e:f8:79:92", "network": {"id": "191f13ce-a864-4c09-8ca5-e8a106e24d37", "bridge": "br-int", "label": "tempest-TestStampPattern-1604601756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.115", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9caae5967744641b7490e1aa91973c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d26e49a-f1", "ovs_interfaceid": "2d26e49a-f1a5-4922-b26f-2eb8c3d59368", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:26:35 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-f75d1052-56ac-4dc6-9007-981c3d7ee40a tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f8:79:92,bridge_name='br-int',has_traffic_filtering=True,id=2d26e49a-f1a5-4922-b26f-2eb8c3d59368,network=Network(191f13ce-a864-4c09-8ca5-e8a106e24d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d26e49a-f1') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:26:35 user nova-compute[75066]: DEBUG os_vif [None req-f75d1052-56ac-4dc6-9007-981c3d7ee40a tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:79:92,bridge_name='br-int',has_traffic_filtering=True,id=2d26e49a-f1a5-4922-b26f-2eb8c3d59368,network=Network(191f13ce-a864-4c09-8ca5-e8a106e24d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d26e49a-f1') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:26:35 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:35 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2d26e49a-f1, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:26:35 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:35 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:26:35 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:35 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:35 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=944d7cee-fa54-43a1-97c3-4f56334b106d) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:26:35 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:35 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:35 user nova-compute[75066]: INFO os_vif [None req-f75d1052-56ac-4dc6-9007-981c3d7ee40a tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:79:92,bridge_name='br-int',has_traffic_filtering=True,id=2d26e49a-f1a5-4922-b26f-2eb8c3d59368,network=Network(191f13ce-a864-4c09-8ca5-e8a106e24d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2d26e49a-f1')
Dec 01 19:26:35 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-f75d1052-56ac-4dc6-9007-981c3d7ee40a tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Deleting instance files /opt/stack/data/nova/instances/ecc194b4-b8b9-49c8-9d34-4213c4dc15b8_del
Dec 01 19:26:35 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-f75d1052-56ac-4dc6-9007-981c3d7ee40a tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Deletion of /opt/stack/data/nova/instances/ecc194b4-b8b9-49c8-9d34-4213c4dc15b8_del complete
Dec 01 19:26:35 user nova-compute[75066]: INFO nova.compute.manager [None req-f75d1052-56ac-4dc6-9007-981c3d7ee40a tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Took 0.96 seconds to destroy the instance on the hypervisor.
Dec 01 19:26:35 user nova-compute[75066]: DEBUG oslo.service.loopingcall [None req-f75d1052-56ac-4dc6-9007-981c3d7ee40a tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75066) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 19:26:35 user nova-compute[75066]: DEBUG nova.compute.manager [-] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Deallocating network for instance {{(pid=75066) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 19:26:35 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] deallocate_for_instance() {{(pid=75066) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 19:26:36 user nova-compute[75066]: DEBUG nova.network.neutron [req-7d22c67a-8fec-42ab-814a-f7fe617a93d4 req-30969738-d13b-4280-b276-a43b8ed40caa service nova] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Updated VIF entry in instance network info cache for port 2d26e49a-f1a5-4922-b26f-2eb8c3d59368. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:26:36 user nova-compute[75066]: DEBUG nova.network.neutron [req-7d22c67a-8fec-42ab-814a-f7fe617a93d4 req-30969738-d13b-4280-b276-a43b8ed40caa service nova] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Updating instance_info_cache with network_info: [{"id": "2d26e49a-f1a5-4922-b26f-2eb8c3d59368", "address": "fa:16:3e:f8:79:92", "network": {"id": "191f13ce-a864-4c09-8ca5-e8a106e24d37", "bridge": "br-int", "label": "tempest-TestStampPattern-1604601756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9caae5967744641b7490e1aa91973c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2d26e49a-f1", "ovs_interfaceid": "2d26e49a-f1a5-4922-b26f-2eb8c3d59368", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:26:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-7d22c67a-8fec-42ab-814a-f7fe617a93d4 req-30969738-d13b-4280-b276-a43b8ed40caa service nova] Releasing lock "refresh_cache-ecc194b4-b8b9-49c8-9d34-4213c4dc15b8" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:26:36 user nova-compute[75066]: DEBUG nova.compute.manager [req-7d22c67a-8fec-42ab-814a-f7fe617a93d4 req-30969738-d13b-4280-b276-a43b8ed40caa service nova] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Received event network-vif-unplugged-2d26e49a-f1a5-4922-b26f-2eb8c3d59368 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:26:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-7d22c67a-8fec-42ab-814a-f7fe617a93d4 req-30969738-d13b-4280-b276-a43b8ed40caa service nova] Acquiring lock "ecc194b4-b8b9-49c8-9d34-4213c4dc15b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:26:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-7d22c67a-8fec-42ab-814a-f7fe617a93d4 req-30969738-d13b-4280-b276-a43b8ed40caa service nova] Lock "ecc194b4-b8b9-49c8-9d34-4213c4dc15b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:26:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-7d22c67a-8fec-42ab-814a-f7fe617a93d4 req-30969738-d13b-4280-b276-a43b8ed40caa service nova] Lock "ecc194b4-b8b9-49c8-9d34-4213c4dc15b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:26:36 user nova-compute[75066]: DEBUG nova.compute.manager [req-7d22c67a-8fec-42ab-814a-f7fe617a93d4 req-30969738-d13b-4280-b276-a43b8ed40caa service nova] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] No waiting events found dispatching network-vif-unplugged-2d26e49a-f1a5-4922-b26f-2eb8c3d59368 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:26:36 user nova-compute[75066]: DEBUG nova.compute.manager [req-7d22c67a-8fec-42ab-814a-f7fe617a93d4 req-30969738-d13b-4280-b276-a43b8ed40caa service nova] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Received event network-vif-unplugged-2d26e49a-f1a5-4922-b26f-2eb8c3d59368 for instance with task_state deleting. {{(pid=75066) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 19:26:36 user nova-compute[75066]: DEBUG nova.compute.manager [req-7d22c67a-8fec-42ab-814a-f7fe617a93d4 req-30969738-d13b-4280-b276-a43b8ed40caa service nova] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Received event network-vif-plugged-2d26e49a-f1a5-4922-b26f-2eb8c3d59368 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:26:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-7d22c67a-8fec-42ab-814a-f7fe617a93d4 req-30969738-d13b-4280-b276-a43b8ed40caa service nova] Acquiring lock "ecc194b4-b8b9-49c8-9d34-4213c4dc15b8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:26:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-7d22c67a-8fec-42ab-814a-f7fe617a93d4 req-30969738-d13b-4280-b276-a43b8ed40caa service nova] Lock "ecc194b4-b8b9-49c8-9d34-4213c4dc15b8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:26:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-7d22c67a-8fec-42ab-814a-f7fe617a93d4 req-30969738-d13b-4280-b276-a43b8ed40caa service nova] Lock "ecc194b4-b8b9-49c8-9d34-4213c4dc15b8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:26:36 user nova-compute[75066]: DEBUG nova.compute.manager [req-7d22c67a-8fec-42ab-814a-f7fe617a93d4 req-30969738-d13b-4280-b276-a43b8ed40caa service nova] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] No waiting events found dispatching network-vif-plugged-2d26e49a-f1a5-4922-b26f-2eb8c3d59368 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:26:36 user nova-compute[75066]: WARNING nova.compute.manager [req-7d22c67a-8fec-42ab-814a-f7fe617a93d4 req-30969738-d13b-4280-b276-a43b8ed40caa service nova] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Received unexpected event network-vif-plugged-2d26e49a-f1a5-4922-b26f-2eb8c3d59368 for instance with vm_state active and task_state deleting.
Dec 01 19:26:36 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:26:36 user nova-compute[75066]: INFO nova.compute.manager [-] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Took 0.63 seconds to deallocate network for instance.
Dec 01 19:26:36 user nova-compute[75066]: DEBUG nova.compute.manager [req-ca4b561a-75d8-4f6e-b9de-de88cac8e581 req-7e962b93-4c96-46bb-afa6-b09e0df45433 service nova] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Received event network-vif-deleted-2d26e49a-f1a5-4922-b26f-2eb8c3d59368 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:26:36 user nova-compute[75066]: INFO nova.compute.manager [req-ca4b561a-75d8-4f6e-b9de-de88cac8e581 req-7e962b93-4c96-46bb-afa6-b09e0df45433 service nova] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Neutron deleted interface 2d26e49a-f1a5-4922-b26f-2eb8c3d59368; detaching it from the instance and deleting it from the info cache
Dec 01 19:26:36 user nova-compute[75066]: DEBUG nova.network.neutron [req-ca4b561a-75d8-4f6e-b9de-de88cac8e581 req-7e962b93-4c96-46bb-afa6-b09e0df45433 service nova] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:26:36 user nova-compute[75066]: DEBUG nova.compute.manager [req-ca4b561a-75d8-4f6e-b9de-de88cac8e581 req-7e962b93-4c96-46bb-afa6-b09e0df45433 service nova] [instance: ecc194b4-b8b9-49c8-9d34-4213c4dc15b8] Detach interface failed, port_id=2d26e49a-f1a5-4922-b26f-2eb8c3d59368, reason: Instance ecc194b4-b8b9-49c8-9d34-4213c4dc15b8 could not be found. {{(pid=75066) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 01 19:26:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-f75d1052-56ac-4dc6-9007-981c3d7ee40a tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:26:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-f75d1052-56ac-4dc6-9007-981c3d7ee40a tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:26:36 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-f75d1052-56ac-4dc6-9007-981c3d7ee40a tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:26:36 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-f75d1052-56ac-4dc6-9007-981c3d7ee40a tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:26:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-f75d1052-56ac-4dc6-9007-981c3d7ee40a tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.476s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:26:36 user nova-compute[75066]: INFO nova.scheduler.client.report [None req-f75d1052-56ac-4dc6-9007-981c3d7ee40a tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Deleted allocations for instance ecc194b4-b8b9-49c8-9d34-4213c4dc15b8
Dec 01 19:26:37 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-f75d1052-56ac-4dc6-9007-981c3d7ee40a tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lock "ecc194b4-b8b9-49c8-9d34-4213c4dc15b8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.301s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:26:37 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:37 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:39 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:40 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:42 user nova-compute[75066]: DEBUG nova.compute.manager [req-378f894e-a1c5-4b42-8415-6ce784c7d887 req-fdaaf12f-f8f4-488c-bdda-755104d07997 service nova] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Received event network-changed-abe9d4d1-5a93-4071-bb76-8723bf6ec62c {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:26:42 user nova-compute[75066]: DEBUG nova.compute.manager [req-378f894e-a1c5-4b42-8415-6ce784c7d887 req-fdaaf12f-f8f4-488c-bdda-755104d07997 service nova] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Refreshing instance network info cache due to event network-changed-abe9d4d1-5a93-4071-bb76-8723bf6ec62c. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:26:42 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-378f894e-a1c5-4b42-8415-6ce784c7d887 req-fdaaf12f-f8f4-488c-bdda-755104d07997 service nova] Acquiring lock "refresh_cache-e84b8c28-e79e-4945-8f3c-dddd7184a166" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:26:42 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-378f894e-a1c5-4b42-8415-6ce784c7d887 req-fdaaf12f-f8f4-488c-bdda-755104d07997 service nova] Acquired lock "refresh_cache-e84b8c28-e79e-4945-8f3c-dddd7184a166" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:26:42 user nova-compute[75066]: DEBUG nova.network.neutron [req-378f894e-a1c5-4b42-8415-6ce784c7d887 req-fdaaf12f-f8f4-488c-bdda-755104d07997 service nova] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Refreshing network info cache for port abe9d4d1-5a93-4071-bb76-8723bf6ec62c {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:26:42 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:43 user nova-compute[75066]: DEBUG nova.network.neutron [req-378f894e-a1c5-4b42-8415-6ce784c7d887 req-fdaaf12f-f8f4-488c-bdda-755104d07997 service nova] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Updated VIF entry in instance network info cache for port abe9d4d1-5a93-4071-bb76-8723bf6ec62c. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:26:43 user nova-compute[75066]: DEBUG nova.network.neutron [req-378f894e-a1c5-4b42-8415-6ce784c7d887 req-fdaaf12f-f8f4-488c-bdda-755104d07997 service nova] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Updating instance_info_cache with network_info: [{"id": "abe9d4d1-5a93-4071-bb76-8723bf6ec62c", "address": "fa:16:3e:8c:32:99", "network": {"id": "49dd72ae-ec07-46a6-8463-e38bdfe1eba0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-738739404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879678dca7054c178839f56e66a6e0ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabe9d4d1-5a", "ovs_interfaceid": "abe9d4d1-5a93-4071-bb76-8723bf6ec62c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:26:43 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-378f894e-a1c5-4b42-8415-6ce784c7d887 req-fdaaf12f-f8f4-488c-bdda-755104d07997 service nova] Releasing lock "refresh_cache-e84b8c28-e79e-4945-8f3c-dddd7184a166" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:26:44 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Acquiring lock "00506483-8f09-4a3d-938a-31ab1b2dbf83" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:26:44 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "00506483-8f09-4a3d-938a-31ab1b2dbf83" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:26:44 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Starting instance... {{(pid=75066) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 19:26:44 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:26:44 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:26:44 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75066) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 19:26:44 user nova-compute[75066]: INFO nova.compute.claims [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Claim successful on node user
Dec 01 19:26:44 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:26:44 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:26:44 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.450s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:26:44 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Start building networks asynchronously for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 19:26:44 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Allocating IP information in the background. {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 19:26:44 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] allocate_for_instance() {{(pid=75066) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 19:26:44 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 19:26:44 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Start building block device mappings for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 19:26:44 user nova-compute[75066]: INFO nova.virt.block_device [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Booting with volume 333c6d2d-5a25-42f1-8a9b-9366196fd6f9 at /dev/vda
Dec 01 19:26:44 user nova-compute[75066]: DEBUG nova.policy [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cfb3e7b4b0444223af282b16da9bd919', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb0f7516d1db4dd5bc7d77a0bd1d44d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75066) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 19:26:44 user nova-compute[75066]: DEBUG os_brick.utils [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:26:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:44 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f8b2a1-b554-4b0b-abec-df2568f122b9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1959854982f\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:26:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:44 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad3ba6e-b38e-4a12-a680-43e46e3c8da8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:26:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:44 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e36919-d4bd-4a50-af75-cdaf41015bc6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:26:44 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7181623-80c7-4396-b8b0-865156c0a7b0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:26:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Running cmd (subprocess): nvme version {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] 'nvme version' failed. Not Retrying. {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:26:44 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] nvme not present on system {{(pid=75066) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 19:26:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:26:44 user nova-compute[75066]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 19:26:44 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[720fa8e7-280f-42db-9bcc-730b23a1abd0]: (4, '') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:26:44 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75066) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 19:26:44 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 19:26:44 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] LIGHTOS: no hostnqn found. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 19:26:44 user nova-compute[75066]: DEBUG os_brick.utils [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1959854982f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:26:44 user nova-compute[75066]: DEBUG nova.virt.block_device [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Updating existing volume attachment record: 730efc0c-1e0e-45c4-b48a-36d131c93bfe {{(pid=75066) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 19:26:45 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Successfully created port: b0528c8d-a14c-4420-a248-fda3f0a92893 {{(pid=75066) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 19:26:45 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:46 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Successfully updated port: b0528c8d-a14c-4420-a248-fda3f0a92893 {{(pid=75066) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 19:26:46 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Acquiring lock "refresh_cache-00506483-8f09-4a3d-938a-31ab1b2dbf83" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:26:46 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Acquired lock "refresh_cache-00506483-8f09-4a3d-938a-31ab1b2dbf83" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:26:46 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:26:46 user nova-compute[75066]: DEBUG nova.compute.manager [req-147f91ba-5d17-41db-8fcb-995b83aeac37 req-615ccd4b-b0fd-4745-8486-8f5958246944 service nova] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Received event network-changed-b0528c8d-a14c-4420-a248-fda3f0a92893 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:26:46 user nova-compute[75066]: DEBUG nova.compute.manager [req-147f91ba-5d17-41db-8fcb-995b83aeac37 req-615ccd4b-b0fd-4745-8486-8f5958246944 service nova] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Refreshing instance network info cache due to event network-changed-b0528c8d-a14c-4420-a248-fda3f0a92893. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:26:46 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-147f91ba-5d17-41db-8fcb-995b83aeac37 req-615ccd4b-b0fd-4745-8486-8f5958246944 service nova] Acquiring lock "refresh_cache-00506483-8f09-4a3d-938a-31ab1b2dbf83" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:26:46 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:26:46 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Updating instance_info_cache with network_info: [{"id": "b0528c8d-a14c-4420-a248-fda3f0a92893", "address": "fa:16:3e:a6:1a:51", "network": {"id": "9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-696310557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0f7516d1db4dd5bc7d77a0bd1d44d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0528c8d-a1", "ovs_interfaceid": "b0528c8d-a14c-4420-a248-fda3f0a92893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:26:46 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Releasing lock "refresh_cache-00506483-8f09-4a3d-938a-31ab1b2dbf83" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:26:46 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Instance network_info: |[{"id": "b0528c8d-a14c-4420-a248-fda3f0a92893", "address": "fa:16:3e:a6:1a:51", "network": {"id": "9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-696310557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0f7516d1db4dd5bc7d77a0bd1d44d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0528c8d-a1", "ovs_interfaceid": "b0528c8d-a14c-4420-a248-fda3f0a92893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 19:26:46 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-147f91ba-5d17-41db-8fcb-995b83aeac37 req-615ccd4b-b0fd-4745-8486-8f5958246944 service nova] Acquired lock "refresh_cache-00506483-8f09-4a3d-938a-31ab1b2dbf83" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:26:46 user nova-compute[75066]: DEBUG nova.network.neutron [req-147f91ba-5d17-41db-8fcb-995b83aeac37 req-615ccd4b-b0fd-4745-8486-8f5958246944 service nova] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Refreshing network info cache for port b0528c8d-a14c-4420-a248-fda3f0a92893 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:26:46 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-848fa115-5ae2-4a16-8356-2c0eb0b3f069 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Acquiring lock "e84b8c28-e79e-4945-8f3c-dddd7184a166" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:26:46 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-848fa115-5ae2-4a16-8356-2c0eb0b3f069 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "e84b8c28-e79e-4945-8f3c-dddd7184a166" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:26:46 user nova-compute[75066]: INFO nova.compute.manager [None req-848fa115-5ae2-4a16-8356-2c0eb0b3f069 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Shelving
Dec 01 19:26:46 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:46 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:46 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:46 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:47 user nova-compute[75066]: DEBUG nova.compute.manager [req-8486be14-1502-418c-8412-46481ae42c62 req-62e4ce6c-da7c-4e02-a54e-cac7753da4bf service nova] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Received event network-vif-unplugged-abe9d4d1-5a93-4071-bb76-8723bf6ec62c {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:26:47 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-8486be14-1502-418c-8412-46481ae42c62 req-62e4ce6c-da7c-4e02-a54e-cac7753da4bf service nova] Acquiring lock "e84b8c28-e79e-4945-8f3c-dddd7184a166-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:26:47 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-8486be14-1502-418c-8412-46481ae42c62 req-62e4ce6c-da7c-4e02-a54e-cac7753da4bf service nova] Lock "e84b8c28-e79e-4945-8f3c-dddd7184a166-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:26:47 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-8486be14-1502-418c-8412-46481ae42c62 req-62e4ce6c-da7c-4e02-a54e-cac7753da4bf service nova] Lock "e84b8c28-e79e-4945-8f3c-dddd7184a166-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:26:47 user nova-compute[75066]: DEBUG nova.compute.manager [req-8486be14-1502-418c-8412-46481ae42c62 req-62e4ce6c-da7c-4e02-a54e-cac7753da4bf service nova] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] No waiting events found dispatching network-vif-unplugged-abe9d4d1-5a93-4071-bb76-8723bf6ec62c {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:26:47 user nova-compute[75066]: WARNING nova.compute.manager [req-8486be14-1502-418c-8412-46481ae42c62 req-62e4ce6c-da7c-4e02-a54e-cac7753da4bf service nova] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Received unexpected event network-vif-unplugged-abe9d4d1-5a93-4071-bb76-8723bf6ec62c for instance with vm_state active and task_state shelving.
Dec 01 19:26:47 user nova-compute[75066]: DEBUG nova.network.neutron [req-147f91ba-5d17-41db-8fcb-995b83aeac37 req-615ccd4b-b0fd-4745-8486-8f5958246944 service nova] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Updated VIF entry in instance network info cache for port b0528c8d-a14c-4420-a248-fda3f0a92893. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:26:47 user nova-compute[75066]: DEBUG nova.network.neutron [req-147f91ba-5d17-41db-8fcb-995b83aeac37 req-615ccd4b-b0fd-4745-8486-8f5958246944 service nova] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Updating instance_info_cache with network_info: [{"id": "b0528c8d-a14c-4420-a248-fda3f0a92893", "address": "fa:16:3e:a6:1a:51", "network": {"id": "9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-696310557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0f7516d1db4dd5bc7d77a0bd1d44d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0528c8d-a1", "ovs_interfaceid": "b0528c8d-a14c-4420-a248-fda3f0a92893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:26:47 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-147f91ba-5d17-41db-8fcb-995b83aeac37 req-615ccd4b-b0fd-4745-8486-8f5958246944 service nova] Releasing lock "refresh_cache-00506483-8f09-4a3d-938a-31ab1b2dbf83" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:26:47 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Instance destroyed successfully.
Dec 01 19:26:47 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-848fa115-5ae2-4a16-8356-2c0eb0b3f069 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Beginning cold snapshot process
Dec 01 19:26:47 user nova-compute[75066]: DEBUG nova.privsep.utils [None req-848fa115-5ae2-4a16-8356-2c0eb0b3f069 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75066) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 01 19:26:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-848fa115-5ae2-4a16-8356-2c0eb0b3f069 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/e84b8c28-e79e-4945-8f3c-dddd7184a166/disk /opt/stack/data/nova/instances/snapshots/tmp06ql2_cu/4119f35ccf0c47ada1b06fb54da99dc7 {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:47 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:48 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-848fa115-5ae2-4a16-8356-2c0eb0b3f069 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/e84b8c28-e79e-4945-8f3c-dddd7184a166/disk /opt/stack/data/nova/instances/snapshots/tmp06ql2_cu/4119f35ccf0c47ada1b06fb54da99dc7" returned: 0 in 0.470s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:48 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-848fa115-5ae2-4a16-8356-2c0eb0b3f069 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Snapshot extracted, beginning image upload
Dec 01 19:26:49 user nova-compute[75066]: DEBUG nova.compute.manager [req-c151e795-8869-4dcf-a755-a7e4a303d902 req-870f8782-396b-4d54-843d-edcf634cb821 service nova] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Received event network-vif-plugged-abe9d4d1-5a93-4071-bb76-8723bf6ec62c {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:26:49 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-c151e795-8869-4dcf-a755-a7e4a303d902 req-870f8782-396b-4d54-843d-edcf634cb821 service nova] Acquiring lock "e84b8c28-e79e-4945-8f3c-dddd7184a166-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:26:49 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-c151e795-8869-4dcf-a755-a7e4a303d902 req-870f8782-396b-4d54-843d-edcf634cb821 service nova] Lock "e84b8c28-e79e-4945-8f3c-dddd7184a166-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:26:49 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-c151e795-8869-4dcf-a755-a7e4a303d902 req-870f8782-396b-4d54-843d-edcf634cb821 service nova] Lock "e84b8c28-e79e-4945-8f3c-dddd7184a166-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:26:49 user nova-compute[75066]: DEBUG nova.compute.manager [req-c151e795-8869-4dcf-a755-a7e4a303d902 req-870f8782-396b-4d54-843d-edcf634cb821 service nova] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] No waiting events found dispatching network-vif-plugged-abe9d4d1-5a93-4071-bb76-8723bf6ec62c {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:26:49 user nova-compute[75066]: WARNING nova.compute.manager [req-c151e795-8869-4dcf-a755-a7e4a303d902 req-870f8782-396b-4d54-843d-edcf634cb821 service nova] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Received unexpected event network-vif-plugged-abe9d4d1-5a93-4071-bb76-8723bf6ec62c for instance with vm_state active and task_state shelving_image_uploading.
Dec 01 19:26:50 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-848fa115-5ae2-4a16-8356-2c0eb0b3f069 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Snapshot image upload complete
Dec 01 19:26:50 user nova-compute[75066]: DEBUG nova.compute.manager [None req-848fa115-5ae2-4a16-8356-2c0eb0b3f069 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:26:50 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:50 user nova-compute[75066]: INFO nova.compute.manager [None req-848fa115-5ae2-4a16-8356-2c0eb0b3f069 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Shelve offloading
Dec 01 19:26:50 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Instance destroyed successfully.
Dec 01 19:26:50 user nova-compute[75066]: DEBUG nova.compute.manager [None req-848fa115-5ae2-4a16-8356-2c0eb0b3f069 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:26:50 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-848fa115-5ae2-4a16-8356-2c0eb0b3f069 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Acquiring lock "refresh_cache-e84b8c28-e79e-4945-8f3c-dddd7184a166" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:26:50 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-848fa115-5ae2-4a16-8356-2c0eb0b3f069 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Acquired lock "refresh_cache-e84b8c28-e79e-4945-8f3c-dddd7184a166" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:26:50 user nova-compute[75066]: DEBUG nova.network.neutron [None req-848fa115-5ae2-4a16-8356-2c0eb0b3f069 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:26:51 user nova-compute[75066]: DEBUG nova.network.neutron [None req-848fa115-5ae2-4a16-8356-2c0eb0b3f069 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Updating instance_info_cache with network_info: [{"id": "abe9d4d1-5a93-4071-bb76-8723bf6ec62c", "address": "fa:16:3e:8c:32:99", "network": {"id": "49dd72ae-ec07-46a6-8463-e38bdfe1eba0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-738739404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879678dca7054c178839f56e66a6e0ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabe9d4d1-5a", "ovs_interfaceid": "abe9d4d1-5a93-4071-bb76-8723bf6ec62c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:26:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-848fa115-5ae2-4a16-8356-2c0eb0b3f069 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Releasing lock "refresh_cache-e84b8c28-e79e-4945-8f3c-dddd7184a166" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:26:52 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Instance destroyed successfully.
Dec 01 19:26:52 user nova-compute[75066]: DEBUG nova.objects.instance [None req-848fa115-5ae2-4a16-8356-2c0eb0b3f069 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lazy-loading 'resources' on Instance uuid e84b8c28-e79e-4945-8f3c-dddd7184a166 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:26:52 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-848fa115-5ae2-4a16-8356-2c0eb0b3f069 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:24:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-496690915',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-496690915',id=24,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFm2fFTSILfeIc9T3aY6YY8ccEuM6T+EqbJVd9fDG+xmK7EqkqBSUEppgYTvwk5yuAt9kwnhrxfnKArtNsaxvKGjkXi1W9s0Vf9iTjlWyxyXjkzBg/S3rJKLyO34An9Qw==',key_name='tempest-keypair-20573267',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:24:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='879678dca7054c178839f56e66a6e0ce',ramdisk_id='',reservation_id='r-frzqz3qo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1680443764',owner_user_name='tempest-AttachVolumeShelveTestJSON-1680443764-project-member',shelved_at='2023-12-01T19:26:50.693576',shelved_host='user',shelved_image_id='b0e48ac0-30b0-46dc-9f72-44b9b4336892'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:26:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90e207044c0741e99c4a83b2c4746cd3',uuid=e84b8c28-e79e-4945-8f3c-dddd7184a166,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "abe9d4d1-5a93-4071-bb76-8723bf6ec62c", "address": "fa:16:3e:8c:32:99", "network": {"id": "49dd72ae-ec07-46a6-8463-e38bdfe1eba0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-738739404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879678dca7054c178839f56e66a6e0ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabe9d4d1-5a", "ovs_interfaceid": "abe9d4d1-5a93-4071-bb76-8723bf6ec62c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:26:52 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-848fa115-5ae2-4a16-8356-2c0eb0b3f069 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Converting VIF {"id": "abe9d4d1-5a93-4071-bb76-8723bf6ec62c", "address": "fa:16:3e:8c:32:99", "network": {"id": "49dd72ae-ec07-46a6-8463-e38bdfe1eba0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-738739404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879678dca7054c178839f56e66a6e0ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabe9d4d1-5a", "ovs_interfaceid": "abe9d4d1-5a93-4071-bb76-8723bf6ec62c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:26:52 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-848fa115-5ae2-4a16-8356-2c0eb0b3f069 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:32:99,bridge_name='br-int',has_traffic_filtering=True,id=abe9d4d1-5a93-4071-bb76-8723bf6ec62c,network=Network(49dd72ae-ec07-46a6-8463-e38bdfe1eba0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabe9d4d1-5a') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:26:52 user nova-compute[75066]: DEBUG os_vif [None req-848fa115-5ae2-4a16-8356-2c0eb0b3f069 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:32:99,bridge_name='br-int',has_traffic_filtering=True,id=abe9d4d1-5a93-4071-bb76-8723bf6ec62c,network=Network(49dd72ae-ec07-46a6-8463-e38bdfe1eba0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabe9d4d1-5a') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:26:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapabe9d4d1-5a, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:26:52 user nova-compute[75066]: DEBUG nova.compute.manager [req-03fe0afb-7959-4bc6-abd7-93711fd4bc33 req-01f3e9a2-bd41-438b-a46c-e6f2b366ee19 service nova] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Received event network-changed-abe9d4d1-5a93-4071-bb76-8723bf6ec62c {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:26:52 user nova-compute[75066]: DEBUG nova.compute.manager [req-03fe0afb-7959-4bc6-abd7-93711fd4bc33 req-01f3e9a2-bd41-438b-a46c-e6f2b366ee19 service nova] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Refreshing instance network info cache due to event network-changed-abe9d4d1-5a93-4071-bb76-8723bf6ec62c. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:26:52 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-03fe0afb-7959-4bc6-abd7-93711fd4bc33 req-01f3e9a2-bd41-438b-a46c-e6f2b366ee19 service nova] Acquiring lock "refresh_cache-e84b8c28-e79e-4945-8f3c-dddd7184a166" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:26:52 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-03fe0afb-7959-4bc6-abd7-93711fd4bc33 req-01f3e9a2-bd41-438b-a46c-e6f2b366ee19 service nova] Acquired lock "refresh_cache-e84b8c28-e79e-4945-8f3c-dddd7184a166" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:26:52 user nova-compute[75066]: DEBUG nova.network.neutron [req-03fe0afb-7959-4bc6-abd7-93711fd4bc33 req-01f3e9a2-bd41-438b-a46c-e6f2b366ee19 service nova] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Refreshing network info cache for port abe9d4d1-5a93-4071-bb76-8723bf6ec62c {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:26:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:26:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=006d0032-36a7-484c-92cb-524e38dbe98c) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:26:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:52 user nova-compute[75066]: INFO os_vif [None req-848fa115-5ae2-4a16-8356-2c0eb0b3f069 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:32:99,bridge_name='br-int',has_traffic_filtering=True,id=abe9d4d1-5a93-4071-bb76-8723bf6ec62c,network=Network(49dd72ae-ec07-46a6-8463-e38bdfe1eba0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabe9d4d1-5a')
Dec 01 19:26:52 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-848fa115-5ae2-4a16-8356-2c0eb0b3f069 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Deleting instance files /opt/stack/data/nova/instances/e84b8c28-e79e-4945-8f3c-dddd7184a166_del
Dec 01 19:26:52 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-848fa115-5ae2-4a16-8356-2c0eb0b3f069 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Deletion of /opt/stack/data/nova/instances/e84b8c28-e79e-4945-8f3c-dddd7184a166_del complete
Dec 01 19:26:52 user nova-compute[75066]: INFO nova.scheduler.client.report [None req-848fa115-5ae2-4a16-8356-2c0eb0b3f069 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Deleted allocations for instance e84b8c28-e79e-4945-8f3c-dddd7184a166
Dec 01 19:26:52 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-848fa115-5ae2-4a16-8356-2c0eb0b3f069 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:26:52 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-848fa115-5ae2-4a16-8356-2c0eb0b3f069 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:26:52 user nova-compute[75066]: DEBUG nova.objects.instance [None req-848fa115-5ae2-4a16-8356-2c0eb0b3f069 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lazy-loading 'numa_topology' on Instance uuid e84b8c28-e79e-4945-8f3c-dddd7184a166 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:26:52 user nova-compute[75066]: DEBUG nova.objects.base [None req-848fa115-5ae2-4a16-8356-2c0eb0b3f069 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Object Instance<e84b8c28-e79e-4945-8f3c-dddd7184a166> lazy-loaded attributes: resources,numa_topology {{(pid=75066) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 19:26:52 user nova-compute[75066]: DEBUG nova.network.neutron [req-03fe0afb-7959-4bc6-abd7-93711fd4bc33 req-01f3e9a2-bd41-438b-a46c-e6f2b366ee19 service nova] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Updated VIF entry in instance network info cache for port abe9d4d1-5a93-4071-bb76-8723bf6ec62c. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:26:52 user nova-compute[75066]: DEBUG nova.network.neutron [req-03fe0afb-7959-4bc6-abd7-93711fd4bc33 req-01f3e9a2-bd41-438b-a46c-e6f2b366ee19 service nova] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Updating instance_info_cache with network_info: [{"id": "abe9d4d1-5a93-4071-bb76-8723bf6ec62c", "address": "fa:16:3e:8c:32:99", "network": {"id": "49dd72ae-ec07-46a6-8463-e38bdfe1eba0", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-738739404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879678dca7054c178839f56e66a6e0ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapabe9d4d1-5a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:26:52 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-03fe0afb-7959-4bc6-abd7-93711fd4bc33 req-01f3e9a2-bd41-438b-a46c-e6f2b366ee19 service nova] Releasing lock "refresh_cache-e84b8c28-e79e-4945-8f3c-dddd7184a166" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:26:52 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-848fa115-5ae2-4a16-8356-2c0eb0b3f069 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:26:52 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-848fa115-5ae2-4a16-8356-2c0eb0b3f069 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:26:52 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-848fa115-5ae2-4a16-8356-2c0eb0b3f069 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.380s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:26:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:52 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-848fa115-5ae2-4a16-8356-2c0eb0b3f069 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "e84b8c28-e79e-4945-8f3c-dddd7184a166" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.050s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Start spawning the instance on the hypervisor. {{(pid=75066) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Creating instance directory {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 19:26:55 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Creating image(s)
Dec 01 19:26:55 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Did not create local disks {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Ensure instance console log exists: /opt/stack/data/nova/instances/00506483-8f09-4a3d-938a-31ab1b2dbf83/console.log {{(pid=75066) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Start _get_guest_xml network_info=[{"id": "b0528c8d-a14c-4420-a248-fda3f0a92893", "address": "fa:16:3e:a6:1a:51", "network": {"id": "9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-696310557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0f7516d1db4dd5bc7d77a0bd1d44d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0528c8d-a1", "ovs_interfaceid": "b0528c8d-a14c-4420-a248-fda3f0a92893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': True, 'attachment_id': '730efc0c-1e0e-45c4-b48a-36d131c93bfe', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gLtkPwAS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '00506483-8f09-4a3d-938a-31ab1b2dbf83', 'attached_at': '', 'detached_at': '', 'volume_id': '333c6d2d-5a25-42f1-8a9b-9366196fd6f9', 'serial': '333c6d2d-5a25-42f1-8a9b-9366196fd6f9'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:26:55 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:26:55 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:26:55 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Calling os-brick to attach iSCSI Volume {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gLtkPwAS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:26:55 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:26:55 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:26:55 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:26:55 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:26:55 user nova-compute[75066]: INFO os_brick.initiator.connectors.iscsi [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 19:26:55 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 -p 172.16.0.220:3260 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[f94a8bcf-f2e3-4725-8ca0-1cc4be1750de]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 19:26:55 user nova-compute[75066]:  {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc830ab0-0ba5-4c82-847c-22bcf70c2b06]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9] added\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9] added
Dec 01 19:26:55 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64ab97e-b64c-4fb4-a8e9-cf7a0b75d743]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62eff84-8025-4453-b405-6d5648154e97]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gLtkPwAS {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gLtkPwAS" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25b58d1-8746-4d44-8011-e75d8f3d1393]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gLtkPwAS'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf1db19-4fb4-4d16-9944-bcb1be3dbfd1]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d62066-e9f5-4cfc-a141-51f66b011fa3]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:26:55 user nova-compute[75066]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)
Dec 01 19:26:55 user nova-compute[75066]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd (non-flash)
Dec 01 19:26:55 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:26:55 user nova-compute[75066]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)
Dec 01 19:26:55 user nova-compute[75066]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd (non-flash)
Dec 01 19:26:55 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 -p 172.16.0.220:3260 --login {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0d4f1e-cb17-4d46-85f6-eccba774c92a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9, portal: 172.16.0.220,3260]
Dec 01 19:26:55 user nova-compute[75066]: Login to [iface: default, target: iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9, portal: 172.16.0.220,3260] successful.
Dec 01 19:26:55 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[6501b463-9284-4296-aff4-6decab67cd58]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e3724c-e42c-40b1-9868-5e8199f68b8c]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:26:55 user nova-compute[75066]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)
Dec 01 19:26:55 user nova-compute[75066]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd (non-flash)
Dec 01 19:26:55 user nova-compute[75066]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)
Dec 01 19:26:55 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:26:55 user nova-compute[75066]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)
Dec 01 19:26:55 user nova-compute[75066]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd (non-flash)
Dec 01 19:26:55 user nova-compute[75066]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)
Dec 01 19:26:55 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Connected to 172.16.0.220:3260 {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] HCTL ('35', '-', '-', 0) found on session 30 with lun 0 {{(pid=75066) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75066) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 19:26:55 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:26:56 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:26:56 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd41a82-a54d-4a0e-ab18-c5af23865628]: (4, ('- - 0', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:26:56 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:26:56 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gLtkPwAS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 19:26:57 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:26:57 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '26365323832643863', 'path': '/dev/sdd'} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:26:57 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365323832643863', 'path': '/dev/sdd'} {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 19:26:57 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:26:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1664862107',display_name='tempest-ServerActionsTestOtherA-server-1664862107',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1664862107',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAjcDJi5RJTCazFFAj7dx2qLuKSEoyASrqNDKgiQGRQPewzJhIu6lQd3yuH2207H2lpqZiyuqBj2lXvz5vQM52pZXpO90p/UH43nVMO2RrMH5S7NUl16+at0nkGQGj24ng==',key_name='tempest-keypair-1092575275',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb0f7516d1db4dd5bc7d77a0bd1d44d7',ramdisk_id='',reservation_id='r-5u7ef9p2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1700253921',owner_user_name='tempest-ServerActionsTestOtherA-1700253921-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:26:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfb3e7b4b0444223af282b16da9bd919',uuid=00506483-8f09-4a3d-938a-31ab1b2dbf83,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0528c8d-a14c-4420-a248-fda3f0a92893", "address": "fa:16:3e:a6:1a:51", "network": {"id": "9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-696310557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0f7516d1db4dd5bc7d77a0bd1d44d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0528c8d-a1", "ovs_interfaceid": "b0528c8d-a14c-4420-a248-fda3f0a92893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:26:57 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Converting VIF {"id": "b0528c8d-a14c-4420-a248-fda3f0a92893", "address": "fa:16:3e:a6:1a:51", "network": {"id": "9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-696310557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0f7516d1db4dd5bc7d77a0bd1d44d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0528c8d-a1", "ovs_interfaceid": "b0528c8d-a14c-4420-a248-fda3f0a92893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:26:57 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:1a:51,bridge_name='br-int',has_traffic_filtering=True,id=b0528c8d-a14c-4420-a248-fda3f0a92893,network=Network(9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0528c8d-a1') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:26:57 user nova-compute[75066]: DEBUG nova.objects.instance [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lazy-loading 'pci_devices' on Instance uuid 00506483-8f09-4a3d-938a-31ab1b2dbf83 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:26:57 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:26:57 user nova-compute[75066]:   <uuid>00506483-8f09-4a3d-938a-31ab1b2dbf83</uuid>
Dec 01 19:26:57 user nova-compute[75066]:   <name>instance-0000001c</name>
Dec 01 19:26:57 user nova-compute[75066]:   <memory>524288</memory>
Dec 01 19:26:57 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:26:57 user nova-compute[75066]:   <metadata>
Dec 01 19:26:57 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:26:57 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:26:57 user nova-compute[75066]:       <nova:name>tempest-ServerActionsTestOtherA-server-1664862107</nova:name>
Dec 01 19:26:57 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:26:55</nova:creationTime>
Dec 01 19:26:57 user nova-compute[75066]:       <nova:flavor name="m1.tiny">
Dec 01 19:26:57 user nova-compute[75066]:         <nova:memory>512</nova:memory>
Dec 01 19:26:57 user nova-compute[75066]:         <nova:disk>1</nova:disk>
Dec 01 19:26:57 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:26:57 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:26:57 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:26:57 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:26:57 user nova-compute[75066]:       <nova:owner>
Dec 01 19:26:57 user nova-compute[75066]:         <nova:user uuid="cfb3e7b4b0444223af282b16da9bd919">tempest-ServerActionsTestOtherA-1700253921-project-member</nova:user>
Dec 01 19:26:57 user nova-compute[75066]:         <nova:project uuid="fb0f7516d1db4dd5bc7d77a0bd1d44d7">tempest-ServerActionsTestOtherA-1700253921</nova:project>
Dec 01 19:26:57 user nova-compute[75066]:       </nova:owner>
Dec 01 19:26:57 user nova-compute[75066]:       <nova:ports>
Dec 01 19:26:57 user nova-compute[75066]:         <nova:port uuid="b0528c8d-a14c-4420-a248-fda3f0a92893">
Dec 01 19:26:57 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Dec 01 19:26:57 user nova-compute[75066]:         </nova:port>
Dec 01 19:26:57 user nova-compute[75066]:       </nova:ports>
Dec 01 19:26:57 user nova-compute[75066]:     </nova:instance>
Dec 01 19:26:57 user nova-compute[75066]:   </metadata>
Dec 01 19:26:57 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:26:57 user nova-compute[75066]:     <system>
Dec 01 19:26:57 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:26:57 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:26:57 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:26:57 user nova-compute[75066]:       <entry name="serial">00506483-8f09-4a3d-938a-31ab1b2dbf83</entry>
Dec 01 19:26:57 user nova-compute[75066]:       <entry name="uuid">00506483-8f09-4a3d-938a-31ab1b2dbf83</entry>
Dec 01 19:26:57 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:26:57 user nova-compute[75066]:     </system>
Dec 01 19:26:57 user nova-compute[75066]:   </sysinfo>
Dec 01 19:26:57 user nova-compute[75066]:   <os>
Dec 01 19:26:57 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:26:57 user nova-compute[75066]:     <boot dev="hd"/>
Dec 01 19:26:57 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:26:57 user nova-compute[75066]:   </os>
Dec 01 19:26:57 user nova-compute[75066]:   <features>
Dec 01 19:26:57 user nova-compute[75066]:     <acpi/>
Dec 01 19:26:57 user nova-compute[75066]:     <apic/>
Dec 01 19:26:57 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:26:57 user nova-compute[75066]:   </features>
Dec 01 19:26:57 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:26:57 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:26:57 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:26:57 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:26:57 user nova-compute[75066]:   </clock>
Dec 01 19:26:57 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:26:57 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:26:57 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:26:57 user nova-compute[75066]:   </cpu>
Dec 01 19:26:57 user nova-compute[75066]:   <devices>
Dec 01 19:26:57 user nova-compute[75066]:     <disk type="block" device="disk">
Dec 01 19:26:57 user nova-compute[75066]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:26:57 user nova-compute[75066]:       <source dev="/dev/sdd"/>
Dec 01 19:26:57 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:26:57 user nova-compute[75066]:       <serial>333c6d2d-5a25-42f1-8a9b-9366196fd6f9</serial>
Dec 01 19:26:57 user nova-compute[75066]:     </disk>
Dec 01 19:26:57 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:26:57 user nova-compute[75066]:       <mac address="fa:16:3e:a6:1a:51"/>
Dec 01 19:26:57 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:26:57 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:26:57 user nova-compute[75066]:       <target dev="tapb0528c8d-a1"/>
Dec 01 19:26:57 user nova-compute[75066]:     </interface>
Dec 01 19:26:57 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:26:57 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/00506483-8f09-4a3d-938a-31ab1b2dbf83/console.log" append="off"/>
Dec 01 19:26:57 user nova-compute[75066]:     </serial>
Dec 01 19:26:57 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:26:57 user nova-compute[75066]:     <video>
Dec 01 19:26:57 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:26:57 user nova-compute[75066]:     </video>
Dec 01 19:26:57 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:26:57 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:26:57 user nova-compute[75066]:     </rng>
Dec 01 19:26:57 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:26:57 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:26:57 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:26:57 user nova-compute[75066]:     </memballoon>
Dec 01 19:26:57 user nova-compute[75066]:   </devices>
Dec 01 19:26:57 user nova-compute[75066]: </domain>
Dec 01 19:26:57 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:26:57 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:26:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1664862107',display_name='tempest-ServerActionsTestOtherA-server-1664862107',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1664862107',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAjcDJi5RJTCazFFAj7dx2qLuKSEoyASrqNDKgiQGRQPewzJhIu6lQd3yuH2207H2lpqZiyuqBj2lXvz5vQM52pZXpO90p/UH43nVMO2RrMH5S7NUl16+at0nkGQGj24ng==',key_name='tempest-keypair-1092575275',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fb0f7516d1db4dd5bc7d77a0bd1d44d7',ramdisk_id='',reservation_id='r-5u7ef9p2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1700253921',owner_user_name='tempest-ServerActionsTestOtherA-1700253921-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:26:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfb3e7b4b0444223af282b16da9bd919',uuid=00506483-8f09-4a3d-938a-31ab1b2dbf83,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0528c8d-a14c-4420-a248-fda3f0a92893", "address": "fa:16:3e:a6:1a:51", "network": {"id": "9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-696310557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0f7516d1db4dd5bc7d77a0bd1d44d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0528c8d-a1", "ovs_interfaceid": "b0528c8d-a14c-4420-a248-fda3f0a92893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:26:57 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Converting VIF {"id": "b0528c8d-a14c-4420-a248-fda3f0a92893", "address": "fa:16:3e:a6:1a:51", "network": {"id": "9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-696310557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0f7516d1db4dd5bc7d77a0bd1d44d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0528c8d-a1", "ovs_interfaceid": "b0528c8d-a14c-4420-a248-fda3f0a92893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:26:57 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:1a:51,bridge_name='br-int',has_traffic_filtering=True,id=b0528c8d-a14c-4420-a248-fda3f0a92893,network=Network(9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0528c8d-a1') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:26:57 user nova-compute[75066]: DEBUG os_vif [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:1a:51,bridge_name='br-int',has_traffic_filtering=True,id=b0528c8d-a14c-4420-a248-fda3f0a92893,network=Network(9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0528c8d-a1') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:26:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:26:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:26:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '57ecada9-4f80-59a8-9466-9d10654167fd', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:26:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb0528c8d-a1, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:26:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb0528c8d-a1, col_values=(('qos', UUID('c5cfd9ff-8bba-4b36-9e9e-8e86dfbcea05')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:26:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb0528c8d-a1, col_values=(('external_ids', {'iface-id': 'b0528c8d-a14c-4420-a248-fda3f0a92893', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:1a:51', 'vm-uuid': '00506483-8f09-4a3d-938a-31ab1b2dbf83'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:26:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:26:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:57 user nova-compute[75066]: INFO os_vif [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:1a:51,bridge_name='br-int',has_traffic_filtering=True,id=b0528c8d-a14c-4420-a248-fda3f0a92893,network=Network(9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0528c8d-a1')
Dec 01 19:26:57 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:26:57 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] No VIF found with MAC fa:16:3e:a6:1a:51, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:26:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:58 user nova-compute[75066]: DEBUG nova.compute.manager [req-4293648b-fe95-4a1b-9199-6265cd0a7bf6 req-ebe39197-16bc-4be6-b7f0-a72e526504ee service nova] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Received event network-vif-plugged-b0528c8d-a14c-4420-a248-fda3f0a92893 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:26:58 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-4293648b-fe95-4a1b-9199-6265cd0a7bf6 req-ebe39197-16bc-4be6-b7f0-a72e526504ee service nova] Acquiring lock "00506483-8f09-4a3d-938a-31ab1b2dbf83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:26:58 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-4293648b-fe95-4a1b-9199-6265cd0a7bf6 req-ebe39197-16bc-4be6-b7f0-a72e526504ee service nova] Lock "00506483-8f09-4a3d-938a-31ab1b2dbf83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:26:58 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-4293648b-fe95-4a1b-9199-6265cd0a7bf6 req-ebe39197-16bc-4be6-b7f0-a72e526504ee service nova] Lock "00506483-8f09-4a3d-938a-31ab1b2dbf83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:26:58 user nova-compute[75066]: DEBUG nova.compute.manager [req-4293648b-fe95-4a1b-9199-6265cd0a7bf6 req-ebe39197-16bc-4be6-b7f0-a72e526504ee service nova] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] No waiting events found dispatching network-vif-plugged-b0528c8d-a14c-4420-a248-fda3f0a92893 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:26:58 user nova-compute[75066]: WARNING nova.compute.manager [req-4293648b-fe95-4a1b-9199-6265cd0a7bf6 req-ebe39197-16bc-4be6-b7f0-a72e526504ee service nova] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Received unexpected event network-vif-plugged-b0528c8d-a14c-4420-a248-fda3f0a92893 for instance with vm_state building and task_state spawning.
Dec 01 19:26:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:26:58 user nova-compute[75066]: DEBUG nova.compute.manager [req-e19a26ff-000e-4397-bba3-42cc9220232d req-9be83f2c-995e-4593-823e-f389bc5e9274 service nova] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Received event network-changed-bc61a5e3-0188-4f8e-8d3e-29954e60ea4c {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:26:58 user nova-compute[75066]: DEBUG nova.compute.manager [req-e19a26ff-000e-4397-bba3-42cc9220232d req-9be83f2c-995e-4593-823e-f389bc5e9274 service nova] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Refreshing instance network info cache due to event network-changed-bc61a5e3-0188-4f8e-8d3e-29954e60ea4c. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:26:58 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-e19a26ff-000e-4397-bba3-42cc9220232d req-9be83f2c-995e-4593-823e-f389bc5e9274 service nova] Acquiring lock "refresh_cache-e32ba192-38b9-46f0-b164-1652a43cf3d2" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:26:58 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-e19a26ff-000e-4397-bba3-42cc9220232d req-9be83f2c-995e-4593-823e-f389bc5e9274 service nova] Acquired lock "refresh_cache-e32ba192-38b9-46f0-b164-1652a43cf3d2" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:26:58 user nova-compute[75066]: DEBUG nova.network.neutron [req-e19a26ff-000e-4397-bba3-42cc9220232d req-9be83f2c-995e-4593-823e-f389bc5e9274 service nova] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Refreshing network info cache for port bc61a5e3-0188-4f8e-8d3e-29954e60ea4c {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:26:59 user nova-compute[75066]: DEBUG nova.network.neutron [req-e19a26ff-000e-4397-bba3-42cc9220232d req-9be83f2c-995e-4593-823e-f389bc5e9274 service nova] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Updated VIF entry in instance network info cache for port bc61a5e3-0188-4f8e-8d3e-29954e60ea4c. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:26:59 user nova-compute[75066]: DEBUG nova.network.neutron [req-e19a26ff-000e-4397-bba3-42cc9220232d req-9be83f2c-995e-4593-823e-f389bc5e9274 service nova] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Updating instance_info_cache with network_info: [{"id": "bc61a5e3-0188-4f8e-8d3e-29954e60ea4c", "address": "fa:16:3e:27:e2:3b", "network": {"id": "195edf10-5722-4eef-b117-7a450e973afa", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2017280124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fb5b77e2da142499315e0a96f86d959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc61a5e3-01", "ovs_interfaceid": "bc61a5e3-0188-4f8e-8d3e-29954e60ea4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:26:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-e19a26ff-000e-4397-bba3-42cc9220232d req-9be83f2c-995e-4593-823e-f389bc5e9274 service nova] Releasing lock "refresh_cache-e32ba192-38b9-46f0-b164-1652a43cf3d2" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:27:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e4611580-9631-4011-aa5f-365121a7bcd3 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Acquiring lock "e32ba192-38b9-46f0-b164-1652a43cf3d2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:27:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e4611580-9631-4011-aa5f-365121a7bcd3 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lock "e32ba192-38b9-46f0-b164-1652a43cf3d2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:27:00 user nova-compute[75066]: DEBUG nova.objects.instance [None req-e4611580-9631-4011-aa5f-365121a7bcd3 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lazy-loading 'flavor' on Instance uuid e32ba192-38b9-46f0-b164-1652a43cf3d2 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:27:00 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-e4611580-9631-4011-aa5f-365121a7bcd3 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Ignoring supplied device name: /dev/vdb
Dec 01 19:27:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e4611580-9631-4011-aa5f-365121a7bcd3 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lock "e32ba192-38b9-46f0-b164-1652a43cf3d2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:27:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e4611580-9631-4011-aa5f-365121a7bcd3 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Acquiring lock "e32ba192-38b9-46f0-b164-1652a43cf3d2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:27:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e4611580-9631-4011-aa5f-365121a7bcd3 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lock "e32ba192-38b9-46f0-b164-1652a43cf3d2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:27:00 user nova-compute[75066]: INFO nova.compute.manager [None req-e4611580-9631-4011-aa5f-365121a7bcd3 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Attaching volume 80cd56ab-657c-459d-aab2-011d8dd87237 to /dev/vdb
Dec 01 19:27:00 user nova-compute[75066]: DEBUG os_brick.utils [None req-e4611580-9631-4011-aa5f-365121a7bcd3 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:27:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:00 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c16134d-cc4a-40ac-8305-27435d5d5c0d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1959854982f\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:00 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[686cbbca-7f5a-465e-8a7d-78a19097d878]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:00 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[4667feb3-57ea-4912-b8ba-68015cda468b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:00 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[719a4ad3-da20-4578-9290-3ec58fdbb530]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-e4611580-9631-4011-aa5f-365121a7bcd3 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Running cmd (subprocess): nvme version {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-e4611580-9631-4011-aa5f-365121a7bcd3 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] 'nvme version' failed. Not Retrying. {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:27:00 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e4611580-9631-4011-aa5f-365121a7bcd3 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] nvme not present on system {{(pid=75066) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 19:27:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:27:00 user nova-compute[75066]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 19:27:00 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aa3704d-6c9b-4987-b79e-f410acf90418]: (4, '') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:00 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-e4611580-9631-4011-aa5f-365121a7bcd3 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75066) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 19:27:00 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-e4611580-9631-4011-aa5f-365121a7bcd3 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 19:27:00 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-e4611580-9631-4011-aa5f-365121a7bcd3 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] LIGHTOS: no hostnqn found. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 19:27:00 user nova-compute[75066]: DEBUG os_brick.utils [None req-e4611580-9631-4011-aa5f-365121a7bcd3 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1959854982f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:27:00 user nova-compute[75066]: DEBUG nova.virt.block_device [None req-e4611580-9631-4011-aa5f-365121a7bcd3 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Updating existing volume attachment record: 914cf277-07cf-46c3-91e9-aac09753fd2c {{(pid=75066) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 19:27:00 user nova-compute[75066]: DEBUG nova.compute.manager [req-8829f19a-a2bf-4abe-a07b-b925df4fb2d6 req-7499cc37-b385-4902-93c5-777b6879d697 service nova] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Received event network-vif-plugged-b0528c8d-a14c-4420-a248-fda3f0a92893 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:27:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-8829f19a-a2bf-4abe-a07b-b925df4fb2d6 req-7499cc37-b385-4902-93c5-777b6879d697 service nova] Acquiring lock "00506483-8f09-4a3d-938a-31ab1b2dbf83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:27:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-8829f19a-a2bf-4abe-a07b-b925df4fb2d6 req-7499cc37-b385-4902-93c5-777b6879d697 service nova] Lock "00506483-8f09-4a3d-938a-31ab1b2dbf83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:27:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-8829f19a-a2bf-4abe-a07b-b925df4fb2d6 req-7499cc37-b385-4902-93c5-777b6879d697 service nova] Lock "00506483-8f09-4a3d-938a-31ab1b2dbf83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:27:00 user nova-compute[75066]: DEBUG nova.compute.manager [req-8829f19a-a2bf-4abe-a07b-b925df4fb2d6 req-7499cc37-b385-4902-93c5-777b6879d697 service nova] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] No waiting events found dispatching network-vif-plugged-b0528c8d-a14c-4420-a248-fda3f0a92893 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:27:00 user nova-compute[75066]: WARNING nova.compute.manager [req-8829f19a-a2bf-4abe-a07b-b925df4fb2d6 req-7499cc37-b385-4902-93c5-777b6879d697 service nova] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Received unexpected event network-vif-plugged-b0528c8d-a14c-4420-a248-fda3f0a92893 for instance with vm_state building and task_state spawning.
Dec 01 19:27:00 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Instance event wait completed in 0 seconds for  {{(pid=75066) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 19:27:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Guest created on hypervisor {{(pid=75066) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 19:27:00 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Instance spawned successfully.
Dec 01 19:27:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 19:27:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Found default for hw_cdrom_bus of ide {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:27:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Found default for hw_disk_bus of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:27:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Found default for hw_input_bus of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:27:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Found default for hw_pointer_model of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:27:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Found default for hw_video_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:27:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Found default for hw_vif_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:27:00 user nova-compute[75066]: INFO nova.compute.manager [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Took 5.12 seconds to spawn the instance on the hypervisor.
Dec 01 19:27:00 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:27:00 user nova-compute[75066]: INFO nova.compute.manager [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Took 16.76 seconds to build instance.
Dec 01 19:27:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] Acquiring lock "22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:27:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] Lock "22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:27:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ea9da7ae-282c-49a4-9334-650889c4b38e tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "00506483-8f09-4a3d-938a-31ab1b2dbf83" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.865s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:27:00 user nova-compute[75066]: DEBUG nova.compute.manager [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Starting instance... {{(pid=75066) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 19:27:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:27:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:27:01 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75066) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 19:27:01 user nova-compute[75066]: INFO nova.compute.claims [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Claim successful on node user
Dec 01 19:27:01 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:27:01 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:27:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.463s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:27:01 user nova-compute[75066]: DEBUG nova.compute.manager [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Start building networks asynchronously for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 19:27:01 user nova-compute[75066]: DEBUG nova.compute.manager [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Allocating IP information in the background. {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 19:27:01 user nova-compute[75066]: DEBUG nova.network.neutron [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] allocate_for_instance() {{(pid=75066) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 19:27:01 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 19:27:01 user nova-compute[75066]: DEBUG nova.compute.manager [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Start building block device mappings for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 19:27:01 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:27:01 user nova-compute[75066]: INFO nova.virt.block_device [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Booting with volume 2b6f49bc-879c-4cf5-809d-6c1ef44cba78 at /dev/vda
Dec 01 19:27:01 user nova-compute[75066]: DEBUG os_brick.utils [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:27:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:01 user nova-compute[75066]: DEBUG nova.policy [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '518cf2ab2ec94b13bfdccb9ccd4a0ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48bc6e4f5cd340629d0dc911144bc461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75066) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 19:27:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:01 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d983851-4786-47fd-91e5-f8805c834bc1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1959854982f\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:01 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[f676482a-0ac5-4e8a-806d-3fdb83295380]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:01 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[abbd9219-40ac-45b1-82ea-c1582b389693]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:01 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f790a2-6dcf-4f71-b353-95e6df1f3071]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] Running cmd (subprocess): nvme version {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] 'nvme version' failed. Not Retrying. {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:27:01 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] nvme not present on system {{(pid=75066) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 19:27:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:27:01 user nova-compute[75066]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 19:27:01 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[3255bf39-5543-438a-b2d6-c27fc470facd]: (4, '') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:01 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75066) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 19:27:01 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 19:27:01 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] LIGHTOS: no hostnqn found. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 19:27:02 user nova-compute[75066]: DEBUG os_brick.utils [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1959854982f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:27:02 user nova-compute[75066]: DEBUG nova.virt.block_device [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Updating existing volume attachment record: 38aa9894-8d34-4e47-a418-5d2f92759efb {{(pid=75066) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 19:27:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:02 user nova-compute[75066]: DEBUG nova.network.neutron [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Successfully created port: 01d3bbe9-6b94-4d41-8054-9a525c08ad07 {{(pid=75066) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 19:27:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:03 user nova-compute[75066]: DEBUG nova.network.neutron [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Successfully created port: b2a9f764-ab49-4ca2-aa95-96bdbbd239c5 {{(pid=75066) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 19:27:04 user nova-compute[75066]: DEBUG nova.network.neutron [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Successfully created port: 34ad241e-f800-489f-9fb7-037e738051c9 {{(pid=75066) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 19:27:04 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:27:04 user nova-compute[75066]: DEBUG nova.network.neutron [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Successfully created port: b41eba69-dd88-43d2-a481-9ee9fee0e007 {{(pid=75066) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 19:27:04 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Acquiring lock "8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:27:04 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:27:05 user nova-compute[75066]: DEBUG nova.compute.manager [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Starting instance... {{(pid=75066) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 19:27:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:27:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:27:05 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75066) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 19:27:05 user nova-compute[75066]: INFO nova.compute.claims [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Claim successful on node user
Dec 01 19:27:05 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:27:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:27:05 user nova-compute[75066]: DEBUG nova.network.neutron [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Successfully created port: 53dd7ae4-2e22-4a10-b9cb-972db80c809d {{(pid=75066) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 19:27:05 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:27:05 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:27:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.547s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:27:05 user nova-compute[75066]: DEBUG nova.compute.manager [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Start building networks asynchronously for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 19:27:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.367s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:27:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.016s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:27:05 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75066) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 19:27:05 user nova-compute[75066]: DEBUG nova.compute.manager [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Allocating IP information in the background. {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 19:27:05 user nova-compute[75066]: DEBUG nova.network.neutron [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] allocate_for_instance() {{(pid=75066) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 19:27:05 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 19:27:05 user nova-compute[75066]: DEBUG nova.compute.manager [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Start building block device mappings for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 19:27:05 user nova-compute[75066]: DEBUG nova.policy [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '964c1681ca8745d0b3879266d24f507e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e000d89bca44cd8acba504256d8d1f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75066) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 19:27:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a553e030-0d69-4725-9f84-6c0c63556ed4/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:06 user nova-compute[75066]: DEBUG nova.compute.manager [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Start spawning the instance on the hypervisor. {{(pid=75066) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 19:27:06 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Creating instance directory {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 19:27:06 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Creating image(s)
Dec 01 19:27:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Acquiring lock "/opt/stack/data/nova/instances/8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:27:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "/opt/stack/data/nova/instances/8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:27:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "/opt/stack/data/nova/instances/8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:27:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a553e030-0d69-4725-9f84-6c0c63556ed4/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a553e030-0d69-4725-9f84-6c0c63556ed4/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:06 user nova-compute[75066]: DEBUG nova.network.neutron [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Successfully updated port: 01d3bbe9-6b94-4d41-8054-9a525c08ad07 {{(pid=75066) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 19:27:06 user nova-compute[75066]: DEBUG nova.compute.manager [req-17432847-47b1-43f6-ab96-da41098fcb42 req-1b487054-45aa-43fe-982a-4f7d40fa5a02 service nova] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Received event network-changed-01d3bbe9-6b94-4d41-8054-9a525c08ad07 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:27:06 user nova-compute[75066]: DEBUG nova.compute.manager [req-17432847-47b1-43f6-ab96-da41098fcb42 req-1b487054-45aa-43fe-982a-4f7d40fa5a02 service nova] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Refreshing instance network info cache due to event network-changed-01d3bbe9-6b94-4d41-8054-9a525c08ad07. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:27:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-17432847-47b1-43f6-ab96-da41098fcb42 req-1b487054-45aa-43fe-982a-4f7d40fa5a02 service nova] Acquiring lock "refresh_cache-22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:27:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-17432847-47b1-43f6-ab96-da41098fcb42 req-1b487054-45aa-43fe-982a-4f7d40fa5a02 service nova] Acquired lock "refresh_cache-22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:27:06 user nova-compute[75066]: DEBUG nova.network.neutron [req-17432847-47b1-43f6-ab96-da41098fcb42 req-1b487054-45aa-43fe-982a-4f7d40fa5a02 service nova] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Refreshing network info cache for port 01d3bbe9-6b94-4d41-8054-9a525c08ad07 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:27:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.244s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Acquiring lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:27:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:27:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:06 user nova-compute[75066]: DEBUG nova.network.neutron [req-17432847-47b1-43f6-ab96-da41098fcb42 req-1b487054-45aa-43fe-982a-4f7d40fa5a02 service nova] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:27:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a553e030-0d69-4725-9f84-6c0c63556ed4/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.179s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298/disk 1073741824 {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e32ba192-38b9-46f0-b164-1652a43cf3d2/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298/disk 1073741824" returned: 0 in 0.105s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.291s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:27:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:06 user nova-compute[75066]: DEBUG nova.network.neutron [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Successfully created port: 7654d80f-b374-4865-9ea5-17f0f93696fe {{(pid=75066) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 19:27:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e32ba192-38b9-46f0-b164-1652a43cf3d2/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e32ba192-38b9-46f0-b164-1652a43cf3d2/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:06 user nova-compute[75066]: DEBUG nova.network.neutron [req-17432847-47b1-43f6-ab96-da41098fcb42 req-1b487054-45aa-43fe-982a-4f7d40fa5a02 service nova] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:27:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-17432847-47b1-43f6-ab96-da41098fcb42 req-1b487054-45aa-43fe-982a-4f7d40fa5a02 service nova] Releasing lock "refresh_cache-22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:27:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.245s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:06 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298/disk. size=1073741824 {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 19:27:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e32ba192-38b9-46f0-b164-1652a43cf3d2/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:06 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:27:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b355778-bd25-42f6-8026-110668920d8b/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:07 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Cannot resize image /opt/stack/data/nova/instances/8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298/disk to a smaller size. {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 19:27:07 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Created local disks {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 19:27:07 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Ensure instance console log exists: /opt/stack/data/nova/instances/8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298/console.log {{(pid=75066) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 19:27:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:27:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:27:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:27:07 user nova-compute[75066]: DEBUG nova.network.neutron [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Successfully updated port: 5a6f499f-c49b-41a7-b9de-e18c2a2aa73c {{(pid=75066) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 19:27:07 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b355778-bd25-42f6-8026-110668920d8b/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b355778-bd25-42f6-8026-110668920d8b/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b355778-bd25-42f6-8026-110668920d8b/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:07 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23e17727-40b4-48f7-9155-abc8ffa9f619/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:07 user nova-compute[75066]: DEBUG nova.network.neutron [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Successfully updated port: 9ad8ee80-89a9-42be-b618-3a59007ca35b {{(pid=75066) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23e17727-40b4-48f7-9155-abc8ffa9f619/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23e17727-40b4-48f7-9155-abc8ffa9f619/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG nova.network.neutron [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Successfully updated port: 7654d80f-b374-4865-9ea5-17f0f93696fe {{(pid=75066) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Acquiring lock "refresh_cache-8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Acquired lock "refresh_cache-8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG nova.network.neutron [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG nova.compute.manager [req-cfbf9073-ddf0-4874-92e5-8c6cacfbdf32 req-4c19c5ea-4bf4-4cbf-a86f-4911dc45a0af service nova] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Received event network-changed-e5f3728a-541f-4b95-9feb-6119687f2eba {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG nova.compute.manager [req-cfbf9073-ddf0-4874-92e5-8c6cacfbdf32 req-4c19c5ea-4bf4-4cbf-a86f-4911dc45a0af service nova] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Refreshing instance network info cache due to event network-changed-e5f3728a-541f-4b95-9feb-6119687f2eba. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-cfbf9073-ddf0-4874-92e5-8c6cacfbdf32 req-4c19c5ea-4bf4-4cbf-a86f-4911dc45a0af service nova] Acquiring lock "refresh_cache-391945f6-fe47-4969-a497-bd320d66cfa3" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-cfbf9073-ddf0-4874-92e5-8c6cacfbdf32 req-4c19c5ea-4bf4-4cbf-a86f-4911dc45a0af service nova] Acquired lock "refresh_cache-391945f6-fe47-4969-a497-bd320d66cfa3" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG nova.network.neutron [req-cfbf9073-ddf0-4874-92e5-8c6cacfbdf32 req-4c19c5ea-4bf4-4cbf-a86f-4911dc45a0af service nova] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Refreshing network info cache for port e5f3728a-541f-4b95-9feb-6119687f2eba {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG nova.network.neutron [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23e17727-40b4-48f7-9155-abc8ffa9f619/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG nova.compute.manager [req-1d94920e-84f0-41db-95a0-5af9b3ce5199 req-d4a885e3-80a8-4728-9bab-1c5977fca089 service nova] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Received event network-changed-5a6f499f-c49b-41a7-b9de-e18c2a2aa73c {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG nova.compute.manager [req-1d94920e-84f0-41db-95a0-5af9b3ce5199 req-d4a885e3-80a8-4728-9bab-1c5977fca089 service nova] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Refreshing instance network info cache due to event network-changed-5a6f499f-c49b-41a7-b9de-e18c2a2aa73c. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-1d94920e-84f0-41db-95a0-5af9b3ce5199 req-d4a885e3-80a8-4728-9bab-1c5977fca089 service nova] Acquiring lock "refresh_cache-22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-1d94920e-84f0-41db-95a0-5af9b3ce5199 req-d4a885e3-80a8-4728-9bab-1c5977fca089 service nova] Acquired lock "refresh_cache-22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG nova.network.neutron [req-1d94920e-84f0-41db-95a0-5af9b3ce5199 req-d4a885e3-80a8-4728-9bab-1c5977fca089 service nova] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Refreshing network info cache for port 5a6f499f-c49b-41a7-b9de-e18c2a2aa73c {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG nova.network.neutron [req-1d94920e-84f0-41db-95a0-5af9b3ce5199 req-d4a885e3-80a8-4728-9bab-1c5977fca089 service nova] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG nova.network.neutron [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Updating instance_info_cache with network_info: [{"id": "7654d80f-b374-4865-9ea5-17f0f93696fe", "address": "fa:16:3e:b6:38:39", "network": {"id": "6b0f48b7-3db2-49b2-a238-8fd811b52d62", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1688127634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e000d89bca44cd8acba504256d8d1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7654d80f-b3", "ovs_interfaceid": "7654d80f-b374-4865-9ea5-17f0f93696fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Releasing lock "refresh_cache-8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG nova.compute.manager [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Instance network_info: |[{"id": "7654d80f-b374-4865-9ea5-17f0f93696fe", "address": "fa:16:3e:b6:38:39", "network": {"id": "6b0f48b7-3db2-49b2-a238-8fd811b52d62", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1688127634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e000d89bca44cd8acba504256d8d1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7654d80f-b3", "ovs_interfaceid": "7654d80f-b374-4865-9ea5-17f0f93696fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Start _get_guest_xml network_info=[{"id": "7654d80f-b374-4865-9ea5-17f0f93696fe", "address": "fa:16:3e:b6:38:39", "network": {"id": "6b0f48b7-3db2-49b2-a238-8fd811b52d62", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1688127634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e000d89bca44cd8acba504256d8d1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7654d80f-b3", "ovs_interfaceid": "7654d80f-b374-4865-9ea5-17f0f93696fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'image_id': '900b237b-e99c-4fdd-a44f-dcb7a08baa86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:27:08 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:27:08 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:27:08 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:27:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-750615184',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-750615184',id=30,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e000d89bca44cd8acba504256d8d1f1',ramdisk_id='',reservation_id='r-0q8l0uxr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-454493649',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:27:06Z,user_data=None,user_id='964c1681ca8745d0b3879266d24f507e',uuid=8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7654d80f-b374-4865-9ea5-17f0f93696fe", "address": "fa:16:3e:b6:38:39", "network": {"id": "6b0f48b7-3db2-49b2-a238-8fd811b52d62", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1688127634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e000d89bca44cd8acba504256d8d1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7654d80f-b3", "ovs_interfaceid": "7654d80f-b374-4865-9ea5-17f0f93696fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Converting VIF {"id": "7654d80f-b374-4865-9ea5-17f0f93696fe", "address": "fa:16:3e:b6:38:39", "network": {"id": "6b0f48b7-3db2-49b2-a238-8fd811b52d62", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1688127634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e000d89bca44cd8acba504256d8d1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7654d80f-b3", "ovs_interfaceid": "7654d80f-b374-4865-9ea5-17f0f93696fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:38:39,bridge_name='br-int',has_traffic_filtering=True,id=7654d80f-b374-4865-9ea5-17f0f93696fe,network=Network(6b0f48b7-3db2-49b2-a238-8fd811b52d62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7654d80f-b3') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG nova.objects.instance [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lazy-loading 'pci_devices' on Instance uuid 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:27:08 user nova-compute[75066]:   <uuid>8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298</uuid>
Dec 01 19:27:08 user nova-compute[75066]:   <name>instance-0000001e</name>
Dec 01 19:27:08 user nova-compute[75066]:   <memory>524288</memory>
Dec 01 19:27:08 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:27:08 user nova-compute[75066]:   <metadata>
Dec 01 19:27:08 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:27:08 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:27:08 user nova-compute[75066]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-750615184</nova:name>
Dec 01 19:27:08 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:27:08</nova:creationTime>
Dec 01 19:27:08 user nova-compute[75066]:       <nova:flavor name="m1.tiny">
Dec 01 19:27:08 user nova-compute[75066]:         <nova:memory>512</nova:memory>
Dec 01 19:27:08 user nova-compute[75066]:         <nova:disk>1</nova:disk>
Dec 01 19:27:08 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:27:08 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:27:08 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:27:08 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:27:08 user nova-compute[75066]:       <nova:owner>
Dec 01 19:27:08 user nova-compute[75066]:         <nova:user uuid="964c1681ca8745d0b3879266d24f507e">tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member</nova:user>
Dec 01 19:27:08 user nova-compute[75066]:         <nova:project uuid="2e000d89bca44cd8acba504256d8d1f1">tempest-ServerBootFromVolumeStableRescueTest-454493649</nova:project>
Dec 01 19:27:08 user nova-compute[75066]:       </nova:owner>
Dec 01 19:27:08 user nova-compute[75066]:       <nova:root type="image" uuid="900b237b-e99c-4fdd-a44f-dcb7a08baa86"/>
Dec 01 19:27:08 user nova-compute[75066]:       <nova:ports>
Dec 01 19:27:08 user nova-compute[75066]:         <nova:port uuid="7654d80f-b374-4865-9ea5-17f0f93696fe">
Dec 01 19:27:08 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Dec 01 19:27:08 user nova-compute[75066]:         </nova:port>
Dec 01 19:27:08 user nova-compute[75066]:       </nova:ports>
Dec 01 19:27:08 user nova-compute[75066]:     </nova:instance>
Dec 01 19:27:08 user nova-compute[75066]:   </metadata>
Dec 01 19:27:08 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:27:08 user nova-compute[75066]:     <system>
Dec 01 19:27:08 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:27:08 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:27:08 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:27:08 user nova-compute[75066]:       <entry name="serial">8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298</entry>
Dec 01 19:27:08 user nova-compute[75066]:       <entry name="uuid">8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298</entry>
Dec 01 19:27:08 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:27:08 user nova-compute[75066]:     </system>
Dec 01 19:27:08 user nova-compute[75066]:   </sysinfo>
Dec 01 19:27:08 user nova-compute[75066]:   <os>
Dec 01 19:27:08 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:27:08 user nova-compute[75066]:     <boot dev="hd"/>
Dec 01 19:27:08 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:27:08 user nova-compute[75066]:   </os>
Dec 01 19:27:08 user nova-compute[75066]:   <features>
Dec 01 19:27:08 user nova-compute[75066]:     <acpi/>
Dec 01 19:27:08 user nova-compute[75066]:     <apic/>
Dec 01 19:27:08 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:27:08 user nova-compute[75066]:   </features>
Dec 01 19:27:08 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:27:08 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:27:08 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:27:08 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:27:08 user nova-compute[75066]:   </clock>
Dec 01 19:27:08 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:27:08 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:27:08 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:27:08 user nova-compute[75066]:   </cpu>
Dec 01 19:27:08 user nova-compute[75066]:   <devices>
Dec 01 19:27:08 user nova-compute[75066]:     <disk type="file" device="disk">
Dec 01 19:27:08 user nova-compute[75066]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 19:27:08 user nova-compute[75066]:       <source file="/opt/stack/data/nova/instances/8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298/disk"/>
Dec 01 19:27:08 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:27:08 user nova-compute[75066]:     </disk>
Dec 01 19:27:08 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:27:08 user nova-compute[75066]:       <mac address="fa:16:3e:b6:38:39"/>
Dec 01 19:27:08 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:27:08 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:27:08 user nova-compute[75066]:       <target dev="tap7654d80f-b3"/>
Dec 01 19:27:08 user nova-compute[75066]:     </interface>
Dec 01 19:27:08 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:27:08 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298/console.log" append="off"/>
Dec 01 19:27:08 user nova-compute[75066]:     </serial>
Dec 01 19:27:08 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:27:08 user nova-compute[75066]:     <video>
Dec 01 19:27:08 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:27:08 user nova-compute[75066]:     </video>
Dec 01 19:27:08 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:27:08 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:27:08 user nova-compute[75066]:     </rng>
Dec 01 19:27:08 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:27:08 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:27:08 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:27:08 user nova-compute[75066]:     </memballoon>
Dec 01 19:27:08 user nova-compute[75066]:   </devices>
Dec 01 19:27:08 user nova-compute[75066]: </domain>
Dec 01 19:27:08 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:27:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-750615184',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-750615184',id=30,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e000d89bca44cd8acba504256d8d1f1',ramdisk_id='',reservation_id='r-0q8l0uxr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-454493649',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:27:06Z,user_data=None,user_id='964c1681ca8745d0b3879266d24f507e',uuid=8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7654d80f-b374-4865-9ea5-17f0f93696fe", "address": "fa:16:3e:b6:38:39", "network": {"id": "6b0f48b7-3db2-49b2-a238-8fd811b52d62", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1688127634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e000d89bca44cd8acba504256d8d1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7654d80f-b3", "ovs_interfaceid": "7654d80f-b374-4865-9ea5-17f0f93696fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Converting VIF {"id": "7654d80f-b374-4865-9ea5-17f0f93696fe", "address": "fa:16:3e:b6:38:39", "network": {"id": "6b0f48b7-3db2-49b2-a238-8fd811b52d62", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1688127634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e000d89bca44cd8acba504256d8d1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7654d80f-b3", "ovs_interfaceid": "7654d80f-b374-4865-9ea5-17f0f93696fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:38:39,bridge_name='br-int',has_traffic_filtering=True,id=7654d80f-b374-4865-9ea5-17f0f93696fe,network=Network(6b0f48b7-3db2-49b2-a238-8fd811b52d62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7654d80f-b3') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG os_vif [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:38:39,bridge_name='br-int',has_traffic_filtering=True,id=7654d80f-b374-4865-9ea5-17f0f93696fe,network=Network(6b0f48b7-3db2-49b2-a238-8fd811b52d62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7654d80f-b3') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd51895ce-17e7-5293-a6d9-14985a06130a', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7654d80f-b3, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7654d80f-b3, col_values=(('qos', UUID('6d9c7f5b-b574-425e-bafb-4a51322cf9ae')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7654d80f-b3, col_values=(('external_ids', {'iface-id': '7654d80f-b374-4865-9ea5-17f0f93696fe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:38:39', 'vm-uuid': '8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:08 user nova-compute[75066]: INFO os_vif [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:38:39,bridge_name='br-int',has_traffic_filtering=True,id=7654d80f-b374-4865-9ea5-17f0f93696fe,network=Network(6b0f48b7-3db2-49b2-a238-8fd811b52d62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7654d80f-b3')
Dec 01 19:27:08 user nova-compute[75066]: DEBUG nova.network.neutron [req-cfbf9073-ddf0-4874-92e5-8c6cacfbdf32 req-4c19c5ea-4bf4-4cbf-a86f-4911dc45a0af service nova] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Updated VIF entry in instance network info cache for port e5f3728a-541f-4b95-9feb-6119687f2eba. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:27:08 user nova-compute[75066]: DEBUG nova.network.neutron [req-cfbf9073-ddf0-4874-92e5-8c6cacfbdf32 req-4c19c5ea-4bf4-4cbf-a86f-4911dc45a0af service nova] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Updating instance_info_cache with network_info: [{"id": "e5f3728a-541f-4b95-9feb-6119687f2eba", "address": "fa:16:3e:9c:60:12", "network": {"id": "3e44df49-3c9c-4812-aafc-ce3f4795874b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-826204178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83c5f90337e64829893181e7e8140b8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5f3728a-54", "ovs_interfaceid": "e5f3728a-541f-4b95-9feb-6119687f2eba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:27:09 user nova-compute[75066]: DEBUG nova.network.neutron [req-1d94920e-84f0-41db-95a0-5af9b3ce5199 req-d4a885e3-80a8-4728-9bab-1c5977fca089 service nova] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:27:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-1d94920e-84f0-41db-95a0-5af9b3ce5199 req-d4a885e3-80a8-4728-9bab-1c5977fca089 service nova] Releasing lock "refresh_cache-22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:27:09 user nova-compute[75066]: DEBUG nova.compute.manager [req-1d94920e-84f0-41db-95a0-5af9b3ce5199 req-d4a885e3-80a8-4728-9bab-1c5977fca089 service nova] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Received event network-changed-9ad8ee80-89a9-42be-b618-3a59007ca35b {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:27:09 user nova-compute[75066]: DEBUG nova.compute.manager [req-1d94920e-84f0-41db-95a0-5af9b3ce5199 req-d4a885e3-80a8-4728-9bab-1c5977fca089 service nova] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Refreshing instance network info cache due to event network-changed-9ad8ee80-89a9-42be-b618-3a59007ca35b. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:27:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-1d94920e-84f0-41db-95a0-5af9b3ce5199 req-d4a885e3-80a8-4728-9bab-1c5977fca089 service nova] Acquiring lock "refresh_cache-22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:27:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-1d94920e-84f0-41db-95a0-5af9b3ce5199 req-d4a885e3-80a8-4728-9bab-1c5977fca089 service nova] Acquired lock "refresh_cache-22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:27:09 user nova-compute[75066]: DEBUG nova.network.neutron [req-1d94920e-84f0-41db-95a0-5af9b3ce5199 req-d4a885e3-80a8-4728-9bab-1c5977fca089 service nova] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Refreshing network info cache for port 9ad8ee80-89a9-42be-b618-3a59007ca35b {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:27:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:09 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:27:09 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] No VIF found with MAC fa:16:3e:b6:38:39, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:27:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-cfbf9073-ddf0-4874-92e5-8c6cacfbdf32 req-4c19c5ea-4bf4-4cbf-a86f-4911dc45a0af service nova] Releasing lock "refresh_cache-391945f6-fe47-4969-a497-bd320d66cfa3" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:27:09 user nova-compute[75066]: DEBUG nova.compute.manager [req-cfbf9073-ddf0-4874-92e5-8c6cacfbdf32 req-4c19c5ea-4bf4-4cbf-a86f-4911dc45a0af service nova] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Received event network-changed-7654d80f-b374-4865-9ea5-17f0f93696fe {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:27:09 user nova-compute[75066]: DEBUG nova.compute.manager [req-cfbf9073-ddf0-4874-92e5-8c6cacfbdf32 req-4c19c5ea-4bf4-4cbf-a86f-4911dc45a0af service nova] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Refreshing instance network info cache due to event network-changed-7654d80f-b374-4865-9ea5-17f0f93696fe. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:27:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-cfbf9073-ddf0-4874-92e5-8c6cacfbdf32 req-4c19c5ea-4bf4-4cbf-a86f-4911dc45a0af service nova] Acquiring lock "refresh_cache-8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:27:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-cfbf9073-ddf0-4874-92e5-8c6cacfbdf32 req-4c19c5ea-4bf4-4cbf-a86f-4911dc45a0af service nova] Acquired lock "refresh_cache-8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:27:09 user nova-compute[75066]: DEBUG nova.network.neutron [req-cfbf9073-ddf0-4874-92e5-8c6cacfbdf32 req-4c19c5ea-4bf4-4cbf-a86f-4911dc45a0af service nova] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Refreshing network info cache for port 7654d80f-b374-4865-9ea5-17f0f93696fe {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:27:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk.rescue --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:09 user nova-compute[75066]: DEBUG nova.network.neutron [req-1d94920e-84f0-41db-95a0-5af9b3ce5199 req-d4a885e3-80a8-4728-9bab-1c5977fca089 service nova] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:27:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk.rescue --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:09 user nova-compute[75066]: DEBUG nova.network.neutron [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Successfully updated port: b2a9f764-ab49-4ca2-aa95-96bdbbd239c5 {{(pid=75066) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 19:27:09 user nova-compute[75066]: INFO nova.compute.manager [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Rebuilding instance
Dec 01 19:27:09 user nova-compute[75066]: DEBUG nova.compute.manager [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:27:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:09 user nova-compute[75066]: DEBUG nova.network.neutron [req-1d94920e-84f0-41db-95a0-5af9b3ce5199 req-d4a885e3-80a8-4728-9bab-1c5977fca089 service nova] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:27:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-1d94920e-84f0-41db-95a0-5af9b3ce5199 req-d4a885e3-80a8-4728-9bab-1c5977fca089 service nova] Releasing lock "refresh_cache-22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:27:09 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:09 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:09 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:09 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:09 user nova-compute[75066]: DEBUG nova.network.neutron [req-cfbf9073-ddf0-4874-92e5-8c6cacfbdf32 req-4c19c5ea-4bf4-4cbf-a86f-4911dc45a0af service nova] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Updated VIF entry in instance network info cache for port 7654d80f-b374-4865-9ea5-17f0f93696fe. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:27:09 user nova-compute[75066]: DEBUG nova.network.neutron [req-cfbf9073-ddf0-4874-92e5-8c6cacfbdf32 req-4c19c5ea-4bf4-4cbf-a86f-4911dc45a0af service nova] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Updating instance_info_cache with network_info: [{"id": "7654d80f-b374-4865-9ea5-17f0f93696fe", "address": "fa:16:3e:b6:38:39", "network": {"id": "6b0f48b7-3db2-49b2-a238-8fd811b52d62", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1688127634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e000d89bca44cd8acba504256d8d1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7654d80f-b3", "ovs_interfaceid": "7654d80f-b374-4865-9ea5-17f0f93696fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:27:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-cfbf9073-ddf0-4874-92e5-8c6cacfbdf32 req-4c19c5ea-4bf4-4cbf-a86f-4911dc45a0af service nova] Releasing lock "refresh_cache-8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:27:10 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:27:10 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:27:10 user nova-compute[75066]: DEBUG nova.compute.manager [req-617904c2-ac33-4f51-9f18-d5de0682dbcc req-1aa6c8b0-7644-4a14-80ba-d9f7ffc4768d service nova] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Received event network-vif-unplugged-e5f3728a-541f-4b95-9feb-6119687f2eba {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:27:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-617904c2-ac33-4f51-9f18-d5de0682dbcc req-1aa6c8b0-7644-4a14-80ba-d9f7ffc4768d service nova] Acquiring lock "391945f6-fe47-4969-a497-bd320d66cfa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:27:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-617904c2-ac33-4f51-9f18-d5de0682dbcc req-1aa6c8b0-7644-4a14-80ba-d9f7ffc4768d service nova] Lock "391945f6-fe47-4969-a497-bd320d66cfa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:27:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-617904c2-ac33-4f51-9f18-d5de0682dbcc req-1aa6c8b0-7644-4a14-80ba-d9f7ffc4768d service nova] Lock "391945f6-fe47-4969-a497-bd320d66cfa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:27:10 user nova-compute[75066]: DEBUG nova.compute.manager [req-617904c2-ac33-4f51-9f18-d5de0682dbcc req-1aa6c8b0-7644-4a14-80ba-d9f7ffc4768d service nova] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] No waiting events found dispatching network-vif-unplugged-e5f3728a-541f-4b95-9feb-6119687f2eba {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:27:10 user nova-compute[75066]: WARNING nova.compute.manager [req-617904c2-ac33-4f51-9f18-d5de0682dbcc req-1aa6c8b0-7644-4a14-80ba-d9f7ffc4768d service nova] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Received unexpected event network-vif-unplugged-e5f3728a-541f-4b95-9feb-6119687f2eba for instance with vm_state active and task_state rebuilding.
Dec 01 19:27:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG nova.network.neutron [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Successfully updated port: 34ad241e-f800-489f-9fb7-037e738051c9 {{(pid=75066) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG nova.compute.manager [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Instance event wait completed in 0 seconds for  {{(pid=75066) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Guest created on hypervisor {{(pid=75066) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG nova.compute.manager [req-5e6797b3-2537-4abb-b53b-0f4daa9ce762 req-f8f7f018-0ba0-42b1-a9a0-0bd33ec11934 service nova] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Received event network-changed-b2a9f764-ab49-4ca2-aa95-96bdbbd239c5 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG nova.compute.manager [req-5e6797b3-2537-4abb-b53b-0f4daa9ce762 req-f8f7f018-0ba0-42b1-a9a0-0bd33ec11934 service nova] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Refreshing instance network info cache due to event network-changed-b2a9f764-ab49-4ca2-aa95-96bdbbd239c5. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-5e6797b3-2537-4abb-b53b-0f4daa9ce762 req-f8f7f018-0ba0-42b1-a9a0-0bd33ec11934 service nova] Acquiring lock "refresh_cache-22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-5e6797b3-2537-4abb-b53b-0f4daa9ce762 req-f8f7f018-0ba0-42b1-a9a0-0bd33ec11934 service nova] Acquired lock "refresh_cache-22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG nova.network.neutron [req-5e6797b3-2537-4abb-b53b-0f4daa9ce762 req-f8f7f018-0ba0-42b1-a9a0-0bd33ec11934 service nova] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Refreshing network info cache for port b2a9f764-ab49-4ca2-aa95-96bdbbd239c5 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG nova.compute.manager [req-7b3472d8-aef6-4d48-96db-b28e67995f68 req-18686c63-b624-49e6-b792-702ae1d369ba service nova] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Received event network-vif-plugged-e5f3728a-541f-4b95-9feb-6119687f2eba {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-7b3472d8-aef6-4d48-96db-b28e67995f68 req-18686c63-b624-49e6-b792-702ae1d369ba service nova] Acquiring lock "391945f6-fe47-4969-a497-bd320d66cfa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-7b3472d8-aef6-4d48-96db-b28e67995f68 req-18686c63-b624-49e6-b792-702ae1d369ba service nova] Lock "391945f6-fe47-4969-a497-bd320d66cfa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-7b3472d8-aef6-4d48-96db-b28e67995f68 req-18686c63-b624-49e6-b792-702ae1d369ba service nova] Lock "391945f6-fe47-4969-a497-bd320d66cfa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG nova.compute.manager [req-7b3472d8-aef6-4d48-96db-b28e67995f68 req-18686c63-b624-49e6-b792-702ae1d369ba service nova] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] No waiting events found dispatching network-vif-plugged-e5f3728a-541f-4b95-9feb-6119687f2eba {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:27:13 user nova-compute[75066]: WARNING nova.compute.manager [req-7b3472d8-aef6-4d48-96db-b28e67995f68 req-18686c63-b624-49e6-b792-702ae1d369ba service nova] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Received unexpected event network-vif-plugged-e5f3728a-541f-4b95-9feb-6119687f2eba for instance with vm_state active and task_state rebuilding.
Dec 01 19:27:13 user nova-compute[75066]: DEBUG nova.compute.manager [req-8e1dc726-73c9-4d8d-8bd5-38af85abe1f5 req-a3a79467-3e1a-40de-bb88-64916f92d2e2 service nova] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Received event network-vif-plugged-7654d80f-b374-4865-9ea5-17f0f93696fe {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-8e1dc726-73c9-4d8d-8bd5-38af85abe1f5 req-a3a79467-3e1a-40de-bb88-64916f92d2e2 service nova] Acquiring lock "8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-8e1dc726-73c9-4d8d-8bd5-38af85abe1f5 req-a3a79467-3e1a-40de-bb88-64916f92d2e2 service nova] Lock "8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-8e1dc726-73c9-4d8d-8bd5-38af85abe1f5 req-a3a79467-3e1a-40de-bb88-64916f92d2e2 service nova] Lock "8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG nova.compute.manager [req-8e1dc726-73c9-4d8d-8bd5-38af85abe1f5 req-a3a79467-3e1a-40de-bb88-64916f92d2e2 service nova] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] No waiting events found dispatching network-vif-plugged-7654d80f-b374-4865-9ea5-17f0f93696fe {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:27:13 user nova-compute[75066]: WARNING nova.compute.manager [req-8e1dc726-73c9-4d8d-8bd5-38af85abe1f5 req-a3a79467-3e1a-40de-bb88-64916f92d2e2 service nova] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Received unexpected event network-vif-plugged-7654d80f-b374-4865-9ea5-17f0f93696fe for instance with vm_state building and task_state spawning.
Dec 01 19:27:13 user nova-compute[75066]: DEBUG nova.compute.manager [req-8e1dc726-73c9-4d8d-8bd5-38af85abe1f5 req-a3a79467-3e1a-40de-bb88-64916f92d2e2 service nova] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Received event network-vif-plugged-7654d80f-b374-4865-9ea5-17f0f93696fe {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-8e1dc726-73c9-4d8d-8bd5-38af85abe1f5 req-a3a79467-3e1a-40de-bb88-64916f92d2e2 service nova] Acquiring lock "8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-8e1dc726-73c9-4d8d-8bd5-38af85abe1f5 req-a3a79467-3e1a-40de-bb88-64916f92d2e2 service nova] Lock "8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-8e1dc726-73c9-4d8d-8bd5-38af85abe1f5 req-a3a79467-3e1a-40de-bb88-64916f92d2e2 service nova] Lock "8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG nova.compute.manager [req-8e1dc726-73c9-4d8d-8bd5-38af85abe1f5 req-a3a79467-3e1a-40de-bb88-64916f92d2e2 service nova] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] No waiting events found dispatching network-vif-plugged-7654d80f-b374-4865-9ea5-17f0f93696fe {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:27:13 user nova-compute[75066]: WARNING nova.compute.manager [req-8e1dc726-73c9-4d8d-8bd5-38af85abe1f5 req-a3a79467-3e1a-40de-bb88-64916f92d2e2 service nova] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Received unexpected event network-vif-plugged-7654d80f-b374-4865-9ea5-17f0f93696fe for instance with vm_state building and task_state spawning.
Dec 01 19:27:13 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4611580-9631-4011-aa5f-365121a7bcd3 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Calling os-brick to attach iSCSI Volume {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4611580-9631-4011-aa5f-365121a7bcd3 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LBCMmEVc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:27:13 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-e4611580-9631-4011-aa5f-365121a7bcd3 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:27:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-e4611580-9631-4011-aa5f-365121a7bcd3 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-e4611580-9631-4011-aa5f-365121a7bcd3 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:27:13 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-e4611580-9631-4011-aa5f-365121a7bcd3 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:27:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-e4611580-9631-4011-aa5f-365121a7bcd3 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-e4611580-9631-4011-aa5f-365121a7bcd3 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:27:13 user nova-compute[75066]: INFO os_brick.initiator.connectors.iscsi [None req-e4611580-9631-4011-aa5f-365121a7bcd3 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 19:27:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237 -p 172.16.0.220:3260 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:13 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Instance destroyed successfully.
Dec 01 19:27:13 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Instance spawned successfully.
Dec 01 19:27:13 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 19:27:13 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:27:13 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:27:13 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Hypervisor/Node resource view: name=user free_ram=7452MB free_disk=24.773483276367188GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75066) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e187fe-f12b-4985-a7f3-45d662531667]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4611580-9631-4011-aa5f-365121a7bcd3 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 19:27:13 user nova-compute[75066]:  {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237 -p 172.16.0.220:3260 --interface default --op new {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Found default for hw_cdrom_bus of ide {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Found default for hw_disk_bus of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Found default for hw_input_bus of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Found default for hw_pointer_model of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Found default for hw_video_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Found default for hw_vif_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cce697d-f54f-450f-827f-7a9dc5d7a291]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237] added\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4611580-9631-4011-aa5f-365121a7bcd3 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237] added
Dec 01 19:27:13 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:13 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Instance destroyed successfully.
Dec 01 19:27:13 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:25:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1380771896',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1159128139',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUt3tvMqWzGNICVgVAPv+5OiL/y2ghL11denluyj9f24y9bvqoYMGhme0+yc1T6ysCdcqg+PZ0E7hkYE+/Fk0+ZZK5gReWc3DTB+0QPq1QAoZu4IKNKVmZ4OKW/6iZMNA==',key_name='tempest-keypair-1648212708',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:25:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='83c5f90337e64829893181e7e8140b8c',ramdisk_id='',reservation_id='r-fz70ky08',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1592554729',owner_user_name='tempest-ServerActionsV293TestJSON-1592554729-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:27:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf5efdf2a7324c96b8b9b2370dc7e31c',uuid=391945f6-fe47-4969-a497-bd320d66cfa3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e5f3728a-541f-4b95-9feb-6119687f2eba", "address": "fa:16:3e:9c:60:12", "network": {"id": "3e44df49-3c9c-4812-aafc-ce3f4795874b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-826204178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83c5f90337e64829893181e7e8140b8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5f3728a-54", "ovs_interfaceid": "e5f3728a-541f-4b95-9feb-6119687f2eba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Converting VIF {"id": "e5f3728a-541f-4b95-9feb-6119687f2eba", "address": "fa:16:3e:9c:60:12", "network": {"id": "3e44df49-3c9c-4812-aafc-ce3f4795874b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-826204178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83c5f90337e64829893181e7e8140b8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5f3728a-54", "ovs_interfaceid": "e5f3728a-541f-4b95-9feb-6119687f2eba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9c:60:12,bridge_name='br-int',has_traffic_filtering=True,id=e5f3728a-541f-4b95-9feb-6119687f2eba,network=Network(3e44df49-3c9c-4812-aafc-ce3f4795874b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5f3728a-54') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG os_vif [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:60:12,bridge_name='br-int',has_traffic_filtering=True,id=e5f3728a-541f-4b95-9feb-6119687f2eba,network=Network(3e44df49-3c9c-4812-aafc-ce3f4795874b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5f3728a-54') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG nova.network.neutron [req-5e6797b3-2537-4abb-b53b-0f4daa9ce762 req-f8f7f018-0ba0-42b1-a9a0-0bd33ec11934 service nova] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape5f3728a-54, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e8d094-eede-442e-8e14-7fee30c16d2c]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4611580-9631-4011-aa5f-365121a7bcd3 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:13 user nova-compute[75066]: INFO nova.virt.block_device [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Booting with volume b50cc214-f4ca-4631-9cba-acfcc88f1dc3 at /dev/vdb
Dec 01 19:27:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b1e4f1cf-562e-4f04-8b57-60e8571c0977) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:13 user nova-compute[75066]: INFO os_vif [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:60:12,bridge_name='br-int',has_traffic_filtering=True,id=e5f3728a-541f-4b95-9feb-6119687f2eba,network=Network(3e44df49-3c9c-4812-aafc-ce3f4795874b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5f3728a-54')
Dec 01 19:27:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbada02e-b222-4dbe-8a9c-5d5fba16733f]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4611580-9631-4011-aa5f-365121a7bcd3 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LBCMmEVc {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] calling os-brick to detach iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, {'target_iqn': 'iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xUAEeuip', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:27:13 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 01 19:27:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:27:13 user nova-compute[75066]: INFO nova.compute.manager [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Took 7.67 seconds to spawn the instance on the hypervisor.
Dec 01 19:27:13 user nova-compute[75066]: DEBUG nova.compute.manager [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LBCMmEVc" returned: 0 in 0.025s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d77485-041e-4def-9cbb-995c09e06ace]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4611580-9631-4011-aa5f-365121a7bcd3 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LBCMmEVc'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG os_brick.utils [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33674bb-16f0-46d9-9171-4abe19fe3002]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4611580-9631-4011-aa5f-365121a7bcd3 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8503953-9d2e-4909-bc42-70262434cb84]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1959854982f\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[83981a71-ce31-41be-93fe-4b8ab62bd440]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4611580-9631-4011-aa5f-365121a7bcd3 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:27:13 user nova-compute[75066]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)
Dec 01 19:27:13 user nova-compute[75066]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd (non-flash)
Dec 01 19:27:13 user nova-compute[75066]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)
Dec 01 19:27:13 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4611580-9631-4011-aa5f-365121a7bcd3 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:27:13 user nova-compute[75066]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)
Dec 01 19:27:13 user nova-compute[75066]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd (non-flash)
Dec 01 19:27:13 user nova-compute[75066]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)
Dec 01 19:27:13 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:27:13 user nova-compute[75066]: INFO nova.compute.manager [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Took 8.67 seconds to build instance.
Dec 01 19:27:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237 -p 172.16.0.220:3260 --login {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.030s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3bb35f3-ebb5-4322-b7ee-61e2c337e25e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance c223be70-8b9c-46d4-9b5a-3b83dfc05a17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 90c49be6-97aa-45f1-bcbe-b9a3875226a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance d564b128-598b-4ad4-8618-afa4dc8a7347 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 14de9d20-9e66-4517-b904-2967e0a06a97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance a553e030-0d69-4725-9f84-6c0c63556ed4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 23e17727-40b4-48f7-9155-abc8ffa9f619 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance e32ba192-38b9-46f0-b164-1652a43cf3d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 391945f6-fe47-4969-a497-bd320d66cfa3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 3b355778-bd25-42f6-8026-110668920d8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 00506483-8f09-4a3d-938a-31ab1b2dbf83 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8514108-8599-4602-b1b3-7d1989d9b948]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[09230b78-edca-43ba-8c2a-9bb0c801a2fe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] Running cmd (subprocess): nvme version {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] 'nvme version' failed. Not Retrying. {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG nova.network.neutron [req-5e6797b3-2537-4abb-b53b-0f4daa9ce762 req-f8f7f018-0ba0-42b1-a9a0-0bd33ec11934 service nova] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] nvme not present on system {{(pid=75066) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b8de9ac5-836e-4bad-9e66-d3b50020fa3e tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.875s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[50fb2179-1af1-4462-a094-f29c9412ac8c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4611580-9631-4011-aa5f-365121a7bcd3 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237, portal: 172.16.0.220,3260]
Dec 01 19:27:13 user nova-compute[75066]: Login to [iface: default, target: iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237, portal: 172.16.0.220,3260] successful.
Dec 01 19:27:13 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-5e6797b3-2537-4abb-b53b-0f4daa9ce762 req-f8f7f018-0ba0-42b1-a9a0-0bd33ec11934 service nova] Releasing lock "refresh_cache-22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG nova.compute.manager [req-5e6797b3-2537-4abb-b53b-0f4daa9ce762 req-f8f7f018-0ba0-42b1-a9a0-0bd33ec11934 service nova] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Received event network-changed-34ad241e-f800-489f-9fb7-037e738051c9 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG nova.compute.manager [req-5e6797b3-2537-4abb-b53b-0f4daa9ce762 req-f8f7f018-0ba0-42b1-a9a0-0bd33ec11934 service nova] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Refreshing instance network info cache due to event network-changed-34ad241e-f800-489f-9fb7-037e738051c9. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-5e6797b3-2537-4abb-b53b-0f4daa9ce762 req-f8f7f018-0ba0-42b1-a9a0-0bd33ec11934 service nova] Acquiring lock "refresh_cache-22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-5e6797b3-2537-4abb-b53b-0f4daa9ce762 req-f8f7f018-0ba0-42b1-a9a0-0bd33ec11934 service nova] Acquired lock "refresh_cache-22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG nova.network.neutron [req-5e6797b3-2537-4abb-b53b-0f4daa9ce762 req-f8f7f018-0ba0-42b1-a9a0-0bd33ec11934 service nova] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Refreshing network info cache for port 34ad241e-f800-489f-9fb7-037e738051c9 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:27:13 user nova-compute[75066]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 19:27:13 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc22edd-de22-4994-b217-853985b28d84]: (4, '') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75066) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] LIGHTOS: no hostnqn found. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG os_brick.utils [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] <== get_connector_properties: return (199ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1959854982f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG nova.virt.block_device [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Updating existing volume attachment record: 61855d66-997b-4d97-96c2-43b5de214869 {{(pid=75066) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c656186-1ff9-4132-a65b-964eddaa54d8]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4611580-9631-4011-aa5f-365121a7bcd3 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[1074f824-b131-480c-8e0d-93d4285eab76]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4611580-9631-4011-aa5f-365121a7bcd3 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:27:13 user nova-compute[75066]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)
Dec 01 19:27:13 user nova-compute[75066]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd (non-flash)
Dec 01 19:27:13 user nova-compute[75066]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)
Dec 01 19:27:13 user nova-compute[75066]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237 (non-flash)
Dec 01 19:27:13 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4611580-9631-4011-aa5f-365121a7bcd3 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:27:13 user nova-compute[75066]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)
Dec 01 19:27:13 user nova-compute[75066]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd (non-flash)
Dec 01 19:27:13 user nova-compute[75066]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)
Dec 01 19:27:13 user nova-compute[75066]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237 (non-flash)
Dec 01 19:27:13 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-e4611580-9631-4011-aa5f-365121a7bcd3 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.410s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4611580-9631-4011-aa5f-365121a7bcd3 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Connected to 172.16.0.220:3260 {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-e4611580-9631-4011-aa5f-365121a7bcd3 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] HCTL ('36', '-', '-', 0) found on session 31 with lun 0 {{(pid=75066) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-e4611580-9631-4011-aa5f-365121a7bcd3 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75066) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 19:27:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.034s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:14 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f32202b-467c-477e-8f44-eaaa691985bb]: (4, ('- - 0', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:14 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-e4611580-9631-4011-aa5f-365121a7bcd3 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Searching for a device in session 31 and hctl ['36', '*', '*', 0] yield: None {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:27:14 user nova-compute[75066]: DEBUG nova.network.neutron [req-5e6797b3-2537-4abb-b53b-0f4daa9ce762 req-f8f7f018-0ba0-42b1-a9a0-0bd33ec11934 service nova] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:27:14 user nova-compute[75066]: DEBUG nova.network.neutron [req-5e6797b3-2537-4abb-b53b-0f4daa9ce762 req-f8f7f018-0ba0-42b1-a9a0-0bd33ec11934 service nova] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:27:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-5e6797b3-2537-4abb-b53b-0f4daa9ce762 req-f8f7f018-0ba0-42b1-a9a0-0bd33ec11934 service nova] Releasing lock "refresh_cache-22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:27:14 user nova-compute[75066]: DEBUG nova.network.neutron [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Successfully updated port: b41eba69-dd88-43d2-a481-9ee9fee0e007 {{(pid=75066) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 19:27:14 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:27:14 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:27:14 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Compute_service record updated for user:user {{(pid=75066) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 19:27:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.837s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:27:14 user nova-compute[75066]: DEBUG nova.compute.manager [req-bd870bb5-71c1-4087-98f6-db9818b3674d req-29da0db1-5fa7-4c04-bc20-d733333bd49a service nova] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Received event network-changed-b41eba69-dd88-43d2-a481-9ee9fee0e007 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:27:14 user nova-compute[75066]: DEBUG nova.compute.manager [req-bd870bb5-71c1-4087-98f6-db9818b3674d req-29da0db1-5fa7-4c04-bc20-d733333bd49a service nova] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Refreshing instance network info cache due to event network-changed-b41eba69-dd88-43d2-a481-9ee9fee0e007. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:27:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-bd870bb5-71c1-4087-98f6-db9818b3674d req-29da0db1-5fa7-4c04-bc20-d733333bd49a service nova] Acquiring lock "refresh_cache-22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:27:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-bd870bb5-71c1-4087-98f6-db9818b3674d req-29da0db1-5fa7-4c04-bc20-d733333bd49a service nova] Acquired lock "refresh_cache-22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:27:14 user nova-compute[75066]: DEBUG nova.network.neutron [req-bd870bb5-71c1-4087-98f6-db9818b3674d req-29da0db1-5fa7-4c04-bc20-d733333bd49a service nova] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Refreshing network info cache for port b41eba69-dd88-43d2-a481-9ee9fee0e007 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:27:14 user nova-compute[75066]: DEBUG nova.network.neutron [req-bd870bb5-71c1-4087-98f6-db9818b3674d req-29da0db1-5fa7-4c04-bc20-d733333bd49a service nova] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:27:14 user nova-compute[75066]: DEBUG nova.network.neutron [req-bd870bb5-71c1-4087-98f6-db9818b3674d req-29da0db1-5fa7-4c04-bc20-d733333bd49a service nova] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:27:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-bd870bb5-71c1-4087-98f6-db9818b3674d req-29da0db1-5fa7-4c04-bc20-d733333bd49a service nova] Releasing lock "refresh_cache-22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:27:14 user nova-compute[75066]: DEBUG nova.network.neutron [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Successfully updated port: 53dd7ae4-2e22-4a10-b9cb-972db80c809d {{(pid=75066) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 19:27:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] Acquiring lock "refresh_cache-22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:27:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] Acquired lock "refresh_cache-22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:27:14 user nova-compute[75066]: DEBUG nova.network.neutron [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-e4611580-9631-4011-aa5f-365121a7bcd3 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Searching for a device in session 31 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4611580-9631-4011-aa5f-365121a7bcd3 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LBCMmEVc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-e4611580-9631-4011-aa5f-365121a7bcd3 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.457s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4611580-9631-4011-aa5f-365121a7bcd3 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] <== connect_volume: return (1458ms) {'type': 'block', 'scsi_wwn': '26132653764396436', 'path': '/dev/sde'} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4611580-9631-4011-aa5f-365121a7bcd3 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26132653764396436', 'path': '/dev/sde'} {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.332s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG nova.objects.instance [None req-e4611580-9631-4011-aa5f-365121a7bcd3 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lazy-loading 'flavor' on Instance uuid e32ba192-38b9-46f0-b164-1652a43cf3d2 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf98aa59-7d0a-4b13-99ab-d4974ad5b6a2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 19:27:15 user nova-compute[75066]: No targets found.
Dec 01 19:27:15 user nova-compute[75066]: iSNS:
Dec 01 19:27:15 user nova-compute[75066]: No targets found.
Dec 01 19:27:15 user nova-compute[75066]: STATIC:
Dec 01 19:27:15 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0
Dec 01 19:27:15 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:27:15 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:27:15 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9
Dec 01 19:27:15 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:27:15 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:27:15 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237
Dec 01 19:27:15 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:27:15 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:27:15 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd
Dec 01 19:27:15 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:27:15 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:27:15 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb
Dec 01 19:27:15 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:27:15 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:27:15 user nova-compute[75066]: FIRMWARE:
Dec 01 19:27:15 user nova-compute[75066]: No targets found.
Dec 01 19:27:15 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 19:27:15 user nova-compute[75066]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 19:27:15 user nova-compute[75066]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75066) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0', 0)] {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-e4611580-9631-4011-aa5f-365121a7bcd3 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 19:27:15 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:27:15 user nova-compute[75066]:   <source dev="/dev/sde"/>
Dec 01 19:27:15 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:27:15 user nova-compute[75066]:   <serial>80cd56ab-657c-459d-aab2-011d8dd87237</serial>
Dec 01 19:27:15 user nova-compute[75066]: </disk>
Dec 01 19:27:15 user nova-compute[75066]:  {{(pid=75066) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[774fcf19-dd5b-4335-9bc0-ca3ccd1364c2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG nova.network.neutron [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77ec3b8-45ad-4ee0-afbb-96eca27a7860]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:27:15 user nova-compute[75066]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)
Dec 01 19:27:15 user nova-compute[75066]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd (non-flash)
Dec 01 19:27:15 user nova-compute[75066]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)
Dec 01 19:27:15 user nova-compute[75066]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237 (non-flash)
Dec 01 19:27:15 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:27:15 user nova-compute[75066]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)
Dec 01 19:27:15 user nova-compute[75066]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd (non-flash)
Dec 01 19:27:15 user nova-compute[75066]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)
Dec 01 19:27:15 user nova-compute[75066]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237 (non-flash)
Dec 01 19:27:15 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9190515630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0'): ({'sdb'}, set())}) {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Removing single pathed devices sdb {{(pid=75066) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[0147ecf5-ffee-4bc8-bfaa-ad4c1f94a22b]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[e298d686-e430-461c-9f56-247b75b4adbb]: (4, ('ok\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Flushing IO for device /dev/sdb {{(pid=75066) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[26bd7098-d09b-41eb-beee-d1665c7037ac]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75066) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.060s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e964c9c-e2d5-4bd2-ac14-1e6f42e690f5]: (4, ('1', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] SCSI volumes sdb have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0')] {{(pid=75066) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2202f71-7418-4aeb-9d62-1d37456eec40]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 -p 172.16.0.220:3260 --logout {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee494c6-9135-4b12-9a6f-cc41764e8a1e]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0, portal: 172.16.0.220,3260]
Dec 01 19:27:15 user nova-compute[75066]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0, portal: 172.16.0.220,3260] successful.
Dec 01 19:27:15 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 -p 172.16.0.220:3260 --op delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[30451dad-ba08-4d54-8b59-004fd3880270]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] <== disconnect_volume: return (1703ms) None {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Disconnected iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 19:27:15 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Deleting instance files /opt/stack/data/nova/instances/391945f6-fe47-4969-a497-bd320d66cfa3_del
Dec 01 19:27:15 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Deletion of /opt/stack/data/nova/instances/391945f6-fe47-4969-a497-bd320d66cfa3_del complete
Dec 01 19:27:15 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Starting heal instance info cache {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "refresh_cache-14de9d20-9e66-4517-b904-2967e0a06a97" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquired lock "refresh_cache-14de9d20-9e66-4517-b904-2967e0a06a97" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Forcefully refreshing network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-e4611580-9631-4011-aa5f-365121a7bcd3 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-e4611580-9631-4011-aa5f-365121a7bcd3 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-e4611580-9631-4011-aa5f-365121a7bcd3 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] No VIF found with MAC fa:16:3e:27:e2:3b, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:27:15 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 391945f6-fe47-4969-a497-bd320d66cfa3 could not be found.
Dec 01 19:27:15 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] calling os-brick to detach iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, {'target_iqn': 'iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xUAEeuip', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:27:15 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 01 19:27:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:27:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:16 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e4611580-9631-4011-aa5f-365121a7bcd3 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lock "e32ba192-38b9-46f0-b164-1652a43cf3d2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.678s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:27:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:16 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[272e3e55-7493-4440-aea1-a35092471820]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:16 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 19:27:16 user nova-compute[75066]: No targets found.
Dec 01 19:27:16 user nova-compute[75066]: iSNS:
Dec 01 19:27:16 user nova-compute[75066]: No targets found.
Dec 01 19:27:16 user nova-compute[75066]: STATIC:
Dec 01 19:27:16 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9
Dec 01 19:27:16 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:27:16 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:27:16 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237
Dec 01 19:27:16 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:27:16 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:27:16 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd
Dec 01 19:27:16 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:27:16 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:27:16 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb
Dec 01 19:27:16 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:27:16 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:27:16 user nova-compute[75066]: FIRMWARE:
Dec 01 19:27:16 user nova-compute[75066]: No targets found.
Dec 01 19:27:16 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:27:16 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 19:27:16 user nova-compute[75066]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 19:27:16 user nova-compute[75066]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75066) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 19:27:16 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0', 0)] {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 19:27:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:16 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de4bec6-9046-4d1b-866c-4959631db53d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:16 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf49313f-1ce3-4cb3-b77d-2b3276dbbf3d]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:16 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:27:16 user nova-compute[75066]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd (non-flash)
Dec 01 19:27:16 user nova-compute[75066]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)
Dec 01 19:27:16 user nova-compute[75066]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237 (non-flash)
Dec 01 19:27:16 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:27:16 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:27:16 user nova-compute[75066]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd (non-flash)
Dec 01 19:27:16 user nova-compute[75066]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)
Dec 01 19:27:16 user nova-compute[75066]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237 (non-flash)
Dec 01 19:27:16 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:27:16 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9190185000>, {}) {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 19:27:16 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Disconnecting from: [] {{(pid=75066) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 19:27:16 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.097s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:27:16 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] <== disconnect_volume: return (100ms) None {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:27:16 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Disconnected iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 19:27:16 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Updating instance_info_cache with network_info: [{"id": "4ab99734-a7a9-43f9-b75e-f02d33a7a50d", "address": "fa:16:3e:54:2d:24", "network": {"id": "47c850ae-6dcb-4977-a02a-e32cd3df4749", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-475363603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "943324a514a84cb4947dbab93abc4f6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ab99734-a7", "ovs_interfaceid": "4ab99734-a7a9-43f9-b75e-f02d33a7a50d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:27:16 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Releasing lock "refresh_cache-14de9d20-9e66-4517-b904-2967e0a06a97" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:27:16 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Updated the network info_cache for instance {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 19:27:16 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:27:16 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:27:16 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:27:16 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:27:16 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75066) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 19:27:16 user nova-compute[75066]: DEBUG nova.compute.manager [req-0476b846-680d-4a7e-83d7-da4b3f3e29aa req-0b0f2cbf-a68c-4ba0-af33-bb158e59716a service nova] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Received event network-changed-53dd7ae4-2e22-4a10-b9cb-972db80c809d {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:27:16 user nova-compute[75066]: DEBUG nova.compute.manager [req-0476b846-680d-4a7e-83d7-da4b3f3e29aa req-0b0f2cbf-a68c-4ba0-af33-bb158e59716a service nova] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Refreshing instance network info cache due to event network-changed-53dd7ae4-2e22-4a10-b9cb-972db80c809d. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:27:16 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-0476b846-680d-4a7e-83d7-da4b3f3e29aa req-0b0f2cbf-a68c-4ba0-af33-bb158e59716a service nova] Acquiring lock "refresh_cache-22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:27:16 user nova-compute[75066]: ERROR nova.volume.cinder [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] Update attachment failed for attachment 61855d66-997b-4d97-96c2-43b5de214869. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-93acf0e9-dc4c-48b1-a73a-d4759363c58e) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-93acf0e9-dc4c-48b1-a73a-d4759363c58e)
Dec 01 19:27:16 user nova-compute[75066]: ERROR nova.compute.manager [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-93acf0e9-dc4c-48b1-a73a-d4759363c58e)
Dec 01 19:27:16 user nova-compute[75066]: ERROR nova.compute.manager [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Traceback (most recent call last):
Dec 01 19:27:16 user nova-compute[75066]: ERROR nova.compute.manager [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Dec 01 19:27:16 user nova-compute[75066]: ERROR nova.compute.manager [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720]     driver_block_device.attach_block_devices(
Dec 01 19:27:16 user nova-compute[75066]: ERROR nova.compute.manager [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Dec 01 19:27:16 user nova-compute[75066]: ERROR nova.compute.manager [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720]     _log_and_attach(device)
Dec 01 19:27:16 user nova-compute[75066]: ERROR nova.compute.manager [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Dec 01 19:27:16 user nova-compute[75066]: ERROR nova.compute.manager [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720]     bdm.attach(*attach_args, **attach_kwargs)
Dec 01 19:27:16 user nova-compute[75066]: ERROR nova.compute.manager [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Dec 01 19:27:16 user nova-compute[75066]: ERROR nova.compute.manager [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720]     ret_val = method(obj, context, *args, **kwargs)
Dec 01 19:27:16 user nova-compute[75066]: ERROR nova.compute.manager [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Dec 01 19:27:16 user nova-compute[75066]: ERROR nova.compute.manager [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720]     self._do_attach(context, instance, volume, volume_api,
Dec 01 19:27:16 user nova-compute[75066]: ERROR nova.compute.manager [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Dec 01 19:27:16 user nova-compute[75066]: ERROR nova.compute.manager [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720]     self._volume_attach(context, volume, connector, instance,
Dec 01 19:27:16 user nova-compute[75066]: ERROR nova.compute.manager [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Dec 01 19:27:16 user nova-compute[75066]: ERROR nova.compute.manager [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720]     connection_info = volume_api.attachment_update(
Dec 01 19:27:16 user nova-compute[75066]: ERROR nova.compute.manager [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Dec 01 19:27:16 user nova-compute[75066]: ERROR nova.compute.manager [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720]     res = method(self, ctx, *args, **kwargs)
Dec 01 19:27:16 user nova-compute[75066]: ERROR nova.compute.manager [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Dec 01 19:27:16 user nova-compute[75066]: ERROR nova.compute.manager [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720]     res = method(self, ctx, attachment_id, *args, **kwargs)
Dec 01 19:27:16 user nova-compute[75066]: ERROR nova.compute.manager [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Dec 01 19:27:16 user nova-compute[75066]: ERROR nova.compute.manager [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720]     with excutils.save_and_reraise_exception():
Dec 01 19:27:16 user nova-compute[75066]: ERROR nova.compute.manager [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Dec 01 19:27:16 user nova-compute[75066]: ERROR nova.compute.manager [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720]     self.force_reraise()
Dec 01 19:27:16 user nova-compute[75066]: ERROR nova.compute.manager [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Dec 01 19:27:16 user nova-compute[75066]: ERROR nova.compute.manager [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720]     raise self.value
Dec 01 19:27:16 user nova-compute[75066]: ERROR nova.compute.manager [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Dec 01 19:27:16 user nova-compute[75066]: ERROR nova.compute.manager [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720]     context, '3.44', skip_version_check=True).attachments.update(
Dec 01 19:27:16 user nova-compute[75066]: ERROR nova.compute.manager [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Dec 01 19:27:16 user nova-compute[75066]: ERROR nova.compute.manager [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720]     return method.func(obj, *args, **kwargs)
Dec 01 19:27:16 user nova-compute[75066]: ERROR nova.compute.manager [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Dec 01 19:27:16 user nova-compute[75066]: ERROR nova.compute.manager [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720]     resp = self._update('/attachments/%s' % id, body)
Dec 01 19:27:16 user nova-compute[75066]: ERROR nova.compute.manager [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Dec 01 19:27:16 user nova-compute[75066]: ERROR nova.compute.manager [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720]     resp, body = self.api.client.put(url, body=body, **kwargs)
Dec 01 19:27:16 user nova-compute[75066]: ERROR nova.compute.manager [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Dec 01 19:27:16 user nova-compute[75066]: ERROR nova.compute.manager [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720]     return self._cs_request(url, 'PUT', **kwargs)
Dec 01 19:27:16 user nova-compute[75066]: ERROR nova.compute.manager [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Dec 01 19:27:16 user nova-compute[75066]: ERROR nova.compute.manager [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720]     return self.request(url, method, **kwargs)
Dec 01 19:27:16 user nova-compute[75066]: ERROR nova.compute.manager [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Dec 01 19:27:16 user nova-compute[75066]: ERROR nova.compute.manager [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720]     raise exceptions.from_response(resp, body)
Dec 01 19:27:16 user nova-compute[75066]: ERROR nova.compute.manager [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-93acf0e9-dc4c-48b1-a73a-d4759363c58e)
Dec 01 19:27:16 user nova-compute[75066]: ERROR nova.compute.manager [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] 
Dec 01 19:27:17 user nova-compute[75066]: DEBUG nova.compute.manager [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Preparing to wait for external event volume-reimaged-8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 {{(pid=75066) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Dec 01 19:27:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Acquiring lock "391945f6-fe47-4969-a497-bd320d66cfa3-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:27:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Lock "391945f6-fe47-4969-a497-bd320d66cfa3-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:27:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Lock "391945f6-fe47-4969-a497-bd320d66cfa3-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:27:17 user nova-compute[75066]: DEBUG nova.network.neutron [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Updating instance_info_cache with network_info: [{"id": "01d3bbe9-6b94-4d41-8054-9a525c08ad07", "address": "fa:16:3e:4d:e4:66", "network": {"id": "e456ec12-5332-48fd-9d52-dd1f746ce827", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1817057325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48bc6e4f5cd340629d0dc911144bc461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01d3bbe9-6b", "ovs_interfaceid": "01d3bbe9-6b94-4d41-8054-9a525c08ad07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5a6f499f-c49b-41a7-b9de-e18c2a2aa73c", "address": "fa:16:3e:35:b3:98", "network": {"id": "6d16c8fa-f1e0-4136-bbc9-e27574d1a62e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1363920269", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "48bc6e4f5cd340629d0dc911144bc461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a6f499f-c4", "ovs_interfaceid": "5a6f499f-c49b-41a7-b9de-e18c2a2aa73c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9ad8ee80-89a9-42be-b618-3a59007ca35b", "address": "fa:16:3e:5d:a3:1b", "network": {"id": "6d16c8fa-f1e0-4136-bbc9-e27574d1a62e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1363920269", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "48bc6e4f5cd340629d0dc911144bc461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ad8ee80-89", "ovs_interfaceid": "9ad8ee80-89a9-42be-b618-3a59007ca35b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b2a9f764-ab49-4ca2-aa95-96bdbbd239c5", "address": "fa:16:3e:eb:e7:9c", "network": {"id": "6d16c8fa-f1e0-4136-bbc9-e27574d1a62e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1363920269", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "48bc6e4f5cd340629d0dc911144bc461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2a9f764-ab", "ovs_interfaceid": "b2a9f764-ab49-4ca2-aa95-96bdbbd239c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "34ad241e-f800-489f-9fb7-037e738051c9", "address": "fa:16:3e:b9:70:45", "network": {"id": "6d16c8fa-f1e0-4136-bbc9-e27574d1a62e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1363920269", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "48bc6e4f5cd340629d0dc911144bc461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34ad241e-f8", "ovs_interfaceid": "34ad241e-f800-489f-9fb7-037e738051c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b41eba69-dd88-43d2-a481-9ee9fee0e007", "address": "fa:16:3e:f8:2d:2a", "network": {"id": "b5472e67-29fb-480f-ace1-6a19e9bb5b42", "bridge": "br-int", "label": "tempest-device-tagging-net2-1053741232", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "48bc6e4f5cd340629d0dc911144bc461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb41eba69-dd", "ovs_interfaceid": "b41eba69-dd88-43d2-a481-9ee9fee0e007", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "53dd7ae4-2e22-4a10-b9cb-972db80c809d", "address": "fa:16:3e:61:ea:34", "network": {"id": "b5472e67-29fb-480f-ace1-6a19e9bb5b42", "bridge": "br-int", "label": "tempest-device-tagging-net2-1053741232", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "48bc6e4f5cd340629d0dc911144bc461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53dd7ae4-2e", "ovs_interfaceid": "53dd7ae4-2e22-4a10-b9cb-972db80c809d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:27:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] Releasing lock "refresh_cache-22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:27:17 user nova-compute[75066]: DEBUG nova.compute.manager [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Instance network_info: |[{"id": "01d3bbe9-6b94-4d41-8054-9a525c08ad07", "address": "fa:16:3e:4d:e4:66", "network": {"id": "e456ec12-5332-48fd-9d52-dd1f746ce827", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1817057325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48bc6e4f5cd340629d0dc911144bc461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01d3bbe9-6b", "ovs_interfaceid": "01d3bbe9-6b94-4d41-8054-9a525c08ad07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5a6f499f-c49b-41a7-b9de-e18c2a2aa73c", "address": "fa:16:3e:35:b3:98", "network": {"id": "6d16c8fa-f1e0-4136-bbc9-e27574d1a62e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1363920269", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "48bc6e4f5cd340629d0dc911144bc461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a6f499f-c4", "ovs_interfaceid": "5a6f499f-c49b-41a7-b9de-e18c2a2aa73c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9ad8ee80-89a9-42be-b618-3a59007ca35b", "address": "fa:16:3e:5d:a3:1b", "network": {"id": "6d16c8fa-f1e0-4136-bbc9-e27574d1a62e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1363920269", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "48bc6e4f5cd340629d0dc911144bc461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ad8ee80-89", "ovs_interfaceid": "9ad8ee80-89a9-42be-b618-3a59007ca35b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b2a9f764-ab49-4ca2-aa95-96bdbbd239c5", "address": "fa:16:3e:eb:e7:9c", "network": {"id": "6d16c8fa-f1e0-4136-bbc9-e27574d1a62e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1363920269", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "48bc6e4f5cd340629d0dc911144bc461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2a9f764-ab", "ovs_interfaceid": "b2a9f764-ab49-4ca2-aa95-96bdbbd239c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "34ad241e-f800-489f-9fb7-037e738051c9", "address": "fa:16:3e:b9:70:45", "network": {"id": "6d16c8fa-f1e0-4136-bbc9-e27574d1a62e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1363920269", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "48bc6e4f5cd340629d0dc911144bc461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34ad241e-f8", "ovs_interfaceid": "34ad241e-f800-489f-9fb7-037e738051c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b41eba69-dd88-43d2-a481-9ee9fee0e007", "address": "fa:16:3e:f8:2d:2a", "network": {"id": "b5472e67-29fb-480f-ace1-6a19e9bb5b42", "bridge": "br-int", "label": "tempest-device-tagging-net2-1053741232", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "48bc6e4f5cd340629d0dc911144bc461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb41eba69-dd", "ovs_interfaceid": "b41eba69-dd88-43d2-a481-9ee9fee0e007", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "53dd7ae4-2e22-4a10-b9cb-972db80c809d", "address": "fa:16:3e:61:ea:34", "network": {"id": "b5472e67-29fb-480f-ace1-6a19e9bb5b42", "bridge": "br-int", "label": "tempest-device-tagging-net2-1053741232", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "48bc6e4f5cd340629d0dc911144bc461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53dd7ae4-2e", "ovs_interfaceid": "53dd7ae4-2e22-4a10-b9cb-972db80c809d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 19:27:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-0476b846-680d-4a7e-83d7-da4b3f3e29aa req-0b0f2cbf-a68c-4ba0-af33-bb158e59716a service nova] Acquired lock "refresh_cache-22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:27:17 user nova-compute[75066]: DEBUG nova.network.neutron [req-0476b846-680d-4a7e-83d7-da4b3f3e29aa req-0b0f2cbf-a68c-4ba0-af33-bb158e59716a service nova] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Refreshing network info cache for port 53dd7ae4-2e22-4a10-b9cb-972db80c809d {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:27:17 user nova-compute[75066]: DEBUG nova.compute.claims [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Aborting claim: <nova.compute.claims.Claim object at 0x7f91905db7c0> {{(pid=75066) abort /opt/stack/nova/nova/compute/claims.py:84}}
Dec 01 19:27:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:27:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:27:17 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:17 user nova-compute[75066]: DEBUG nova.network.neutron [req-0476b846-680d-4a7e-83d7-da4b3f3e29aa req-0b0f2cbf-a68c-4ba0-af33-bb158e59716a service nova] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Updated VIF entry in instance network info cache for port 53dd7ae4-2e22-4a10-b9cb-972db80c809d. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:27:17 user nova-compute[75066]: DEBUG nova.network.neutron [req-0476b846-680d-4a7e-83d7-da4b3f3e29aa req-0b0f2cbf-a68c-4ba0-af33-bb158e59716a service nova] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Updating instance_info_cache with network_info: [{"id": "01d3bbe9-6b94-4d41-8054-9a525c08ad07", "address": "fa:16:3e:4d:e4:66", "network": {"id": "e456ec12-5332-48fd-9d52-dd1f746ce827", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1817057325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48bc6e4f5cd340629d0dc911144bc461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01d3bbe9-6b", "ovs_interfaceid": "01d3bbe9-6b94-4d41-8054-9a525c08ad07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "5a6f499f-c49b-41a7-b9de-e18c2a2aa73c", "address": "fa:16:3e:35:b3:98", "network": {"id": "6d16c8fa-f1e0-4136-bbc9-e27574d1a62e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1363920269", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "48bc6e4f5cd340629d0dc911144bc461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a6f499f-c4", "ovs_interfaceid": "5a6f499f-c49b-41a7-b9de-e18c2a2aa73c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9ad8ee80-89a9-42be-b618-3a59007ca35b", "address": "fa:16:3e:5d:a3:1b", "network": {"id": "6d16c8fa-f1e0-4136-bbc9-e27574d1a62e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1363920269", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "48bc6e4f5cd340629d0dc911144bc461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ad8ee80-89", "ovs_interfaceid": "9ad8ee80-89a9-42be-b618-3a59007ca35b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b2a9f764-ab49-4ca2-aa95-96bdbbd239c5", "address": "fa:16:3e:eb:e7:9c", "network": {"id": "6d16c8fa-f1e0-4136-bbc9-e27574d1a62e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1363920269", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "48bc6e4f5cd340629d0dc911144bc461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2a9f764-ab", "ovs_interfaceid": "b2a9f764-ab49-4ca2-aa95-96bdbbd239c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "34ad241e-f800-489f-9fb7-037e738051c9", "address": "fa:16:3e:b9:70:45", "network": {"id": "6d16c8fa-f1e0-4136-bbc9-e27574d1a62e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1363920269", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "48bc6e4f5cd340629d0dc911144bc461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34ad241e-f8", "ovs_interfaceid": "34ad241e-f800-489f-9fb7-037e738051c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b41eba69-dd88-43d2-a481-9ee9fee0e007", "address": "fa:16:3e:f8:2d:2a", "network": {"id": "b5472e67-29fb-480f-ace1-6a19e9bb5b42", "bridge": "br-int", "label": "tempest-device-tagging-net2-1053741232", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "48bc6e4f5cd340629d0dc911144bc461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb41eba69-dd", "ovs_interfaceid": "b41eba69-dd88-43d2-a481-9ee9fee0e007", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "53dd7ae4-2e22-4a10-b9cb-972db80c809d", "address": "fa:16:3e:61:ea:34", "network": {"id": "b5472e67-29fb-480f-ace1-6a19e9bb5b42", "bridge": "br-int", "label": "tempest-device-tagging-net2-1053741232", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "48bc6e4f5cd340629d0dc911144bc461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53dd7ae4-2e", "ovs_interfaceid": "53dd7ae4-2e22-4a10-b9cb-972db80c809d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:27:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-0476b846-680d-4a7e-83d7-da4b3f3e29aa req-0b0f2cbf-a68c-4ba0-af33-bb158e59716a service nova] Releasing lock "refresh_cache-22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:27:17 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:27:17 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:27:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.622s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:27:17 user nova-compute[75066]: DEBUG nova.compute.manager [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Build of instance 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-93acf0e9-dc4c-48b1-a73a-d4759363c58e) {{(pid=75066) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2660}}
Dec 01 19:27:17 user nova-compute[75066]: DEBUG nova.compute.utils [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Build of instance 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: {{(pid=75066) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Dec 01 19:27:18 user nova-compute[75066]: ERROR nova.compute.manager [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Build of instance 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-93acf0e9-dc4c-48b1-a73a-d4759363c58e): nova.exception.BuildAbortException: Build of instance 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-93acf0e9-dc4c-48b1-a73a-d4759363c58e)
Dec 01 19:27:18 user nova-compute[75066]: DEBUG nova.compute.manager [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Unplugging VIFs for instance {{(pid=75066) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2996}}
Dec 01 19:27:18 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T19:27:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2055221450',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2055221450',id=29,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCwc0PDDfQ2fqDXHWmPPjw1+VdFzlbq5EhjKtbd99FjhV6iIcWpYPaelUUYih+aemh0LqT4H8jWW33RESjUIJl2ZZJga3f5KjoZc5kDqq8SagTRJQurcSoEdkA/dVOa3mw==',key_name='tempest-keypair-965341286',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='48bc6e4f5cd340629d0dc911144bc461',ramdisk_id='',reservation_id='r-8zg0n7dp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1453333572',owner_user_name='tempest-TaggedBootDevicesTest_v242-1453333572-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:27:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='518cf2ab2ec94b13bfdccb9ccd4a0ee3',uuid=22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01d3bbe9-6b94-4d41-8054-9a525c08ad07", "address": "fa:16:3e:4d:e4:66", "network": {"id": "e456ec12-5332-48fd-9d52-dd1f746ce827", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1817057325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48bc6e4f5cd340629d0dc911144bc461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01d3bbe9-6b", "ovs_interfaceid": "01d3bbe9-6b94-4d41-8054-9a525c08ad07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:27:18 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] Converting VIF {"id": "01d3bbe9-6b94-4d41-8054-9a525c08ad07", "address": "fa:16:3e:4d:e4:66", "network": {"id": "e456ec12-5332-48fd-9d52-dd1f746ce827", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1817057325-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48bc6e4f5cd340629d0dc911144bc461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01d3bbe9-6b", "ovs_interfaceid": "01d3bbe9-6b94-4d41-8054-9a525c08ad07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:27:18 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:e4:66,bridge_name='br-int',has_traffic_filtering=True,id=01d3bbe9-6b94-4d41-8054-9a525c08ad07,network=Network(e456ec12-5332-48fd-9d52-dd1f746ce827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01d3bbe9-6b') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:27:18 user nova-compute[75066]: DEBUG os_vif [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:e4:66,bridge_name='br-int',has_traffic_filtering=True,id=01d3bbe9-6b94-4d41-8054-9a525c08ad07,network=Network(e456ec12-5332-48fd-9d52-dd1f746ce827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01d3bbe9-6b') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:27:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap01d3bbe9-6b, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:27:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:27:18 user nova-compute[75066]: INFO os_vif [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:e4:66,bridge_name='br-int',has_traffic_filtering=True,id=01d3bbe9-6b94-4d41-8054-9a525c08ad07,network=Network(e456ec12-5332-48fd-9d52-dd1f746ce827),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01d3bbe9-6b')
Dec 01 19:27:18 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T19:27:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2055221450',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2055221450',id=29,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCwc0PDDfQ2fqDXHWmPPjw1+VdFzlbq5EhjKtbd99FjhV6iIcWpYPaelUUYih+aemh0LqT4H8jWW33RESjUIJl2ZZJga3f5KjoZc5kDqq8SagTRJQurcSoEdkA/dVOa3mw==',key_name='tempest-keypair-965341286',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='48bc6e4f5cd340629d0dc911144bc461',ramdisk_id='',reservation_id='r-8zg0n7dp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1453333572',owner_user_name='tempest-TaggedBootDevicesTest_v242-1453333572-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:27:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='518cf2ab2ec94b13bfdccb9ccd4a0ee3',uuid=22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a6f499f-c49b-41a7-b9de-e18c2a2aa73c", "address": "fa:16:3e:35:b3:98", "network": {"id": "6d16c8fa-f1e0-4136-bbc9-e27574d1a62e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1363920269", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "48bc6e4f5cd340629d0dc911144bc461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a6f499f-c4", "ovs_interfaceid": "5a6f499f-c49b-41a7-b9de-e18c2a2aa73c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:27:18 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] Converting VIF {"id": "5a6f499f-c49b-41a7-b9de-e18c2a2aa73c", "address": "fa:16:3e:35:b3:98", "network": {"id": "6d16c8fa-f1e0-4136-bbc9-e27574d1a62e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1363920269", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.130", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "48bc6e4f5cd340629d0dc911144bc461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a6f499f-c4", "ovs_interfaceid": "5a6f499f-c49b-41a7-b9de-e18c2a2aa73c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:27:18 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:35:b3:98,bridge_name='br-int',has_traffic_filtering=True,id=5a6f499f-c49b-41a7-b9de-e18c2a2aa73c,network=Network(6d16c8fa-f1e0-4136-bbc9-e27574d1a62e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5a6f499f-c4') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:27:18 user nova-compute[75066]: DEBUG os_vif [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:b3:98,bridge_name='br-int',has_traffic_filtering=True,id=5a6f499f-c49b-41a7-b9de-e18c2a2aa73c,network=Network(6d16c8fa-f1e0-4136-bbc9-e27574d1a62e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5a6f499f-c4') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:27:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5a6f499f-c4, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:27:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:27:18 user nova-compute[75066]: INFO os_vif [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:35:b3:98,bridge_name='br-int',has_traffic_filtering=True,id=5a6f499f-c49b-41a7-b9de-e18c2a2aa73c,network=Network(6d16c8fa-f1e0-4136-bbc9-e27574d1a62e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap5a6f499f-c4')
Dec 01 19:27:18 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T19:27:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2055221450',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2055221450',id=29,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCwc0PDDfQ2fqDXHWmPPjw1+VdFzlbq5EhjKtbd99FjhV6iIcWpYPaelUUYih+aemh0LqT4H8jWW33RESjUIJl2ZZJga3f5KjoZc5kDqq8SagTRJQurcSoEdkA/dVOa3mw==',key_name='tempest-keypair-965341286',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='48bc6e4f5cd340629d0dc911144bc461',ramdisk_id='',reservation_id='r-8zg0n7dp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1453333572',owner_user_name='tempest-TaggedBootDevicesTest_v242-1453333572-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:27:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='518cf2ab2ec94b13bfdccb9ccd4a0ee3',uuid=22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9ad8ee80-89a9-42be-b618-3a59007ca35b", "address": "fa:16:3e:5d:a3:1b", "network": {"id": "6d16c8fa-f1e0-4136-bbc9-e27574d1a62e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1363920269", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "48bc6e4f5cd340629d0dc911144bc461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ad8ee80-89", "ovs_interfaceid": "9ad8ee80-89a9-42be-b618-3a59007ca35b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:27:18 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] Converting VIF {"id": "9ad8ee80-89a9-42be-b618-3a59007ca35b", "address": "fa:16:3e:5d:a3:1b", "network": {"id": "6d16c8fa-f1e0-4136-bbc9-e27574d1a62e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1363920269", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "48bc6e4f5cd340629d0dc911144bc461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9ad8ee80-89", "ovs_interfaceid": "9ad8ee80-89a9-42be-b618-3a59007ca35b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:27:18 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:a3:1b,bridge_name='br-int',has_traffic_filtering=True,id=9ad8ee80-89a9-42be-b618-3a59007ca35b,network=Network(6d16c8fa-f1e0-4136-bbc9-e27574d1a62e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9ad8ee80-89') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:27:18 user nova-compute[75066]: DEBUG os_vif [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:a3:1b,bridge_name='br-int',has_traffic_filtering=True,id=9ad8ee80-89a9-42be-b618-3a59007ca35b,network=Network(6d16c8fa-f1e0-4136-bbc9-e27574d1a62e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9ad8ee80-89') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:27:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9ad8ee80-89, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:27:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:27:18 user nova-compute[75066]: INFO os_vif [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:a3:1b,bridge_name='br-int',has_traffic_filtering=True,id=9ad8ee80-89a9-42be-b618-3a59007ca35b,network=Network(6d16c8fa-f1e0-4136-bbc9-e27574d1a62e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap9ad8ee80-89')
Dec 01 19:27:18 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T19:27:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2055221450',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2055221450',id=29,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCwc0PDDfQ2fqDXHWmPPjw1+VdFzlbq5EhjKtbd99FjhV6iIcWpYPaelUUYih+aemh0LqT4H8jWW33RESjUIJl2ZZJga3f5KjoZc5kDqq8SagTRJQurcSoEdkA/dVOa3mw==',key_name='tempest-keypair-965341286',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='48bc6e4f5cd340629d0dc911144bc461',ramdisk_id='',reservation_id='r-8zg0n7dp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1453333572',owner_user_name='tempest-TaggedBootDevicesTest_v242-1453333572-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:27:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='518cf2ab2ec94b13bfdccb9ccd4a0ee3',uuid=22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b2a9f764-ab49-4ca2-aa95-96bdbbd239c5", "address": "fa:16:3e:eb:e7:9c", "network": {"id": "6d16c8fa-f1e0-4136-bbc9-e27574d1a62e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1363920269", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "48bc6e4f5cd340629d0dc911144bc461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2a9f764-ab", "ovs_interfaceid": "b2a9f764-ab49-4ca2-aa95-96bdbbd239c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:27:18 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] Converting VIF {"id": "b2a9f764-ab49-4ca2-aa95-96bdbbd239c5", "address": "fa:16:3e:eb:e7:9c", "network": {"id": "6d16c8fa-f1e0-4136-bbc9-e27574d1a62e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1363920269", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.149", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "48bc6e4f5cd340629d0dc911144bc461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb2a9f764-ab", "ovs_interfaceid": "b2a9f764-ab49-4ca2-aa95-96bdbbd239c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:27:18 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:e7:9c,bridge_name='br-int',has_traffic_filtering=True,id=b2a9f764-ab49-4ca2-aa95-96bdbbd239c5,network=Network(6d16c8fa-f1e0-4136-bbc9-e27574d1a62e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2a9f764-ab') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:27:18 user nova-compute[75066]: DEBUG os_vif [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:e7:9c,bridge_name='br-int',has_traffic_filtering=True,id=b2a9f764-ab49-4ca2-aa95-96bdbbd239c5,network=Network(6d16c8fa-f1e0-4136-bbc9-e27574d1a62e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2a9f764-ab') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:27:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb2a9f764-ab, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:27:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:27:18 user nova-compute[75066]: INFO os_vif [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:e7:9c,bridge_name='br-int',has_traffic_filtering=True,id=b2a9f764-ab49-4ca2-aa95-96bdbbd239c5,network=Network(6d16c8fa-f1e0-4136-bbc9-e27574d1a62e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb2a9f764-ab')
Dec 01 19:27:18 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T19:27:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2055221450',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2055221450',id=29,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCwc0PDDfQ2fqDXHWmPPjw1+VdFzlbq5EhjKtbd99FjhV6iIcWpYPaelUUYih+aemh0LqT4H8jWW33RESjUIJl2ZZJga3f5KjoZc5kDqq8SagTRJQurcSoEdkA/dVOa3mw==',key_name='tempest-keypair-965341286',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='48bc6e4f5cd340629d0dc911144bc461',ramdisk_id='',reservation_id='r-8zg0n7dp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1453333572',owner_user_name='tempest-TaggedBootDevicesTest_v242-1453333572-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:27:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='518cf2ab2ec94b13bfdccb9ccd4a0ee3',uuid=22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "34ad241e-f800-489f-9fb7-037e738051c9", "address": "fa:16:3e:b9:70:45", "network": {"id": "6d16c8fa-f1e0-4136-bbc9-e27574d1a62e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1363920269", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "48bc6e4f5cd340629d0dc911144bc461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34ad241e-f8", "ovs_interfaceid": "34ad241e-f800-489f-9fb7-037e738051c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:27:18 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] Converting VIF {"id": "34ad241e-f800-489f-9fb7-037e738051c9", "address": "fa:16:3e:b9:70:45", "network": {"id": "6d16c8fa-f1e0-4136-bbc9-e27574d1a62e", "bridge": "br-int", "label": "tempest-device-tagging-net1-1363920269", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.54", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "48bc6e4f5cd340629d0dc911144bc461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap34ad241e-f8", "ovs_interfaceid": "34ad241e-f800-489f-9fb7-037e738051c9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:27:18 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:70:45,bridge_name='br-int',has_traffic_filtering=True,id=34ad241e-f800-489f-9fb7-037e738051c9,network=Network(6d16c8fa-f1e0-4136-bbc9-e27574d1a62e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34ad241e-f8') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:27:18 user nova-compute[75066]: DEBUG os_vif [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:70:45,bridge_name='br-int',has_traffic_filtering=True,id=34ad241e-f800-489f-9fb7-037e738051c9,network=Network(6d16c8fa-f1e0-4136-bbc9-e27574d1a62e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34ad241e-f8') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:27:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap34ad241e-f8, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:27:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:27:18 user nova-compute[75066]: INFO os_vif [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:70:45,bridge_name='br-int',has_traffic_filtering=True,id=34ad241e-f800-489f-9fb7-037e738051c9,network=Network(6d16c8fa-f1e0-4136-bbc9-e27574d1a62e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap34ad241e-f8')
Dec 01 19:27:18 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T19:27:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2055221450',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2055221450',id=29,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCwc0PDDfQ2fqDXHWmPPjw1+VdFzlbq5EhjKtbd99FjhV6iIcWpYPaelUUYih+aemh0LqT4H8jWW33RESjUIJl2ZZJga3f5KjoZc5kDqq8SagTRJQurcSoEdkA/dVOa3mw==',key_name='tempest-keypair-965341286',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='48bc6e4f5cd340629d0dc911144bc461',ramdisk_id='',reservation_id='r-8zg0n7dp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1453333572',owner_user_name='tempest-TaggedBootDevicesTest_v242-1453333572-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:27:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='518cf2ab2ec94b13bfdccb9ccd4a0ee3',uuid=22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b41eba69-dd88-43d2-a481-9ee9fee0e007", "address": "fa:16:3e:f8:2d:2a", "network": {"id": "b5472e67-29fb-480f-ace1-6a19e9bb5b42", "bridge": "br-int", "label": "tempest-device-tagging-net2-1053741232", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "48bc6e4f5cd340629d0dc911144bc461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb41eba69-dd", "ovs_interfaceid": "b41eba69-dd88-43d2-a481-9ee9fee0e007", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:27:18 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] Converting VIF {"id": "b41eba69-dd88-43d2-a481-9ee9fee0e007", "address": "fa:16:3e:f8:2d:2a", "network": {"id": "b5472e67-29fb-480f-ace1-6a19e9bb5b42", "bridge": "br-int", "label": "tempest-device-tagging-net2-1053741232", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "48bc6e4f5cd340629d0dc911144bc461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb41eba69-dd", "ovs_interfaceid": "b41eba69-dd88-43d2-a481-9ee9fee0e007", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:27:18 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:2d:2a,bridge_name='br-int',has_traffic_filtering=True,id=b41eba69-dd88-43d2-a481-9ee9fee0e007,network=Network(b5472e67-29fb-480f-ace1-6a19e9bb5b42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb41eba69-dd') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:27:18 user nova-compute[75066]: DEBUG os_vif [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:2d:2a,bridge_name='br-int',has_traffic_filtering=True,id=b41eba69-dd88-43d2-a481-9ee9fee0e007,network=Network(b5472e67-29fb-480f-ace1-6a19e9bb5b42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb41eba69-dd') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:27:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb41eba69-dd, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:27:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:27:18 user nova-compute[75066]: INFO os_vif [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:2d:2a,bridge_name='br-int',has_traffic_filtering=True,id=b41eba69-dd88-43d2-a481-9ee9fee0e007,network=Network(b5472e67-29fb-480f-ace1-6a19e9bb5b42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb41eba69-dd')
Dec 01 19:27:18 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-12-01T19:27:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2055221450',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2055221450',id=29,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCwc0PDDfQ2fqDXHWmPPjw1+VdFzlbq5EhjKtbd99FjhV6iIcWpYPaelUUYih+aemh0LqT4H8jWW33RESjUIJl2ZZJga3f5KjoZc5kDqq8SagTRJQurcSoEdkA/dVOa3mw==',key_name='tempest-keypair-965341286',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='48bc6e4f5cd340629d0dc911144bc461',ramdisk_id='',reservation_id='r-8zg0n7dp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1453333572',owner_user_name='tempest-TaggedBootDevicesTest_v242-1453333572-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:27:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='518cf2ab2ec94b13bfdccb9ccd4a0ee3',uuid=22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53dd7ae4-2e22-4a10-b9cb-972db80c809d", "address": "fa:16:3e:61:ea:34", "network": {"id": "b5472e67-29fb-480f-ace1-6a19e9bb5b42", "bridge": "br-int", "label": "tempest-device-tagging-net2-1053741232", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "48bc6e4f5cd340629d0dc911144bc461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53dd7ae4-2e", "ovs_interfaceid": "53dd7ae4-2e22-4a10-b9cb-972db80c809d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:27:18 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] Converting VIF {"id": "53dd7ae4-2e22-4a10-b9cb-972db80c809d", "address": "fa:16:3e:61:ea:34", "network": {"id": "b5472e67-29fb-480f-ace1-6a19e9bb5b42", "bridge": "br-int", "label": "tempest-device-tagging-net2-1053741232", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "48bc6e4f5cd340629d0dc911144bc461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53dd7ae4-2e", "ovs_interfaceid": "53dd7ae4-2e22-4a10-b9cb-972db80c809d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:27:18 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:ea:34,bridge_name='br-int',has_traffic_filtering=True,id=53dd7ae4-2e22-4a10-b9cb-972db80c809d,network=Network(b5472e67-29fb-480f-ace1-6a19e9bb5b42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53dd7ae4-2e') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:27:18 user nova-compute[75066]: DEBUG os_vif [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:ea:34,bridge_name='br-int',has_traffic_filtering=True,id=53dd7ae4-2e22-4a10-b9cb-972db80c809d,network=Network(b5472e67-29fb-480f-ace1-6a19e9bb5b42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53dd7ae4-2e') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:27:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap53dd7ae4-2e, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:27:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:27:18 user nova-compute[75066]: INFO os_vif [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:ea:34,bridge_name='br-int',has_traffic_filtering=True,id=53dd7ae4-2e22-4a10-b9cb-972db80c809d,network=Network(b5472e67-29fb-480f-ace1-6a19e9bb5b42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53dd7ae4-2e')
Dec 01 19:27:18 user nova-compute[75066]: DEBUG nova.compute.manager [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Unplugged VIFs for instance {{(pid=75066) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:3032}}
Dec 01 19:27:18 user nova-compute[75066]: DEBUG nova.compute.manager [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Deallocating network for instance {{(pid=75066) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 19:27:18 user nova-compute[75066]: DEBUG nova.network.neutron [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] deallocate_for_instance() {{(pid=75066) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 19:27:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:21 user nova-compute[75066]: DEBUG nova.network.neutron [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:27:21 user nova-compute[75066]: INFO nova.compute.manager [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Took 3.06 seconds to deallocate network for instance.
Dec 01 19:27:21 user nova-compute[75066]: DEBUG nova.compute.manager [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Detaching volume: 2b6f49bc-879c-4cf5-809d-6c1ef44cba78 {{(pid=75066) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Dec 01 19:27:21 user nova-compute[75066]: INFO nova.compute.manager [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Detaching volume 2b6f49bc-879c-4cf5-809d-6c1ef44cba78
Dec 01 19:27:21 user nova-compute[75066]: DEBUG nova.virt.block_device [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Skipping driver_detach during remote rebuild. {{(pid=75066) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Dec 01 19:27:22 user nova-compute[75066]: WARNING nova.compute.manager [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] Failed to detach volume: 2b6f49bc-879c-4cf5-809d-6c1ef44cba78 due to 'NoneType' object has no attribute 'devices'
Dec 01 19:27:22 user nova-compute[75066]: DEBUG nova.compute.manager [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Detaching volume: b50cc214-f4ca-4631-9cba-acfcc88f1dc3 {{(pid=75066) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Dec 01 19:27:22 user nova-compute[75066]: INFO nova.compute.manager [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Detaching volume b50cc214-f4ca-4631-9cba-acfcc88f1dc3
Dec 01 19:27:22 user nova-compute[75066]: DEBUG nova.virt.block_device [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Skipping driver_detach during remote rebuild. {{(pid=75066) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Dec 01 19:27:22 user nova-compute[75066]: WARNING nova.compute.manager [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] Failed to detach volume: b50cc214-f4ca-4631-9cba-acfcc88f1dc3 due to 'NoneType' object has no attribute 'devices'
Dec 01 19:27:22 user nova-compute[75066]: DEBUG nova.compute.manager [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Detaching volume: ff4d2642-d16d-465c-9cb0-930f81866e34 {{(pid=75066) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Dec 01 19:27:22 user nova-compute[75066]: INFO nova.compute.manager [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Detaching volume ff4d2642-d16d-465c-9cb0-930f81866e34
Dec 01 19:27:22 user nova-compute[75066]: DEBUG nova.virt.block_device [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] [instance: 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720] Skipping driver_detach during remote rebuild. {{(pid=75066) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Dec 01 19:27:22 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:22 user nova-compute[75066]: INFO nova.scheduler.client.report [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] Deleted allocations for instance 22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720
Dec 01 19:27:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e6a22e55-83ae-44a7-96a8-1c09deeb38cf tempest-TaggedBootDevicesTest_v242-1453333572 tempest-TaggedBootDevicesTest_v242-1453333572-project-member] Lock "22ab0d4a-49f8-4d7f-b38a-bdfcaa73e720" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.071s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:27:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:27 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:32 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:35 user nova-compute[75066]: DEBUG nova.compute.manager [req-01b1ff02-fa63-4804-aabf-433ea336b3de req-8dda2623-7bdc-4896-b919-a62d31054d4b service nova] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Received event network-changed-0472fc48-19d0-4e5e-ac11-7c28e1ddd485 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:27:35 user nova-compute[75066]: DEBUG nova.compute.manager [req-01b1ff02-fa63-4804-aabf-433ea336b3de req-8dda2623-7bdc-4896-b919-a62d31054d4b service nova] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Refreshing instance network info cache due to event network-changed-0472fc48-19d0-4e5e-ac11-7c28e1ddd485. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:27:35 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-01b1ff02-fa63-4804-aabf-433ea336b3de req-8dda2623-7bdc-4896-b919-a62d31054d4b service nova] Acquiring lock "refresh_cache-a553e030-0d69-4725-9f84-6c0c63556ed4" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:27:35 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-01b1ff02-fa63-4804-aabf-433ea336b3de req-8dda2623-7bdc-4896-b919-a62d31054d4b service nova] Acquired lock "refresh_cache-a553e030-0d69-4725-9f84-6c0c63556ed4" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:27:35 user nova-compute[75066]: DEBUG nova.network.neutron [req-01b1ff02-fa63-4804-aabf-433ea336b3de req-8dda2623-7bdc-4896-b919-a62d31054d4b service nova] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Refreshing network info cache for port 0472fc48-19d0-4e5e-ac11-7c28e1ddd485 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:27:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed36c78e-c785-457e-9fbe-640bd84da2ca tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Acquiring lock "a553e030-0d69-4725-9f84-6c0c63556ed4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:27:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed36c78e-c785-457e-9fbe-640bd84da2ca tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lock "a553e030-0d69-4725-9f84-6c0c63556ed4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:27:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed36c78e-c785-457e-9fbe-640bd84da2ca tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Acquiring lock "a553e030-0d69-4725-9f84-6c0c63556ed4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:27:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed36c78e-c785-457e-9fbe-640bd84da2ca tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lock "a553e030-0d69-4725-9f84-6c0c63556ed4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:27:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed36c78e-c785-457e-9fbe-640bd84da2ca tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lock "a553e030-0d69-4725-9f84-6c0c63556ed4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:27:36 user nova-compute[75066]: INFO nova.compute.manager [None req-ed36c78e-c785-457e-9fbe-640bd84da2ca tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Terminating instance
Dec 01 19:27:36 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed36c78e-c785-457e-9fbe-640bd84da2ca tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Start destroying the instance on the hypervisor. {{(pid=75066) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 19:27:36 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:36 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:36 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:36 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:36 user nova-compute[75066]: DEBUG nova.network.neutron [req-01b1ff02-fa63-4804-aabf-433ea336b3de req-8dda2623-7bdc-4896-b919-a62d31054d4b service nova] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Updated VIF entry in instance network info cache for port 0472fc48-19d0-4e5e-ac11-7c28e1ddd485. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:27:36 user nova-compute[75066]: DEBUG nova.network.neutron [req-01b1ff02-fa63-4804-aabf-433ea336b3de req-8dda2623-7bdc-4896-b919-a62d31054d4b service nova] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Updating instance_info_cache with network_info: [{"id": "0472fc48-19d0-4e5e-ac11-7c28e1ddd485", "address": "fa:16:3e:18:e9:73", "network": {"id": "191f13ce-a864-4c09-8ca5-e8a106e24d37", "bridge": "br-int", "label": "tempest-TestStampPattern-1604601756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9caae5967744641b7490e1aa91973c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0472fc48-19", "ovs_interfaceid": "0472fc48-19d0-4e5e-ac11-7c28e1ddd485", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:27:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-01b1ff02-fa63-4804-aabf-433ea336b3de req-8dda2623-7bdc-4896-b919-a62d31054d4b service nova] Releasing lock "refresh_cache-a553e030-0d69-4725-9f84-6c0c63556ed4" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:27:37 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Instance destroyed successfully.
Dec 01 19:27:37 user nova-compute[75066]: DEBUG nova.objects.instance [None req-ed36c78e-c785-457e-9fbe-640bd84da2ca tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lazy-loading 'resources' on Instance uuid a553e030-0d69-4725-9f84-6c0c63556ed4 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:27:37 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-ed36c78e-c785-457e-9fbe-640bd84da2ca tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:20:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1617344885',display_name='tempest-TestStampPattern-server-1617344885',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1617344885',id=18,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLSWelIBdKpY5tDhTVMPXRfCvQwvHNWZhGDeDhkjt6+GDQnshog1py5tqU+qYJowL71BLCNBO5cYXwkrz8pBEBbdzILknRNr0r/SkH7MZtJef4QVznd62i44CV3XthbMbQ==',key_name='tempest-TestStampPattern-1467755075',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:20:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c9caae5967744641b7490e1aa91973c0',ramdisk_id='',reservation_id='r-6zps15ix',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-859706400',owner_user_name='tempest-TestStampPattern-859706400-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:23:35Z,user_data=None,user_id='7c1a5012f94b43e38161f8c823173f7f',uuid=a553e030-0d69-4725-9f84-6c0c63556ed4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0472fc48-19d0-4e5e-ac11-7c28e1ddd485", "address": "fa:16:3e:18:e9:73", "network": {"id": "191f13ce-a864-4c09-8ca5-e8a106e24d37", "bridge": "br-int", "label": "tempest-TestStampPattern-1604601756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9caae5967744641b7490e1aa91973c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0472fc48-19", "ovs_interfaceid": "0472fc48-19d0-4e5e-ac11-7c28e1ddd485", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:27:37 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-ed36c78e-c785-457e-9fbe-640bd84da2ca tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Converting VIF {"id": "0472fc48-19d0-4e5e-ac11-7c28e1ddd485", "address": "fa:16:3e:18:e9:73", "network": {"id": "191f13ce-a864-4c09-8ca5-e8a106e24d37", "bridge": "br-int", "label": "tempest-TestStampPattern-1604601756-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9caae5967744641b7490e1aa91973c0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0472fc48-19", "ovs_interfaceid": "0472fc48-19d0-4e5e-ac11-7c28e1ddd485", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:27:37 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-ed36c78e-c785-457e-9fbe-640bd84da2ca tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:18:e9:73,bridge_name='br-int',has_traffic_filtering=True,id=0472fc48-19d0-4e5e-ac11-7c28e1ddd485,network=Network(191f13ce-a864-4c09-8ca5-e8a106e24d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0472fc48-19') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:27:37 user nova-compute[75066]: DEBUG os_vif [None req-ed36c78e-c785-457e-9fbe-640bd84da2ca tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:e9:73,bridge_name='br-int',has_traffic_filtering=True,id=0472fc48-19d0-4e5e-ac11-7c28e1ddd485,network=Network(191f13ce-a864-4c09-8ca5-e8a106e24d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0472fc48-19') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:27:37 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:37 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0472fc48-19, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:27:37 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:37 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:27:37 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:37 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9263affa-2c9b-4066-ba37-f1f924b2b58f) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:27:37 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:37 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:27:37 user nova-compute[75066]: INFO os_vif [None req-ed36c78e-c785-457e-9fbe-640bd84da2ca tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:e9:73,bridge_name='br-int',has_traffic_filtering=True,id=0472fc48-19d0-4e5e-ac11-7c28e1ddd485,network=Network(191f13ce-a864-4c09-8ca5-e8a106e24d37),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0472fc48-19')
Dec 01 19:27:37 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-ed36c78e-c785-457e-9fbe-640bd84da2ca tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Deleting instance files /opt/stack/data/nova/instances/a553e030-0d69-4725-9f84-6c0c63556ed4_del
Dec 01 19:27:37 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-ed36c78e-c785-457e-9fbe-640bd84da2ca tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Deletion of /opt/stack/data/nova/instances/a553e030-0d69-4725-9f84-6c0c63556ed4_del complete
Dec 01 19:27:37 user nova-compute[75066]: DEBUG nova.compute.manager [req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 req-ad8c13dc-3f63-42d5-a4ed-65e27356f568 service nova] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Received event volume-reimaged-8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:27:37 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 req-ad8c13dc-3f63-42d5-a4ed-65e27356f568 service nova] Acquiring lock "391945f6-fe47-4969-a497-bd320d66cfa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:27:37 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 req-ad8c13dc-3f63-42d5-a4ed-65e27356f568 service nova] Lock "391945f6-fe47-4969-a497-bd320d66cfa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:27:37 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 req-ad8c13dc-3f63-42d5-a4ed-65e27356f568 service nova] Lock "391945f6-fe47-4969-a497-bd320d66cfa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:27:37 user nova-compute[75066]: DEBUG nova.compute.manager [req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 req-ad8c13dc-3f63-42d5-a4ed-65e27356f568 service nova] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Processing event volume-reimaged-8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 {{(pid=75066) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Dec 01 19:27:37 user nova-compute[75066]: DEBUG nova.compute.manager [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Instance event wait completed in 19 seconds for volume-reimaged {{(pid=75066) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 19:27:37 user nova-compute[75066]: INFO nova.compute.manager [None req-ed36c78e-c785-457e-9fbe-640bd84da2ca tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Took 0.92 seconds to destroy the instance on the hypervisor.
Dec 01 19:27:37 user nova-compute[75066]: DEBUG oslo.service.loopingcall [None req-ed36c78e-c785-457e-9fbe-640bd84da2ca tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75066) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 19:27:37 user nova-compute[75066]: DEBUG nova.compute.manager [-] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Deallocating network for instance {{(pid=75066) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 19:27:37 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] deallocate_for_instance() {{(pid=75066) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 19:27:37 user nova-compute[75066]: INFO nova.virt.block_device [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Booting with volume 8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 at /dev/vda
Dec 01 19:27:37 user nova-compute[75066]: DEBUG os_brick.utils [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:27:37 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:37 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:37 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6770cb5-a1ba-434e-a7c5-0ca9f3f74b3d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1959854982f\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:37 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:37 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.027s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:37 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[af86c571-c11f-4a00-b2f1-b5e73fd8782f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:37 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:37 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:37 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdee016b-6512-490b-8c96-0d3201e9e121]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:37 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[245f4220-75ed-43bc-8ecc-43ef506b179e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:37 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Running cmd (subprocess): nvme version {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:37 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] 'nvme version' failed. Not Retrying. {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:27:37 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.nvmeof [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] nvme not present on system {{(pid=75066) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 19:27:37 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:37 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:27:37 user nova-compute[75066]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 19:27:37 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a59408-090c-4f7e-866f-1e0b838dddd7]: (4, '') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:37 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75066) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 19:27:37 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 19:27:37 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] LIGHTOS: no hostnqn found. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 19:27:37 user nova-compute[75066]: DEBUG os_brick.utils [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1959854982f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:27:37 user nova-compute[75066]: DEBUG nova.virt.block_device [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Updating existing volume attachment record: 9025664f-f278-4341-a21d-b14b45645b88 {{(pid=75066) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 19:27:37 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:27:37 user nova-compute[75066]: INFO nova.compute.manager [-] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Took 0.40 seconds to deallocate network for instance.
Dec 01 19:27:37 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed36c78e-c785-457e-9fbe-640bd84da2ca tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:27:37 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed36c78e-c785-457e-9fbe-640bd84da2ca tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:27:37 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:38 user nova-compute[75066]: DEBUG nova.compute.manager [req-d25121d7-56bf-41cf-84fc-8c4a36b69eb0 req-66786fd2-796e-4cb9-9d40-921caba4cd54 service nova] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Received event network-vif-unplugged-0472fc48-19d0-4e5e-ac11-7c28e1ddd485 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:27:38 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d25121d7-56bf-41cf-84fc-8c4a36b69eb0 req-66786fd2-796e-4cb9-9d40-921caba4cd54 service nova] Acquiring lock "a553e030-0d69-4725-9f84-6c0c63556ed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:27:38 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d25121d7-56bf-41cf-84fc-8c4a36b69eb0 req-66786fd2-796e-4cb9-9d40-921caba4cd54 service nova] Lock "a553e030-0d69-4725-9f84-6c0c63556ed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:27:38 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d25121d7-56bf-41cf-84fc-8c4a36b69eb0 req-66786fd2-796e-4cb9-9d40-921caba4cd54 service nova] Lock "a553e030-0d69-4725-9f84-6c0c63556ed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:27:38 user nova-compute[75066]: DEBUG nova.compute.manager [req-d25121d7-56bf-41cf-84fc-8c4a36b69eb0 req-66786fd2-796e-4cb9-9d40-921caba4cd54 service nova] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] No waiting events found dispatching network-vif-unplugged-0472fc48-19d0-4e5e-ac11-7c28e1ddd485 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:27:38 user nova-compute[75066]: WARNING nova.compute.manager [req-d25121d7-56bf-41cf-84fc-8c4a36b69eb0 req-66786fd2-796e-4cb9-9d40-921caba4cd54 service nova] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Received unexpected event network-vif-unplugged-0472fc48-19d0-4e5e-ac11-7c28e1ddd485 for instance with vm_state deleted and task_state None.
Dec 01 19:27:38 user nova-compute[75066]: DEBUG nova.compute.manager [req-d25121d7-56bf-41cf-84fc-8c4a36b69eb0 req-66786fd2-796e-4cb9-9d40-921caba4cd54 service nova] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Received event network-vif-plugged-0472fc48-19d0-4e5e-ac11-7c28e1ddd485 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:27:38 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d25121d7-56bf-41cf-84fc-8c4a36b69eb0 req-66786fd2-796e-4cb9-9d40-921caba4cd54 service nova] Acquiring lock "a553e030-0d69-4725-9f84-6c0c63556ed4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:27:38 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d25121d7-56bf-41cf-84fc-8c4a36b69eb0 req-66786fd2-796e-4cb9-9d40-921caba4cd54 service nova] Lock "a553e030-0d69-4725-9f84-6c0c63556ed4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:27:38 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d25121d7-56bf-41cf-84fc-8c4a36b69eb0 req-66786fd2-796e-4cb9-9d40-921caba4cd54 service nova] Lock "a553e030-0d69-4725-9f84-6c0c63556ed4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:27:38 user nova-compute[75066]: DEBUG nova.compute.manager [req-d25121d7-56bf-41cf-84fc-8c4a36b69eb0 req-66786fd2-796e-4cb9-9d40-921caba4cd54 service nova] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] No waiting events found dispatching network-vif-plugged-0472fc48-19d0-4e5e-ac11-7c28e1ddd485 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:27:38 user nova-compute[75066]: WARNING nova.compute.manager [req-d25121d7-56bf-41cf-84fc-8c4a36b69eb0 req-66786fd2-796e-4cb9-9d40-921caba4cd54 service nova] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Received unexpected event network-vif-plugged-0472fc48-19d0-4e5e-ac11-7c28e1ddd485 for instance with vm_state deleted and task_state None.
Dec 01 19:27:38 user nova-compute[75066]: DEBUG nova.compute.manager [req-d25121d7-56bf-41cf-84fc-8c4a36b69eb0 req-66786fd2-796e-4cb9-9d40-921caba4cd54 service nova] [instance: a553e030-0d69-4725-9f84-6c0c63556ed4] Received event network-vif-deleted-0472fc48-19d0-4e5e-ac11-7c28e1ddd485 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:27:38 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-ed36c78e-c785-457e-9fbe-640bd84da2ca tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:27:38 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed36c78e-c785-457e-9fbe-640bd84da2ca tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:27:38 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed36c78e-c785-457e-9fbe-640bd84da2ca tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.492s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:27:38 user nova-compute[75066]: INFO nova.scheduler.client.report [None req-ed36c78e-c785-457e-9fbe-640bd84da2ca tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Deleted allocations for instance a553e030-0d69-4725-9f84-6c0c63556ed4
Dec 01 19:27:38 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed36c78e-c785-457e-9fbe-640bd84da2ca tempest-TestStampPattern-859706400 tempest-TestStampPattern-859706400-project-member] Lock "a553e030-0d69-4725-9f84-6c0c63556ed4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.003s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:27:38 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-1801aa20-840a-4638-8514-c1ea96795957 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Acquiring lock "e32ba192-38b9-46f0-b164-1652a43cf3d2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:27:38 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-1801aa20-840a-4638-8514-c1ea96795957 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lock "e32ba192-38b9-46f0-b164-1652a43cf3d2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:27:38 user nova-compute[75066]: INFO nova.compute.manager [None req-1801aa20-840a-4638-8514-c1ea96795957 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Detaching volume 80cd56ab-657c-459d-aab2-011d8dd87237
Dec 01 19:27:38 user nova-compute[75066]: INFO nova.virt.block_device [None req-1801aa20-840a-4638-8514-c1ea96795957 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Attempting to driver detach volume 80cd56ab-657c-459d-aab2-011d8dd87237 from mountpoint /dev/vdb
Dec 01 19:27:38 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-1801aa20-840a-4638-8514-c1ea96795957 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Attempting to detach device vdb from instance e32ba192-38b9-46f0-b164-1652a43cf3d2 from the persistent domain config. {{(pid=75066) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 19:27:38 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-1801aa20-840a-4638-8514-c1ea96795957 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 19:27:38 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:27:38 user nova-compute[75066]:   <source dev="/dev/sde"/>
Dec 01 19:27:38 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:27:38 user nova-compute[75066]:   <serial>80cd56ab-657c-459d-aab2-011d8dd87237</serial>
Dec 01 19:27:38 user nova-compute[75066]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 19:27:38 user nova-compute[75066]: </disk>
Dec 01 19:27:38 user nova-compute[75066]:  {{(pid=75066) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 19:27:38 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-1801aa20-840a-4638-8514-c1ea96795957 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Successfully detached device vdb from instance e32ba192-38b9-46f0-b164-1652a43cf3d2 from the persistent domain config.
Dec 01 19:27:38 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-1801aa20-840a-4638-8514-c1ea96795957 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e32ba192-38b9-46f0-b164-1652a43cf3d2 from the live domain config. {{(pid=75066) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 19:27:38 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-1801aa20-840a-4638-8514-c1ea96795957 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 19:27:38 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:27:38 user nova-compute[75066]:   <source dev="/dev/sde"/>
Dec 01 19:27:38 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:27:38 user nova-compute[75066]:   <serial>80cd56ab-657c-459d-aab2-011d8dd87237</serial>
Dec 01 19:27:38 user nova-compute[75066]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 19:27:38 user nova-compute[75066]: </disk>
Dec 01 19:27:38 user nova-compute[75066]:  {{(pid=75066) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 19:27:38 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5877ae63-67cd-4aa2-86d7-f838a71e6d06 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Acquiring lock "e32ba192-38b9-46f0-b164-1652a43cf3d2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:27:39 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-1801aa20-840a-4638-8514-c1ea96795957 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e32ba192-38b9-46f0-b164-1652a43cf3d2 {{(pid=75066) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 19:27:42 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:42 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Creating instance directory {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 19:27:47 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Creating image(s)
Dec 01 19:27:47 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Did not create local disks {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Ensure instance console log exists: /opt/stack/data/nova/instances/391945f6-fe47-4969-a497-bd320d66cfa3/console.log {{(pid=75066) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Start _get_guest_xml network_info=[{"id": "e5f3728a-541f-4b95-9feb-6119687f2eba", "address": "fa:16:3e:9c:60:12", "network": {"id": "3e44df49-3c9c-4812-aafc-ce3f4795874b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-826204178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83c5f90337e64829893181e7e8140b8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5f3728a-54", "ovs_interfaceid": "e5f3728a-541f-4b95-9feb-6119687f2eba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': True, 'attachment_id': '9025664f-f278-4341-a21d-b14b45645b88', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xUAEeuip', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '391945f6-fe47-4969-a497-bd320d66cfa3', 'attached_at': '', 'detached_at': '', 'volume_id': '8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0', 'serial': '8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:27:47 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Dec 01 19:27:47 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Dec 01 19:27:47 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG nova.objects.instance [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Lazy-loading 'vcpu_model' on Instance uuid 391945f6-fe47-4969-a497-bd320d66cfa3 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Calling os-brick to attach iSCSI Volume {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xUAEeuip', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:27:47 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 01 19:27:47 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:27:47 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Dec 01 19:27:47 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:27:47 user nova-compute[75066]: INFO os_brick.initiator.connectors.iscsi [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 19:27:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 -p 172.16.0.220:3260 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[191bcc9f-bcdc-431c-8d26-91462b39f2e8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 19:27:47 user nova-compute[75066]:  {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 -p 172.16.0.220:3260 --interface default --op new {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[d030170b-0512-49c2-ac63-bd4a4d401272]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0] added\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0] added
Dec 01 19:27:47 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[d423c64e-d08d-4b15-9a61-7ff630f30717]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14b0933-4e6b-4814-a4b9-c5a78da9a709]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xUAEeuip {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xUAEeuip" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[6813ae57-5f66-480d-89ba-11226572ff55]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xUAEeuip'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f98f718-4046-46a9-942b-4915cd0f831b]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fff1ee2-215f-447b-9142-bba784491417]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:27:47 user nova-compute[75066]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd (non-flash)
Dec 01 19:27:47 user nova-compute[75066]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)
Dec 01 19:27:47 user nova-compute[75066]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237 (non-flash)
Dec 01 19:27:47 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:27:47 user nova-compute[75066]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd (non-flash)
Dec 01 19:27:47 user nova-compute[75066]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)
Dec 01 19:27:47 user nova-compute[75066]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237 (non-flash)
Dec 01 19:27:47 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 -p 172.16.0.220:3260 --login {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5bee1a-fd40-4148-9e4b-f7be12c3389c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0, portal: 172.16.0.220,3260]
Dec 01 19:27:47 user nova-compute[75066]: Login to [iface: default, target: iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0, portal: 172.16.0.220,3260] successful.
Dec 01 19:27:47 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[2623c87a-900b-46f2-b26d-70cebfc41829]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[77bfa21d-70c2-4035-94f1-18a406742994]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:27:47 user nova-compute[75066]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd (non-flash)
Dec 01 19:27:47 user nova-compute[75066]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)
Dec 01 19:27:47 user nova-compute[75066]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237 (non-flash)
Dec 01 19:27:47 user nova-compute[75066]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)
Dec 01 19:27:47 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:27:47 user nova-compute[75066]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd (non-flash)
Dec 01 19:27:47 user nova-compute[75066]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)
Dec 01 19:27:47 user nova-compute[75066]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237 (non-flash)
Dec 01 19:27:47 user nova-compute[75066]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)
Dec 01 19:27:47 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Connected to 172.16.0.220:3260 {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] HCTL ('33', '-', '-', 0) found on session 33 with lun 0 {{(pid=75066) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75066) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[d360308c-2a51-4122-8af1-21f17e65c563]: (4, ('- - 0', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:47 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Searching for a device in session 33 and hctl ['33', '*', '*', 0] yield: None {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:27:48 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Searching for a device in session 33 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:27:48 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xUAEeuip', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 19:27:48 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:27:48 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23635323134333263', 'path': '/dev/sdb'} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:27:48 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23635323134333263', 'path': '/dev/sdb'} {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 19:27:48 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-01T19:25:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1380771896',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1159128139',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUt3tvMqWzGNICVgVAPv+5OiL/y2ghL11denluyj9f24y9bvqoYMGhme0+yc1T6ysCdcqg+PZ0E7hkYE+/Fk0+ZZK5gReWc3DTB+0QPq1QAoZu4IKNKVmZ4OKW/6iZMNA==',key_name='tempest-keypair-1648212708',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:25:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='83c5f90337e64829893181e7e8140b8c',ramdisk_id='',reservation_id='r-fz70ky08',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1592554729',owner_user_name='tempest-ServerActionsV293TestJSON-1592554729-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:27:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf5efdf2a7324c96b8b9b2370dc7e31c',uuid=391945f6-fe47-4969-a497-bd320d66cfa3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e5f3728a-541f-4b95-9feb-6119687f2eba", "address": "fa:16:3e:9c:60:12", "network": {"id": "3e44df49-3c9c-4812-aafc-ce3f4795874b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-826204178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83c5f90337e64829893181e7e8140b8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5f3728a-54", "ovs_interfaceid": "e5f3728a-541f-4b95-9feb-6119687f2eba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:27:48 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Converting VIF {"id": "e5f3728a-541f-4b95-9feb-6119687f2eba", "address": "fa:16:3e:9c:60:12", "network": {"id": "3e44df49-3c9c-4812-aafc-ce3f4795874b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-826204178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83c5f90337e64829893181e7e8140b8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5f3728a-54", "ovs_interfaceid": "e5f3728a-541f-4b95-9feb-6119687f2eba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:27:48 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9c:60:12,bridge_name='br-int',has_traffic_filtering=True,id=e5f3728a-541f-4b95-9feb-6119687f2eba,network=Network(3e44df49-3c9c-4812-aafc-ce3f4795874b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5f3728a-54') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:27:48 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:27:48 user nova-compute[75066]:   <uuid>391945f6-fe47-4969-a497-bd320d66cfa3</uuid>
Dec 01 19:27:48 user nova-compute[75066]:   <name>instance-0000001a</name>
Dec 01 19:27:48 user nova-compute[75066]:   <memory>524288</memory>
Dec 01 19:27:48 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:27:48 user nova-compute[75066]:   <metadata>
Dec 01 19:27:48 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:27:48 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:27:48 user nova-compute[75066]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1380771896</nova:name>
Dec 01 19:27:48 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:27:47</nova:creationTime>
Dec 01 19:27:48 user nova-compute[75066]:       <nova:flavor name="m1.tiny">
Dec 01 19:27:48 user nova-compute[75066]:         <nova:memory>512</nova:memory>
Dec 01 19:27:48 user nova-compute[75066]:         <nova:disk>1</nova:disk>
Dec 01 19:27:48 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:27:48 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:27:48 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:27:48 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:27:48 user nova-compute[75066]:       <nova:owner>
Dec 01 19:27:48 user nova-compute[75066]:         <nova:user uuid="cf5efdf2a7324c96b8b9b2370dc7e31c">tempest-ServerActionsV293TestJSON-1592554729-project-member</nova:user>
Dec 01 19:27:48 user nova-compute[75066]:         <nova:project uuid="83c5f90337e64829893181e7e8140b8c">tempest-ServerActionsV293TestJSON-1592554729</nova:project>
Dec 01 19:27:48 user nova-compute[75066]:       </nova:owner>
Dec 01 19:27:48 user nova-compute[75066]:       <nova:ports>
Dec 01 19:27:48 user nova-compute[75066]:         <nova:port uuid="e5f3728a-541f-4b95-9feb-6119687f2eba">
Dec 01 19:27:48 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Dec 01 19:27:48 user nova-compute[75066]:         </nova:port>
Dec 01 19:27:48 user nova-compute[75066]:       </nova:ports>
Dec 01 19:27:48 user nova-compute[75066]:     </nova:instance>
Dec 01 19:27:48 user nova-compute[75066]:   </metadata>
Dec 01 19:27:48 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:27:48 user nova-compute[75066]:     <system>
Dec 01 19:27:48 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:27:48 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:27:48 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:27:48 user nova-compute[75066]:       <entry name="serial">391945f6-fe47-4969-a497-bd320d66cfa3</entry>
Dec 01 19:27:48 user nova-compute[75066]:       <entry name="uuid">391945f6-fe47-4969-a497-bd320d66cfa3</entry>
Dec 01 19:27:48 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:27:48 user nova-compute[75066]:     </system>
Dec 01 19:27:48 user nova-compute[75066]:   </sysinfo>
Dec 01 19:27:48 user nova-compute[75066]:   <os>
Dec 01 19:27:48 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:27:48 user nova-compute[75066]:     <boot dev="hd"/>
Dec 01 19:27:48 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:27:48 user nova-compute[75066]:   </os>
Dec 01 19:27:48 user nova-compute[75066]:   <features>
Dec 01 19:27:48 user nova-compute[75066]:     <acpi/>
Dec 01 19:27:48 user nova-compute[75066]:     <apic/>
Dec 01 19:27:48 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:27:48 user nova-compute[75066]:   </features>
Dec 01 19:27:48 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:27:48 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:27:48 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:27:48 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:27:48 user nova-compute[75066]:   </clock>
Dec 01 19:27:48 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:27:48 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:27:48 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:27:48 user nova-compute[75066]:   </cpu>
Dec 01 19:27:48 user nova-compute[75066]:   <devices>
Dec 01 19:27:48 user nova-compute[75066]:     <disk type="block" device="disk">
Dec 01 19:27:48 user nova-compute[75066]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:27:48 user nova-compute[75066]:       <source dev="/dev/sdb"/>
Dec 01 19:27:48 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:27:48 user nova-compute[75066]:       <serial>8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0</serial>
Dec 01 19:27:48 user nova-compute[75066]:     </disk>
Dec 01 19:27:48 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:27:48 user nova-compute[75066]:       <mac address="fa:16:3e:9c:60:12"/>
Dec 01 19:27:48 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:27:48 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:27:48 user nova-compute[75066]:       <target dev="tape5f3728a-54"/>
Dec 01 19:27:48 user nova-compute[75066]:     </interface>
Dec 01 19:27:48 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:27:48 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/391945f6-fe47-4969-a497-bd320d66cfa3/console.log" append="off"/>
Dec 01 19:27:48 user nova-compute[75066]:     </serial>
Dec 01 19:27:48 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:27:48 user nova-compute[75066]:     <video>
Dec 01 19:27:48 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:27:48 user nova-compute[75066]:     </video>
Dec 01 19:27:48 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:27:48 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:27:48 user nova-compute[75066]:     </rng>
Dec 01 19:27:48 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:27:48 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:27:48 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:27:48 user nova-compute[75066]:     </memballoon>
Dec 01 19:27:48 user nova-compute[75066]:   </devices>
Dec 01 19:27:48 user nova-compute[75066]: </domain>
Dec 01 19:27:48 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:27:48 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-01T19:25:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1380771896',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1159128139',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUt3tvMqWzGNICVgVAPv+5OiL/y2ghL11denluyj9f24y9bvqoYMGhme0+yc1T6ysCdcqg+PZ0E7hkYE+/Fk0+ZZK5gReWc3DTB+0QPq1QAoZu4IKNKVmZ4OKW/6iZMNA==',key_name='tempest-keypair-1648212708',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:25:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='83c5f90337e64829893181e7e8140b8c',ramdisk_id='',reservation_id='r-fz70ky08',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1592554729',owner_user_name='tempest-ServerActionsV293TestJSON-1592554729-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:27:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf5efdf2a7324c96b8b9b2370dc7e31c',uuid=391945f6-fe47-4969-a497-bd320d66cfa3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e5f3728a-541f-4b95-9feb-6119687f2eba", "address": "fa:16:3e:9c:60:12", "network": {"id": "3e44df49-3c9c-4812-aafc-ce3f4795874b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-826204178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83c5f90337e64829893181e7e8140b8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5f3728a-54", "ovs_interfaceid": "e5f3728a-541f-4b95-9feb-6119687f2eba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:27:48 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Converting VIF {"id": "e5f3728a-541f-4b95-9feb-6119687f2eba", "address": "fa:16:3e:9c:60:12", "network": {"id": "3e44df49-3c9c-4812-aafc-ce3f4795874b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-826204178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83c5f90337e64829893181e7e8140b8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5f3728a-54", "ovs_interfaceid": "e5f3728a-541f-4b95-9feb-6119687f2eba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:27:48 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9c:60:12,bridge_name='br-int',has_traffic_filtering=True,id=e5f3728a-541f-4b95-9feb-6119687f2eba,network=Network(3e44df49-3c9c-4812-aafc-ce3f4795874b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5f3728a-54') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:27:48 user nova-compute[75066]: DEBUG os_vif [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:60:12,bridge_name='br-int',has_traffic_filtering=True,id=e5f3728a-541f-4b95-9feb-6119687f2eba,network=Network(3e44df49-3c9c-4812-aafc-ce3f4795874b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5f3728a-54') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:27:48 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:48 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:27:48 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:27:48 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:48 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '732e3b7f-b0bf-5290-9bd3-0c5f41a640e5', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:27:48 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:48 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:27:48 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:48 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape5f3728a-54, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:27:48 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape5f3728a-54, col_values=(('qos', UUID('e3701aab-cb06-4331-ade7-71c172fb256e')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:27:48 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape5f3728a-54, col_values=(('external_ids', {'iface-id': 'e5f3728a-541f-4b95-9feb-6119687f2eba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:60:12', 'vm-uuid': '391945f6-fe47-4969-a497-bd320d66cfa3'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:27:48 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:48 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:27:48 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:48 user nova-compute[75066]: INFO os_vif [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:60:12,bridge_name='br-int',has_traffic_filtering=True,id=e5f3728a-541f-4b95-9feb-6119687f2eba,network=Network(3e44df49-3c9c-4812-aafc-ce3f4795874b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5f3728a-54')
Dec 01 19:27:48 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:27:48 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] No VIF found with MAC fa:16:3e:9c:60:12, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:27:50 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:50 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:50 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:50 user nova-compute[75066]: DEBUG nova.compute.manager [req-8b76f0d3-011d-49ba-8017-6bb8058cf0bf req-0a877cae-d846-4ff2-ada1-6303b99a3dfa service nova] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Received event network-vif-plugged-e5f3728a-541f-4b95-9feb-6119687f2eba {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:27:50 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-8b76f0d3-011d-49ba-8017-6bb8058cf0bf req-0a877cae-d846-4ff2-ada1-6303b99a3dfa service nova] Acquiring lock "391945f6-fe47-4969-a497-bd320d66cfa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:27:50 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-8b76f0d3-011d-49ba-8017-6bb8058cf0bf req-0a877cae-d846-4ff2-ada1-6303b99a3dfa service nova] Lock "391945f6-fe47-4969-a497-bd320d66cfa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:27:50 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-8b76f0d3-011d-49ba-8017-6bb8058cf0bf req-0a877cae-d846-4ff2-ada1-6303b99a3dfa service nova] Lock "391945f6-fe47-4969-a497-bd320d66cfa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:27:50 user nova-compute[75066]: DEBUG nova.compute.manager [req-8b76f0d3-011d-49ba-8017-6bb8058cf0bf req-0a877cae-d846-4ff2-ada1-6303b99a3dfa service nova] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] No waiting events found dispatching network-vif-plugged-e5f3728a-541f-4b95-9feb-6119687f2eba {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:27:50 user nova-compute[75066]: WARNING nova.compute.manager [req-8b76f0d3-011d-49ba-8017-6bb8058cf0bf req-0a877cae-d846-4ff2-ada1-6303b99a3dfa service nova] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Received unexpected event network-vif-plugged-e5f3728a-541f-4b95-9feb-6119687f2eba for instance with vm_state active and task_state rebuild_spawning.
Dec 01 19:27:50 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:50 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:50 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:50 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:50 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:52 user nova-compute[75066]: DEBUG nova.compute.manager [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Instance event wait completed in 0 seconds for  {{(pid=75066) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 19:27:52 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Guest created on hypervisor {{(pid=75066) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 19:27:52 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Instance spawned successfully.
Dec 01 19:27:52 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 19:27:52 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Found default for hw_cdrom_bus of ide {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:27:52 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Found default for hw_disk_bus of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:27:52 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Found default for hw_input_bus of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:27:52 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Found default for hw_pointer_model of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:27:52 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Found default for hw_video_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:27:52 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Found default for hw_vif_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:27:52 user nova-compute[75066]: DEBUG nova.compute.manager [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:27:52 user nova-compute[75066]: DEBUG nova.compute.manager [req-58de29e7-16b6-4fff-93fe-60653edac952 req-d864c345-c996-4a01-aad1-39fba1f523cd service nova] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Received event network-vif-plugged-e5f3728a-541f-4b95-9feb-6119687f2eba {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:27:52 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-58de29e7-16b6-4fff-93fe-60653edac952 req-d864c345-c996-4a01-aad1-39fba1f523cd service nova] Acquiring lock "391945f6-fe47-4969-a497-bd320d66cfa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:27:52 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-58de29e7-16b6-4fff-93fe-60653edac952 req-d864c345-c996-4a01-aad1-39fba1f523cd service nova] Lock "391945f6-fe47-4969-a497-bd320d66cfa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:27:52 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-58de29e7-16b6-4fff-93fe-60653edac952 req-d864c345-c996-4a01-aad1-39fba1f523cd service nova] Lock "391945f6-fe47-4969-a497-bd320d66cfa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:27:52 user nova-compute[75066]: DEBUG nova.compute.manager [req-58de29e7-16b6-4fff-93fe-60653edac952 req-d864c345-c996-4a01-aad1-39fba1f523cd service nova] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] No waiting events found dispatching network-vif-plugged-e5f3728a-541f-4b95-9feb-6119687f2eba {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:27:52 user nova-compute[75066]: WARNING nova.compute.manager [req-58de29e7-16b6-4fff-93fe-60653edac952 req-d864c345-c996-4a01-aad1-39fba1f523cd service nova] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Received unexpected event network-vif-plugged-e5f3728a-541f-4b95-9feb-6119687f2eba for instance with vm_state active and task_state rebuild_spawning.
Dec 01 19:27:52 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:27:52 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:27:52 user nova-compute[75066]: DEBUG nova.objects.instance [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75066) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Dec 01 19:27:52 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-14e3ca27-ce83-4f0c-ab3e-b92b33af4521 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.080s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:27:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:53 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:54 user nova-compute[75066]: DEBUG nova.compute.manager [req-1965f38f-e1af-4d90-82ba-88c8f5a2c7da req-7af59a7b-712e-4353-968c-28c2b0ffa661 service nova] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Received event network-changed-918beedf-26db-4ea9-be7b-5170ca29ee52 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:27:54 user nova-compute[75066]: DEBUG nova.compute.manager [req-1965f38f-e1af-4d90-82ba-88c8f5a2c7da req-7af59a7b-712e-4353-968c-28c2b0ffa661 service nova] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Refreshing instance network info cache due to event network-changed-918beedf-26db-4ea9-be7b-5170ca29ee52. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:27:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-1965f38f-e1af-4d90-82ba-88c8f5a2c7da req-7af59a7b-712e-4353-968c-28c2b0ffa661 service nova] Acquiring lock "refresh_cache-3b355778-bd25-42f6-8026-110668920d8b" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:27:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-1965f38f-e1af-4d90-82ba-88c8f5a2c7da req-7af59a7b-712e-4353-968c-28c2b0ffa661 service nova] Acquired lock "refresh_cache-3b355778-bd25-42f6-8026-110668920d8b" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:27:54 user nova-compute[75066]: DEBUG nova.network.neutron [req-1965f38f-e1af-4d90-82ba-88c8f5a2c7da req-7af59a7b-712e-4353-968c-28c2b0ffa661 service nova] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Refreshing network info cache for port 918beedf-26db-4ea9-be7b-5170ca29ee52 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:27:54 user nova-compute[75066]: DEBUG nova.network.neutron [req-1965f38f-e1af-4d90-82ba-88c8f5a2c7da req-7af59a7b-712e-4353-968c-28c2b0ffa661 service nova] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Updated VIF entry in instance network info cache for port 918beedf-26db-4ea9-be7b-5170ca29ee52. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:27:54 user nova-compute[75066]: DEBUG nova.network.neutron [req-1965f38f-e1af-4d90-82ba-88c8f5a2c7da req-7af59a7b-712e-4353-968c-28c2b0ffa661 service nova] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Updating instance_info_cache with network_info: [{"id": "918beedf-26db-4ea9-be7b-5170ca29ee52", "address": "fa:16:3e:e9:75:23", "network": {"id": "4a6c6c26-4d29-486c-b11e-fc53769083ea", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1139388453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "492e0b2da61e4e4f9ea991df15531e24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap918beedf-26", "ovs_interfaceid": "918beedf-26db-4ea9-be7b-5170ca29ee52", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:27:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-1965f38f-e1af-4d90-82ba-88c8f5a2c7da req-7af59a7b-712e-4353-968c-28c2b0ffa661 service nova] Releasing lock "refresh_cache-3b355778-bd25-42f6-8026-110668920d8b" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:27:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:58 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-f50c2f0f-a5f2-40bf-a3c1-3023da1c9164 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Acquiring lock "3b355778-bd25-42f6-8026-110668920d8b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:27:58 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-f50c2f0f-a5f2-40bf-a3c1-3023da1c9164 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "3b355778-bd25-42f6-8026-110668920d8b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:27:58 user nova-compute[75066]: DEBUG nova.objects.instance [None req-f50c2f0f-a5f2-40bf-a3c1-3023da1c9164 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lazy-loading 'flavor' on Instance uuid 3b355778-bd25-42f6-8026-110668920d8b {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:27:58 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-f50c2f0f-a5f2-40bf-a3c1-3023da1c9164 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "3b355778-bd25-42f6-8026-110668920d8b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:27:58 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-f50c2f0f-a5f2-40bf-a3c1-3023da1c9164 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Acquiring lock "3b355778-bd25-42f6-8026-110668920d8b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:27:58 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-f50c2f0f-a5f2-40bf-a3c1-3023da1c9164 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "3b355778-bd25-42f6-8026-110668920d8b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:27:58 user nova-compute[75066]: INFO nova.compute.manager [None req-f50c2f0f-a5f2-40bf-a3c1-3023da1c9164 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Attaching volume f817b8a7-1ac5-43d3-a87f-51e048c26567 to /dev/vdb
Dec 01 19:27:58 user nova-compute[75066]: DEBUG os_brick.utils [None req-f50c2f0f-a5f2-40bf-a3c1-3023da1c9164 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:27:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:58 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fcd105a-a2fa-4e43-8768-c369cf3ca27a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1959854982f\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:58 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c71d430-f5a4-40a1-a925-7f600d33c844]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:58 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[be777603-9b24-4dc3-bd12-7f622e39c2e8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:58 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[063f44de-2a79-4416-8c47-fc8ef79b0325]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-f50c2f0f-a5f2-40bf-a3c1-3023da1c9164 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Running cmd (subprocess): nvme version {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-f50c2f0f-a5f2-40bf-a3c1-3023da1c9164 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] 'nvme version' failed. Not Retrying. {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:27:58 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f50c2f0f-a5f2-40bf-a3c1-3023da1c9164 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] nvme not present on system {{(pid=75066) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 19:27:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:27:58 user nova-compute[75066]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 19:27:58 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e3d147-e585-4a90-9bc0-46e12203d3bd]: (4, '') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:58 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-f50c2f0f-a5f2-40bf-a3c1-3023da1c9164 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75066) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 19:27:58 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-f50c2f0f-a5f2-40bf-a3c1-3023da1c9164 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 19:27:58 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-f50c2f0f-a5f2-40bf-a3c1-3023da1c9164 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] LIGHTOS: no hostnqn found. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 19:27:58 user nova-compute[75066]: DEBUG os_brick.utils [None req-f50c2f0f-a5f2-40bf-a3c1-3023da1c9164 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1959854982f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:27:58 user nova-compute[75066]: DEBUG nova.virt.block_device [None req-f50c2f0f-a5f2-40bf-a3c1-3023da1c9164 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Updating existing volume attachment record: beef3d53-e328-421c-84a0-77d316b90841 {{(pid=75066) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 19:27:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:27:59 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-1801aa20-840a-4638-8514-c1ea96795957 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e32ba192-38b9-46f0-b164-1652a43cf3d2 is timed out.
Dec 01 19:27:59 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-1801aa20-840a-4638-8514-c1ea96795957 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Successfully detached device vdb from instance e32ba192-38b9-46f0-b164-1652a43cf3d2 from the live domain config.
Dec 01 19:27:59 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1801aa20-840a-4638-8514-c1ea96795957 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] calling os-brick to detach iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 19:27:59 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1801aa20-840a-4638-8514-c1ea96795957 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, {'target_iqn': 'iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LBCMmEVc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:27:59 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-1801aa20-840a-4638-8514-c1ea96795957 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:27:59 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-1801aa20-840a-4638-8514-c1ea96795957 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:27:59 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-1801aa20-840a-4638-8514-c1ea96795957 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:27:59 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:59 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:59 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5e04390-426e-4484-b254-5a1fc151ab4e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:59 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1801aa20-840a-4638-8514-c1ea96795957 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 19:27:59 user nova-compute[75066]: No targets found.
Dec 01 19:27:59 user nova-compute[75066]: iSNS:
Dec 01 19:27:59 user nova-compute[75066]: No targets found.
Dec 01 19:27:59 user nova-compute[75066]: STATIC:
Dec 01 19:27:59 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0
Dec 01 19:27:59 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:27:59 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:27:59 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9
Dec 01 19:27:59 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:27:59 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:27:59 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237
Dec 01 19:27:59 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:27:59 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:27:59 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd
Dec 01 19:27:59 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:27:59 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:27:59 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb
Dec 01 19:27:59 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:27:59 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:27:59 user nova-compute[75066]: FIRMWARE:
Dec 01 19:27:59 user nova-compute[75066]: No targets found.
Dec 01 19:27:59 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:27:59 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1801aa20-840a-4638-8514-c1ea96795957 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 19:27:59 user nova-compute[75066]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 19:27:59 user nova-compute[75066]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75066) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 19:27:59 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1801aa20-840a-4638-8514-c1ea96795957 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237', 0)] {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 19:27:59 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:59 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:59 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee72bc3b-dabd-4333-a000-126d1df402c0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:59 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:59 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:59 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd63b79-5e1a-4bbb-9cc9-5a1629c91068]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:59 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1801aa20-840a-4638-8514-c1ea96795957 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:27:59 user nova-compute[75066]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd (non-flash)
Dec 01 19:27:59 user nova-compute[75066]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)
Dec 01 19:27:59 user nova-compute[75066]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237 (non-flash)
Dec 01 19:27:59 user nova-compute[75066]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)
Dec 01 19:27:59 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:27:59 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1801aa20-840a-4638-8514-c1ea96795957 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:27:59 user nova-compute[75066]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd (non-flash)
Dec 01 19:27:59 user nova-compute[75066]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)
Dec 01 19:27:59 user nova-compute[75066]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237 (non-flash)
Dec 01 19:27:59 user nova-compute[75066]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)
Dec 01 19:27:59 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:27:59 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1801aa20-840a-4638-8514-c1ea96795957 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f919062cee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237'): ({'sde'}, set())}) {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 19:27:59 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-1801aa20-840a-4638-8514-c1ea96795957 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Removing single pathed devices sde {{(pid=75066) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 19:27:59 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:59 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:59 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[06efa9b6-70a3-4d0c-8175-f3d5810af259]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:59 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:59 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:59 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[c997f20a-6348-4a80-b833-45628a2715db]: (4, ('ok\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:59 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-1801aa20-840a-4638-8514-c1ea96795957 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Flushing IO for device /dev/sde {{(pid=75066) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 19:27:59 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:59 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:59 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[d640e184-8f67-47ef-ad01-1a1c152bbbb8]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:59 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-1801aa20-840a-4638-8514-c1ea96795957 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75066) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 19:27:59 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:59 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.036s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:59 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbaa1929-b933-4775-929c-6033aadf967e]: (4, ('1', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:59 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-1801aa20-840a-4638-8514-c1ea96795957 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 19:27:59 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-1801aa20-840a-4638-8514-c1ea96795957 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] SCSI volumes sde have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 19:27:59 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1801aa20-840a-4638-8514-c1ea96795957 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237')] {{(pid=75066) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 19:27:59 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:59 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:59 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[e211eff9-007c-4664-849e-4c6cd534a776]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:59 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1801aa20-840a-4638-8514-c1ea96795957 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:27:59 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237 -p 172.16.0.220:3260 --logout {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:59 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:59 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[7329565c-b2b7-4f34-8f42-7a169d47686b]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:59 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1801aa20-840a-4638-8514-c1ea96795957 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237, portal: 172.16.0.220,3260]
Dec 01 19:27:59 user nova-compute[75066]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237, portal: 172.16.0.220,3260] successful.
Dec 01 19:27:59 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:27:59 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237 -p 172.16.0.220:3260 --op delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:27:59 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:27:59 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa8346d5-19db-4d9a-85ac-8655a5dcad51]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:27:59 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1801aa20-840a-4638-8514-c1ea96795957 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:27:59 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-1801aa20-840a-4638-8514-c1ea96795957 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:27:59 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1801aa20-840a-4638-8514-c1ea96795957 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] <== disconnect_volume: return (314ms) None {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:27:59 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1801aa20-840a-4638-8514-c1ea96795957 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Disconnected iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 19:28:00 user nova-compute[75066]: DEBUG nova.objects.instance [None req-1801aa20-840a-4638-8514-c1ea96795957 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lazy-loading 'flavor' on Instance uuid e32ba192-38b9-46f0-b164-1652a43cf3d2 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:28:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-1801aa20-840a-4638-8514-c1ea96795957 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lock "e32ba192-38b9-46f0-b164-1652a43cf3d2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.760s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:28:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5877ae63-67cd-4aa2-86d7-f838a71e6d06 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lock "e32ba192-38b9-46f0-b164-1652a43cf3d2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.648s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:28:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5877ae63-67cd-4aa2-86d7-f838a71e6d06 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Acquiring lock "e32ba192-38b9-46f0-b164-1652a43cf3d2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:28:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5877ae63-67cd-4aa2-86d7-f838a71e6d06 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lock "e32ba192-38b9-46f0-b164-1652a43cf3d2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:28:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5877ae63-67cd-4aa2-86d7-f838a71e6d06 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lock "e32ba192-38b9-46f0-b164-1652a43cf3d2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:28:00 user nova-compute[75066]: INFO nova.compute.manager [None req-5877ae63-67cd-4aa2-86d7-f838a71e6d06 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Terminating instance
Dec 01 19:28:00 user nova-compute[75066]: DEBUG nova.compute.manager [None req-5877ae63-67cd-4aa2-86d7-f838a71e6d06 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Start destroying the instance on the hypervisor. {{(pid=75066) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 19:28:00 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:28:00 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:28:00 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:28:00 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:28:00 user nova-compute[75066]: DEBUG nova.compute.manager [req-05a5e6c5-11d4-468e-9eb3-964aea3f0384 req-7e8aec29-a73f-4dd1-a532-b14b9f575990 service nova] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Received event network-vif-unplugged-bc61a5e3-0188-4f8e-8d3e-29954e60ea4c {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:28:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-05a5e6c5-11d4-468e-9eb3-964aea3f0384 req-7e8aec29-a73f-4dd1-a532-b14b9f575990 service nova] Acquiring lock "e32ba192-38b9-46f0-b164-1652a43cf3d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:28:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-05a5e6c5-11d4-468e-9eb3-964aea3f0384 req-7e8aec29-a73f-4dd1-a532-b14b9f575990 service nova] Lock "e32ba192-38b9-46f0-b164-1652a43cf3d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:28:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-05a5e6c5-11d4-468e-9eb3-964aea3f0384 req-7e8aec29-a73f-4dd1-a532-b14b9f575990 service nova] Lock "e32ba192-38b9-46f0-b164-1652a43cf3d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:28:00 user nova-compute[75066]: DEBUG nova.compute.manager [req-05a5e6c5-11d4-468e-9eb3-964aea3f0384 req-7e8aec29-a73f-4dd1-a532-b14b9f575990 service nova] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] No waiting events found dispatching network-vif-unplugged-bc61a5e3-0188-4f8e-8d3e-29954e60ea4c {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:28:00 user nova-compute[75066]: DEBUG nova.compute.manager [req-05a5e6c5-11d4-468e-9eb3-964aea3f0384 req-7e8aec29-a73f-4dd1-a532-b14b9f575990 service nova] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Received event network-vif-unplugged-bc61a5e3-0188-4f8e-8d3e-29954e60ea4c for instance with task_state deleting. {{(pid=75066) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 19:28:01 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Instance destroyed successfully.
Dec 01 19:28:01 user nova-compute[75066]: DEBUG nova.objects.instance [None req-5877ae63-67cd-4aa2-86d7-f838a71e6d06 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lazy-loading 'resources' on Instance uuid e32ba192-38b9-46f0-b164-1652a43cf3d2 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:28:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-5877ae63-67cd-4aa2-86d7-f838a71e6d06 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:25:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-456080780',display_name='tempest-VolumesSnapshotTestJSON-instance-456080780',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-456080780',id=25,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4EC0MO4UJsa5au5uhrtmvhSY+F58Kn228qfpqumBg4aaDl1mgE0V6yWTbB37jyyif6C7rIAAZGRtzZ5RdzEmhW2nNFxWtuCt5QkVwAdQBuHd6OXMX2oOypGsj7/biznw==',key_name='tempest-keypair-201555204',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:25:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6fb5b77e2da142499315e0a96f86d959',ramdisk_id='',reservation_id='r-gpo4b460',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1069530394',owner_user_name='tempest-VolumesSnapshotTestJSON-1069530394-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:25:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a0be767f43744d73a35ed6b7a45c8b95',uuid=e32ba192-38b9-46f0-b164-1652a43cf3d2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bc61a5e3-0188-4f8e-8d3e-29954e60ea4c", "address": "fa:16:3e:27:e2:3b", "network": {"id": "195edf10-5722-4eef-b117-7a450e973afa", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2017280124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fb5b77e2da142499315e0a96f86d959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc61a5e3-01", "ovs_interfaceid": "bc61a5e3-0188-4f8e-8d3e-29954e60ea4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:28:01 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-5877ae63-67cd-4aa2-86d7-f838a71e6d06 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Converting VIF {"id": "bc61a5e3-0188-4f8e-8d3e-29954e60ea4c", "address": "fa:16:3e:27:e2:3b", "network": {"id": "195edf10-5722-4eef-b117-7a450e973afa", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-2017280124-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6fb5b77e2da142499315e0a96f86d959", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc61a5e3-01", "ovs_interfaceid": "bc61a5e3-0188-4f8e-8d3e-29954e60ea4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:28:01 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-5877ae63-67cd-4aa2-86d7-f838a71e6d06 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:e2:3b,bridge_name='br-int',has_traffic_filtering=True,id=bc61a5e3-0188-4f8e-8d3e-29954e60ea4c,network=Network(195edf10-5722-4eef-b117-7a450e973afa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc61a5e3-01') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:28:01 user nova-compute[75066]: DEBUG os_vif [None req-5877ae63-67cd-4aa2-86d7-f838a71e6d06 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:e2:3b,bridge_name='br-int',has_traffic_filtering=True,id=bc61a5e3-0188-4f8e-8d3e-29954e60ea4c,network=Network(195edf10-5722-4eef-b117-7a450e973afa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc61a5e3-01') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:28:01 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:28:01 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbc61a5e3-01, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:28:01 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:28:01 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:28:01 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:28:01 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=05add985-7232-496c-bb1b-68e9d4721579) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:28:01 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:28:01 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:28:01 user nova-compute[75066]: INFO os_vif [None req-5877ae63-67cd-4aa2-86d7-f838a71e6d06 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:e2:3b,bridge_name='br-int',has_traffic_filtering=True,id=bc61a5e3-0188-4f8e-8d3e-29954e60ea4c,network=Network(195edf10-5722-4eef-b117-7a450e973afa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc61a5e3-01')
Dec 01 19:28:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5877ae63-67cd-4aa2-86d7-f838a71e6d06 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] calling os-brick to detach iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 19:28:01 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-5877ae63-67cd-4aa2-86d7-f838a71e6d06 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, {'target_iqn': 'iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LBCMmEVc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:28:01 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-5877ae63-67cd-4aa2-86d7-f838a71e6d06 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:28:01 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-5877ae63-67cd-4aa2-86d7-f838a71e6d06 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:28:01 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-5877ae63-67cd-4aa2-86d7-f838a71e6d06 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:28:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:01 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7168115-b18e-4c63-a547-1527fbd084f4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:01 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-5877ae63-67cd-4aa2-86d7-f838a71e6d06 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 19:28:01 user nova-compute[75066]: No targets found.
Dec 01 19:28:01 user nova-compute[75066]: iSNS:
Dec 01 19:28:01 user nova-compute[75066]: No targets found.
Dec 01 19:28:01 user nova-compute[75066]: STATIC:
Dec 01 19:28:01 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0
Dec 01 19:28:01 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:28:01 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:28:01 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9
Dec 01 19:28:01 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:28:01 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:28:01 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd
Dec 01 19:28:01 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:28:01 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:28:01 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb
Dec 01 19:28:01 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:28:01 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:28:01 user nova-compute[75066]: FIRMWARE:
Dec 01 19:28:01 user nova-compute[75066]: No targets found.
Dec 01 19:28:01 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:28:01 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-5877ae63-67cd-4aa2-86d7-f838a71e6d06 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 19:28:01 user nova-compute[75066]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 19:28:01 user nova-compute[75066]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75066) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 19:28:01 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-5877ae63-67cd-4aa2-86d7-f838a71e6d06 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80cd56ab-657c-459d-aab2-011d8dd87237', 0)] {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 19:28:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:01 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[de597856-a3a7-4623-87c1-603b6e1f4639]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.063s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:01 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e17b4e5-5147-4444-8e7b-3bf5564f8acd]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:01 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-5877ae63-67cd-4aa2-86d7-f838a71e6d06 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:28:01 user nova-compute[75066]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd (non-flash)
Dec 01 19:28:01 user nova-compute[75066]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)
Dec 01 19:28:01 user nova-compute[75066]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)
Dec 01 19:28:01 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:28:01 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-5877ae63-67cd-4aa2-86d7-f838a71e6d06 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:28:01 user nova-compute[75066]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd (non-flash)
Dec 01 19:28:01 user nova-compute[75066]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)
Dec 01 19:28:01 user nova-compute[75066]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)
Dec 01 19:28:01 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:28:01 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-5877ae63-67cd-4aa2-86d7-f838a71e6d06 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91904435b0>, {}) {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 19:28:01 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-5877ae63-67cd-4aa2-86d7-f838a71e6d06 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Disconnecting from: [] {{(pid=75066) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 19:28:01 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-5877ae63-67cd-4aa2-86d7-f838a71e6d06 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.114s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:28:01 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-5877ae63-67cd-4aa2-86d7-f838a71e6d06 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] <== disconnect_volume: return (115ms) None {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:28:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5877ae63-67cd-4aa2-86d7-f838a71e6d06 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Disconnected iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 19:28:01 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-5877ae63-67cd-4aa2-86d7-f838a71e6d06 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Deleting instance files /opt/stack/data/nova/instances/e32ba192-38b9-46f0-b164-1652a43cf3d2_del
Dec 01 19:28:01 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-5877ae63-67cd-4aa2-86d7-f838a71e6d06 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Deletion of /opt/stack/data/nova/instances/e32ba192-38b9-46f0-b164-1652a43cf3d2_del complete
Dec 01 19:28:01 user nova-compute[75066]: INFO nova.compute.manager [None req-5877ae63-67cd-4aa2-86d7-f838a71e6d06 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Took 1.01 seconds to destroy the instance on the hypervisor.
Dec 01 19:28:01 user nova-compute[75066]: DEBUG oslo.service.loopingcall [None req-5877ae63-67cd-4aa2-86d7-f838a71e6d06 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75066) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 19:28:01 user nova-compute[75066]: DEBUG nova.compute.manager [-] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Deallocating network for instance {{(pid=75066) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 19:28:01 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] deallocate_for_instance() {{(pid=75066) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 19:28:02 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:28:02 user nova-compute[75066]: INFO nova.compute.manager [-] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Took 0.90 seconds to deallocate network for instance.
Dec 01 19:28:02 user nova-compute[75066]: WARNING nova.volume.cinder [None req-5877ae63-67cd-4aa2-86d7-f838a71e6d06 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Attachment 914cf277-07cf-46c3-91e9-aac09753fd2c does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 914cf277-07cf-46c3-91e9-aac09753fd2c. (HTTP 404) (Request-ID: req-876af12d-00de-4aa3-b531-39c295132402)
Dec 01 19:28:02 user nova-compute[75066]: INFO nova.compute.manager [None req-5877ae63-67cd-4aa2-86d7-f838a71e6d06 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Took 0.02 seconds to detach 1 volumes for instance.
Dec 01 19:28:02 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5877ae63-67cd-4aa2-86d7-f838a71e6d06 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:28:02 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5877ae63-67cd-4aa2-86d7-f838a71e6d06 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:28:02 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:28:02 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-5877ae63-67cd-4aa2-86d7-f838a71e6d06 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:28:02 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-5877ae63-67cd-4aa2-86d7-f838a71e6d06 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:28:02 user nova-compute[75066]: DEBUG nova.compute.manager [req-275e1e79-c9d9-4d04-aa97-ba7342ec15f1 req-6ce00429-68b9-41d0-acf7-835b7498cf85 service nova] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Received event network-vif-plugged-bc61a5e3-0188-4f8e-8d3e-29954e60ea4c {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:28:02 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-275e1e79-c9d9-4d04-aa97-ba7342ec15f1 req-6ce00429-68b9-41d0-acf7-835b7498cf85 service nova] Acquiring lock "e32ba192-38b9-46f0-b164-1652a43cf3d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:28:02 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-275e1e79-c9d9-4d04-aa97-ba7342ec15f1 req-6ce00429-68b9-41d0-acf7-835b7498cf85 service nova] Lock "e32ba192-38b9-46f0-b164-1652a43cf3d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:28:02 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-275e1e79-c9d9-4d04-aa97-ba7342ec15f1 req-6ce00429-68b9-41d0-acf7-835b7498cf85 service nova] Lock "e32ba192-38b9-46f0-b164-1652a43cf3d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:28:02 user nova-compute[75066]: DEBUG nova.compute.manager [req-275e1e79-c9d9-4d04-aa97-ba7342ec15f1 req-6ce00429-68b9-41d0-acf7-835b7498cf85 service nova] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] No waiting events found dispatching network-vif-plugged-bc61a5e3-0188-4f8e-8d3e-29954e60ea4c {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:28:02 user nova-compute[75066]: WARNING nova.compute.manager [req-275e1e79-c9d9-4d04-aa97-ba7342ec15f1 req-6ce00429-68b9-41d0-acf7-835b7498cf85 service nova] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Received unexpected event network-vif-plugged-bc61a5e3-0188-4f8e-8d3e-29954e60ea4c for instance with vm_state deleted and task_state None.
Dec 01 19:28:02 user nova-compute[75066]: DEBUG nova.compute.manager [req-275e1e79-c9d9-4d04-aa97-ba7342ec15f1 req-6ce00429-68b9-41d0-acf7-835b7498cf85 service nova] [instance: e32ba192-38b9-46f0-b164-1652a43cf3d2] Received event network-vif-deleted-bc61a5e3-0188-4f8e-8d3e-29954e60ea4c {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:28:02 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5877ae63-67cd-4aa2-86d7-f838a71e6d06 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.371s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:28:02 user nova-compute[75066]: INFO nova.scheduler.client.report [None req-5877ae63-67cd-4aa2-86d7-f838a71e6d06 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Deleted allocations for instance e32ba192-38b9-46f0-b164-1652a43cf3d2
Dec 01 19:28:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:28:02 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5877ae63-67cd-4aa2-86d7-f838a71e6d06 tempest-VolumesSnapshotTestJSON-1069530394 tempest-VolumesSnapshotTestJSON-1069530394-project-member] Lock "e32ba192-38b9-46f0-b164-1652a43cf3d2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.537s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:28:06 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:28:06 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:28:06 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:28:07 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:28:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:28:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:28:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:28:07 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75066) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 19:28:07 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:28:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b355778-bd25-42f6-8026-110668920d8b/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b355778-bd25-42f6-8026-110668920d8b/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b355778-bd25-42f6-8026-110668920d8b/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:07 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:28:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b355778-bd25-42f6-8026-110668920d8b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23e17727-40b4-48f7-9155-abc8ffa9f619/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23e17727-40b4-48f7-9155-abc8ffa9f619/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23e17727-40b4-48f7-9155-abc8ffa9f619/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23e17727-40b4-48f7-9155-abc8ffa9f619/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:08 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:28:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:09 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f50c2f0f-a5f2-40bf-a3c1-3023da1c9164 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Calling os-brick to attach iSCSI Volume {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 19:28:09 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50c2f0f-a5f2-40bf-a3c1-3023da1c9164 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jwYhkKmT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:28:09 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-f50c2f0f-a5f2-40bf-a3c1-3023da1c9164 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:28:09 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-f50c2f0f-a5f2-40bf-a3c1-3023da1c9164 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:28:09 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-f50c2f0f-a5f2-40bf-a3c1-3023da1c9164 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:28:09 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-f50c2f0f-a5f2-40bf-a3c1-3023da1c9164 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:28:09 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-f50c2f0f-a5f2-40bf-a3c1-3023da1c9164 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:28:09 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-f50c2f0f-a5f2-40bf-a3c1-3023da1c9164 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:28:09 user nova-compute[75066]: INFO os_brick.initiator.connectors.iscsi [None req-f50c2f0f-a5f2-40bf-a3c1-3023da1c9164 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 19:28:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567 -p 172.16.0.220:3260 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:09 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8680235-5ecd-436a-9098-17ddfa6d1cbd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:09 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50c2f0f-a5f2-40bf-a3c1-3023da1c9164 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 19:28:09 user nova-compute[75066]:  {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:28:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567 -p 172.16.0.220:3260 --interface default --op new {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:09 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[573d3d84-e8f8-4bf7-a0cb-b081cd1968f6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567] added\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:09 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50c2f0f-a5f2-40bf-a3c1-3023da1c9164 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567] added
Dec 01 19:28:09 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:28:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:09 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[e289c33b-35b0-4b4e-8633-e58522841484]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:09 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50c2f0f-a5f2-40bf-a3c1-3023da1c9164 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:28:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:09 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[520c99d9-f64f-4818-bb78-9e8a80d1f026]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:09 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50c2f0f-a5f2-40bf-a3c1-3023da1c9164 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:28:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jwYhkKmT {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jwYhkKmT" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:09 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[15729a30-749d-4ee6-ad92-098ca5f47d88]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:09 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50c2f0f-a5f2-40bf-a3c1-3023da1c9164 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jwYhkKmT'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:28:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:09 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[2947d21a-bdc5-470c-91e3-0c93ed069967]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:09 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50c2f0f-a5f2-40bf-a3c1-3023da1c9164 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:28:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:09 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9708a5-ba63-4e60-9252-8f0e1285ef72]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:09 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50c2f0f-a5f2-40bf-a3c1-3023da1c9164 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:28:09 user nova-compute[75066]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd (non-flash)
Dec 01 19:28:09 user nova-compute[75066]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)
Dec 01 19:28:09 user nova-compute[75066]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)
Dec 01 19:28:09 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:28:09 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50c2f0f-a5f2-40bf-a3c1-3023da1c9164 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:28:09 user nova-compute[75066]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd (non-flash)
Dec 01 19:28:09 user nova-compute[75066]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)
Dec 01 19:28:09 user nova-compute[75066]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)
Dec 01 19:28:09 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:28:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567 -p 172.16.0.220:3260 --login {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:09 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb45612-3896-4046-bada-685e018001eb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:09 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50c2f0f-a5f2-40bf-a3c1-3023da1c9164 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567, portal: 172.16.0.220,3260]
Dec 01 19:28:09 user nova-compute[75066]: Login to [iface: default, target: iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567, portal: 172.16.0.220,3260] successful.
Dec 01 19:28:09 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:28:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk.rescue --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:09 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1dd02b-e66b-4470-ada6-c5d036899499]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:09 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50c2f0f-a5f2-40bf-a3c1-3023da1c9164 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:28:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:09 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef8b458-da55-410d-9721-8781bd694df9]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:09 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50c2f0f-a5f2-40bf-a3c1-3023da1c9164 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:28:09 user nova-compute[75066]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd (non-flash)
Dec 01 19:28:09 user nova-compute[75066]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)
Dec 01 19:28:09 user nova-compute[75066]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)
Dec 01 19:28:09 user nova-compute[75066]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567 (non-flash)
Dec 01 19:28:09 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:28:09 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50c2f0f-a5f2-40bf-a3c1-3023da1c9164 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:28:09 user nova-compute[75066]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd (non-flash)
Dec 01 19:28:09 user nova-compute[75066]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)
Dec 01 19:28:09 user nova-compute[75066]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)
Dec 01 19:28:09 user nova-compute[75066]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567 (non-flash)
Dec 01 19:28:09 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:28:09 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-f50c2f0f-a5f2-40bf-a3c1-3023da1c9164 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.353s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:28:09 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50c2f0f-a5f2-40bf-a3c1-3023da1c9164 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Connected to 172.16.0.220:3260 {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 19:28:09 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-f50c2f0f-a5f2-40bf-a3c1-3023da1c9164 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] HCTL ('36', '-', '-', 0) found on session 34 with lun 0 {{(pid=75066) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 19:28:09 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-f50c2f0f-a5f2-40bf-a3c1-3023da1c9164 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75066) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 19:28:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:09 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8bc6a6-4170-4c16-b711-ccdb29ff2393]: (4, ('- - 0', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:09 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-f50c2f0f-a5f2-40bf-a3c1-3023da1c9164 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:28:09 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50c2f0f-a5f2-40bf-a3c1-3023da1c9164 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jwYhkKmT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 19:28:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk.rescue --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk.rescue --force-share --output=json" returned: 0 in 0.218s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:10 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-f50c2f0f-a5f2-40bf-a3c1-3023da1c9164 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.397s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:28:10 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50c2f0f-a5f2-40bf-a3c1-3023da1c9164 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] <== connect_volume: return (1402ms) {'type': 'block', 'scsi_wwn': '26437386631643061', 'path': '/dev/sde'} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:28:10 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f50c2f0f-a5f2-40bf-a3c1-3023da1c9164 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26437386631643061', 'path': '/dev/sde'} {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 19:28:10 user nova-compute[75066]: DEBUG nova.objects.instance [None req-f50c2f0f-a5f2-40bf-a3c1-3023da1c9164 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lazy-loading 'flavor' on Instance uuid 3b355778-bd25-42f6-8026-110668920d8b {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:28:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:10 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:28:10 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:28:10 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-f50c2f0f-a5f2-40bf-a3c1-3023da1c9164 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 19:28:10 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:28:10 user nova-compute[75066]:   <source dev="/dev/sde"/>
Dec 01 19:28:10 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:28:10 user nova-compute[75066]:   <serial>f817b8a7-1ac5-43d3-a87f-51e048c26567</serial>
Dec 01 19:28:10 user nova-compute[75066]: </disk>
Dec 01 19:28:10 user nova-compute[75066]:  {{(pid=75066) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 19:28:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:28:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:28:11 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:28:11 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:28:11 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Hypervisor/Node resource view: name=user free_ram=7438MB free_disk=24.885543823242188GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75066) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 19:28:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:28:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:28:11 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-f50c2f0f-a5f2-40bf-a3c1-3023da1c9164 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:28:11 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-f50c2f0f-a5f2-40bf-a3c1-3023da1c9164 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:28:11 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-f50c2f0f-a5f2-40bf-a3c1-3023da1c9164 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] No VIF found with MAC fa:16:3e:e9:75:23, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:28:11 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance c223be70-8b9c-46d4-9b5a-3b83dfc05a17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:28:11 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 90c49be6-97aa-45f1-bcbe-b9a3875226a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:28:11 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance d564b128-598b-4ad4-8618-afa4dc8a7347 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:28:11 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 14de9d20-9e66-4517-b904-2967e0a06a97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:28:11 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:28:11 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 23e17727-40b4-48f7-9155-abc8ffa9f619 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:28:11 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 391945f6-fe47-4969-a497-bd320d66cfa3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:28:11 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 3b355778-bd25-42f6-8026-110668920d8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:28:11 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 00506483-8f09-4a3d-938a-31ab1b2dbf83 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:28:11 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:28:11 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 19:28:11 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 19:28:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-f50c2f0f-a5f2-40bf-a3c1-3023da1c9164 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "3b355778-bd25-42f6-8026-110668920d8b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.922s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:28:11 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:28:11 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:28:11 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Compute_service record updated for user:user {{(pid=75066) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 19:28:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.507s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:28:11 user nova-compute[75066]: DEBUG nova.compute.manager [req-b39b6f99-d4f1-492c-b95f-f9d5444435f8 req-4a51909e-a128-4416-a135-9d2bbefb57bb service nova] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Received event network-changed-902b1013-6c79-4a5a-ab19-782ac8dc715b {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:28:11 user nova-compute[75066]: DEBUG nova.compute.manager [req-b39b6f99-d4f1-492c-b95f-f9d5444435f8 req-4a51909e-a128-4416-a135-9d2bbefb57bb service nova] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Refreshing instance network info cache due to event network-changed-902b1013-6c79-4a5a-ab19-782ac8dc715b. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:28:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-b39b6f99-d4f1-492c-b95f-f9d5444435f8 req-4a51909e-a128-4416-a135-9d2bbefb57bb service nova] Acquiring lock "refresh_cache-23e17727-40b4-48f7-9155-abc8ffa9f619" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:28:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-b39b6f99-d4f1-492c-b95f-f9d5444435f8 req-4a51909e-a128-4416-a135-9d2bbefb57bb service nova] Acquired lock "refresh_cache-23e17727-40b4-48f7-9155-abc8ffa9f619" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:28:11 user nova-compute[75066]: DEBUG nova.network.neutron [req-b39b6f99-d4f1-492c-b95f-f9d5444435f8 req-4a51909e-a128-4416-a135-9d2bbefb57bb service nova] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Refreshing network info cache for port 902b1013-6c79-4a5a-ab19-782ac8dc715b {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:28:12 user nova-compute[75066]: DEBUG nova.network.neutron [req-b39b6f99-d4f1-492c-b95f-f9d5444435f8 req-4a51909e-a128-4416-a135-9d2bbefb57bb service nova] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Updated VIF entry in instance network info cache for port 902b1013-6c79-4a5a-ab19-782ac8dc715b. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:28:12 user nova-compute[75066]: DEBUG nova.network.neutron [req-b39b6f99-d4f1-492c-b95f-f9d5444435f8 req-4a51909e-a128-4416-a135-9d2bbefb57bb service nova] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Updating instance_info_cache with network_info: [{"id": "902b1013-6c79-4a5a-ab19-782ac8dc715b", "address": "fa:16:3e:fe:93:cc", "network": {"id": "4fe4d56e-afe2-42a6-984a-9af8bc5377a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126385357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5326c00d464e008337e0dc8577fc2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap902b1013-6c", "ovs_interfaceid": "902b1013-6c79-4a5a-ab19-782ac8dc715b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:28:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-b39b6f99-d4f1-492c-b95f-f9d5444435f8 req-4a51909e-a128-4416-a135-9d2bbefb57bb service nova] Releasing lock "refresh_cache-23e17727-40b4-48f7-9155-abc8ffa9f619" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:28:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:28:13 user nova-compute[75066]: DEBUG nova.compute.manager [req-5cc4c00e-9f1e-4997-92cb-8676e3941414 req-6060dc51-2897-417a-b703-a45e7a6131c0 service nova] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Received event network-changed-902b1013-6c79-4a5a-ab19-782ac8dc715b {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:28:13 user nova-compute[75066]: DEBUG nova.compute.manager [req-5cc4c00e-9f1e-4997-92cb-8676e3941414 req-6060dc51-2897-417a-b703-a45e7a6131c0 service nova] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Refreshing instance network info cache due to event network-changed-902b1013-6c79-4a5a-ab19-782ac8dc715b. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:28:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-5cc4c00e-9f1e-4997-92cb-8676e3941414 req-6060dc51-2897-417a-b703-a45e7a6131c0 service nova] Acquiring lock "refresh_cache-23e17727-40b4-48f7-9155-abc8ffa9f619" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:28:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-5cc4c00e-9f1e-4997-92cb-8676e3941414 req-6060dc51-2897-417a-b703-a45e7a6131c0 service nova] Acquired lock "refresh_cache-23e17727-40b4-48f7-9155-abc8ffa9f619" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:28:13 user nova-compute[75066]: DEBUG nova.network.neutron [req-5cc4c00e-9f1e-4997-92cb-8676e3941414 req-6060dc51-2897-417a-b703-a45e7a6131c0 service nova] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Refreshing network info cache for port 902b1013-6c79-4a5a-ab19-782ac8dc715b {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:28:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c15a0111-92bd-4d53-a6e8-38944e23a4f1 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Acquiring lock "23e17727-40b4-48f7-9155-abc8ffa9f619" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:28:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c15a0111-92bd-4d53-a6e8-38944e23a4f1 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "23e17727-40b4-48f7-9155-abc8ffa9f619" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:28:13 user nova-compute[75066]: INFO nova.compute.manager [None req-c15a0111-92bd-4d53-a6e8-38944e23a4f1 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Detaching volume 70247d7d-96cf-4e91-9969-caa1b67610fd
Dec 01 19:28:13 user nova-compute[75066]: INFO nova.virt.block_device [None req-c15a0111-92bd-4d53-a6e8-38944e23a4f1 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Attempting to driver detach volume 70247d7d-96cf-4e91-9969-caa1b67610fd from mountpoint /dev/vdb
Dec 01 19:28:13 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c15a0111-92bd-4d53-a6e8-38944e23a4f1 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Attempting to detach device vdb from instance 23e17727-40b4-48f7-9155-abc8ffa9f619 from the persistent domain config. {{(pid=75066) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 19:28:13 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-c15a0111-92bd-4d53-a6e8-38944e23a4f1 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 19:28:13 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:28:13 user nova-compute[75066]:   <source dev="/dev/sdc"/>
Dec 01 19:28:13 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:28:13 user nova-compute[75066]:   <serial>70247d7d-96cf-4e91-9969-caa1b67610fd</serial>
Dec 01 19:28:13 user nova-compute[75066]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 01 19:28:13 user nova-compute[75066]: </disk>
Dec 01 19:28:13 user nova-compute[75066]:  {{(pid=75066) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 19:28:13 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-c15a0111-92bd-4d53-a6e8-38944e23a4f1 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Successfully detached device vdb from instance 23e17727-40b4-48f7-9155-abc8ffa9f619 from the persistent domain config.
Dec 01 19:28:13 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c15a0111-92bd-4d53-a6e8-38944e23a4f1 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 23e17727-40b4-48f7-9155-abc8ffa9f619 from the live domain config. {{(pid=75066) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 19:28:13 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-c15a0111-92bd-4d53-a6e8-38944e23a4f1 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 19:28:13 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:28:13 user nova-compute[75066]:   <source dev="/dev/sdc"/>
Dec 01 19:28:13 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:28:13 user nova-compute[75066]:   <serial>70247d7d-96cf-4e91-9969-caa1b67610fd</serial>
Dec 01 19:28:13 user nova-compute[75066]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 01 19:28:13 user nova-compute[75066]: </disk>
Dec 01 19:28:13 user nova-compute[75066]:  {{(pid=75066) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 19:28:13 user nova-compute[75066]: DEBUG nova.network.neutron [req-5cc4c00e-9f1e-4997-92cb-8676e3941414 req-6060dc51-2897-417a-b703-a45e7a6131c0 service nova] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Updated VIF entry in instance network info cache for port 902b1013-6c79-4a5a-ab19-782ac8dc715b. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:28:13 user nova-compute[75066]: DEBUG nova.network.neutron [req-5cc4c00e-9f1e-4997-92cb-8676e3941414 req-6060dc51-2897-417a-b703-a45e7a6131c0 service nova] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Updating instance_info_cache with network_info: [{"id": "902b1013-6c79-4a5a-ab19-782ac8dc715b", "address": "fa:16:3e:fe:93:cc", "network": {"id": "4fe4d56e-afe2-42a6-984a-9af8bc5377a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126385357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5326c00d464e008337e0dc8577fc2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap902b1013-6c", "ovs_interfaceid": "902b1013-6c79-4a5a-ab19-782ac8dc715b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:28:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-5cc4c00e-9f1e-4997-92cb-8676e3941414 req-6060dc51-2897-417a-b703-a45e7a6131c0 service nova] Releasing lock "refresh_cache-23e17727-40b4-48f7-9155-abc8ffa9f619" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:28:13 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c15a0111-92bd-4d53-a6e8-38944e23a4f1 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 23e17727-40b4-48f7-9155-abc8ffa9f619 {{(pid=75066) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 19:28:14 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:28:14 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:28:14 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:28:14 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Starting heal instance info cache {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 19:28:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "refresh_cache-905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:28:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquired lock "refresh_cache-905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:28:14 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Forcefully refreshing network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 19:28:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e3fb8b27-35eb-4c00-9491-9ca1796e63de tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Acquiring lock "3b355778-bd25-42f6-8026-110668920d8b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:28:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e3fb8b27-35eb-4c00-9491-9ca1796e63de tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "3b355778-bd25-42f6-8026-110668920d8b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:28:15 user nova-compute[75066]: DEBUG nova.objects.instance [None req-e3fb8b27-35eb-4c00-9491-9ca1796e63de tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lazy-loading 'flavor' on Instance uuid 3b355778-bd25-42f6-8026-110668920d8b {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:28:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e3fb8b27-35eb-4c00-9491-9ca1796e63de tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "3b355778-bd25-42f6-8026-110668920d8b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:28:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e3fb8b27-35eb-4c00-9491-9ca1796e63de tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Acquiring lock "3b355778-bd25-42f6-8026-110668920d8b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:28:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e3fb8b27-35eb-4c00-9491-9ca1796e63de tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "3b355778-bd25-42f6-8026-110668920d8b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:28:15 user nova-compute[75066]: INFO nova.compute.manager [None req-e3fb8b27-35eb-4c00-9491-9ca1796e63de tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Attaching volume 1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f to /dev/vdc
Dec 01 19:28:15 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Updating instance_info_cache with network_info: [{"id": "6c41fc1e-7ed5-490d-a375-0db34c7ae40b", "address": "fa:16:3e:ed:e9:7c", "network": {"id": "6b0f48b7-3db2-49b2-a238-8fd811b52d62", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1688127634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e000d89bca44cd8acba504256d8d1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c41fc1e-7e", "ovs_interfaceid": "6c41fc1e-7ed5-490d-a375-0db34c7ae40b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:28:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Releasing lock "refresh_cache-905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:28:15 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Updated the network info_cache for instance {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 19:28:15 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:28:15 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:28:15 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:28:15 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75066) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 19:28:15 user nova-compute[75066]: DEBUG os_brick.utils [None req-e3fb8b27-35eb-4c00-9491-9ca1796e63de tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:28:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:15 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[2450ff37-cfa7-40dd-93e0-dc8f8a97131a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1959854982f\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:15 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb00bbb2-0837-4b3c-897b-866608add7ea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:15 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2dce06e-2b9d-43bf-a8f1-31a910cabad4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:15 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[55549208-7332-42b1-bfbc-37cfdf05df85]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-e3fb8b27-35eb-4c00-9491-9ca1796e63de tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Running cmd (subprocess): nvme version {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-e3fb8b27-35eb-4c00-9491-9ca1796e63de tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] 'nvme version' failed. Not Retrying. {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:28:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e3fb8b27-35eb-4c00-9491-9ca1796e63de tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] nvme not present on system {{(pid=75066) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 19:28:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:28:15 user nova-compute[75066]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 19:28:15 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[8205eab2-0e62-412f-afe5-caf5b5cfbdbc]: (4, '') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-e3fb8b27-35eb-4c00-9491-9ca1796e63de tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75066) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 19:28:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-e3fb8b27-35eb-4c00-9491-9ca1796e63de tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 19:28:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-e3fb8b27-35eb-4c00-9491-9ca1796e63de tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] LIGHTOS: no hostnqn found. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 19:28:15 user nova-compute[75066]: DEBUG os_brick.utils [None req-e3fb8b27-35eb-4c00-9491-9ca1796e63de tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1959854982f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:28:15 user nova-compute[75066]: DEBUG nova.virt.block_device [None req-e3fb8b27-35eb-4c00-9491-9ca1796e63de tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Updating existing volume attachment record: 93f8c4b0-fcda-4ba9-a7d5-8b5cc5f95eeb {{(pid=75066) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 19:28:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:28:17 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:28:21 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:28:22 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:28:23 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Acquiring lock "b2c6c900-5d1b-44f8-8435-d9ad88b3a412" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:28:23 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "b2c6c900-5d1b-44f8-8435-d9ad88b3a412" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:28:23 user nova-compute[75066]: DEBUG nova.compute.manager [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Starting instance... {{(pid=75066) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 19:28:23 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:28:23 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:28:23 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75066) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 19:28:23 user nova-compute[75066]: INFO nova.compute.claims [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Claim successful on node user
Dec 01 19:28:23 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:28:23 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:28:23 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.443s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:28:23 user nova-compute[75066]: DEBUG nova.compute.manager [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Start building networks asynchronously for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 19:28:24 user nova-compute[75066]: DEBUG nova.compute.manager [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Allocating IP information in the background. {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 19:28:24 user nova-compute[75066]: DEBUG nova.network.neutron [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] allocate_for_instance() {{(pid=75066) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 19:28:24 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 19:28:24 user nova-compute[75066]: DEBUG nova.compute.manager [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Start building block device mappings for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 19:28:24 user nova-compute[75066]: DEBUG nova.policy [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e6ee9ed4a8d8418082a59be8db20cf2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '943324a514a84cb4947dbab93abc4f6c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75066) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 19:28:24 user nova-compute[75066]: DEBUG nova.compute.manager [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Start spawning the instance on the hypervisor. {{(pid=75066) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 19:28:24 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Creating instance directory {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 19:28:24 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Creating image(s)
Dec 01 19:28:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Acquiring lock "/opt/stack/data/nova/instances/b2c6c900-5d1b-44f8-8435-d9ad88b3a412/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:28:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "/opt/stack/data/nova/instances/b2c6c900-5d1b-44f8-8435-d9ad88b3a412/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:28:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "/opt/stack/data/nova/instances/b2c6c900-5d1b-44f8-8435-d9ad88b3a412/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:28:24 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:24 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.223s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Acquiring lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:28:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:28:24 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:24 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.207s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:24 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/b2c6c900-5d1b-44f8-8435-d9ad88b3a412/disk 1073741824 {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:24 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/b2c6c900-5d1b-44f8-8435-d9ad88b3a412/disk 1073741824" returned: 0 in 0.053s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:28:24 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:24 user nova-compute[75066]: DEBUG nova.network.neutron [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Successfully created port: 5b64624f-4059-4689-83ef-856573e0eab0 {{(pid=75066) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 19:28:24 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.184s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:24 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b2c6c900-5d1b-44f8-8435-d9ad88b3a412/disk. size=1073741824 {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 19:28:24 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6c900-5d1b-44f8-8435-d9ad88b3a412/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6c900-5d1b-44f8-8435-d9ad88b3a412/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Cannot resize image /opt/stack/data/nova/instances/b2c6c900-5d1b-44f8-8435-d9ad88b3a412/disk to a smaller size. {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Created local disks {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Ensure instance console log exists: /opt/stack/data/nova/instances/b2c6c900-5d1b-44f8-8435-d9ad88b3a412/console.log {{(pid=75066) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG nova.network.neutron [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Successfully updated port: 5b64624f-4059-4689-83ef-856573e0eab0 {{(pid=75066) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Acquiring lock "refresh_cache-b2c6c900-5d1b-44f8-8435-d9ad88b3a412" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Acquired lock "refresh_cache-b2c6c900-5d1b-44f8-8435-d9ad88b3a412" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG nova.network.neutron [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG nova.compute.manager [req-bd783d2f-b0e0-422f-914f-de864e36f18c req-36b4efe7-1f17-4a9b-bd0b-36f860de85ff service nova] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Received event network-changed-5b64624f-4059-4689-83ef-856573e0eab0 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG nova.compute.manager [req-bd783d2f-b0e0-422f-914f-de864e36f18c req-36b4efe7-1f17-4a9b-bd0b-36f860de85ff service nova] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Refreshing instance network info cache due to event network-changed-5b64624f-4059-4689-83ef-856573e0eab0. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-bd783d2f-b0e0-422f-914f-de864e36f18c req-36b4efe7-1f17-4a9b-bd0b-36f860de85ff service nova] Acquiring lock "refresh_cache-b2c6c900-5d1b-44f8-8435-d9ad88b3a412" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG nova.network.neutron [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3fb8b27-35eb-4c00-9491-9ca1796e63de tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Calling os-brick to attach iSCSI Volume {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fb8b27-35eb-4c00-9491-9ca1796e63de tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CmOGcXpD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:28:25 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-e3fb8b27-35eb-4c00-9491-9ca1796e63de tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:28:25 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-e3fb8b27-35eb-4c00-9491-9ca1796e63de tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-e3fb8b27-35eb-4c00-9491-9ca1796e63de tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:28:25 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-e3fb8b27-35eb-4c00-9491-9ca1796e63de tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:28:25 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-e3fb8b27-35eb-4c00-9491-9ca1796e63de tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-e3fb8b27-35eb-4c00-9491-9ca1796e63de tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:28:25 user nova-compute[75066]: INFO os_brick.initiator.connectors.iscsi [None req-e3fb8b27-35eb-4c00-9491-9ca1796e63de tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 19:28:25 user nova-compute[75066]: DEBUG nova.network.neutron [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Updating instance_info_cache with network_info: [{"id": "5b64624f-4059-4689-83ef-856573e0eab0", "address": "fa:16:3e:3f:cc:a8", "network": {"id": "47c850ae-6dcb-4977-a02a-e32cd3df4749", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-475363603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "943324a514a84cb4947dbab93abc4f6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b64624f-40", "ovs_interfaceid": "5b64624f-4059-4689-83ef-856573e0eab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f -p 172.16.0.220:3260 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Releasing lock "refresh_cache-b2c6c900-5d1b-44f8-8435-d9ad88b3a412" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG nova.compute.manager [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Instance network_info: |[{"id": "5b64624f-4059-4689-83ef-856573e0eab0", "address": "fa:16:3e:3f:cc:a8", "network": {"id": "47c850ae-6dcb-4977-a02a-e32cd3df4749", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-475363603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "943324a514a84cb4947dbab93abc4f6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b64624f-40", "ovs_interfaceid": "5b64624f-4059-4689-83ef-856573e0eab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[2647f2b0-0cf6-41c3-980b-3a908a8f4387]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-bd783d2f-b0e0-422f-914f-de864e36f18c req-36b4efe7-1f17-4a9b-bd0b-36f860de85ff service nova] Acquired lock "refresh_cache-b2c6c900-5d1b-44f8-8435-d9ad88b3a412" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG nova.network.neutron [req-bd783d2f-b0e0-422f-914f-de864e36f18c req-36b4efe7-1f17-4a9b-bd0b-36f860de85ff service nova] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Refreshing network info cache for port 5b64624f-4059-4689-83ef-856573e0eab0 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Start _get_guest_xml network_info=[{"id": "5b64624f-4059-4689-83ef-856573e0eab0", "address": "fa:16:3e:3f:cc:a8", "network": {"id": "47c850ae-6dcb-4977-a02a-e32cd3df4749", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-475363603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "943324a514a84cb4947dbab93abc4f6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b64624f-40", "ovs_interfaceid": "5b64624f-4059-4689-83ef-856573e0eab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'image_id': '900b237b-e99c-4fdd-a44f-dcb7a08baa86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fb8b27-35eb-4c00-9491-9ca1796e63de tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 19:28:25 user nova-compute[75066]:  {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f -p 172.16.0.220:3260 --interface default --op new {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:25 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:28:25 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:28:25 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[64523cee-6c50-4ed5-b8ef-6f4cd43c34df]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f] added\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fb8b27-35eb-4c00-9491-9ca1796e63de tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f] added
Dec 01 19:28:25 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:28:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1435487615',display_name='tempest-ServerRescueNegativeTestJSON-server-1435487615',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1435487615',id=31,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDCNeprmgnfVxogNGgOlPPfFndhuZOSmJ9cRoqBokaw77D1VjF05n80FVq2sXbC1g2yqvZwE0g/0YU+PBmyhkD7PWUIyoZLPPecgdaLZA1vtC7lvG4JylIPIbZvcQHhUPw==',key_name='tempest-keypair-645274599',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='943324a514a84cb4947dbab93abc4f6c',ramdisk_id='',reservation_id='r-c4an3hxc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-146516797',owner_user_name='tempest-ServerRescueNegativeTestJSON-146516797-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:28:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6ee9ed4a8d8418082a59be8db20cf2e',uuid=b2c6c900-5d1b-44f8-8435-d9ad88b3a412,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b64624f-4059-4689-83ef-856573e0eab0", "address": "fa:16:3e:3f:cc:a8", "network": {"id": "47c850ae-6dcb-4977-a02a-e32cd3df4749", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-475363603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "943324a514a84cb4947dbab93abc4f6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b64624f-40", "ovs_interfaceid": "5b64624f-4059-4689-83ef-856573e0eab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Converting VIF {"id": "5b64624f-4059-4689-83ef-856573e0eab0", "address": "fa:16:3e:3f:cc:a8", "network": {"id": "47c850ae-6dcb-4977-a02a-e32cd3df4749", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-475363603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "943324a514a84cb4947dbab93abc4f6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b64624f-40", "ovs_interfaceid": "5b64624f-4059-4689-83ef-856573e0eab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:cc:a8,bridge_name='br-int',has_traffic_filtering=True,id=5b64624f-4059-4689-83ef-856573e0eab0,network=Network(47c850ae-6dcb-4977-a02a-e32cd3df4749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b64624f-40') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG nova.objects.instance [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lazy-loading 'pci_devices' on Instance uuid b2c6c900-5d1b-44f8-8435-d9ad88b3a412 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[a776f87f-eb27-4044-8480-838435ecc722]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fb8b27-35eb-4c00-9491-9ca1796e63de tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:28:25 user nova-compute[75066]:   <uuid>b2c6c900-5d1b-44f8-8435-d9ad88b3a412</uuid>
Dec 01 19:28:25 user nova-compute[75066]:   <name>instance-0000001f</name>
Dec 01 19:28:25 user nova-compute[75066]:   <memory>524288</memory>
Dec 01 19:28:25 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:28:25 user nova-compute[75066]:   <metadata>
Dec 01 19:28:25 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:28:25 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:28:25 user nova-compute[75066]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1435487615</nova:name>
Dec 01 19:28:25 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:28:25</nova:creationTime>
Dec 01 19:28:25 user nova-compute[75066]:       <nova:flavor name="m1.tiny">
Dec 01 19:28:25 user nova-compute[75066]:         <nova:memory>512</nova:memory>
Dec 01 19:28:25 user nova-compute[75066]:         <nova:disk>1</nova:disk>
Dec 01 19:28:25 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:28:25 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:28:25 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:28:25 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:28:25 user nova-compute[75066]:       <nova:owner>
Dec 01 19:28:25 user nova-compute[75066]:         <nova:user uuid="e6ee9ed4a8d8418082a59be8db20cf2e">tempest-ServerRescueNegativeTestJSON-146516797-project-member</nova:user>
Dec 01 19:28:25 user nova-compute[75066]:         <nova:project uuid="943324a514a84cb4947dbab93abc4f6c">tempest-ServerRescueNegativeTestJSON-146516797</nova:project>
Dec 01 19:28:25 user nova-compute[75066]:       </nova:owner>
Dec 01 19:28:25 user nova-compute[75066]:       <nova:root type="image" uuid="900b237b-e99c-4fdd-a44f-dcb7a08baa86"/>
Dec 01 19:28:25 user nova-compute[75066]:       <nova:ports>
Dec 01 19:28:25 user nova-compute[75066]:         <nova:port uuid="5b64624f-4059-4689-83ef-856573e0eab0">
Dec 01 19:28:25 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Dec 01 19:28:25 user nova-compute[75066]:         </nova:port>
Dec 01 19:28:25 user nova-compute[75066]:       </nova:ports>
Dec 01 19:28:25 user nova-compute[75066]:     </nova:instance>
Dec 01 19:28:25 user nova-compute[75066]:   </metadata>
Dec 01 19:28:25 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:28:25 user nova-compute[75066]:     <system>
Dec 01 19:28:25 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:28:25 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:28:25 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:28:25 user nova-compute[75066]:       <entry name="serial">b2c6c900-5d1b-44f8-8435-d9ad88b3a412</entry>
Dec 01 19:28:25 user nova-compute[75066]:       <entry name="uuid">b2c6c900-5d1b-44f8-8435-d9ad88b3a412</entry>
Dec 01 19:28:25 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:28:25 user nova-compute[75066]:     </system>
Dec 01 19:28:25 user nova-compute[75066]:   </sysinfo>
Dec 01 19:28:25 user nova-compute[75066]:   <os>
Dec 01 19:28:25 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:28:25 user nova-compute[75066]:     <boot dev="hd"/>
Dec 01 19:28:25 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:28:25 user nova-compute[75066]:   </os>
Dec 01 19:28:25 user nova-compute[75066]:   <features>
Dec 01 19:28:25 user nova-compute[75066]:     <acpi/>
Dec 01 19:28:25 user nova-compute[75066]:     <apic/>
Dec 01 19:28:25 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:28:25 user nova-compute[75066]:   </features>
Dec 01 19:28:25 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:28:25 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:28:25 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:28:25 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:28:25 user nova-compute[75066]:   </clock>
Dec 01 19:28:25 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:28:25 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:28:25 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:28:25 user nova-compute[75066]:   </cpu>
Dec 01 19:28:25 user nova-compute[75066]:   <devices>
Dec 01 19:28:25 user nova-compute[75066]:     <disk type="file" device="disk">
Dec 01 19:28:25 user nova-compute[75066]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 19:28:25 user nova-compute[75066]:       <source file="/opt/stack/data/nova/instances/b2c6c900-5d1b-44f8-8435-d9ad88b3a412/disk"/>
Dec 01 19:28:25 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:28:25 user nova-compute[75066]:     </disk>
Dec 01 19:28:25 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:28:25 user nova-compute[75066]:       <mac address="fa:16:3e:3f:cc:a8"/>
Dec 01 19:28:25 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:28:25 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:28:25 user nova-compute[75066]:       <target dev="tap5b64624f-40"/>
Dec 01 19:28:25 user nova-compute[75066]:     </interface>
Dec 01 19:28:25 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:28:25 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/b2c6c900-5d1b-44f8-8435-d9ad88b3a412/console.log" append="off"/>
Dec 01 19:28:25 user nova-compute[75066]:     </serial>
Dec 01 19:28:25 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:28:25 user nova-compute[75066]:     <video>
Dec 01 19:28:25 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:28:25 user nova-compute[75066]:     </video>
Dec 01 19:28:25 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:28:25 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:28:25 user nova-compute[75066]:     </rng>
Dec 01 19:28:25 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:28:25 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:28:25 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:28:25 user nova-compute[75066]:     </memballoon>
Dec 01 19:28:25 user nova-compute[75066]:   </devices>
Dec 01 19:28:25 user nova-compute[75066]: </domain>
Dec 01 19:28:25 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:28:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1435487615',display_name='tempest-ServerRescueNegativeTestJSON-server-1435487615',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1435487615',id=31,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDCNeprmgnfVxogNGgOlPPfFndhuZOSmJ9cRoqBokaw77D1VjF05n80FVq2sXbC1g2yqvZwE0g/0YU+PBmyhkD7PWUIyoZLPPecgdaLZA1vtC7lvG4JylIPIbZvcQHhUPw==',key_name='tempest-keypair-645274599',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='943324a514a84cb4947dbab93abc4f6c',ramdisk_id='',reservation_id='r-c4an3hxc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-146516797',owner_user_name='tempest-ServerRescueNegativeTestJSON-146516797-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:28:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6ee9ed4a8d8418082a59be8db20cf2e',uuid=b2c6c900-5d1b-44f8-8435-d9ad88b3a412,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b64624f-4059-4689-83ef-856573e0eab0", "address": "fa:16:3e:3f:cc:a8", "network": {"id": "47c850ae-6dcb-4977-a02a-e32cd3df4749", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-475363603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "943324a514a84cb4947dbab93abc4f6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b64624f-40", "ovs_interfaceid": "5b64624f-4059-4689-83ef-856573e0eab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Converting VIF {"id": "5b64624f-4059-4689-83ef-856573e0eab0", "address": "fa:16:3e:3f:cc:a8", "network": {"id": "47c850ae-6dcb-4977-a02a-e32cd3df4749", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-475363603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "943324a514a84cb4947dbab93abc4f6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b64624f-40", "ovs_interfaceid": "5b64624f-4059-4689-83ef-856573e0eab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:cc:a8,bridge_name='br-int',has_traffic_filtering=True,id=5b64624f-4059-4689-83ef-856573e0eab0,network=Network(47c850ae-6dcb-4977-a02a-e32cd3df4749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b64624f-40') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG os_vif [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:cc:a8,bridge_name='br-int',has_traffic_filtering=True,id=5b64624f-4059-4689-83ef-856573e0eab0,network=Network(47c850ae-6dcb-4977-a02a-e32cd3df4749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b64624f-40') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f55a19-d204-4110-9d1b-3f90b0cfbcd1]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '004ac403-7c7e-5895-943f-201659e30016', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fb8b27-35eb-4c00-9491-9ca1796e63de tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CmOGcXpD {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b64624f-40, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5b64624f-40, col_values=(('qos', UUID('c3cc5585-52b9-4874-b049-f7cf1e1d23ed')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5b64624f-40, col_values=(('external_ids', {'iface-id': '5b64624f-4059-4689-83ef-856573e0eab0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:cc:a8', 'vm-uuid': 'b2c6c900-5d1b-44f8-8435-d9ad88b3a412'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:28:25 user nova-compute[75066]: INFO os_vif [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:cc:a8,bridge_name='br-int',has_traffic_filtering=True,id=5b64624f-4059-4689-83ef-856573e0eab0,network=Network(47c850ae-6dcb-4977-a02a-e32cd3df4749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b64624f-40')
Dec 01 19:28:25 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CmOGcXpD" returned: 0 in 0.022s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a5d809-fde4-4016-bf69-45bf515791b6]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fb8b27-35eb-4c00-9491-9ca1796e63de tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CmOGcXpD'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:28:25 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:26 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3d30b4-96ce-4cb7-94cf-b3e4976a9934]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:26 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fb8b27-35eb-4c00-9491-9ca1796e63de tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:28:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:26 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:28:26 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] No VIF found with MAC fa:16:3e:3f:cc:a8, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:28:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:26 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ba47c2-6808-4aa4-97af-6798b6fb1708]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:26 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fb8b27-35eb-4c00-9491-9ca1796e63de tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:28:26 user nova-compute[75066]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd (non-flash)
Dec 01 19:28:26 user nova-compute[75066]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)
Dec 01 19:28:26 user nova-compute[75066]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)
Dec 01 19:28:26 user nova-compute[75066]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567 (non-flash)
Dec 01 19:28:26 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:28:26 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fb8b27-35eb-4c00-9491-9ca1796e63de tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:28:26 user nova-compute[75066]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd (non-flash)
Dec 01 19:28:26 user nova-compute[75066]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)
Dec 01 19:28:26 user nova-compute[75066]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)
Dec 01 19:28:26 user nova-compute[75066]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567 (non-flash)
Dec 01 19:28:26 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:28:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f -p 172.16.0.220:3260 --login {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:26 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[dab8ffd4-fb78-4463-b5f7-c6adcfe32660]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:26 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fb8b27-35eb-4c00-9491-9ca1796e63de tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f, portal: 172.16.0.220,3260]
Dec 01 19:28:26 user nova-compute[75066]: Login to [iface: default, target: iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f, portal: 172.16.0.220,3260] successful.
Dec 01 19:28:26 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:28:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:26 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[b965a849-741c-4b36-8d4f-9e90c6ade9d0]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:26 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fb8b27-35eb-4c00-9491-9ca1796e63de tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:28:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:26 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d41a71-097b-4171-9e7d-172e9c3ef4aa]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:26 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fb8b27-35eb-4c00-9491-9ca1796e63de tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:28:26 user nova-compute[75066]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd (non-flash)
Dec 01 19:28:26 user nova-compute[75066]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)
Dec 01 19:28:26 user nova-compute[75066]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)
Dec 01 19:28:26 user nova-compute[75066]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567 (non-flash)
Dec 01 19:28:26 user nova-compute[75066]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f (non-flash)
Dec 01 19:28:26 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:28:26 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fb8b27-35eb-4c00-9491-9ca1796e63de tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:28:26 user nova-compute[75066]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd (non-flash)
Dec 01 19:28:26 user nova-compute[75066]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)
Dec 01 19:28:26 user nova-compute[75066]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)
Dec 01 19:28:26 user nova-compute[75066]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567 (non-flash)
Dec 01 19:28:26 user nova-compute[75066]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f (non-flash)
Dec 01 19:28:26 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:28:26 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-e3fb8b27-35eb-4c00-9491-9ca1796e63de tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.355s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:28:26 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fb8b27-35eb-4c00-9491-9ca1796e63de tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Connected to 172.16.0.220:3260 {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 19:28:26 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-e3fb8b27-35eb-4c00-9491-9ca1796e63de tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] HCTL ('38', '-', '-', 0) found on session 35 with lun 0 {{(pid=75066) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 19:28:26 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-e3fb8b27-35eb-4c00-9491-9ca1796e63de tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75066) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 19:28:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.021s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:26 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9f6cd4-70e5-49f7-bd18-a2935b76e15a]: (4, ('- - 0', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:26 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-e3fb8b27-35eb-4c00-9491-9ca1796e63de tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Searching for a device in session 35 and hctl ['38', '*', '*', 0] yield: None {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:28:26 user nova-compute[75066]: DEBUG nova.network.neutron [req-bd783d2f-b0e0-422f-914f-de864e36f18c req-36b4efe7-1f17-4a9b-bd0b-36f860de85ff service nova] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Updated VIF entry in instance network info cache for port 5b64624f-4059-4689-83ef-856573e0eab0. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:28:26 user nova-compute[75066]: DEBUG nova.network.neutron [req-bd783d2f-b0e0-422f-914f-de864e36f18c req-36b4efe7-1f17-4a9b-bd0b-36f860de85ff service nova] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Updating instance_info_cache with network_info: [{"id": "5b64624f-4059-4689-83ef-856573e0eab0", "address": "fa:16:3e:3f:cc:a8", "network": {"id": "47c850ae-6dcb-4977-a02a-e32cd3df4749", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-475363603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "943324a514a84cb4947dbab93abc4f6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b64624f-40", "ovs_interfaceid": "5b64624f-4059-4689-83ef-856573e0eab0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:28:26 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-bd783d2f-b0e0-422f-914f-de864e36f18c req-36b4efe7-1f17-4a9b-bd0b-36f860de85ff service nova] Releasing lock "refresh_cache-b2c6c900-5d1b-44f8-8435-d9ad88b3a412" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:28:27 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-e3fb8b27-35eb-4c00-9491-9ca1796e63de tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Searching for a device in session 35 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:28:27 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fb8b27-35eb-4c00-9491-9ca1796e63de tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CmOGcXpD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 19:28:27 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-e3fb8b27-35eb-4c00-9491-9ca1796e63de tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:28:27 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3fb8b27-35eb-4c00-9491-9ca1796e63de tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] <== connect_volume: return (1391ms) {'type': 'block', 'scsi_wwn': '23731326462626533', 'path': '/dev/sdg'} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:28:27 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3fb8b27-35eb-4c00-9491-9ca1796e63de tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23731326462626533', 'path': '/dev/sdg'} {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 19:28:27 user nova-compute[75066]: DEBUG nova.objects.instance [None req-e3fb8b27-35eb-4c00-9491-9ca1796e63de tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lazy-loading 'flavor' on Instance uuid 3b355778-bd25-42f6-8026-110668920d8b {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:28:27 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-e3fb8b27-35eb-4c00-9491-9ca1796e63de tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 19:28:27 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:28:27 user nova-compute[75066]:   <source dev="/dev/sdg"/>
Dec 01 19:28:27 user nova-compute[75066]:   <target dev="vdc" bus="virtio"/>
Dec 01 19:28:27 user nova-compute[75066]:   <serial>1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f</serial>
Dec 01 19:28:27 user nova-compute[75066]: </disk>
Dec 01 19:28:27 user nova-compute[75066]:  {{(pid=75066) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 19:28:27 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:28:27 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:28:27 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:28:27 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:28:27 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:28:27 user nova-compute[75066]: DEBUG nova.compute.manager [req-42b0bb98-88f5-427c-85d2-26a1ad57e730 req-3c0722de-1291-45d3-ab77-65f75df20303 service nova] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Received event network-vif-plugged-5b64624f-4059-4689-83ef-856573e0eab0 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:28:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-42b0bb98-88f5-427c-85d2-26a1ad57e730 req-3c0722de-1291-45d3-ab77-65f75df20303 service nova] Acquiring lock "b2c6c900-5d1b-44f8-8435-d9ad88b3a412-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:28:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-42b0bb98-88f5-427c-85d2-26a1ad57e730 req-3c0722de-1291-45d3-ab77-65f75df20303 service nova] Lock "b2c6c900-5d1b-44f8-8435-d9ad88b3a412-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:28:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-42b0bb98-88f5-427c-85d2-26a1ad57e730 req-3c0722de-1291-45d3-ab77-65f75df20303 service nova] Lock "b2c6c900-5d1b-44f8-8435-d9ad88b3a412-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:28:27 user nova-compute[75066]: DEBUG nova.compute.manager [req-42b0bb98-88f5-427c-85d2-26a1ad57e730 req-3c0722de-1291-45d3-ab77-65f75df20303 service nova] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] No waiting events found dispatching network-vif-plugged-5b64624f-4059-4689-83ef-856573e0eab0 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:28:27 user nova-compute[75066]: WARNING nova.compute.manager [req-42b0bb98-88f5-427c-85d2-26a1ad57e730 req-3c0722de-1291-45d3-ab77-65f75df20303 service nova] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Received unexpected event network-vif-plugged-5b64624f-4059-4689-83ef-856573e0eab0 for instance with vm_state building and task_state spawning.
Dec 01 19:28:27 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-e3fb8b27-35eb-4c00-9491-9ca1796e63de tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:28:27 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-e3fb8b27-35eb-4c00-9491-9ca1796e63de tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:28:27 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-e3fb8b27-35eb-4c00-9491-9ca1796e63de tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:28:27 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-e3fb8b27-35eb-4c00-9491-9ca1796e63de tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] No VIF found with MAC fa:16:3e:e9:75:23, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:28:27 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:28:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e3fb8b27-35eb-4c00-9491-9ca1796e63de tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "3b355778-bd25-42f6-8026-110668920d8b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.496s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:28:28 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-bcb35b1e-55ae-478c-8b06-efe254633f0c tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Acquiring lock "3b355778-bd25-42f6-8026-110668920d8b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:28:28 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-bcb35b1e-55ae-478c-8b06-efe254633f0c tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "3b355778-bd25-42f6-8026-110668920d8b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:28:28 user nova-compute[75066]: INFO nova.compute.manager [None req-bcb35b1e-55ae-478c-8b06-efe254633f0c tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Detaching volume f817b8a7-1ac5-43d3-a87f-51e048c26567
Dec 01 19:28:28 user nova-compute[75066]: INFO nova.virt.block_device [None req-bcb35b1e-55ae-478c-8b06-efe254633f0c tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Attempting to driver detach volume f817b8a7-1ac5-43d3-a87f-51e048c26567 from mountpoint /dev/vdb
Dec 01 19:28:28 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-bcb35b1e-55ae-478c-8b06-efe254633f0c tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Attempting to detach device vdb from instance 3b355778-bd25-42f6-8026-110668920d8b from the persistent domain config. {{(pid=75066) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 19:28:28 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-bcb35b1e-55ae-478c-8b06-efe254633f0c tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 19:28:28 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:28:28 user nova-compute[75066]:   <source dev="/dev/sde"/>
Dec 01 19:28:28 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:28:28 user nova-compute[75066]:   <serial>f817b8a7-1ac5-43d3-a87f-51e048c26567</serial>
Dec 01 19:28:28 user nova-compute[75066]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 19:28:28 user nova-compute[75066]: </disk>
Dec 01 19:28:28 user nova-compute[75066]:  {{(pid=75066) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 19:28:28 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-bcb35b1e-55ae-478c-8b06-efe254633f0c tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Successfully detached device vdb from instance 3b355778-bd25-42f6-8026-110668920d8b from the persistent domain config.
Dec 01 19:28:28 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-bcb35b1e-55ae-478c-8b06-efe254633f0c tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3b355778-bd25-42f6-8026-110668920d8b from the live domain config. {{(pid=75066) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 19:28:28 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-bcb35b1e-55ae-478c-8b06-efe254633f0c tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 19:28:28 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:28:28 user nova-compute[75066]:   <source dev="/dev/sde"/>
Dec 01 19:28:28 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:28:28 user nova-compute[75066]:   <serial>f817b8a7-1ac5-43d3-a87f-51e048c26567</serial>
Dec 01 19:28:28 user nova-compute[75066]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 19:28:28 user nova-compute[75066]: </disk>
Dec 01 19:28:28 user nova-compute[75066]:  {{(pid=75066) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 19:28:29 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-bcb35b1e-55ae-478c-8b06-efe254633f0c tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3b355778-bd25-42f6-8026-110668920d8b {{(pid=75066) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 19:28:29 user nova-compute[75066]: DEBUG nova.compute.manager [req-547fdef2-a70a-4368-b6b2-9ea5a5b0976f req-d3e1d122-ac5b-493b-8c1e-9d46b27f6fdc service nova] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Received event network-vif-plugged-5b64624f-4059-4689-83ef-856573e0eab0 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:28:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-547fdef2-a70a-4368-b6b2-9ea5a5b0976f req-d3e1d122-ac5b-493b-8c1e-9d46b27f6fdc service nova] Acquiring lock "b2c6c900-5d1b-44f8-8435-d9ad88b3a412-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:28:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-547fdef2-a70a-4368-b6b2-9ea5a5b0976f req-d3e1d122-ac5b-493b-8c1e-9d46b27f6fdc service nova] Lock "b2c6c900-5d1b-44f8-8435-d9ad88b3a412-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:28:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-547fdef2-a70a-4368-b6b2-9ea5a5b0976f req-d3e1d122-ac5b-493b-8c1e-9d46b27f6fdc service nova] Lock "b2c6c900-5d1b-44f8-8435-d9ad88b3a412-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:28:29 user nova-compute[75066]: DEBUG nova.compute.manager [req-547fdef2-a70a-4368-b6b2-9ea5a5b0976f req-d3e1d122-ac5b-493b-8c1e-9d46b27f6fdc service nova] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] No waiting events found dispatching network-vif-plugged-5b64624f-4059-4689-83ef-856573e0eab0 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:28:29 user nova-compute[75066]: WARNING nova.compute.manager [req-547fdef2-a70a-4368-b6b2-9ea5a5b0976f req-d3e1d122-ac5b-493b-8c1e-9d46b27f6fdc service nova] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Received unexpected event network-vif-plugged-5b64624f-4059-4689-83ef-856573e0eab0 for instance with vm_state building and task_state spawning.
Dec 01 19:28:30 user nova-compute[75066]: DEBUG nova.compute.manager [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Instance event wait completed in 0 seconds for  {{(pid=75066) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 19:28:30 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Guest created on hypervisor {{(pid=75066) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 19:28:30 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Instance spawned successfully.
Dec 01 19:28:30 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 19:28:30 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Found default for hw_cdrom_bus of ide {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:28:30 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Found default for hw_disk_bus of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:28:30 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Found default for hw_input_bus of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:28:30 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Found default for hw_pointer_model of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:28:30 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Found default for hw_video_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:28:30 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Found default for hw_vif_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:28:30 user nova-compute[75066]: INFO nova.compute.manager [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Took 5.89 seconds to spawn the instance on the hypervisor.
Dec 01 19:28:30 user nova-compute[75066]: DEBUG nova.compute.manager [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:28:30 user nova-compute[75066]: INFO nova.compute.manager [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Took 6.70 seconds to build instance.
Dec 01 19:28:30 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c78efa00-b8fa-46bd-87a3-80d18724c50c tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "b2c6c900-5d1b-44f8-8435-d9ad88b3a412" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.843s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:28:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:28:32 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:28:33 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-c15a0111-92bd-4d53-a6e8-38944e23a4f1 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 23e17727-40b4-48f7-9155-abc8ffa9f619 is timed out.
Dec 01 19:28:33 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-c15a0111-92bd-4d53-a6e8-38944e23a4f1 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Successfully detached device vdb from instance 23e17727-40b4-48f7-9155-abc8ffa9f619 from the live domain config.
Dec 01 19:28:33 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c15a0111-92bd-4d53-a6e8-38944e23a4f1 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] calling os-brick to detach iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 19:28:33 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15a0111-92bd-4d53-a6e8-38944e23a4f1 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, {'target_iqn': 'iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xAPSKUhw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:28:33 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-c15a0111-92bd-4d53-a6e8-38944e23a4f1 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:28:33 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-c15a0111-92bd-4d53-a6e8-38944e23a4f1 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:28:33 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-c15a0111-92bd-4d53-a6e8-38944e23a4f1 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:28:33 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:33 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:33 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f686c4-d780-4d0a-a7c1-536de9fdc340]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:33 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15a0111-92bd-4d53-a6e8-38944e23a4f1 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 19:28:33 user nova-compute[75066]: No targets found.
Dec 01 19:28:33 user nova-compute[75066]: iSNS:
Dec 01 19:28:33 user nova-compute[75066]: No targets found.
Dec 01 19:28:33 user nova-compute[75066]: STATIC:
Dec 01 19:28:33 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0
Dec 01 19:28:33 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:28:33 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:28:33 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9
Dec 01 19:28:33 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:28:33 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:28:33 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567
Dec 01 19:28:33 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:28:33 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:28:33 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f
Dec 01 19:28:33 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:28:33 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:28:33 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd
Dec 01 19:28:33 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:28:33 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:28:33 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb
Dec 01 19:28:33 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:28:33 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:28:33 user nova-compute[75066]: FIRMWARE:
Dec 01 19:28:33 user nova-compute[75066]: No targets found.
Dec 01 19:28:33 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:28:33 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15a0111-92bd-4d53-a6e8-38944e23a4f1 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 19:28:33 user nova-compute[75066]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 19:28:33 user nova-compute[75066]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75066) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 19:28:33 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15a0111-92bd-4d53-a6e8-38944e23a4f1 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd', 0)] {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 19:28:33 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:33 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:33 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45de2ad-1137-4bc9-9ca2-eba5493de811]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:33 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:33 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:33 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b8c20f-bba9-46cf-bfb9-b5211fe60df3]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:33 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15a0111-92bd-4d53-a6e8-38944e23a4f1 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:28:33 user nova-compute[75066]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd (non-flash)
Dec 01 19:28:33 user nova-compute[75066]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)
Dec 01 19:28:33 user nova-compute[75066]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)
Dec 01 19:28:33 user nova-compute[75066]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567 (non-flash)
Dec 01 19:28:33 user nova-compute[75066]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f (non-flash)
Dec 01 19:28:33 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:28:33 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15a0111-92bd-4d53-a6e8-38944e23a4f1 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:28:33 user nova-compute[75066]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd (non-flash)
Dec 01 19:28:33 user nova-compute[75066]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)
Dec 01 19:28:33 user nova-compute[75066]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)
Dec 01 19:28:33 user nova-compute[75066]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567 (non-flash)
Dec 01 19:28:33 user nova-compute[75066]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f (non-flash)
Dec 01 19:28:33 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:28:33 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15a0111-92bd-4d53-a6e8-38944e23a4f1 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91907a8dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd'): ({'sdc'}, set())}) {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 19:28:33 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-c15a0111-92bd-4d53-a6e8-38944e23a4f1 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Removing single pathed devices sdc {{(pid=75066) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 19:28:33 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:33 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:33 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[da335de9-d75e-49d3-900b-c4611ca21c2a]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:33 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:33 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:33 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c35ca86-dc20-423e-9d23-6b58a2fa96ff]: (4, ('ok\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:33 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-c15a0111-92bd-4d53-a6e8-38944e23a4f1 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Flushing IO for device /dev/sdc {{(pid=75066) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 19:28:33 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:33 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:33 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[9087543c-2956-413a-ae6b-794f2c69adc0]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:33 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-c15a0111-92bd-4d53-a6e8-38944e23a4f1 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75066) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 19:28:33 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:34 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.063s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:34 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[264bd977-1e76-4a30-97b7-ed79d9240545]: (4, ('1', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:34 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-c15a0111-92bd-4d53-a6e8-38944e23a4f1 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 19:28:34 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-c15a0111-92bd-4d53-a6e8-38944e23a4f1 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] SCSI volumes sdc have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 19:28:34 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15a0111-92bd-4d53-a6e8-38944e23a4f1 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd')] {{(pid=75066) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 19:28:34 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:34 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:34 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[04fc8e10-cb09-4169-8c93-63b6abcab464]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:34 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15a0111-92bd-4d53-a6e8-38944e23a4f1 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:28:34 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd -p 172.16.0.220:3260 --logout {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:34 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:34 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9819688-6c06-4510-a343-5e91825c7855]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:34 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15a0111-92bd-4d53-a6e8-38944e23a4f1 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd, portal: 172.16.0.220,3260]
Dec 01 19:28:34 user nova-compute[75066]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd, portal: 172.16.0.220,3260] successful.
Dec 01 19:28:34 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:28:34 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd -p 172.16.0.220:3260 --op delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:34 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:70247d7d-96cf-4e91-9969-caa1b67610fd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:34 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7968edf-9adc-4bd4-ac97-8ba1f46b0c84]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:34 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15a0111-92bd-4d53-a6e8-38944e23a4f1 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:28:34 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-c15a0111-92bd-4d53-a6e8-38944e23a4f1 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.391s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:28:34 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c15a0111-92bd-4d53-a6e8-38944e23a4f1 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] <== disconnect_volume: return (392ms) None {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:28:34 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c15a0111-92bd-4d53-a6e8-38944e23a4f1 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Disconnected iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 19:28:35 user nova-compute[75066]: DEBUG nova.compute.manager [req-ee5a214b-b527-45b7-bfcc-35bea1e8119f req-f6785f08-df9e-4547-b5bd-fe0f7bf3c338 service nova] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Received event network-changed-2698607a-e8b6-4da8-bfc7-90dc528ade6b {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:28:35 user nova-compute[75066]: DEBUG nova.compute.manager [req-ee5a214b-b527-45b7-bfcc-35bea1e8119f req-f6785f08-df9e-4547-b5bd-fe0f7bf3c338 service nova] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Refreshing instance network info cache due to event network-changed-2698607a-e8b6-4da8-bfc7-90dc528ade6b. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:28:35 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-ee5a214b-b527-45b7-bfcc-35bea1e8119f req-f6785f08-df9e-4547-b5bd-fe0f7bf3c338 service nova] Acquiring lock "refresh_cache-c223be70-8b9c-46d4-9b5a-3b83dfc05a17" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:28:35 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-ee5a214b-b527-45b7-bfcc-35bea1e8119f req-f6785f08-df9e-4547-b5bd-fe0f7bf3c338 service nova] Acquired lock "refresh_cache-c223be70-8b9c-46d4-9b5a-3b83dfc05a17" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:28:35 user nova-compute[75066]: DEBUG nova.network.neutron [req-ee5a214b-b527-45b7-bfcc-35bea1e8119f req-f6785f08-df9e-4547-b5bd-fe0f7bf3c338 service nova] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Refreshing network info cache for port 2698607a-e8b6-4da8-bfc7-90dc528ade6b {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:28:35 user nova-compute[75066]: DEBUG nova.network.neutron [req-ee5a214b-b527-45b7-bfcc-35bea1e8119f req-f6785f08-df9e-4547-b5bd-fe0f7bf3c338 service nova] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Updated VIF entry in instance network info cache for port 2698607a-e8b6-4da8-bfc7-90dc528ade6b. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:28:35 user nova-compute[75066]: DEBUG nova.network.neutron [req-ee5a214b-b527-45b7-bfcc-35bea1e8119f req-f6785f08-df9e-4547-b5bd-fe0f7bf3c338 service nova] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Updating instance_info_cache with network_info: [{"id": "2698607a-e8b6-4da8-bfc7-90dc528ade6b", "address": "fa:16:3e:52:d6:e9", "network": {"id": "9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-696310557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0f7516d1db4dd5bc7d77a0bd1d44d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2698607a-e8", "ovs_interfaceid": "2698607a-e8b6-4da8-bfc7-90dc528ade6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:28:35 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-ee5a214b-b527-45b7-bfcc-35bea1e8119f req-f6785f08-df9e-4547-b5bd-fe0f7bf3c338 service nova] Releasing lock "refresh_cache-c223be70-8b9c-46d4-9b5a-3b83dfc05a17" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:28:35 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:28:36 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:28:37 user nova-compute[75066]: DEBUG nova.objects.instance [None req-c15a0111-92bd-4d53-a6e8-38944e23a4f1 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lazy-loading 'flavor' on Instance uuid 23e17727-40b4-48f7-9155-abc8ffa9f619 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:28:37 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c15a0111-92bd-4d53-a6e8-38944e23a4f1 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "23e17727-40b4-48f7-9155-abc8ffa9f619" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.841s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:28:37 user nova-compute[75066]: DEBUG nova.compute.manager [req-78d2c5ba-a884-4d03-873d-ee6763ede4af req-849f0a55-9ab1-4861-8248-ee77ba35768d service nova] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Received event network-changed-b0528c8d-a14c-4420-a248-fda3f0a92893 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:28:37 user nova-compute[75066]: DEBUG nova.compute.manager [req-78d2c5ba-a884-4d03-873d-ee6763ede4af req-849f0a55-9ab1-4861-8248-ee77ba35768d service nova] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Refreshing instance network info cache due to event network-changed-b0528c8d-a14c-4420-a248-fda3f0a92893. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:28:37 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-78d2c5ba-a884-4d03-873d-ee6763ede4af req-849f0a55-9ab1-4861-8248-ee77ba35768d service nova] Acquiring lock "refresh_cache-00506483-8f09-4a3d-938a-31ab1b2dbf83" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:28:37 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-78d2c5ba-a884-4d03-873d-ee6763ede4af req-849f0a55-9ab1-4861-8248-ee77ba35768d service nova] Acquired lock "refresh_cache-00506483-8f09-4a3d-938a-31ab1b2dbf83" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:28:37 user nova-compute[75066]: DEBUG nova.network.neutron [req-78d2c5ba-a884-4d03-873d-ee6763ede4af req-849f0a55-9ab1-4861-8248-ee77ba35768d service nova] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Refreshing network info cache for port b0528c8d-a14c-4420-a248-fda3f0a92893 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:28:37 user nova-compute[75066]: DEBUG nova.compute.manager [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Stashing vm_state: active {{(pid=75066) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Dec 01 19:28:37 user nova-compute[75066]: DEBUG nova.network.neutron [req-78d2c5ba-a884-4d03-873d-ee6763ede4af req-849f0a55-9ab1-4861-8248-ee77ba35768d service nova] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Updated VIF entry in instance network info cache for port b0528c8d-a14c-4420-a248-fda3f0a92893. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:28:37 user nova-compute[75066]: DEBUG nova.network.neutron [req-78d2c5ba-a884-4d03-873d-ee6763ede4af req-849f0a55-9ab1-4861-8248-ee77ba35768d service nova] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Updating instance_info_cache with network_info: [{"id": "b0528c8d-a14c-4420-a248-fda3f0a92893", "address": "fa:16:3e:a6:1a:51", "network": {"id": "9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-696310557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0f7516d1db4dd5bc7d77a0bd1d44d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0528c8d-a1", "ovs_interfaceid": "b0528c8d-a14c-4420-a248-fda3f0a92893", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:28:37 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-78d2c5ba-a884-4d03-873d-ee6763ede4af req-849f0a55-9ab1-4861-8248-ee77ba35768d service nova] Releasing lock "refresh_cache-00506483-8f09-4a3d-938a-31ab1b2dbf83" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:28:37 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:28:37 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:28:37 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:28:37 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75066) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 19:28:37 user nova-compute[75066]: INFO nova.compute.claims [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Claim successful on node user
Dec 01 19:28:37 user nova-compute[75066]: INFO nova.compute.resource_tracker [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Updating resource usage from migration 01d1f16f-013f-4fb4-baca-3d734eb87e84
Dec 01 19:28:38 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:28:38 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:28:38 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.684s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:28:38 user nova-compute[75066]: INFO nova.compute.manager [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Migrating
Dec 01 19:28:38 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Acquiring lock "refresh_cache-00506483-8f09-4a3d-938a-31ab1b2dbf83" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:28:38 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Acquired lock "refresh_cache-00506483-8f09-4a3d-938a-31ab1b2dbf83" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:28:38 user nova-compute[75066]: DEBUG nova.network.neutron [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:28:39 user nova-compute[75066]: DEBUG nova.network.neutron [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Updating instance_info_cache with network_info: [{"id": "b0528c8d-a14c-4420-a248-fda3f0a92893", "address": "fa:16:3e:a6:1a:51", "network": {"id": "9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-696310557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0f7516d1db4dd5bc7d77a0bd1d44d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0528c8d-a1", "ovs_interfaceid": "b0528c8d-a14c-4420-a248-fda3f0a92893", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:28:39 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Releasing lock "refresh_cache-00506483-8f09-4a3d-938a-31ab1b2dbf83" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:28:39 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Starting migrate_disk_and_power_off {{(pid=75066) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11481}}
Dec 01 19:28:39 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:28:39 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:28:39 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Acquiring lock "e84b8c28-e79e-4945-8f3c-dddd7184a166" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:28:39 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "e84b8c28-e79e-4945-8f3c-dddd7184a166" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:28:39 user nova-compute[75066]: INFO nova.compute.manager [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Unshelving
Dec 01 19:28:39 user nova-compute[75066]: DEBUG nova.compute.manager [req-b15ed84d-00c6-4d78-bec7-6660e34cec74 req-efc33fb3-6b9b-4862-a357-dde5979fca3b service nova] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Received event network-vif-unplugged-b0528c8d-a14c-4420-a248-fda3f0a92893 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:28:39 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-b15ed84d-00c6-4d78-bec7-6660e34cec74 req-efc33fb3-6b9b-4862-a357-dde5979fca3b service nova] Acquiring lock "00506483-8f09-4a3d-938a-31ab1b2dbf83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:28:39 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-b15ed84d-00c6-4d78-bec7-6660e34cec74 req-efc33fb3-6b9b-4862-a357-dde5979fca3b service nova] Lock "00506483-8f09-4a3d-938a-31ab1b2dbf83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:28:39 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-b15ed84d-00c6-4d78-bec7-6660e34cec74 req-efc33fb3-6b9b-4862-a357-dde5979fca3b service nova] Lock "00506483-8f09-4a3d-938a-31ab1b2dbf83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:28:39 user nova-compute[75066]: DEBUG nova.compute.manager [req-b15ed84d-00c6-4d78-bec7-6660e34cec74 req-efc33fb3-6b9b-4862-a357-dde5979fca3b service nova] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] No waiting events found dispatching network-vif-unplugged-b0528c8d-a14c-4420-a248-fda3f0a92893 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:28:39 user nova-compute[75066]: WARNING nova.compute.manager [req-b15ed84d-00c6-4d78-bec7-6660e34cec74 req-efc33fb3-6b9b-4862-a357-dde5979fca3b service nova] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Received unexpected event network-vif-unplugged-b0528c8d-a14c-4420-a248-fda3f0a92893 for instance with vm_state active and task_state resize_migrating.
Dec 01 19:28:39 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:28:39 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:28:39 user nova-compute[75066]: INFO nova.virt.block_device [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Booting with volume 6a9ece83-f1e6-4f8c-914e-85de45be4e1a at /dev/vdc
Dec 01 19:28:39 user nova-compute[75066]: DEBUG os_brick.utils [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:28:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:39 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f429ca-d372-44e3-902e-48c957900988]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1959854982f\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:39 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ffbd4d4-674d-4ddf-82c5-16b31a6c72a2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:39 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[7066bd9a-8cfd-41bf-9a02-ac7584f4e7f7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:39 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d409c12-c0f7-460a-b25d-41bd0dd04bb0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Running cmd (subprocess): nvme version {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] 'nvme version' failed. Not Retrying. {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] nvme not present on system {{(pid=75066) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:28:40 user nova-compute[75066]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 19:28:40 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d653098-8ad7-4a0a-afa8-c29cb0ae1f81]: (4, '') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75066) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] LIGHTOS: no hostnqn found. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG os_brick.utils [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1959854982f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG nova.virt.block_device [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Updating existing volume attachment record: afd2a25f-ae97-4683-9276-79d2959f3bd9 {{(pid=75066) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 19:28:40 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Instance destroyed successfully.
Dec 01 19:28:40 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:26:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1664862107',display_name='tempest-ServerActionsTestOtherA-server-1664862107',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1664862107',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAjcDJi5RJTCazFFAj7dx2qLuKSEoyASrqNDKgiQGRQPewzJhIu6lQd3yuH2207H2lpqZiyuqBj2lXvz5vQM52pZXpO90p/UH43nVMO2RrMH5S7NUl16+at0nkGQGj24ng==',key_name='tempest-keypair-1092575275',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:27:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fb0f7516d1db4dd5bc7d77a0bd1d44d7',ramdisk_id='',reservation_id='r-5u7ef9p2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1700253921',owner_user_name='tempest-ServerActionsTestOtherA-1700253921-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:28:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfb3e7b4b0444223af282b16da9bd919',uuid=00506483-8f09-4a3d-938a-31ab1b2dbf83,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b0528c8d-a14c-4420-a248-fda3f0a92893", "address": "fa:16:3e:a6:1a:51", "network": {"id": "9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-696310557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-696310557-network", "vif_mac": "fa:16:3e:a6:1a:51"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0f7516d1db4dd5bc7d77a0bd1d44d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0528c8d-a1", "ovs_interfaceid": "b0528c8d-a14c-4420-a248-fda3f0a92893", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Converting VIF {"id": "b0528c8d-a14c-4420-a248-fda3f0a92893", "address": "fa:16:3e:a6:1a:51", "network": {"id": "9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-696310557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-696310557-network", "vif_mac": "fa:16:3e:a6:1a:51"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0f7516d1db4dd5bc7d77a0bd1d44d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0528c8d-a1", "ovs_interfaceid": "b0528c8d-a14c-4420-a248-fda3f0a92893", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a6:1a:51,bridge_name='br-int',has_traffic_filtering=True,id=b0528c8d-a14c-4420-a248-fda3f0a92893,network=Network(9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0528c8d-a1') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG os_vif [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:1a:51,bridge_name='br-int',has_traffic_filtering=True,id=b0528c8d-a14c-4420-a248-fda3f0a92893,network=Network(9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0528c8d-a1') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb0528c8d-a1, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c5cfd9ff-8bba-4b36-9e9e-8e86dfbcea05) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:28:40 user nova-compute[75066]: INFO os_vif [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:1a:51,bridge_name='br-int',has_traffic_filtering=True,id=b0528c8d-a14c-4420-a248-fda3f0a92893,network=Network(9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0528c8d-a1')
Dec 01 19:28:40 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] calling os-brick to detach iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, {'target_iqn': 'iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gLtkPwAS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:28:40 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:28:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b86823a-3759-42d8-a6cc-e7363c0067fb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 19:28:40 user nova-compute[75066]: No targets found.
Dec 01 19:28:40 user nova-compute[75066]: iSNS:
Dec 01 19:28:40 user nova-compute[75066]: No targets found.
Dec 01 19:28:40 user nova-compute[75066]: STATIC:
Dec 01 19:28:40 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0
Dec 01 19:28:40 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:28:40 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:28:40 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9
Dec 01 19:28:40 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:28:40 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:28:40 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567
Dec 01 19:28:40 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:28:40 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:28:40 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f
Dec 01 19:28:40 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:28:40 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:28:40 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb
Dec 01 19:28:40 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:28:40 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:28:40 user nova-compute[75066]: FIRMWARE:
Dec 01 19:28:40 user nova-compute[75066]: No targets found.
Dec 01 19:28:40 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 19:28:40 user nova-compute[75066]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 19:28:40 user nova-compute[75066]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75066) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9', 0)] {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[0769a4b7-f5a7-4afa-aa08-42264187ac82]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2164aa3-53e1-4351-8694-a50e3d2ad412]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:28:40 user nova-compute[75066]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)
Dec 01 19:28:40 user nova-compute[75066]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)
Dec 01 19:28:40 user nova-compute[75066]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567 (non-flash)
Dec 01 19:28:40 user nova-compute[75066]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f (non-flash)
Dec 01 19:28:40 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:28:40 user nova-compute[75066]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)
Dec 01 19:28:40 user nova-compute[75066]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)
Dec 01 19:28:40 user nova-compute[75066]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567 (non-flash)
Dec 01 19:28:40 user nova-compute[75066]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f (non-flash)
Dec 01 19:28:40 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9190551000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9'): ({'sdd'}, set())}) {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Removing single pathed devices sdd {{(pid=75066) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[93526b81-e39b-4cdf-89e7-4a68c766882d]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[d415181a-2768-43bb-a375-4718f46c10de]: (4, ('ok\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Flushing IO for device /dev/sdd {{(pid=75066) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[6513be79-3281-4ea7-921f-9d7f3b027572]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75066) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.058s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[01fa4719-39a1-4986-99eb-ef08b051c401]: (4, ('1', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] SCSI volumes sdd have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_2fe16681', '/dev/disk/by-id/scsi-1SCST_BIO2fe16681-ce282d8c7df6b6a0', '/dev/disk/by-id/scsi-26365323832643863') {{(pid=86136) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Dec 01 19:28:40 user nova-compute[75066]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_2fe16681
Dec 01 19:28:40 user nova-compute[75066]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO2fe16681-ce282d8c7df6b6a0
Dec 01 19:28:40 user nova-compute[75066]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26365323832643863
Dec 01 19:28:40 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e60b895-2b91-4adc-b087-8a0b181ad9cd]: (4, None) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9')] {{(pid=75066) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a96a379-583f-472e-ac54-b113da44548d]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 -p 172.16.0.220:3260 --logout {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c739c7-71ce-4244-aea8-f3c7cc2e4101]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9, portal: 172.16.0.220,3260]
Dec 01 19:28:40 user nova-compute[75066]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9, portal: 172.16.0.220,3260] successful.
Dec 01 19:28:40 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 -p 172.16.0.220:3260 --op delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[216bf903-0f3b-4b38-b3db-e8be58e2aefc]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.384s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] <== disconnect_volume: return (387ms) None {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Disconnected iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 19:28:40 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:28:41 user nova-compute[75066]: DEBUG nova.compute.manager [req-776b3f9b-f03a-491a-bd0e-13ab901de6e9 req-f23c0084-71c7-41c6-807d-09cc40b1cae8 service nova] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Received event network-vif-plugged-b0528c8d-a14c-4420-a248-fda3f0a92893 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:28:41 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-776b3f9b-f03a-491a-bd0e-13ab901de6e9 req-f23c0084-71c7-41c6-807d-09cc40b1cae8 service nova] Acquiring lock "00506483-8f09-4a3d-938a-31ab1b2dbf83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:28:41 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-776b3f9b-f03a-491a-bd0e-13ab901de6e9 req-f23c0084-71c7-41c6-807d-09cc40b1cae8 service nova] Lock "00506483-8f09-4a3d-938a-31ab1b2dbf83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:28:41 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-776b3f9b-f03a-491a-bd0e-13ab901de6e9 req-f23c0084-71c7-41c6-807d-09cc40b1cae8 service nova] Lock "00506483-8f09-4a3d-938a-31ab1b2dbf83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:28:41 user nova-compute[75066]: DEBUG nova.compute.manager [req-776b3f9b-f03a-491a-bd0e-13ab901de6e9 req-f23c0084-71c7-41c6-807d-09cc40b1cae8 service nova] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] No waiting events found dispatching network-vif-plugged-b0528c8d-a14c-4420-a248-fda3f0a92893 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:28:41 user nova-compute[75066]: WARNING nova.compute.manager [req-776b3f9b-f03a-491a-bd0e-13ab901de6e9 req-f23c0084-71c7-41c6-807d-09cc40b1cae8 service nova] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Received unexpected event network-vif-plugged-b0528c8d-a14c-4420-a248-fda3f0a92893 for instance with vm_state active and task_state resize_migrating.
Dec 01 19:28:45 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:28:47 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:28:49 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-bcb35b1e-55ae-478c-8b06-efe254633f0c tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3b355778-bd25-42f6-8026-110668920d8b is timed out.
Dec 01 19:28:49 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-bcb35b1e-55ae-478c-8b06-efe254633f0c tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Successfully detached device vdb from instance 3b355778-bd25-42f6-8026-110668920d8b from the live domain config.
Dec 01 19:28:49 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bcb35b1e-55ae-478c-8b06-efe254633f0c tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: 3b355778-bd25-42f6-8026-110668920d8b] calling os-brick to detach iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 19:28:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcb35b1e-55ae-478c-8b06-efe254633f0c tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, {'target_iqn': 'iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jwYhkKmT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:28:49 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-bcb35b1e-55ae-478c-8b06-efe254633f0c tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:28:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-bcb35b1e-55ae-478c-8b06-efe254633f0c tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:28:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-bcb35b1e-55ae-478c-8b06-efe254633f0c tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:28:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:49 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca18f14d-5247-47e3-9efa-24339c938a43]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcb35b1e-55ae-478c-8b06-efe254633f0c tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 19:28:49 user nova-compute[75066]: No targets found.
Dec 01 19:28:49 user nova-compute[75066]: iSNS:
Dec 01 19:28:49 user nova-compute[75066]: No targets found.
Dec 01 19:28:49 user nova-compute[75066]: STATIC:
Dec 01 19:28:49 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0
Dec 01 19:28:49 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:28:49 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:28:49 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567
Dec 01 19:28:49 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:28:49 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:28:49 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f
Dec 01 19:28:49 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:28:49 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:28:49 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb
Dec 01 19:28:49 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:28:49 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:28:49 user nova-compute[75066]: FIRMWARE:
Dec 01 19:28:49 user nova-compute[75066]: No targets found.
Dec 01 19:28:49 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:28:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcb35b1e-55ae-478c-8b06-efe254633f0c tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 19:28:49 user nova-compute[75066]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 19:28:49 user nova-compute[75066]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75066) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 19:28:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcb35b1e-55ae-478c-8b06-efe254633f0c tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567', 0)] {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 19:28:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:49 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[20824920-11df-4d00-9e72-b55fc092a8fc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:49 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9eec7cb-5dc2-4e98-af09-315a0ef06faa]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcb35b1e-55ae-478c-8b06-efe254633f0c tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:28:49 user nova-compute[75066]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)
Dec 01 19:28:49 user nova-compute[75066]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567 (non-flash)
Dec 01 19:28:49 user nova-compute[75066]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f (non-flash)
Dec 01 19:28:49 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:28:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcb35b1e-55ae-478c-8b06-efe254633f0c tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:28:49 user nova-compute[75066]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)
Dec 01 19:28:49 user nova-compute[75066]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567 (non-flash)
Dec 01 19:28:49 user nova-compute[75066]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f (non-flash)
Dec 01 19:28:49 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:28:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcb35b1e-55ae-478c-8b06-efe254633f0c tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9190175990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567'): ({'sde'}, set())}) {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 19:28:49 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-bcb35b1e-55ae-478c-8b06-efe254633f0c tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Removing single pathed devices sde {{(pid=75066) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 19:28:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:49 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[422ef5c8-5ba5-4f24-b6a0-75ae2a981b66]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:49 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a28721b-7591-4de0-a42d-f11aa8d070f9]: (4, ('ok\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:49 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-bcb35b1e-55ae-478c-8b06-efe254633f0c tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Flushing IO for device /dev/sde {{(pid=75066) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 19:28:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:49 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[476b953f-a06e-4534-a99f-97b5774842cb]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:49 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-bcb35b1e-55ae-478c-8b06-efe254633f0c tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75066) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 19:28:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.053s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:49 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[534c223c-2fb3-44fd-bc1d-31a61ebfee44]: (4, ('1', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:49 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-bcb35b1e-55ae-478c-8b06-efe254633f0c tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 19:28:49 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-bcb35b1e-55ae-478c-8b06-efe254633f0c tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] SCSI volumes sde have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 19:28:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcb35b1e-55ae-478c-8b06-efe254633f0c tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567')] {{(pid=75066) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 19:28:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:49 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a432a15-209e-4b55-82b9-20e03d88697e]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcb35b1e-55ae-478c-8b06-efe254633f0c tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:28:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567 -p 172.16.0.220:3260 --logout {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:49 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12df47a-4362-4275-bad5-508d1004fd4b]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcb35b1e-55ae-478c-8b06-efe254633f0c tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567, portal: 172.16.0.220,3260]
Dec 01 19:28:49 user nova-compute[75066]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567, portal: 172.16.0.220,3260] successful.
Dec 01 19:28:49 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:28:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567 -p 172.16.0.220:3260 --op delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f817b8a7-1ac5-43d3-a87f-51e048c26567 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:49 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b0f5ce8-c089-4112-8a83-23574f41fcfd]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcb35b1e-55ae-478c-8b06-efe254633f0c tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:28:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-bcb35b1e-55ae-478c-8b06-efe254633f0c tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:28:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcb35b1e-55ae-478c-8b06-efe254633f0c tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] <== disconnect_volume: return (325ms) None {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:28:49 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bcb35b1e-55ae-478c-8b06-efe254633f0c tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Disconnected iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 19:28:50 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:28:50 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:28:50 user nova-compute[75066]: DEBUG nova.objects.instance [None req-bcb35b1e-55ae-478c-8b06-efe254633f0c tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lazy-loading 'flavor' on Instance uuid 3b355778-bd25-42f6-8026-110668920d8b {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:28:50 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-bcb35b1e-55ae-478c-8b06-efe254633f0c tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "3b355778-bd25-42f6-8026-110668920d8b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.003s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:28:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-94d6f90c-d253-4eb6-8a0f-01e826a5b7e2 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Acquiring lock "3b355778-bd25-42f6-8026-110668920d8b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:28:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-94d6f90c-d253-4eb6-8a0f-01e826a5b7e2 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "3b355778-bd25-42f6-8026-110668920d8b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:28:51 user nova-compute[75066]: INFO nova.compute.manager [None req-94d6f90c-d253-4eb6-8a0f-01e826a5b7e2 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Detaching volume 1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f
Dec 01 19:28:51 user nova-compute[75066]: INFO nova.virt.block_device [None req-94d6f90c-d253-4eb6-8a0f-01e826a5b7e2 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Attempting to driver detach volume 1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f from mountpoint /dev/vdc
Dec 01 19:28:51 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-94d6f90c-d253-4eb6-8a0f-01e826a5b7e2 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Attempting to detach device vdc from instance 3b355778-bd25-42f6-8026-110668920d8b from the persistent domain config. {{(pid=75066) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 19:28:51 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-94d6f90c-d253-4eb6-8a0f-01e826a5b7e2 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 19:28:51 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:28:51 user nova-compute[75066]:   <source dev="/dev/sdg"/>
Dec 01 19:28:51 user nova-compute[75066]:   <target dev="vdc" bus="virtio"/>
Dec 01 19:28:51 user nova-compute[75066]:   <serial>1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f</serial>
Dec 01 19:28:51 user nova-compute[75066]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Dec 01 19:28:51 user nova-compute[75066]: </disk>
Dec 01 19:28:51 user nova-compute[75066]:  {{(pid=75066) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 19:28:51 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-94d6f90c-d253-4eb6-8a0f-01e826a5b7e2 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Successfully detached device vdc from instance 3b355778-bd25-42f6-8026-110668920d8b from the persistent domain config.
Dec 01 19:28:51 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-94d6f90c-d253-4eb6-8a0f-01e826a5b7e2 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 3b355778-bd25-42f6-8026-110668920d8b from the live domain config. {{(pid=75066) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 19:28:51 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-94d6f90c-d253-4eb6-8a0f-01e826a5b7e2 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 19:28:51 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:28:51 user nova-compute[75066]:   <source dev="/dev/sdg"/>
Dec 01 19:28:51 user nova-compute[75066]:   <target dev="vdc" bus="virtio"/>
Dec 01 19:28:51 user nova-compute[75066]:   <serial>1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f</serial>
Dec 01 19:28:51 user nova-compute[75066]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Dec 01 19:28:51 user nova-compute[75066]: </disk>
Dec 01 19:28:51 user nova-compute[75066]:  {{(pid=75066) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 19:28:51 user nova-compute[75066]: DEBUG nova.network.neutron [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Port b0528c8d-a14c-4420-a248-fda3f0a92893 binding to destination host user is already ACTIVE {{(pid=75066) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Dec 01 19:28:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Acquiring lock "00506483-8f09-4a3d-938a-31ab1b2dbf83-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:28:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "00506483-8f09-4a3d-938a-31ab1b2dbf83-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:28:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "00506483-8f09-4a3d-938a-31ab1b2dbf83-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:28:51 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-94d6f90c-d253-4eb6-8a0f-01e826a5b7e2 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 3b355778-bd25-42f6-8026-110668920d8b {{(pid=75066) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 19:28:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Acquiring lock "refresh_cache-00506483-8f09-4a3d-938a-31ab1b2dbf83" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:28:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Acquired lock "refresh_cache-00506483-8f09-4a3d-938a-31ab1b2dbf83" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:28:51 user nova-compute[75066]: DEBUG nova.network.neutron [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:28:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:28:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:28:51 user nova-compute[75066]: DEBUG nova.objects.instance [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lazy-loading 'pci_requests' on Instance uuid e84b8c28-e79e-4945-8f3c-dddd7184a166 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:28:51 user nova-compute[75066]: DEBUG nova.objects.instance [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lazy-loading 'numa_topology' on Instance uuid e84b8c28-e79e-4945-8f3c-dddd7184a166 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:28:51 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75066) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 19:28:51 user nova-compute[75066]: INFO nova.compute.claims [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Claim successful on node user
Dec 01 19:28:52 user nova-compute[75066]: DEBUG nova.network.neutron [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Updating instance_info_cache with network_info: [{"id": "b0528c8d-a14c-4420-a248-fda3f0a92893", "address": "fa:16:3e:a6:1a:51", "network": {"id": "9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-696310557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0f7516d1db4dd5bc7d77a0bd1d44d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0528c8d-a1", "ovs_interfaceid": "b0528c8d-a14c-4420-a248-fda3f0a92893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:28:52 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Releasing lock "refresh_cache-00506483-8f09-4a3d-938a-31ab1b2dbf83" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:28:52 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:28:52 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:28:52 user nova-compute[75066]: DEBUG os_brick.utils [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:28:52 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:52 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.587s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:28:52 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:52 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[2705b650-dfa5-40eb-9cc6-f141b87966cf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1959854982f\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:52 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:52 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:52 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6954460-4c4c-4456-a839-0a3af4ab645d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:52 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:52 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:52 user nova-compute[75066]: INFO nova.network.neutron [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Updating port abe9d4d1-5a93-4071-bb76-8723bf6ec62c with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Dec 01 19:28:52 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e7bb9a-d53f-4b0e-a9c4-9819bfb56c42]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:52 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c47d286-a8dd-415c-853c-e1758af6bbbf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:52 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Running cmd (subprocess): nvme version {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:52 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] 'nvme version' failed. Not Retrying. {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:28:52 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] nvme not present on system {{(pid=75066) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 19:28:52 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:52 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:28:52 user nova-compute[75066]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 19:28:52 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[99655e02-5273-433a-a22e-914b9f6cc007]: (4, '') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:28:52 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75066) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 19:28:52 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 19:28:52 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] LIGHTOS: no hostnqn found. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 19:28:52 user nova-compute[75066]: DEBUG os_brick.utils [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1959854982f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:28:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:28:53 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Acquiring lock "refresh_cache-e84b8c28-e79e-4945-8f3c-dddd7184a166" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:28:53 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Acquired lock "refresh_cache-e84b8c28-e79e-4945-8f3c-dddd7184a166" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:28:53 user nova-compute[75066]: DEBUG nova.network.neutron [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:28:53 user nova-compute[75066]: DEBUG nova.compute.manager [req-b0bae0b2-2878-4f6e-bc9e-977b2e4213af req-c91f619e-33dd-4c43-a0ba-53c2ffcf5703 service nova] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Received event network-changed-abe9d4d1-5a93-4071-bb76-8723bf6ec62c {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:28:53 user nova-compute[75066]: DEBUG nova.compute.manager [req-b0bae0b2-2878-4f6e-bc9e-977b2e4213af req-c91f619e-33dd-4c43-a0ba-53c2ffcf5703 service nova] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Refreshing instance network info cache due to event network-changed-abe9d4d1-5a93-4071-bb76-8723bf6ec62c. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:28:53 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-b0bae0b2-2878-4f6e-bc9e-977b2e4213af req-c91f619e-33dd-4c43-a0ba-53c2ffcf5703 service nova] Acquiring lock "refresh_cache-e84b8c28-e79e-4945-8f3c-dddd7184a166" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:28:53 user nova-compute[75066]: DEBUG nova.network.neutron [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Updating instance_info_cache with network_info: [{"id": "abe9d4d1-5a93-4071-bb76-8723bf6ec62c", "address": "fa:16:3e:8c:32:99", "network": {"id": "49dd72ae-ec07-46a6-8463-e38bdfe1eba0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-738739404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879678dca7054c178839f56e66a6e0ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabe9d4d1-5a", "ovs_interfaceid": "abe9d4d1-5a93-4071-bb76-8723bf6ec62c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:28:53 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Releasing lock "refresh_cache-e84b8c28-e79e-4945-8f3c-dddd7184a166" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:28:53 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Creating instance directory {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 19:28:53 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Creating image(s)
Dec 01 19:28:53 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Acquiring lock "/opt/stack/data/nova/instances/e84b8c28-e79e-4945-8f3c-dddd7184a166/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:28:53 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "/opt/stack/data/nova/instances/e84b8c28-e79e-4945-8f3c-dddd7184a166/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:28:53 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "/opt/stack/data/nova/instances/e84b8c28-e79e-4945-8f3c-dddd7184a166/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:28:53 user nova-compute[75066]: DEBUG nova.objects.instance [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lazy-loading 'trusted_certs' on Instance uuid e84b8c28-e79e-4945-8f3c-dddd7184a166 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:28:53 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-b0bae0b2-2878-4f6e-bc9e-977b2e4213af req-c91f619e-33dd-4c43-a0ba-53c2ffcf5703 service nova] Acquired lock "refresh_cache-e84b8c28-e79e-4945-8f3c-dddd7184a166" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:28:53 user nova-compute[75066]: DEBUG nova.network.neutron [req-b0bae0b2-2878-4f6e-bc9e-977b2e4213af req-c91f619e-33dd-4c43-a0ba-53c2ffcf5703 service nova] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Refreshing network info cache for port abe9d4d1-5a93-4071-bb76-8723bf6ec62c {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:28:53 user nova-compute[75066]: DEBUG nova.objects.base [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Object Instance<e84b8c28-e79e-4945-8f3c-dddd7184a166> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75066) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 19:28:53 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Acquiring lock "0d416c5251b32eed450ffc84216db80ae55b05e6" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:28:53 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "0d416c5251b32eed450ffc84216db80ae55b05e6" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:28:54 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d416c5251b32eed450ffc84216db80ae55b05e6.part --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:55 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d416c5251b32eed450ffc84216db80ae55b05e6.part --force-share --output=json" returned: 0 in 0.184s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:55 user nova-compute[75066]: DEBUG nova.virt.images [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] b0e48ac0-30b0-46dc-9f72-44b9b4336892 was qcow2, converting to raw {{(pid=75066) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 01 19:28:55 user nova-compute[75066]: DEBUG nova.privsep.utils [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75066) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 01 19:28:55 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0d416c5251b32eed450ffc84216db80ae55b05e6.part /opt/stack/data/nova/instances/_base/0d416c5251b32eed450ffc84216db80ae55b05e6.converted {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:55 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:28:55 user nova-compute[75066]: DEBUG nova.network.neutron [req-b0bae0b2-2878-4f6e-bc9e-977b2e4213af req-c91f619e-33dd-4c43-a0ba-53c2ffcf5703 service nova] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Updated VIF entry in instance network info cache for port abe9d4d1-5a93-4071-bb76-8723bf6ec62c. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:28:55 user nova-compute[75066]: DEBUG nova.network.neutron [req-b0bae0b2-2878-4f6e-bc9e-977b2e4213af req-c91f619e-33dd-4c43-a0ba-53c2ffcf5703 service nova] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Updating instance_info_cache with network_info: [{"id": "abe9d4d1-5a93-4071-bb76-8723bf6ec62c", "address": "fa:16:3e:8c:32:99", "network": {"id": "49dd72ae-ec07-46a6-8463-e38bdfe1eba0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-738739404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879678dca7054c178839f56e66a6e0ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabe9d4d1-5a", "ovs_interfaceid": "abe9d4d1-5a93-4071-bb76-8723bf6ec62c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:28:55 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-b0bae0b2-2878-4f6e-bc9e-977b2e4213af req-c91f619e-33dd-4c43-a0ba-53c2ffcf5703 service nova] Releasing lock "refresh_cache-e84b8c28-e79e-4945-8f3c-dddd7184a166" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:28:55 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0d416c5251b32eed450ffc84216db80ae55b05e6.part /opt/stack/data/nova/instances/_base/0d416c5251b32eed450ffc84216db80ae55b05e6.converted" returned: 0 in 0.531s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:55 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d416c5251b32eed450ffc84216db80ae55b05e6.converted --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:55 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d416c5251b32eed450ffc84216db80ae55b05e6.converted --force-share --output=json" returned: 0 in 0.190s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:55 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "0d416c5251b32eed450ffc84216db80ae55b05e6" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.064s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:28:55 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d416c5251b32eed450ffc84216db80ae55b05e6 --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:56 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d416c5251b32eed450ffc84216db80ae55b05e6 --force-share --output=json" returned: 0 in 0.200s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Acquiring lock "0d416c5251b32eed450ffc84216db80ae55b05e6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:28:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "0d416c5251b32eed450ffc84216db80ae55b05e6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:28:56 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d416c5251b32eed450ffc84216db80ae55b05e6 --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:56 user nova-compute[75066]: DEBUG nova.compute.manager [None req-c4c52f2c-71df-41af-abc9-a7372401b763 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:28:56 user nova-compute[75066]: INFO nova.compute.manager [None req-c4c52f2c-71df-41af-abc9-a7372401b763 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] instance snapshotting
Dec 01 19:28:56 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d416c5251b32eed450ffc84216db80ae55b05e6 --force-share --output=json" returned: 0 in 0.196s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:56 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d416c5251b32eed450ffc84216db80ae55b05e6,backing_fmt=raw /opt/stack/data/nova/instances/e84b8c28-e79e-4945-8f3c-dddd7184a166/disk 1073741824 {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:56 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d416c5251b32eed450ffc84216db80ae55b05e6,backing_fmt=raw /opt/stack/data/nova/instances/e84b8c28-e79e-4945-8f3c-dddd7184a166/disk 1073741824" returned: 0 in 0.051s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "0d416c5251b32eed450ffc84216db80ae55b05e6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:28:56 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d416c5251b32eed450ffc84216db80ae55b05e6 --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:56 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-c4c52f2c-71df-41af-abc9-a7372401b763 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Beginning live snapshot process
Dec 01 19:28:56 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d416c5251b32eed450ffc84216db80ae55b05e6 --force-share --output=json" returned: 0 in 0.182s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:56 user nova-compute[75066]: DEBUG nova.objects.instance [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lazy-loading 'migration_context' on Instance uuid e84b8c28-e79e-4945-8f3c-dddd7184a166 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:28:56 user nova-compute[75066]: DEBUG nova.objects.base [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Object Instance<e84b8c28-e79e-4945-8f3c-dddd7184a166> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75066) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 19:28:56 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Rebasing disk image.
Dec 01 19:28:56 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:56 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-c4c52f2c-71df-41af-abc9-a7372401b763 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298/disk --force-share --output=json -f qcow2 {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:56 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.234s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:56 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d -F raw /opt/stack/data/nova/instances/e84b8c28-e79e-4945-8f3c-dddd7184a166/disk {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:56 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-c4c52f2c-71df-41af-abc9-a7372401b763 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298/disk --force-share --output=json -f qcow2" returned: 0 in 0.216s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:56 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-c4c52f2c-71df-41af-abc9-a7372401b763 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298/disk --force-share --output=json -f qcow2 {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:56 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-c4c52f2c-71df-41af-abc9-a7372401b763 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298/disk --force-share --output=json -f qcow2" returned: 0 in 0.179s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:56 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-c4c52f2c-71df-41af-abc9-a7372401b763 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-c4c52f2c-71df-41af-abc9-a7372401b763 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.196s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-c4c52f2c-71df-41af-abc9-a7372401b763 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpb84errow/5a62a12546104114ac76f2d964d7c8d2.delta 1073741824 {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:28:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-c4c52f2c-71df-41af-abc9-a7372401b763 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpb84errow/5a62a12546104114ac76f2d964d7c8d2.delta 1073741824" returned: 0 in 0.054s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:28:57 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-c4c52f2c-71df-41af-abc9-a7372401b763 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Quiescing instance not available: QEMU guest agent is not enabled.
Dec 01 19:28:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:28:57 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-c4c52f2c-71df-41af-abc9-a7372401b763 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] COPY block job progress, current cursor: 524288 final cursor: 75497472 {{(pid=75066) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 19:28:58 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-c4c52f2c-71df-41af-abc9-a7372401b763 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75066) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Dec 01 19:28:58 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-c4c52f2c-71df-41af-abc9-a7372401b763 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Skipping quiescing instance: QEMU guest agent is not enabled.
Dec 01 19:28:59 user nova-compute[75066]: DEBUG nova.privsep.utils [None req-c4c52f2c-71df-41af-abc9-a7372401b763 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75066) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 01 19:28:59 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-c4c52f2c-71df-41af-abc9-a7372401b763 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpb84errow/5a62a12546104114ac76f2d964d7c8d2.delta /opt/stack/data/nova/instances/snapshots/tmpb84errow/5a62a12546104114ac76f2d964d7c8d2 {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-c4c52f2c-71df-41af-abc9-a7372401b763 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpb84errow/5a62a12546104114ac76f2d964d7c8d2.delta /opt/stack/data/nova/instances/snapshots/tmpb84errow/5a62a12546104114ac76f2d964d7c8d2" returned: 0 in 1.087s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:00 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-c4c52f2c-71df-41af-abc9-a7372401b763 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Snapshot extracted, beginning image upload
Dec 01 19:29:00 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d -F raw /opt/stack/data/nova/instances/e84b8c28-e79e-4945-8f3c-dddd7184a166/disk" returned: 0 in 3.689s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Created local disks {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Ensure instance console log exists: /opt/stack/data/nova/instances/e84b8c28-e79e-4945-8f3c-dddd7184a166/console.log {{(pid=75066) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Start _get_guest_xml network_info=[{"id": "abe9d4d1-5a93-4071-bb76-8723bf6ec62c", "address": "fa:16:3e:8c:32:99", "network": {"id": "49dd72ae-ec07-46a6-8463-e38bdfe1eba0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-738739404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879678dca7054c178839f56e66a6e0ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabe9d4d1-5a", "ovs_interfaceid": "abe9d4d1-5a93-4071-bb76-8723bf6ec62c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='add8cfdfc40bc08d5f65a5d74e61d76b',container_format='bare',created_at=2023-12-01T19:26:47Z,direct_url=<?>,disk_format='qcow2',id=b0e48ac0-30b0-46dc-9f72-44b9b4336892,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-496690915-shelved',owner='879678dca7054c178839f56e66a6e0ce',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-12-01T19:26:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'image_id': '900b237b-e99c-4fdd-a44f-dcb7a08baa86'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'mount_device': '/dev/vdc', 'guest_format': None, 'delete_on_termination': False, 'attachment_id': 'afd2a25f-ae97-4683-9276-79d2959f3bd9', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jzdkhQag', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'e84b8c28-e79e-4945-8f3c-dddd7184a166', 'attached_at': '', 'detached_at': '', 'volume_id': '6a9ece83-f1e6-4f8c-914e-85de45be4e1a', 'serial': '6a9ece83-f1e6-4f8c-914e-85de45be4e1a'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:29:00 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:29:00 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:29:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='add8cfdfc40bc08d5f65a5d74e61d76b',container_format='bare',created_at=2023-12-01T19:26:47Z,direct_url=<?>,disk_format='qcow2',id=b0e48ac0-30b0-46dc-9f72-44b9b4336892,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-496690915-shelved',owner='879678dca7054c178839f56e66a6e0ce',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-12-01T19:26:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG nova.objects.instance [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lazy-loading 'vcpu_model' on Instance uuid e84b8c28-e79e-4945-8f3c-dddd7184a166 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG nova.objects.base [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Object Instance<e84b8c28-e79e-4945-8f3c-dddd7184a166> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75066) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Calling os-brick to attach iSCSI Volume {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jzdkhQag', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:29:00 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:29:00 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:29:00 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:29:00 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:29:00 user nova-compute[75066]: INFO os_brick.initiator.connectors.iscsi [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 19:29:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a -p 172.16.0.220:3260 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a -p 172.16.0.220:3260" returned: 21 in 0.040s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[c07dfb3e-abed-4850-bb0f-bb69e4b3802b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 19:29:00 user nova-compute[75066]:  {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a -p 172.16.0.220:3260 --interface default --op new {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e8453e-6eb7-4209-b83b-62bb9e3adec4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a] added\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a] added
Dec 01 19:29:00 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d33e2e-89b2-47ef-9f8f-bfb964433433]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c325ab1-5975-4f81-8d90-ea585f96b822]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jzdkhQag {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jzdkhQag" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f49834-2788-4ed0-a9cf-38f231bc82c7]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jzdkhQag'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1cae191-7ab1-4695-98a0-31824001dab5]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[675ff7ad-ec91-491c-b747-adfc6d290a99]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:29:00 user nova-compute[75066]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)
Dec 01 19:29:00 user nova-compute[75066]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f (non-flash)
Dec 01 19:29:00 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:29:00 user nova-compute[75066]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)
Dec 01 19:29:00 user nova-compute[75066]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f (non-flash)
Dec 01 19:29:00 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a -p 172.16.0.220:3260 --login {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59b964c-43ee-4282-9671-b368c0ae265d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a, portal: 172.16.0.220,3260]
Dec 01 19:29:00 user nova-compute[75066]: Login to [iface: default, target: iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a, portal: 172.16.0.220,3260] successful.
Dec 01 19:29:00 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaab99e0-57ba-410d-9dd7-cb039569f2c7]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[504d842e-b7a3-4757-8a91-89342ef69ab9]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:29:00 user nova-compute[75066]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)
Dec 01 19:29:00 user nova-compute[75066]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f (non-flash)
Dec 01 19:29:00 user nova-compute[75066]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a (non-flash)
Dec 01 19:29:00 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:29:00 user nova-compute[75066]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)
Dec 01 19:29:00 user nova-compute[75066]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f (non-flash)
Dec 01 19:29:00 user nova-compute[75066]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a (non-flash)
Dec 01 19:29:00 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Connected to 172.16.0.220:3260 {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] HCTL ('34', '-', '-', 0) found on session 36 with lun 0 {{(pid=75066) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75066) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1242da3-e7d1-43c6-bbae-51a850009a4a]: (4, ('- - 0', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:29:00 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jzdkhQag', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 19:29:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-407fa32e-4da0-4eb5-8350-c77a7d0ec443 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Acquiring lock "391945f6-fe47-4969-a497-bd320d66cfa3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:29:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-407fa32e-4da0-4eb5-8350-c77a7d0ec443 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Lock "391945f6-fe47-4969-a497-bd320d66cfa3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:29:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-407fa32e-4da0-4eb5-8350-c77a7d0ec443 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Acquiring lock "391945f6-fe47-4969-a497-bd320d66cfa3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:29:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-407fa32e-4da0-4eb5-8350-c77a7d0ec443 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Lock "391945f6-fe47-4969-a497-bd320d66cfa3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:29:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-407fa32e-4da0-4eb5-8350-c77a7d0ec443 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Lock "391945f6-fe47-4969-a497-bd320d66cfa3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:29:01 user nova-compute[75066]: INFO nova.compute.manager [None req-407fa32e-4da0-4eb5-8350-c77a7d0ec443 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Terminating instance
Dec 01 19:29:01 user nova-compute[75066]: DEBUG nova.compute.manager [None req-407fa32e-4da0-4eb5-8350-c77a7d0ec443 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Start destroying the instance on the hypervisor. {{(pid=75066) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 19:29:01 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:01 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:01 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:01 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:01 user nova-compute[75066]: DEBUG nova.compute.manager [req-5c8589b0-9194-4d6c-9239-9e920b301701 req-ec69a5a4-e9af-4ee7-9b94-1ba5bbf30e0a service nova] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Received event network-vif-unplugged-e5f3728a-541f-4b95-9feb-6119687f2eba {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:29:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-5c8589b0-9194-4d6c-9239-9e920b301701 req-ec69a5a4-e9af-4ee7-9b94-1ba5bbf30e0a service nova] Acquiring lock "391945f6-fe47-4969-a497-bd320d66cfa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:29:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-5c8589b0-9194-4d6c-9239-9e920b301701 req-ec69a5a4-e9af-4ee7-9b94-1ba5bbf30e0a service nova] Lock "391945f6-fe47-4969-a497-bd320d66cfa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:29:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-5c8589b0-9194-4d6c-9239-9e920b301701 req-ec69a5a4-e9af-4ee7-9b94-1ba5bbf30e0a service nova] Lock "391945f6-fe47-4969-a497-bd320d66cfa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:29:01 user nova-compute[75066]: DEBUG nova.compute.manager [req-5c8589b0-9194-4d6c-9239-9e920b301701 req-ec69a5a4-e9af-4ee7-9b94-1ba5bbf30e0a service nova] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] No waiting events found dispatching network-vif-unplugged-e5f3728a-541f-4b95-9feb-6119687f2eba {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:29:01 user nova-compute[75066]: DEBUG nova.compute.manager [req-5c8589b0-9194-4d6c-9239-9e920b301701 req-ec69a5a4-e9af-4ee7-9b94-1ba5bbf30e0a service nova] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Received event network-vif-unplugged-e5f3728a-541f-4b95-9feb-6119687f2eba for instance with task_state deleting. {{(pid=75066) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 19:29:01 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.388s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:29:01 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] <== connect_volume: return (1389ms) {'type': 'block', 'scsi_wwn': '23738396131376636', 'path': '/dev/sdc'} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:29:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23738396131376636', 'path': '/dev/sdc'} {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 19:29:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-01T19:24:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-496690915',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-496690915',id=24,image_ref='b0e48ac0-30b0-46dc-9f72-44b9b4336892',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-20573267',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:24:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='879678dca7054c178839f56e66a6e0ce',ramdisk_id='',reservation_id='r-frzqz3qo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1680443764',owner_user_name='tempest-AttachVolumeShelveTestJSON-1680443764-project-member',shelved_at='2023-12-01T19:26:50.693576',shelved_host='user',shelved_image_id='b0e48ac0-30b0-46dc-9f72-44b9b4336892'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:28:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90e207044c0741e99c4a83b2c4746cd3',uuid=e84b8c28-e79e-4945-8f3c-dddd7184a166,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "abe9d4d1-5a93-4071-bb76-8723bf6ec62c", "address": "fa:16:3e:8c:32:99", "network": {"id": "49dd72ae-ec07-46a6-8463-e38bdfe1eba0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-738739404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879678dca7054c178839f56e66a6e0ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabe9d4d1-5a", "ovs_interfaceid": "abe9d4d1-5a93-4071-bb76-8723bf6ec62c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:29:01 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Converting VIF {"id": "abe9d4d1-5a93-4071-bb76-8723bf6ec62c", "address": "fa:16:3e:8c:32:99", "network": {"id": "49dd72ae-ec07-46a6-8463-e38bdfe1eba0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-738739404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879678dca7054c178839f56e66a6e0ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabe9d4d1-5a", "ovs_interfaceid": "abe9d4d1-5a93-4071-bb76-8723bf6ec62c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:29:01 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:32:99,bridge_name='br-int',has_traffic_filtering=True,id=abe9d4d1-5a93-4071-bb76-8723bf6ec62c,network=Network(49dd72ae-ec07-46a6-8463-e38bdfe1eba0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabe9d4d1-5a') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:29:01 user nova-compute[75066]: DEBUG nova.objects.instance [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lazy-loading 'pci_devices' on Instance uuid e84b8c28-e79e-4945-8f3c-dddd7184a166 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:29:01 user nova-compute[75066]: DEBUG nova.objects.base [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Object Instance<e84b8c28-e79e-4945-8f3c-dddd7184a166> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75066) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 19:29:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:29:01 user nova-compute[75066]:   <uuid>e84b8c28-e79e-4945-8f3c-dddd7184a166</uuid>
Dec 01 19:29:01 user nova-compute[75066]:   <name>instance-00000018</name>
Dec 01 19:29:01 user nova-compute[75066]:   <memory>524288</memory>
Dec 01 19:29:01 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:29:01 user nova-compute[75066]:   <metadata>
Dec 01 19:29:01 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:29:01 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:29:01 user nova-compute[75066]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-496690915</nova:name>
Dec 01 19:29:01 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:29:00</nova:creationTime>
Dec 01 19:29:01 user nova-compute[75066]:       <nova:flavor name="m1.tiny">
Dec 01 19:29:01 user nova-compute[75066]:         <nova:memory>512</nova:memory>
Dec 01 19:29:01 user nova-compute[75066]:         <nova:disk>1</nova:disk>
Dec 01 19:29:01 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:29:01 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:29:01 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:29:01 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:29:01 user nova-compute[75066]:       <nova:owner>
Dec 01 19:29:01 user nova-compute[75066]:         <nova:user uuid="90e207044c0741e99c4a83b2c4746cd3">tempest-AttachVolumeShelveTestJSON-1680443764-project-member</nova:user>
Dec 01 19:29:01 user nova-compute[75066]:         <nova:project uuid="879678dca7054c178839f56e66a6e0ce">tempest-AttachVolumeShelveTestJSON-1680443764</nova:project>
Dec 01 19:29:01 user nova-compute[75066]:       </nova:owner>
Dec 01 19:29:01 user nova-compute[75066]:       <nova:root type="image" uuid="b0e48ac0-30b0-46dc-9f72-44b9b4336892"/>
Dec 01 19:29:01 user nova-compute[75066]:       <nova:ports>
Dec 01 19:29:01 user nova-compute[75066]:         <nova:port uuid="abe9d4d1-5a93-4071-bb76-8723bf6ec62c">
Dec 01 19:29:01 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Dec 01 19:29:01 user nova-compute[75066]:         </nova:port>
Dec 01 19:29:01 user nova-compute[75066]:       </nova:ports>
Dec 01 19:29:01 user nova-compute[75066]:     </nova:instance>
Dec 01 19:29:01 user nova-compute[75066]:   </metadata>
Dec 01 19:29:01 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:29:01 user nova-compute[75066]:     <system>
Dec 01 19:29:01 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:29:01 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:29:01 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:29:01 user nova-compute[75066]:       <entry name="serial">e84b8c28-e79e-4945-8f3c-dddd7184a166</entry>
Dec 01 19:29:01 user nova-compute[75066]:       <entry name="uuid">e84b8c28-e79e-4945-8f3c-dddd7184a166</entry>
Dec 01 19:29:01 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:29:01 user nova-compute[75066]:     </system>
Dec 01 19:29:01 user nova-compute[75066]:   </sysinfo>
Dec 01 19:29:01 user nova-compute[75066]:   <os>
Dec 01 19:29:01 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:29:01 user nova-compute[75066]:     <boot dev="hd"/>
Dec 01 19:29:01 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:29:01 user nova-compute[75066]:   </os>
Dec 01 19:29:01 user nova-compute[75066]:   <features>
Dec 01 19:29:01 user nova-compute[75066]:     <acpi/>
Dec 01 19:29:01 user nova-compute[75066]:     <apic/>
Dec 01 19:29:01 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:29:01 user nova-compute[75066]:   </features>
Dec 01 19:29:01 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:29:01 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:29:01 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:29:01 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:29:01 user nova-compute[75066]:   </clock>
Dec 01 19:29:01 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:29:01 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:29:01 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:29:01 user nova-compute[75066]:   </cpu>
Dec 01 19:29:01 user nova-compute[75066]:   <devices>
Dec 01 19:29:01 user nova-compute[75066]:     <disk type="file" device="disk">
Dec 01 19:29:01 user nova-compute[75066]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 19:29:01 user nova-compute[75066]:       <source file="/opt/stack/data/nova/instances/e84b8c28-e79e-4945-8f3c-dddd7184a166/disk"/>
Dec 01 19:29:01 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:29:01 user nova-compute[75066]:     </disk>
Dec 01 19:29:01 user nova-compute[75066]:     <disk type="block" device="disk">
Dec 01 19:29:01 user nova-compute[75066]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:29:01 user nova-compute[75066]:       <source dev="/dev/sdc"/>
Dec 01 19:29:01 user nova-compute[75066]:       <target dev="vdc" bus="virtio"/>
Dec 01 19:29:01 user nova-compute[75066]:       <serial>6a9ece83-f1e6-4f8c-914e-85de45be4e1a</serial>
Dec 01 19:29:01 user nova-compute[75066]:     </disk>
Dec 01 19:29:01 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:29:01 user nova-compute[75066]:       <mac address="fa:16:3e:8c:32:99"/>
Dec 01 19:29:01 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:29:01 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:29:01 user nova-compute[75066]:       <target dev="tapabe9d4d1-5a"/>
Dec 01 19:29:01 user nova-compute[75066]:     </interface>
Dec 01 19:29:01 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:29:01 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/e84b8c28-e79e-4945-8f3c-dddd7184a166/console.log" append="off"/>
Dec 01 19:29:01 user nova-compute[75066]:     </serial>
Dec 01 19:29:01 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:29:01 user nova-compute[75066]:     <video>
Dec 01 19:29:01 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:29:01 user nova-compute[75066]:     </video>
Dec 01 19:29:01 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:29:01 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:29:01 user nova-compute[75066]:     </rng>
Dec 01 19:29:01 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:29:01 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:29:01 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:29:01 user nova-compute[75066]:     </memballoon>
Dec 01 19:29:01 user nova-compute[75066]:   </devices>
Dec 01 19:29:01 user nova-compute[75066]: </domain>
Dec 01 19:29:01 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:29:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-01T19:24:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-496690915',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-496690915',id=24,image_ref='b0e48ac0-30b0-46dc-9f72-44b9b4336892',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-20573267',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:24:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='879678dca7054c178839f56e66a6e0ce',ramdisk_id='',reservation_id='r-frzqz3qo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1680443764',owner_user_name='tempest-AttachVolumeShelveTestJSON-1680443764-project-member',shelved_at='2023-12-01T19:26:50.693576',shelved_host='user',shelved_image_id='b0e48ac0-30b0-46dc-9f72-44b9b4336892'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:28:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90e207044c0741e99c4a83b2c4746cd3',uuid=e84b8c28-e79e-4945-8f3c-dddd7184a166,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "abe9d4d1-5a93-4071-bb76-8723bf6ec62c", "address": "fa:16:3e:8c:32:99", "network": {"id": "49dd72ae-ec07-46a6-8463-e38bdfe1eba0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-738739404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879678dca7054c178839f56e66a6e0ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabe9d4d1-5a", "ovs_interfaceid": "abe9d4d1-5a93-4071-bb76-8723bf6ec62c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:29:01 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Converting VIF {"id": "abe9d4d1-5a93-4071-bb76-8723bf6ec62c", "address": "fa:16:3e:8c:32:99", "network": {"id": "49dd72ae-ec07-46a6-8463-e38bdfe1eba0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-738739404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879678dca7054c178839f56e66a6e0ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabe9d4d1-5a", "ovs_interfaceid": "abe9d4d1-5a93-4071-bb76-8723bf6ec62c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:29:01 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:32:99,bridge_name='br-int',has_traffic_filtering=True,id=abe9d4d1-5a93-4071-bb76-8723bf6ec62c,network=Network(49dd72ae-ec07-46a6-8463-e38bdfe1eba0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabe9d4d1-5a') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:29:01 user nova-compute[75066]: DEBUG os_vif [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:32:99,bridge_name='br-int',has_traffic_filtering=True,id=abe9d4d1-5a93-4071-bb76-8723bf6ec62c,network=Network(49dd72ae-ec07-46a6-8463-e38bdfe1eba0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabe9d4d1-5a') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:29:01 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:01 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:29:01 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:29:01 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:01 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1ea35bf2-775c-5405-9a90-742f82448b48', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:29:01 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:01 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:29:01 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:01 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:01 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapabe9d4d1-5a, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:29:01 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapabe9d4d1-5a, col_values=(('qos', UUID('4621a068-60f7-4861-b08a-b10063c35d32')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:29:01 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapabe9d4d1-5a, col_values=(('external_ids', {'iface-id': 'abe9d4d1-5a93-4071-bb76-8723bf6ec62c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:32:99', 'vm-uuid': 'e84b8c28-e79e-4945-8f3c-dddd7184a166'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:29:01 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:01 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:29:01 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:01 user nova-compute[75066]: INFO os_vif [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:32:99,bridge_name='br-int',has_traffic_filtering=True,id=abe9d4d1-5a93-4071-bb76-8723bf6ec62c,network=Network(49dd72ae-ec07-46a6-8463-e38bdfe1eba0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabe9d4d1-5a')
Dec 01 19:29:02 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] No VIF found with MAC fa:16:3e:8c:32:99, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:29:02 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Instance destroyed successfully.
Dec 01 19:29:02 user nova-compute[75066]: DEBUG nova.objects.instance [None req-407fa32e-4da0-4eb5-8350-c77a7d0ec443 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Lazy-loading 'resources' on Instance uuid 391945f6-fe47-4969-a497-bd320d66cfa3 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-407fa32e-4da0-4eb5-8350-c77a7d0ec443 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-01T19:25:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1380771896',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1159128139',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFUt3tvMqWzGNICVgVAPv+5OiL/y2ghL11denluyj9f24y9bvqoYMGhme0+yc1T6ysCdcqg+PZ0E7hkYE+/Fk0+ZZK5gReWc3DTB+0QPq1QAoZu4IKNKVmZ4OKW/6iZMNA==',key_name='tempest-keypair-1648212708',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:27:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83c5f90337e64829893181e7e8140b8c',ramdisk_id='',reservation_id='r-fz70ky08',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1592554729',owner_user_name='tempest-ServerActionsV293TestJSON-1592554729-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:27:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cf5efdf2a7324c96b8b9b2370dc7e31c',uuid=391945f6-fe47-4969-a497-bd320d66cfa3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e5f3728a-541f-4b95-9feb-6119687f2eba", "address": "fa:16:3e:9c:60:12", "network": {"id": "3e44df49-3c9c-4812-aafc-ce3f4795874b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-826204178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83c5f90337e64829893181e7e8140b8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5f3728a-54", "ovs_interfaceid": "e5f3728a-541f-4b95-9feb-6119687f2eba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-407fa32e-4da0-4eb5-8350-c77a7d0ec443 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Converting VIF {"id": "e5f3728a-541f-4b95-9feb-6119687f2eba", "address": "fa:16:3e:9c:60:12", "network": {"id": "3e44df49-3c9c-4812-aafc-ce3f4795874b", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-826204178-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.134", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83c5f90337e64829893181e7e8140b8c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape5f3728a-54", "ovs_interfaceid": "e5f3728a-541f-4b95-9feb-6119687f2eba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-407fa32e-4da0-4eb5-8350-c77a7d0ec443 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9c:60:12,bridge_name='br-int',has_traffic_filtering=True,id=e5f3728a-541f-4b95-9feb-6119687f2eba,network=Network(3e44df49-3c9c-4812-aafc-ce3f4795874b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5f3728a-54') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG os_vif [None req-407fa32e-4da0-4eb5-8350-c77a7d0ec443 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:60:12,bridge_name='br-int',has_traffic_filtering=True,id=e5f3728a-541f-4b95-9feb-6119687f2eba,network=Network(3e44df49-3c9c-4812-aafc-ce3f4795874b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5f3728a-54') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape5f3728a-54, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e3701aab-cb06-4331-ade7-71c172fb256e) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:02 user nova-compute[75066]: INFO os_vif [None req-407fa32e-4da0-4eb5-8350-c77a7d0ec443 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:60:12,bridge_name='br-int',has_traffic_filtering=True,id=e5f3728a-541f-4b95-9feb-6119687f2eba,network=Network(3e44df49-3c9c-4812-aafc-ce3f4795874b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape5f3728a-54')
Dec 01 19:29:02 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-407fa32e-4da0-4eb5-8350-c77a7d0ec443 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] calling os-brick to detach iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-407fa32e-4da0-4eb5-8350-c77a7d0ec443 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, {'target_iqn': 'iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xUAEeuip', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:29:02 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-407fa32e-4da0-4eb5-8350-c77a7d0ec443 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:29:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-407fa32e-4da0-4eb5-8350-c77a7d0ec443 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-407fa32e-4da0-4eb5-8350-c77a7d0ec443 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f283d94-e94b-4d87-830e-334e06f79023]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-407fa32e-4da0-4eb5-8350-c77a7d0ec443 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 19:29:02 user nova-compute[75066]: No targets found.
Dec 01 19:29:02 user nova-compute[75066]: iSNS:
Dec 01 19:29:02 user nova-compute[75066]: No targets found.
Dec 01 19:29:02 user nova-compute[75066]: STATIC:
Dec 01 19:29:02 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0
Dec 01 19:29:02 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:29:02 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:29:02 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a
Dec 01 19:29:02 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:29:02 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:29:02 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f
Dec 01 19:29:02 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:29:02 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:29:02 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb
Dec 01 19:29:02 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:29:02 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:29:02 user nova-compute[75066]: FIRMWARE:
Dec 01 19:29:02 user nova-compute[75066]: No targets found.
Dec 01 19:29:02 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-407fa32e-4da0-4eb5-8350-c77a7d0ec443 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 19:29:02 user nova-compute[75066]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 19:29:02 user nova-compute[75066]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75066) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-407fa32e-4da0-4eb5-8350-c77a7d0ec443 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0', 0)] {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa703c1-5eb8-4441-8422-4f715bc29ddf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f16d48-8a02-42a8-9c57-8ff95a2daab4]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-407fa32e-4da0-4eb5-8350-c77a7d0ec443 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:29:02 user nova-compute[75066]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)
Dec 01 19:29:02 user nova-compute[75066]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f (non-flash)
Dec 01 19:29:02 user nova-compute[75066]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a (non-flash)
Dec 01 19:29:02 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-407fa32e-4da0-4eb5-8350-c77a7d0ec443 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:29:02 user nova-compute[75066]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 (non-flash)
Dec 01 19:29:02 user nova-compute[75066]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f (non-flash)
Dec 01 19:29:02 user nova-compute[75066]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a (non-flash)
Dec 01 19:29:02 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-407fa32e-4da0-4eb5-8350-c77a7d0ec443 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9190162cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0'): ({'sdb'}, set())}) {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-407fa32e-4da0-4eb5-8350-c77a7d0ec443 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Removing single pathed devices sdb {{(pid=75066) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.042s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde9e4c8-2695-4b6d-a1a8-8b4ace82a085]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba788719-70fa-4324-9f9d-8452e23e8829]: (4, ('ok\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-407fa32e-4da0-4eb5-8350-c77a7d0ec443 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Flushing IO for device /dev/sdb {{(pid=75066) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[69741aea-3ff9-4fec-b5e7-7dfca4c82595]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-407fa32e-4da0-4eb5-8350-c77a7d0ec443 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75066) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d130f7-78f0-4401-a31d-c44d2933af56]: (4, ('1', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-407fa32e-4da0-4eb5-8350-c77a7d0ec443 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-407fa32e-4da0-4eb5-8350-c77a7d0ec443 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] SCSI volumes sdb have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-407fa32e-4da0-4eb5-8350-c77a7d0ec443 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0')] {{(pid=75066) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[1365d648-2bda-4ac4-9ec4-f3340929a816]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-407fa32e-4da0-4eb5-8350-c77a7d0ec443 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 -p 172.16.0.220:3260 --logout {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4f4df4-3915-443e-acaa-6c5c7089b45f]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-407fa32e-4da0-4eb5-8350-c77a7d0ec443 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0, portal: 172.16.0.220,3260]
Dec 01 19:29:02 user nova-compute[75066]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0, portal: 172.16.0.220,3260] successful.
Dec 01 19:29:02 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 -p 172.16.0.220:3260 --op delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[296763ba-7f4b-44a6-9576-3f55b63fa17c]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-407fa32e-4da0-4eb5-8350-c77a7d0ec443 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-407fa32e-4da0-4eb5-8350-c77a7d0ec443 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-407fa32e-4da0-4eb5-8350-c77a7d0ec443 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] <== disconnect_volume: return (356ms) None {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-407fa32e-4da0-4eb5-8350-c77a7d0ec443 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Disconnected iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 19:29:02 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-407fa32e-4da0-4eb5-8350-c77a7d0ec443 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Deleting instance files /opt/stack/data/nova/instances/391945f6-fe47-4969-a497-bd320d66cfa3_del
Dec 01 19:29:02 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-407fa32e-4da0-4eb5-8350-c77a7d0ec443 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Deletion of /opt/stack/data/nova/instances/391945f6-fe47-4969-a497-bd320d66cfa3_del complete
Dec 01 19:29:02 user nova-compute[75066]: INFO nova.compute.manager [None req-407fa32e-4da0-4eb5-8350-c77a7d0ec443 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Took 1.64 seconds to destroy the instance on the hypervisor.
Dec 01 19:29:02 user nova-compute[75066]: DEBUG oslo.service.loopingcall [None req-407fa32e-4da0-4eb5-8350-c77a7d0ec443 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75066) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG nova.compute.manager [-] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Deallocating network for instance {{(pid=75066) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 19:29:02 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] deallocate_for_instance() {{(pid=75066) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 19:29:03 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:29:03 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:03 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:03 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:03 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:03 user nova-compute[75066]: DEBUG nova.compute.manager [req-92757cbf-ca4a-4b82-906d-d859797885ec req-bc062ee4-2770-498b-ba37-4448c6e8cd9c service nova] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Received event network-vif-plugged-e5f3728a-541f-4b95-9feb-6119687f2eba {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:29:03 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-92757cbf-ca4a-4b82-906d-d859797885ec req-bc062ee4-2770-498b-ba37-4448c6e8cd9c service nova] Acquiring lock "391945f6-fe47-4969-a497-bd320d66cfa3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:29:03 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-92757cbf-ca4a-4b82-906d-d859797885ec req-bc062ee4-2770-498b-ba37-4448c6e8cd9c service nova] Lock "391945f6-fe47-4969-a497-bd320d66cfa3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:29:03 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-92757cbf-ca4a-4b82-906d-d859797885ec req-bc062ee4-2770-498b-ba37-4448c6e8cd9c service nova] Lock "391945f6-fe47-4969-a497-bd320d66cfa3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:29:03 user nova-compute[75066]: DEBUG nova.compute.manager [req-92757cbf-ca4a-4b82-906d-d859797885ec req-bc062ee4-2770-498b-ba37-4448c6e8cd9c service nova] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] No waiting events found dispatching network-vif-plugged-e5f3728a-541f-4b95-9feb-6119687f2eba {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:29:03 user nova-compute[75066]: WARNING nova.compute.manager [req-92757cbf-ca4a-4b82-906d-d859797885ec req-bc062ee4-2770-498b-ba37-4448c6e8cd9c service nova] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Received unexpected event network-vif-plugged-e5f3728a-541f-4b95-9feb-6119687f2eba for instance with vm_state active and task_state deleting.
Dec 01 19:29:03 user nova-compute[75066]: DEBUG nova.compute.manager [req-1879d979-d15d-4850-8555-07e7c316f267 req-99f76c83-20fc-4699-8fce-6a2fb4736be1 service nova] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Received event network-vif-plugged-abe9d4d1-5a93-4071-bb76-8723bf6ec62c {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:29:03 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-1879d979-d15d-4850-8555-07e7c316f267 req-99f76c83-20fc-4699-8fce-6a2fb4736be1 service nova] Acquiring lock "e84b8c28-e79e-4945-8f3c-dddd7184a166-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:29:03 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-1879d979-d15d-4850-8555-07e7c316f267 req-99f76c83-20fc-4699-8fce-6a2fb4736be1 service nova] Lock "e84b8c28-e79e-4945-8f3c-dddd7184a166-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:29:03 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-1879d979-d15d-4850-8555-07e7c316f267 req-99f76c83-20fc-4699-8fce-6a2fb4736be1 service nova] Lock "e84b8c28-e79e-4945-8f3c-dddd7184a166-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:29:03 user nova-compute[75066]: DEBUG nova.compute.manager [req-1879d979-d15d-4850-8555-07e7c316f267 req-99f76c83-20fc-4699-8fce-6a2fb4736be1 service nova] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] No waiting events found dispatching network-vif-plugged-abe9d4d1-5a93-4071-bb76-8723bf6ec62c {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:29:03 user nova-compute[75066]: WARNING nova.compute.manager [req-1879d979-d15d-4850-8555-07e7c316f267 req-99f76c83-20fc-4699-8fce-6a2fb4736be1 service nova] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Received unexpected event network-vif-plugged-abe9d4d1-5a93-4071-bb76-8723bf6ec62c for instance with vm_state shelved_offloaded and task_state spawning.
Dec 01 19:29:03 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-c4c52f2c-71df-41af-abc9-a7372401b763 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Snapshot image upload complete
Dec 01 19:29:03 user nova-compute[75066]: INFO nova.compute.manager [None req-c4c52f2c-71df-41af-abc9-a7372401b763 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Took 7.74 seconds to snapshot the instance on the hypervisor.
Dec 01 19:29:04 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:04 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:04 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:04 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:29:04 user nova-compute[75066]: DEBUG nova.compute.manager [req-1afbeddc-f732-45d4-9481-600ae0ecd257 req-c9cae9d9-624b-449d-b430-1695cde0f521 service nova] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Received event network-vif-deleted-e5f3728a-541f-4b95-9feb-6119687f2eba {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:29:04 user nova-compute[75066]: INFO nova.compute.manager [req-1afbeddc-f732-45d4-9481-600ae0ecd257 req-c9cae9d9-624b-449d-b430-1695cde0f521 service nova] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Neutron deleted interface e5f3728a-541f-4b95-9feb-6119687f2eba; detaching it from the instance and deleting it from the info cache
Dec 01 19:29:04 user nova-compute[75066]: DEBUG nova.network.neutron [req-1afbeddc-f732-45d4-9481-600ae0ecd257 req-c9cae9d9-624b-449d-b430-1695cde0f521 service nova] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:29:04 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:04 user nova-compute[75066]: INFO nova.compute.manager [-] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Took 1.59 seconds to deallocate network for instance.
Dec 01 19:29:04 user nova-compute[75066]: DEBUG nova.compute.manager [req-1afbeddc-f732-45d4-9481-600ae0ecd257 req-c9cae9d9-624b-449d-b430-1695cde0f521 service nova] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Detach interface failed, port_id=e5f3728a-541f-4b95-9feb-6119687f2eba, reason: Instance 391945f6-fe47-4969-a497-bd320d66cfa3 could not be found. {{(pid=75066) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 01 19:29:05 user nova-compute[75066]: INFO nova.compute.manager [None req-407fa32e-4da0-4eb5-8350-c77a7d0ec443 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Took 0.91 seconds to detach 1 volumes for instance.
Dec 01 19:29:05 user nova-compute[75066]: DEBUG nova.compute.manager [None req-407fa32e-4da0-4eb5-8350-c77a7d0ec443 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] [instance: 391945f6-fe47-4969-a497-bd320d66cfa3] Deleting volume: 8bd4931f-3dd4-4b2d-be9e-51b2a1d32cd0 {{(pid=75066) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Dec 01 19:29:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-407fa32e-4da0-4eb5-8350-c77a7d0ec443 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:29:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-407fa32e-4da0-4eb5-8350-c77a7d0ec443 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:29:05 user nova-compute[75066]: DEBUG nova.compute.manager [req-b097b73f-c330-4e48-a959-1310f5c48691 req-c72cc978-614a-48f0-a34c-71658ad797a3 service nova] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Received event network-vif-plugged-abe9d4d1-5a93-4071-bb76-8723bf6ec62c {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:29:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-b097b73f-c330-4e48-a959-1310f5c48691 req-c72cc978-614a-48f0-a34c-71658ad797a3 service nova] Acquiring lock "e84b8c28-e79e-4945-8f3c-dddd7184a166-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:29:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-b097b73f-c330-4e48-a959-1310f5c48691 req-c72cc978-614a-48f0-a34c-71658ad797a3 service nova] Lock "e84b8c28-e79e-4945-8f3c-dddd7184a166-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:29:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-b097b73f-c330-4e48-a959-1310f5c48691 req-c72cc978-614a-48f0-a34c-71658ad797a3 service nova] Lock "e84b8c28-e79e-4945-8f3c-dddd7184a166-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:29:05 user nova-compute[75066]: DEBUG nova.compute.manager [req-b097b73f-c330-4e48-a959-1310f5c48691 req-c72cc978-614a-48f0-a34c-71658ad797a3 service nova] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] No waiting events found dispatching network-vif-plugged-abe9d4d1-5a93-4071-bb76-8723bf6ec62c {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:29:05 user nova-compute[75066]: WARNING nova.compute.manager [req-b097b73f-c330-4e48-a959-1310f5c48691 req-c72cc978-614a-48f0-a34c-71658ad797a3 service nova] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Received unexpected event network-vif-plugged-abe9d4d1-5a93-4071-bb76-8723bf6ec62c for instance with vm_state shelved_offloaded and task_state spawning.
Dec 01 19:29:06 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-407fa32e-4da0-4eb5-8350-c77a7d0ec443 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:29:06 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-407fa32e-4da0-4eb5-8350-c77a7d0ec443 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:29:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-407fa32e-4da0-4eb5-8350-c77a7d0ec443 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.706s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:29:06 user nova-compute[75066]: INFO nova.scheduler.client.report [None req-407fa32e-4da0-4eb5-8350-c77a7d0ec443 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Deleted allocations for instance 391945f6-fe47-4969-a497-bd320d66cfa3
Dec 01 19:29:06 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:29:06 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:29:06 user nova-compute[75066]: DEBUG nova.compute.manager [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Instance event wait completed in 0 seconds for  {{(pid=75066) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 19:29:06 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Guest created on hypervisor {{(pid=75066) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 19:29:06 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Instance spawned successfully.
Dec 01 19:29:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-407fa32e-4da0-4eb5-8350-c77a7d0ec443 tempest-ServerActionsV293TestJSON-1592554729 tempest-ServerActionsV293TestJSON-1592554729-project-member] Lock "391945f6-fe47-4969-a497-bd320d66cfa3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.167s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:29:06 user nova-compute[75066]: DEBUG nova.compute.manager [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:29:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-4454f6a3-94b7-4c36-962e-bdb08676fd2f tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "e84b8c28-e79e-4945-8f3c-dddd7184a166" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 27.251s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:29:07 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:29:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:29:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:29:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:29:07 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75066) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 19:29:07 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:07 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:29:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b355778-bd25-42f6-8026-110668920d8b/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b355778-bd25-42f6-8026-110668920d8b/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b355778-bd25-42f6-8026-110668920d8b/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:07 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b355778-bd25-42f6-8026-110668920d8b/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23e17727-40b4-48f7-9155-abc8ffa9f619/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23e17727-40b4-48f7-9155-abc8ffa9f619/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23e17727-40b4-48f7-9155-abc8ffa9f619/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/23e17727-40b4-48f7-9155-abc8ffa9f619/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk.rescue --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk.rescue --force-share --output=json" returned: 0 in 0.247s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk.rescue --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk.rescue --force-share --output=json" returned: 0 in 0.234s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:11 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:29:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6c900-5d1b-44f8-8435-d9ad88b3a412/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6c900-5d1b-44f8-8435-d9ad88b3a412/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6c900-5d1b-44f8-8435-d9ad88b3a412/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:11 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-94d6f90c-d253-4eb6-8a0f-01e826a5b7e2 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 3b355778-bd25-42f6-8026-110668920d8b is timed out.
Dec 01 19:29:11 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-94d6f90c-d253-4eb6-8a0f-01e826a5b7e2 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Successfully detached device vdc from instance 3b355778-bd25-42f6-8026-110668920d8b from the live domain config.
Dec 01 19:29:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6c900-5d1b-44f8-8435-d9ad88b3a412/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:11 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94d6f90c-d253-4eb6-8a0f-01e826a5b7e2 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: 3b355778-bd25-42f6-8026-110668920d8b] calling os-brick to detach iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 19:29:11 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-94d6f90c-d253-4eb6-8a0f-01e826a5b7e2 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, {'target_iqn': 'iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CmOGcXpD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:29:11 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-94d6f90c-d253-4eb6-8a0f-01e826a5b7e2 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:29:11 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-94d6f90c-d253-4eb6-8a0f-01e826a5b7e2 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:29:11 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-94d6f90c-d253-4eb6-8a0f-01e826a5b7e2 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:29:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84b8c28-e79e-4945-8f3c-dddd7184a166/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:11 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3878d9-c13c-4584-ab55-9bbf0b71a7d1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:29:11 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-94d6f90c-d253-4eb6-8a0f-01e826a5b7e2 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 19:29:11 user nova-compute[75066]: No targets found.
Dec 01 19:29:11 user nova-compute[75066]: iSNS:
Dec 01 19:29:11 user nova-compute[75066]: No targets found.
Dec 01 19:29:11 user nova-compute[75066]: STATIC:
Dec 01 19:29:11 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a
Dec 01 19:29:11 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:29:11 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:29:11 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f
Dec 01 19:29:11 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:29:11 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:29:11 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb
Dec 01 19:29:11 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:29:11 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:29:11 user nova-compute[75066]: FIRMWARE:
Dec 01 19:29:11 user nova-compute[75066]: No targets found.
Dec 01 19:29:11 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:29:11 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-94d6f90c-d253-4eb6-8a0f-01e826a5b7e2 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 19:29:11 user nova-compute[75066]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 19:29:11 user nova-compute[75066]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75066) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 19:29:11 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-94d6f90c-d253-4eb6-8a0f-01e826a5b7e2 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f', 0)] {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 19:29:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:11 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd7ab24-bb3f-4aa1-9d7a-a1b08380fbf2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:29:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:11 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28eac85-ee95-4a8d-adb5-0b443adc2f34]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:29:11 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-94d6f90c-d253-4eb6-8a0f-01e826a5b7e2 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:29:11 user nova-compute[75066]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f (non-flash)
Dec 01 19:29:11 user nova-compute[75066]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a (non-flash)
Dec 01 19:29:11 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:29:11 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-94d6f90c-d253-4eb6-8a0f-01e826a5b7e2 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:29:11 user nova-compute[75066]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f (non-flash)
Dec 01 19:29:11 user nova-compute[75066]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a (non-flash)
Dec 01 19:29:11 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:29:11 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-94d6f90c-d253-4eb6-8a0f-01e826a5b7e2 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f919017c670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f'): ({'sdg'}, set())}) {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 19:29:11 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-94d6f90c-d253-4eb6-8a0f-01e826a5b7e2 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Removing single pathed devices sdg {{(pid=75066) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 19:29:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:11 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[34fa82b2-3e2c-4f34-9343-7689eb794afe]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:29:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:11 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c56346-5c53-46d3-8b49-a0e1f5941f69]: (4, ('ok\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:29:11 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-94d6f90c-d253-4eb6-8a0f-01e826a5b7e2 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Flushing IO for device /dev/sdg {{(pid=75066) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 19:29:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:11 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3ea0e0-e463-485a-a31b-73389aa9282f]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:29:11 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-94d6f90c-d253-4eb6-8a0f-01e826a5b7e2 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75066) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 19:29:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84b8c28-e79e-4945-8f3c-dddd7184a166/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84b8c28-e79e-4945-8f3c-dddd7184a166/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.056s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:11 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7575b8a-d700-45c0-bc41-70607ca9a88b]: (4, ('1', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:29:11 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-94d6f90c-d253-4eb6-8a0f-01e826a5b7e2 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 19:29:11 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-94d6f90c-d253-4eb6-8a0f-01e826a5b7e2 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] SCSI volumes sdg have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 19:29:11 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-94d6f90c-d253-4eb6-8a0f-01e826a5b7e2 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f')] {{(pid=75066) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 19:29:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:11 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff4082c-82cc-4a2f-96f5-897b7fcb284c]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:29:11 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-94d6f90c-d253-4eb6-8a0f-01e826a5b7e2 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:29:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f -p 172.16.0.220:3260 --logout {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:12 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d46a40e-d189-4862-ab44-e608ad0bcf1a]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:29:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-94d6f90c-d253-4eb6-8a0f-01e826a5b7e2 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f, portal: 172.16.0.220,3260]
Dec 01 19:29:12 user nova-compute[75066]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f, portal: 172.16.0.220,3260] successful.
Dec 01 19:29:12 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:29:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f -p 172.16.0.220:3260 --op delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1e4d0d93-2de3-4419-b37b-1c3c6e27ec1f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:12 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb41b31-a898-4ab4-ad03-82e0dd9bc122]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:29:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-94d6f90c-d253-4eb6-8a0f-01e826a5b7e2 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:29:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-94d6f90c-d253-4eb6-8a0f-01e826a5b7e2 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.397s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:29:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-94d6f90c-d253-4eb6-8a0f-01e826a5b7e2 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] <== disconnect_volume: return (400ms) None {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:29:12 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94d6f90c-d253-4eb6-8a0f-01e826a5b7e2 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Disconnected iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 19:29:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84b8c28-e79e-4945-8f3c-dddd7184a166/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:12 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:29:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:12 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:29:12 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:29:12 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Hypervisor/Node resource view: name=user free_ram=7719MB free_disk=24.76836395263672GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75066) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 19:29:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:29:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:29:12 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Applying migration context for instance 00506483-8f09-4a3d-938a-31ab1b2dbf83 as it has an incoming, in-progress migration 01d1f16f-013f-4fb4-baca-3d734eb87e84. Migration status is post-migrating {{(pid=75066) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Dec 01 19:29:12 user nova-compute[75066]: INFO nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Updating resource usage from migration 01d1f16f-013f-4fb4-baca-3d734eb87e84
Dec 01 19:29:12 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance c223be70-8b9c-46d4-9b5a-3b83dfc05a17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:29:12 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 90c49be6-97aa-45f1-bcbe-b9a3875226a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:29:12 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance d564b128-598b-4ad4-8618-afa4dc8a7347 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:29:12 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 14de9d20-9e66-4517-b904-2967e0a06a97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:29:12 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:29:12 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 23e17727-40b4-48f7-9155-abc8ffa9f619 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:29:12 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 3b355778-bd25-42f6-8026-110668920d8b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:29:12 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:29:12 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance b2c6c900-5d1b-44f8-8435-d9ad88b3a412 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:29:12 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Migration 01d1f16f-013f-4fb4-baca-3d734eb87e84 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Dec 01 19:29:12 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 00506483-8f09-4a3d-938a-31ab1b2dbf83 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:29:12 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance e84b8c28-e79e-4945-8f3c-dddd7184a166 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:29:12 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 19:29:12 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 19:29:13 user nova-compute[75066]: DEBUG nova.objects.instance [None req-94d6f90c-d253-4eb6-8a0f-01e826a5b7e2 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lazy-loading 'flavor' on Instance uuid 3b355778-bd25-42f6-8026-110668920d8b {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:29:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-94d6f90c-d253-4eb6-8a0f-01e826a5b7e2 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "3b355778-bd25-42f6-8026-110668920d8b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.103s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:29:13 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:29:13 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:29:13 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Compute_service record updated for user:user {{(pid=75066) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 19:29:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.682s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:29:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d81ce119-1b29-4cf2-929f-3f729d367046 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Acquiring lock "3b355778-bd25-42f6-8026-110668920d8b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:29:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d81ce119-1b29-4cf2-929f-3f729d367046 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "3b355778-bd25-42f6-8026-110668920d8b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:29:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d81ce119-1b29-4cf2-929f-3f729d367046 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Acquiring lock "3b355778-bd25-42f6-8026-110668920d8b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:29:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d81ce119-1b29-4cf2-929f-3f729d367046 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "3b355778-bd25-42f6-8026-110668920d8b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:29:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d81ce119-1b29-4cf2-929f-3f729d367046 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "3b355778-bd25-42f6-8026-110668920d8b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:29:14 user nova-compute[75066]: INFO nova.compute.manager [None req-d81ce119-1b29-4cf2-929f-3f729d367046 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Terminating instance
Dec 01 19:29:14 user nova-compute[75066]: DEBUG nova.compute.manager [None req-d81ce119-1b29-4cf2-929f-3f729d367046 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Start destroying the instance on the hypervisor. {{(pid=75066) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 19:29:14 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:14 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:14 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:14 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG nova.compute.manager [req-16575211-e04c-4667-b794-a519243b697f req-15ac2cb7-5bd9-44c7-b430-0e88aa6ed459 service nova] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Received event network-vif-unplugged-918beedf-26db-4ea9-be7b-5170ca29ee52 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-16575211-e04c-4667-b794-a519243b697f req-15ac2cb7-5bd9-44c7-b430-0e88aa6ed459 service nova] Acquiring lock "3b355778-bd25-42f6-8026-110668920d8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-16575211-e04c-4667-b794-a519243b697f req-15ac2cb7-5bd9-44c7-b430-0e88aa6ed459 service nova] Lock "3b355778-bd25-42f6-8026-110668920d8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-16575211-e04c-4667-b794-a519243b697f req-15ac2cb7-5bd9-44c7-b430-0e88aa6ed459 service nova] Lock "3b355778-bd25-42f6-8026-110668920d8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG nova.compute.manager [req-16575211-e04c-4667-b794-a519243b697f req-15ac2cb7-5bd9-44c7-b430-0e88aa6ed459 service nova] [instance: 3b355778-bd25-42f6-8026-110668920d8b] No waiting events found dispatching network-vif-unplugged-918beedf-26db-4ea9-be7b-5170ca29ee52 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG nova.compute.manager [req-16575211-e04c-4667-b794-a519243b697f req-15ac2cb7-5bd9-44c7-b430-0e88aa6ed459 service nova] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Received event network-vif-unplugged-918beedf-26db-4ea9-be7b-5170ca29ee52 for instance with task_state deleting. {{(pid=75066) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-354ba73a-67df-4672-88e6-5dfdfc6dc07d tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Acquiring lock "23e17727-40b4-48f7-9155-abc8ffa9f619" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-354ba73a-67df-4672-88e6-5dfdfc6dc07d tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "23e17727-40b4-48f7-9155-abc8ffa9f619" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-354ba73a-67df-4672-88e6-5dfdfc6dc07d tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Acquiring lock "23e17727-40b4-48f7-9155-abc8ffa9f619-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-354ba73a-67df-4672-88e6-5dfdfc6dc07d tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "23e17727-40b4-48f7-9155-abc8ffa9f619-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-354ba73a-67df-4672-88e6-5dfdfc6dc07d tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "23e17727-40b4-48f7-9155-abc8ffa9f619-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:29:15 user nova-compute[75066]: INFO nova.compute.manager [None req-354ba73a-67df-4672-88e6-5dfdfc6dc07d tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Terminating instance
Dec 01 19:29:15 user nova-compute[75066]: DEBUG nova.compute.manager [None req-354ba73a-67df-4672-88e6-5dfdfc6dc07d tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Start destroying the instance on the hypervisor. {{(pid=75066) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Starting finish_migration {{(pid=75066) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11668}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Instance directory exists: not creating {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4719}}
Dec 01 19:29:15 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Creating image(s)
Dec 01 19:29:15 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Did not create local disks {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Ensure instance console log exists: /opt/stack/data/nova/instances/00506483-8f09-4a3d-938a-31ab1b2dbf83/console.log {{(pid=75066) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Start _get_guest_xml network_info=[{"id": "b0528c8d-a14c-4420-a248-fda3f0a92893", "address": "fa:16:3e:a6:1a:51", "network": {"id": "9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-696310557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-696310557-network", "vif_mac": "fa:16:3e:a6:1a:51"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0f7516d1db4dd5bc7d77a0bd1d44d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0528c8d-a1", "ovs_interfaceid": "b0528c8d-a14c-4420-a248-fda3f0a92893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': True, 'attachment_id': 'a7558b12-624f-4939-8134-0b44c588d4b6', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gLtkPwAS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '00506483-8f09-4a3d-938a-31ab1b2dbf83', 'attached_at': '2023-12-01T19:29:15.000000', 'detached_at': '', 'volume_id': '333c6d2d-5a25-42f1-8a9b-9366196fd6f9', 'serial': '333c6d2d-5a25-42f1-8a9b-9366196fd6f9'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:29:15 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:29:15 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:29:15 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:12Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Calling os-brick to attach iSCSI Volume {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gLtkPwAS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:29:15 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:29:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:29:15 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:29:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:29:15 user nova-compute[75066]: INFO os_brick.initiator.connectors.iscsi [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 19:29:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 -p 172.16.0.220:3260 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99c355f-302b-4401-9746-499b18558663]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 19:29:15 user nova-compute[75066]:  {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2ce0c7-017f-44b2-9127-4d77d40c5f9a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9] added\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9] added
Dec 01 19:29:15 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:15 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Instance destroyed successfully.
Dec 01 19:29:15 user nova-compute[75066]: DEBUG nova.objects.instance [None req-d81ce119-1b29-4cf2-929f-3f729d367046 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lazy-loading 'resources' on Instance uuid 3b355778-bd25-42f6-8026-110668920d8b {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a497a9f-4e00-4bd5-85ce-d58ad260196e]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-d81ce119-1b29-4cf2-929f-3f729d367046 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:26:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-557600286',display_name='tempest-AttachVolumeTestJSON-server-557600286',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-557600286',id=27,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAdWHJWeGP/AbZ3+1EtOkP8/eRZQqjpXhplJYgQLvS/jvHZ7vDtJCnd+UiVCBh0FxacrsX/W32e4T18M3x1h1aGCAQU31BjWAQ155GKtUM+Z6Z0gELHUmAkZPicLTDxLoQ==',key_name='tempest-keypair-276144069',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:26:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='492e0b2da61e4e4f9ea991df15531e24',ramdisk_id='',reservation_id='r-5t5zqdps',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1914192398',owner_user_name='tempest-AttachVolumeTestJSON-1914192398-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:26:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2e047112719c414d900ccb2adccf963a',uuid=3b355778-bd25-42f6-8026-110668920d8b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "918beedf-26db-4ea9-be7b-5170ca29ee52", "address": "fa:16:3e:e9:75:23", "network": {"id": "4a6c6c26-4d29-486c-b11e-fc53769083ea", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1139388453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "492e0b2da61e4e4f9ea991df15531e24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap918beedf-26", "ovs_interfaceid": "918beedf-26db-4ea9-be7b-5170ca29ee52", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-d81ce119-1b29-4cf2-929f-3f729d367046 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Converting VIF {"id": "918beedf-26db-4ea9-be7b-5170ca29ee52", "address": "fa:16:3e:e9:75:23", "network": {"id": "4a6c6c26-4d29-486c-b11e-fc53769083ea", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1139388453-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "492e0b2da61e4e4f9ea991df15531e24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap918beedf-26", "ovs_interfaceid": "918beedf-26db-4ea9-be7b-5170ca29ee52", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-d81ce119-1b29-4cf2-929f-3f729d367046 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e9:75:23,bridge_name='br-int',has_traffic_filtering=True,id=918beedf-26db-4ea9-be7b-5170ca29ee52,network=Network(4a6c6c26-4d29-486c-b11e-fc53769083ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap918beedf-26') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG os_vif [None req-d81ce119-1b29-4cf2-929f-3f729d367046 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:75:23,bridge_name='br-int',has_traffic_filtering=True,id=918beedf-26db-4ea9-be7b-5170ca29ee52,network=Network(4a6c6c26-4d29-486c-b11e-fc53769083ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap918beedf-26') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap918beedf-26, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f84963-878e-43e1-971e-bd06ed477523]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gLtkPwAS {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gLtkPwAS" returned: 0 in 0.028s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2fb636-d13b-4bbc-82ae-9fd7a4116955]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gLtkPwAS'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b32ef438-f2cd-427a-8dce-a48d069b614a) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8ad885-ed07-47e3-b824-e63a8b5bd30b]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:15 user nova-compute[75066]: INFO os_vif [None req-d81ce119-1b29-4cf2-929f-3f729d367046 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e9:75:23,bridge_name='br-int',has_traffic_filtering=True,id=918beedf-26db-4ea9-be7b-5170ca29ee52,network=Network(4a6c6c26-4d29-486c-b11e-fc53769083ea),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap918beedf-26')
Dec 01 19:29:15 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-d81ce119-1b29-4cf2-929f-3f729d367046 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Deleting instance files /opt/stack/data/nova/instances/3b355778-bd25-42f6-8026-110668920d8b_del
Dec 01 19:29:15 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-d81ce119-1b29-4cf2-929f-3f729d367046 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Deletion of /opt/stack/data/nova/instances/3b355778-bd25-42f6-8026-110668920d8b_del complete
Dec 01 19:29:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[8751d74d-1911-4d6e-86b5-d69292069bc3]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:29:15 user nova-compute[75066]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a (non-flash)
Dec 01 19:29:15 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:29:15 user nova-compute[75066]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a (non-flash)
Dec 01 19:29:15 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG nova.compute.manager [req-8c8eaf36-fe24-4096-8654-92219a04cc8f req-687c35bc-7b56-44ea-8ab9-fc1d4f5cce62 service nova] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Received event network-vif-unplugged-902b1013-6c79-4a5a-ab19-782ac8dc715b {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-8c8eaf36-fe24-4096-8654-92219a04cc8f req-687c35bc-7b56-44ea-8ab9-fc1d4f5cce62 service nova] Acquiring lock "23e17727-40b4-48f7-9155-abc8ffa9f619-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-8c8eaf36-fe24-4096-8654-92219a04cc8f req-687c35bc-7b56-44ea-8ab9-fc1d4f5cce62 service nova] Lock "23e17727-40b4-48f7-9155-abc8ffa9f619-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-8c8eaf36-fe24-4096-8654-92219a04cc8f req-687c35bc-7b56-44ea-8ab9-fc1d4f5cce62 service nova] Lock "23e17727-40b4-48f7-9155-abc8ffa9f619-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG nova.compute.manager [req-8c8eaf36-fe24-4096-8654-92219a04cc8f req-687c35bc-7b56-44ea-8ab9-fc1d4f5cce62 service nova] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] No waiting events found dispatching network-vif-unplugged-902b1013-6c79-4a5a-ab19-782ac8dc715b {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG nova.compute.manager [req-8c8eaf36-fe24-4096-8654-92219a04cc8f req-687c35bc-7b56-44ea-8ab9-fc1d4f5cce62 service nova] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Received event network-vif-unplugged-902b1013-6c79-4a5a-ab19-782ac8dc715b for instance with task_state deleting. {{(pid=75066) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 -p 172.16.0.220:3260 --login {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:15 user nova-compute[75066]: INFO nova.compute.manager [None req-d81ce119-1b29-4cf2-929f-3f729d367046 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Took 1.14 seconds to destroy the instance on the hypervisor.
Dec 01 19:29:15 user nova-compute[75066]: DEBUG oslo.service.loopingcall [None req-d81ce119-1b29-4cf2-929f-3f729d367046 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75066) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG nova.compute.manager [-] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Deallocating network for instance {{(pid=75066) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: 3b355778-bd25-42f6-8026-110668920d8b] deallocate_for_instance() {{(pid=75066) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[480e8525-9cf9-4043-877a-78e5cc830322]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9, portal: 172.16.0.220,3260]
Dec 01 19:29:15 user nova-compute[75066]: Login to [iface: default, target: iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9, portal: 172.16.0.220,3260] successful.
Dec 01 19:29:15 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6b1fd3-3acf-4241-a3e5-a757b8a7cbbe]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[f222380b-7255-442c-b0e7-498705d8054f]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:29:15 user nova-compute[75066]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a (non-flash)
Dec 01 19:29:15 user nova-compute[75066]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)
Dec 01 19:29:15 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:29:15 user nova-compute[75066]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a (non-flash)
Dec 01 19:29:15 user nova-compute[75066]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)
Dec 01 19:29:15 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.413s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Connected to 172.16.0.220:3260 {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] HCTL ('33', '-', '-', 0) found on session 37 with lun 0 {{(pid=75066) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75066) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d7aa61-09f1-4a95-b8f4-8f8ec88e1607]: (4, ('- - 0', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:29:15 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: None {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:29:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:16 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Instance destroyed successfully.
Dec 01 19:29:16 user nova-compute[75066]: DEBUG nova.objects.instance [None req-354ba73a-67df-4672-88e6-5dfdfc6dc07d tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lazy-loading 'resources' on Instance uuid 23e17727-40b4-48f7-9155-abc8ffa9f619 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:29:16 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-354ba73a-67df-4672-88e6-5dfdfc6dc07d tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:23:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1401953060',display_name='tempest-TestMinimumBasicScenario-server-1401953060',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1401953060',id=23,image_ref='5632f29c-8b44-432c-88c6-02567939cb91',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQs/30B1+efn0s6ylAyaZU6Z3hXoydPhUb7ZPkYfCAu2HdecYo2d432waybQvON1UMMmv9wZKmPPC/QNvONmacAOntBzffLTnAROursLsedELFAEGhWq1DVqf4nlmD2xw==',key_name='tempest-TestMinimumBasicScenario-1507068812',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:24:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1d5326c00d464e008337e0dc8577fc2d',ramdisk_id='',reservation_id='r-ytr9w0in',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='5632f29c-8b44-432c-88c6-02567939cb91',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-555382044',owner_user_name='tempest-TestMinimumBasicScenario-555382044-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:26:27Z,user_data=None,user_id='eeb6ade6e91541b5b737150a67b6bd39',uuid=23e17727-40b4-48f7-9155-abc8ffa9f619,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "902b1013-6c79-4a5a-ab19-782ac8dc715b", "address": "fa:16:3e:fe:93:cc", "network": {"id": "4fe4d56e-afe2-42a6-984a-9af8bc5377a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126385357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5326c00d464e008337e0dc8577fc2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap902b1013-6c", "ovs_interfaceid": "902b1013-6c79-4a5a-ab19-782ac8dc715b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:29:16 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-354ba73a-67df-4672-88e6-5dfdfc6dc07d tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Converting VIF {"id": "902b1013-6c79-4a5a-ab19-782ac8dc715b", "address": "fa:16:3e:fe:93:cc", "network": {"id": "4fe4d56e-afe2-42a6-984a-9af8bc5377a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126385357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5326c00d464e008337e0dc8577fc2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap902b1013-6c", "ovs_interfaceid": "902b1013-6c79-4a5a-ab19-782ac8dc715b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:29:16 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-354ba73a-67df-4672-88e6-5dfdfc6dc07d tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:93:cc,bridge_name='br-int',has_traffic_filtering=True,id=902b1013-6c79-4a5a-ab19-782ac8dc715b,network=Network(4fe4d56e-afe2-42a6-984a-9af8bc5377a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap902b1013-6c') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:29:16 user nova-compute[75066]: DEBUG os_vif [None req-354ba73a-67df-4672-88e6-5dfdfc6dc07d tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:93:cc,bridge_name='br-int',has_traffic_filtering=True,id=902b1013-6c79-4a5a-ab19-782ac8dc715b,network=Network(4fe4d56e-afe2-42a6-984a-9af8bc5377a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap902b1013-6c') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:29:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap902b1013-6c, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:29:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:29:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3c584295-77b9-4f7f-a76c-d9710f416931) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:29:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:16 user nova-compute[75066]: INFO os_vif [None req-354ba73a-67df-4672-88e6-5dfdfc6dc07d tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:93:cc,bridge_name='br-int',has_traffic_filtering=True,id=902b1013-6c79-4a5a-ab19-782ac8dc715b,network=Network(4fe4d56e-afe2-42a6-984a-9af8bc5377a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap902b1013-6c')
Dec 01 19:29:16 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-354ba73a-67df-4672-88e6-5dfdfc6dc07d tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Deleting instance files /opt/stack/data/nova/instances/23e17727-40b4-48f7-9155-abc8ffa9f619_del
Dec 01 19:29:16 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-354ba73a-67df-4672-88e6-5dfdfc6dc07d tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Deletion of /opt/stack/data/nova/instances/23e17727-40b4-48f7-9155-abc8ffa9f619_del complete
Dec 01 19:29:16 user nova-compute[75066]: INFO nova.compute.manager [None req-354ba73a-67df-4672-88e6-5dfdfc6dc07d tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Took 0.99 seconds to destroy the instance on the hypervisor.
Dec 01 19:29:16 user nova-compute[75066]: DEBUG oslo.service.loopingcall [None req-354ba73a-67df-4672-88e6-5dfdfc6dc07d tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75066) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 19:29:16 user nova-compute[75066]: DEBUG nova.compute.manager [-] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Deallocating network for instance {{(pid=75066) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 19:29:16 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] deallocate_for_instance() {{(pid=75066) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 19:29:16 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:29:16 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:29:16 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Starting heal instance info cache {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 19:29:16 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Didn't find any instances for network info cache update. {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 01 19:29:16 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:29:16 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:29:16 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:29:16 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75066) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 19:29:16 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:29:16 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:29:16 user nova-compute[75066]: INFO nova.compute.manager [-] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Took 0.87 seconds to deallocate network for instance.
Dec 01 19:29:16 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d81ce119-1b29-4cf2-929f-3f729d367046 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:29:16 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d81ce119-1b29-4cf2-929f-3f729d367046 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:29:16 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:29:16 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gLtkPwAS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 19:29:16 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.448s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:29:16 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] <== connect_volume: return (1448ms) {'type': 'block', 'scsi_wwn': '26365323832643863', 'path': '/dev/sdb'} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:29:16 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365323832643863', 'path': '/dev/sdb'} {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 19:29:16 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:26:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1664862107',display_name='tempest-ServerActionsTestOtherA-server-1664862107',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1664862107',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAjcDJi5RJTCazFFAj7dx2qLuKSEoyASrqNDKgiQGRQPewzJhIu6lQd3yuH2207H2lpqZiyuqBj2lXvz5vQM52pZXpO90p/UH43nVMO2RrMH5S7NUl16+at0nkGQGj24ng==',key_name='tempest-keypair-1092575275',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:27:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fb0f7516d1db4dd5bc7d77a0bd1d44d7',ramdisk_id='',reservation_id='r-5u7ef9p2',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1700253921',owner_user_name='tempest-ServerActionsTestOtherA-1700253921-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:28:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfb3e7b4b0444223af282b16da9bd919',uuid=00506483-8f09-4a3d-938a-31ab1b2dbf83,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b0528c8d-a14c-4420-a248-fda3f0a92893", "address": "fa:16:3e:a6:1a:51", "network": {"id": "9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-696310557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-696310557-network", "vif_mac": "fa:16:3e:a6:1a:51"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0f7516d1db4dd5bc7d77a0bd1d44d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0528c8d-a1", "ovs_interfaceid": "b0528c8d-a14c-4420-a248-fda3f0a92893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:29:16 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Converting VIF {"id": "b0528c8d-a14c-4420-a248-fda3f0a92893", "address": "fa:16:3e:a6:1a:51", "network": {"id": "9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-696310557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-696310557-network", "vif_mac": "fa:16:3e:a6:1a:51"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0f7516d1db4dd5bc7d77a0bd1d44d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0528c8d-a1", "ovs_interfaceid": "b0528c8d-a14c-4420-a248-fda3f0a92893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:29:16 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:1a:51,bridge_name='br-int',has_traffic_filtering=True,id=b0528c8d-a14c-4420-a248-fda3f0a92893,network=Network(9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0528c8d-a1') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:29:16 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:29:16 user nova-compute[75066]:   <uuid>00506483-8f09-4a3d-938a-31ab1b2dbf83</uuid>
Dec 01 19:29:16 user nova-compute[75066]:   <name>instance-0000001c</name>
Dec 01 19:29:16 user nova-compute[75066]:   <memory>2097152</memory>
Dec 01 19:29:16 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:29:16 user nova-compute[75066]:   <metadata>
Dec 01 19:29:16 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:29:16 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:29:16 user nova-compute[75066]:       <nova:name>tempest-ServerActionsTestOtherA-server-1664862107</nova:name>
Dec 01 19:29:16 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:29:15</nova:creationTime>
Dec 01 19:29:16 user nova-compute[75066]:       <nova:flavor name="m1.small">
Dec 01 19:29:16 user nova-compute[75066]:         <nova:memory>2048</nova:memory>
Dec 01 19:29:16 user nova-compute[75066]:         <nova:disk>20</nova:disk>
Dec 01 19:29:16 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:29:16 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:29:16 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:29:16 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:29:16 user nova-compute[75066]:       <nova:owner>
Dec 01 19:29:16 user nova-compute[75066]:         <nova:user uuid="cfb3e7b4b0444223af282b16da9bd919">tempest-ServerActionsTestOtherA-1700253921-project-member</nova:user>
Dec 01 19:29:16 user nova-compute[75066]:         <nova:project uuid="fb0f7516d1db4dd5bc7d77a0bd1d44d7">tempest-ServerActionsTestOtherA-1700253921</nova:project>
Dec 01 19:29:16 user nova-compute[75066]:       </nova:owner>
Dec 01 19:29:16 user nova-compute[75066]:       <nova:ports>
Dec 01 19:29:16 user nova-compute[75066]:         <nova:port uuid="b0528c8d-a14c-4420-a248-fda3f0a92893">
Dec 01 19:29:16 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Dec 01 19:29:16 user nova-compute[75066]:         </nova:port>
Dec 01 19:29:16 user nova-compute[75066]:       </nova:ports>
Dec 01 19:29:16 user nova-compute[75066]:     </nova:instance>
Dec 01 19:29:16 user nova-compute[75066]:   </metadata>
Dec 01 19:29:16 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:29:16 user nova-compute[75066]:     <system>
Dec 01 19:29:16 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:29:16 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:29:16 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:29:16 user nova-compute[75066]:       <entry name="serial">00506483-8f09-4a3d-938a-31ab1b2dbf83</entry>
Dec 01 19:29:16 user nova-compute[75066]:       <entry name="uuid">00506483-8f09-4a3d-938a-31ab1b2dbf83</entry>
Dec 01 19:29:16 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:29:16 user nova-compute[75066]:     </system>
Dec 01 19:29:16 user nova-compute[75066]:   </sysinfo>
Dec 01 19:29:16 user nova-compute[75066]:   <os>
Dec 01 19:29:16 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:29:16 user nova-compute[75066]:     <boot dev="hd"/>
Dec 01 19:29:16 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:29:16 user nova-compute[75066]:   </os>
Dec 01 19:29:16 user nova-compute[75066]:   <features>
Dec 01 19:29:16 user nova-compute[75066]:     <acpi/>
Dec 01 19:29:16 user nova-compute[75066]:     <apic/>
Dec 01 19:29:16 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:29:16 user nova-compute[75066]:   </features>
Dec 01 19:29:16 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:29:16 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:29:16 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:29:16 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:29:16 user nova-compute[75066]:   </clock>
Dec 01 19:29:16 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:29:16 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:29:16 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:29:16 user nova-compute[75066]:   </cpu>
Dec 01 19:29:16 user nova-compute[75066]:   <devices>
Dec 01 19:29:16 user nova-compute[75066]:     <disk type="block" device="disk">
Dec 01 19:29:16 user nova-compute[75066]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:29:16 user nova-compute[75066]:       <source dev="/dev/sdb"/>
Dec 01 19:29:16 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:29:16 user nova-compute[75066]:       <serial>333c6d2d-5a25-42f1-8a9b-9366196fd6f9</serial>
Dec 01 19:29:16 user nova-compute[75066]:     </disk>
Dec 01 19:29:16 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:29:16 user nova-compute[75066]:       <mac address="fa:16:3e:a6:1a:51"/>
Dec 01 19:29:16 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:29:16 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:29:16 user nova-compute[75066]:       <target dev="tapb0528c8d-a1"/>
Dec 01 19:29:16 user nova-compute[75066]:     </interface>
Dec 01 19:29:16 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:29:16 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/00506483-8f09-4a3d-938a-31ab1b2dbf83/console.log" append="off"/>
Dec 01 19:29:16 user nova-compute[75066]:     </serial>
Dec 01 19:29:16 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:29:16 user nova-compute[75066]:     <video>
Dec 01 19:29:16 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:29:16 user nova-compute[75066]:     </video>
Dec 01 19:29:16 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:29:16 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:29:16 user nova-compute[75066]:     </rng>
Dec 01 19:29:16 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:29:16 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:29:16 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:29:16 user nova-compute[75066]:     </memballoon>
Dec 01 19:29:16 user nova-compute[75066]:   </devices>
Dec 01 19:29:16 user nova-compute[75066]: </domain>
Dec 01 19:29:16 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:29:16 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:26:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1664862107',display_name='tempest-ServerActionsTestOtherA-server-1664862107',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1664862107',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAjcDJi5RJTCazFFAj7dx2qLuKSEoyASrqNDKgiQGRQPewzJhIu6lQd3yuH2207H2lpqZiyuqBj2lXvz5vQM52pZXpO90p/UH43nVMO2RrMH5S7NUl16+at0nkGQGj24ng==',key_name='tempest-keypair-1092575275',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:27:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='fb0f7516d1db4dd5bc7d77a0bd1d44d7',ramdisk_id='',reservation_id='r-5u7ef9p2',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1700253921',owner_user_name='tempest-ServerActionsTestOtherA-1700253921-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:28:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfb3e7b4b0444223af282b16da9bd919',uuid=00506483-8f09-4a3d-938a-31ab1b2dbf83,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b0528c8d-a14c-4420-a248-fda3f0a92893", "address": "fa:16:3e:a6:1a:51", "network": {"id": "9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-696310557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-696310557-network", "vif_mac": "fa:16:3e:a6:1a:51"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0f7516d1db4dd5bc7d77a0bd1d44d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0528c8d-a1", "ovs_interfaceid": "b0528c8d-a14c-4420-a248-fda3f0a92893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:29:16 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Converting VIF {"id": "b0528c8d-a14c-4420-a248-fda3f0a92893", "address": "fa:16:3e:a6:1a:51", "network": {"id": "9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-696310557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-696310557-network", "vif_mac": "fa:16:3e:a6:1a:51"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0f7516d1db4dd5bc7d77a0bd1d44d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0528c8d-a1", "ovs_interfaceid": "b0528c8d-a14c-4420-a248-fda3f0a92893", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:29:16 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:1a:51,bridge_name='br-int',has_traffic_filtering=True,id=b0528c8d-a14c-4420-a248-fda3f0a92893,network=Network(9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0528c8d-a1') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:29:16 user nova-compute[75066]: DEBUG os_vif [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:1a:51,bridge_name='br-int',has_traffic_filtering=True,id=b0528c8d-a14c-4420-a248-fda3f0a92893,network=Network(9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0528c8d-a1') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:29:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:29:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:29:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '57ecada9-4f80-59a8-9466-9d10654167fd', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:29:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:16 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:29:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:29:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb0528c8d-a1, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:29:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb0528c8d-a1, col_values=(('qos', UUID('b3f1b2fa-761f-4035-968f-75dc10b4c527')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:29:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb0528c8d-a1, col_values=(('external_ids', {'iface-id': 'b0528c8d-a14c-4420-a248-fda3f0a92893', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:1a:51', 'vm-uuid': '00506483-8f09-4a3d-938a-31ab1b2dbf83'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:29:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:29:16 user nova-compute[75066]: INFO nova.compute.manager [-] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Took 0.68 seconds to deallocate network for instance.
Dec 01 19:29:16 user nova-compute[75066]: INFO os_vif [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:1a:51,bridge_name='br-int',has_traffic_filtering=True,id=b0528c8d-a14c-4420-a248-fda3f0a92893,network=Network(9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0528c8d-a1')
Dec 01 19:29:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-354ba73a-67df-4672-88e6-5dfdfc6dc07d tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:29:17 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:29:17 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] No VIF found with MAC fa:16:3e:a6:1a:51, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:29:17 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-d81ce119-1b29-4cf2-929f-3f729d367046 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:29:17 user nova-compute[75066]: DEBUG nova.compute.manager [req-6b484ce5-13ff-4bf6-af47-6a5eb74449ad req-45614def-274a-4c01-87b5-99a5f9f25bf5 service nova] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Received event network-vif-plugged-918beedf-26db-4ea9-be7b-5170ca29ee52 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:29:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-6b484ce5-13ff-4bf6-af47-6a5eb74449ad req-45614def-274a-4c01-87b5-99a5f9f25bf5 service nova] Acquiring lock "3b355778-bd25-42f6-8026-110668920d8b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:29:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-6b484ce5-13ff-4bf6-af47-6a5eb74449ad req-45614def-274a-4c01-87b5-99a5f9f25bf5 service nova] Lock "3b355778-bd25-42f6-8026-110668920d8b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:29:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-6b484ce5-13ff-4bf6-af47-6a5eb74449ad req-45614def-274a-4c01-87b5-99a5f9f25bf5 service nova] Lock "3b355778-bd25-42f6-8026-110668920d8b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:29:17 user nova-compute[75066]: DEBUG nova.compute.manager [req-6b484ce5-13ff-4bf6-af47-6a5eb74449ad req-45614def-274a-4c01-87b5-99a5f9f25bf5 service nova] [instance: 3b355778-bd25-42f6-8026-110668920d8b] No waiting events found dispatching network-vif-plugged-918beedf-26db-4ea9-be7b-5170ca29ee52 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:29:17 user nova-compute[75066]: WARNING nova.compute.manager [req-6b484ce5-13ff-4bf6-af47-6a5eb74449ad req-45614def-274a-4c01-87b5-99a5f9f25bf5 service nova] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Received unexpected event network-vif-plugged-918beedf-26db-4ea9-be7b-5170ca29ee52 for instance with vm_state deleted and task_state None.
Dec 01 19:29:17 user nova-compute[75066]: DEBUG nova.compute.manager [req-6b484ce5-13ff-4bf6-af47-6a5eb74449ad req-45614def-274a-4c01-87b5-99a5f9f25bf5 service nova] [instance: 3b355778-bd25-42f6-8026-110668920d8b] Received event network-vif-deleted-918beedf-26db-4ea9-be7b-5170ca29ee52 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:29:17 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-d81ce119-1b29-4cf2-929f-3f729d367046 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:29:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d81ce119-1b29-4cf2-929f-3f729d367046 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.496s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:29:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-354ba73a-67df-4672-88e6-5dfdfc6dc07d tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.166s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:29:17 user nova-compute[75066]: INFO nova.scheduler.client.report [None req-d81ce119-1b29-4cf2-929f-3f729d367046 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Deleted allocations for instance 3b355778-bd25-42f6-8026-110668920d8b
Dec 01 19:29:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d81ce119-1b29-4cf2-929f-3f729d367046 tempest-AttachVolumeTestJSON-1914192398 tempest-AttachVolumeTestJSON-1914192398-project-member] Lock "3b355778-bd25-42f6-8026-110668920d8b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.767s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:29:17 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-354ba73a-67df-4672-88e6-5dfdfc6dc07d tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:29:17 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-354ba73a-67df-4672-88e6-5dfdfc6dc07d tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:29:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-354ba73a-67df-4672-88e6-5dfdfc6dc07d tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.425s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:29:17 user nova-compute[75066]: INFO nova.scheduler.client.report [None req-354ba73a-67df-4672-88e6-5dfdfc6dc07d tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Deleted allocations for instance 23e17727-40b4-48f7-9155-abc8ffa9f619
Dec 01 19:29:17 user nova-compute[75066]: DEBUG nova.compute.manager [req-9faf29cd-cff5-46ea-8cd6-f81fce94fb9c req-4bd03eb5-15e8-4094-84bb-2ce7285e7b88 service nova] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Received event network-vif-plugged-902b1013-6c79-4a5a-ab19-782ac8dc715b {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:29:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-9faf29cd-cff5-46ea-8cd6-f81fce94fb9c req-4bd03eb5-15e8-4094-84bb-2ce7285e7b88 service nova] Acquiring lock "23e17727-40b4-48f7-9155-abc8ffa9f619-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:29:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-9faf29cd-cff5-46ea-8cd6-f81fce94fb9c req-4bd03eb5-15e8-4094-84bb-2ce7285e7b88 service nova] Lock "23e17727-40b4-48f7-9155-abc8ffa9f619-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:29:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-9faf29cd-cff5-46ea-8cd6-f81fce94fb9c req-4bd03eb5-15e8-4094-84bb-2ce7285e7b88 service nova] Lock "23e17727-40b4-48f7-9155-abc8ffa9f619-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:29:17 user nova-compute[75066]: DEBUG nova.compute.manager [req-9faf29cd-cff5-46ea-8cd6-f81fce94fb9c req-4bd03eb5-15e8-4094-84bb-2ce7285e7b88 service nova] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] No waiting events found dispatching network-vif-plugged-902b1013-6c79-4a5a-ab19-782ac8dc715b {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:29:17 user nova-compute[75066]: WARNING nova.compute.manager [req-9faf29cd-cff5-46ea-8cd6-f81fce94fb9c req-4bd03eb5-15e8-4094-84bb-2ce7285e7b88 service nova] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Received unexpected event network-vif-plugged-902b1013-6c79-4a5a-ab19-782ac8dc715b for instance with vm_state deleted and task_state None.
Dec 01 19:29:17 user nova-compute[75066]: DEBUG nova.compute.manager [req-9faf29cd-cff5-46ea-8cd6-f81fce94fb9c req-4bd03eb5-15e8-4094-84bb-2ce7285e7b88 service nova] [instance: 23e17727-40b4-48f7-9155-abc8ffa9f619] Received event network-vif-deleted-902b1013-6c79-4a5a-ab19-782ac8dc715b {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:29:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-354ba73a-67df-4672-88e6-5dfdfc6dc07d tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "23e17727-40b4-48f7-9155-abc8ffa9f619" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.525s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:29:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:18 user nova-compute[75066]: DEBUG nova.compute.manager [req-7cb81c15-028f-4e02-928e-1872fa78de76 req-1392bc97-1246-4743-80c4-aadba9af7117 service nova] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Received event network-vif-plugged-b0528c8d-a14c-4420-a248-fda3f0a92893 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:29:18 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-7cb81c15-028f-4e02-928e-1872fa78de76 req-1392bc97-1246-4743-80c4-aadba9af7117 service nova] Acquiring lock "00506483-8f09-4a3d-938a-31ab1b2dbf83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:29:18 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-7cb81c15-028f-4e02-928e-1872fa78de76 req-1392bc97-1246-4743-80c4-aadba9af7117 service nova] Lock "00506483-8f09-4a3d-938a-31ab1b2dbf83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:29:18 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-7cb81c15-028f-4e02-928e-1872fa78de76 req-1392bc97-1246-4743-80c4-aadba9af7117 service nova] Lock "00506483-8f09-4a3d-938a-31ab1b2dbf83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:29:18 user nova-compute[75066]: DEBUG nova.compute.manager [req-7cb81c15-028f-4e02-928e-1872fa78de76 req-1392bc97-1246-4743-80c4-aadba9af7117 service nova] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] No waiting events found dispatching network-vif-plugged-b0528c8d-a14c-4420-a248-fda3f0a92893 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:29:18 user nova-compute[75066]: WARNING nova.compute.manager [req-7cb81c15-028f-4e02-928e-1872fa78de76 req-1392bc97-1246-4743-80c4-aadba9af7117 service nova] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Received unexpected event network-vif-plugged-b0528c8d-a14c-4420-a248-fda3f0a92893 for instance with vm_state active and task_state resize_finish.
Dec 01 19:29:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:20 user nova-compute[75066]: DEBUG nova.compute.manager [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Instance event wait completed in 0 seconds for  {{(pid=75066) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 19:29:20 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Instance running successfully.
Dec 01 19:29:20 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Failed to set time: agent not configured {{(pid=75066) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Dec 01 19:29:20 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-d31c09f8-5330-4e67-a51e-0f233855289f tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] finish_migration finished successfully. {{(pid=75066) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11763}}
Dec 01 19:29:20 user nova-compute[75066]: DEBUG nova.compute.manager [req-af0e359e-e7b8-418c-a29e-f905d8b201b8 req-290e7c38-d41b-43ff-beac-d49496414501 service nova] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Received event network-vif-plugged-b0528c8d-a14c-4420-a248-fda3f0a92893 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:29:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-af0e359e-e7b8-418c-a29e-f905d8b201b8 req-290e7c38-d41b-43ff-beac-d49496414501 service nova] Acquiring lock "00506483-8f09-4a3d-938a-31ab1b2dbf83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:29:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-af0e359e-e7b8-418c-a29e-f905d8b201b8 req-290e7c38-d41b-43ff-beac-d49496414501 service nova] Lock "00506483-8f09-4a3d-938a-31ab1b2dbf83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:29:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-af0e359e-e7b8-418c-a29e-f905d8b201b8 req-290e7c38-d41b-43ff-beac-d49496414501 service nova] Lock "00506483-8f09-4a3d-938a-31ab1b2dbf83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:29:20 user nova-compute[75066]: DEBUG nova.compute.manager [req-af0e359e-e7b8-418c-a29e-f905d8b201b8 req-290e7c38-d41b-43ff-beac-d49496414501 service nova] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] No waiting events found dispatching network-vif-plugged-b0528c8d-a14c-4420-a248-fda3f0a92893 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:29:20 user nova-compute[75066]: WARNING nova.compute.manager [req-af0e359e-e7b8-418c-a29e-f905d8b201b8 req-290e7c38-d41b-43ff-beac-d49496414501 service nova] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Received unexpected event network-vif-plugged-b0528c8d-a14c-4420-a248-fda3f0a92893 for instance with vm_state active and task_state resize_finish.
Dec 01 19:29:21 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:22 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:26 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:27 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:31 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:32 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:35 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:36 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:37 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:37 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:41 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:42 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:42 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:44 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:46 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:47 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:48 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Acquiring lock "e9a9bf17-1c03-426a-b33e-9d8c458df283" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:29:48 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Lock "e9a9bf17-1c03-426a-b33e-9d8c458df283" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:29:48 user nova-compute[75066]: DEBUG nova.compute.manager [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Starting instance... {{(pid=75066) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 19:29:48 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:29:48 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:29:48 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75066) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 19:29:48 user nova-compute[75066]: INFO nova.compute.claims [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Claim successful on node user
Dec 01 19:29:48 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:29:48 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:29:48 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.422s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:29:48 user nova-compute[75066]: DEBUG nova.compute.manager [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Start building networks asynchronously for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 19:29:48 user nova-compute[75066]: DEBUG nova.compute.manager [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Allocating IP information in the background. {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 19:29:48 user nova-compute[75066]: DEBUG nova.network.neutron [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] allocate_for_instance() {{(pid=75066) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 19:29:48 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 19:29:48 user nova-compute[75066]: DEBUG nova.compute.manager [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Start building block device mappings for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 19:29:49 user nova-compute[75066]: DEBUG nova.policy [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c263caa90725445e8cf7eb481fc6af3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99b27d42c6c64cf08f74c75717439c13', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75066) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 19:29:49 user nova-compute[75066]: DEBUG nova.compute.manager [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Start spawning the instance on the hypervisor. {{(pid=75066) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 19:29:49 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Creating instance directory {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 19:29:49 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Creating image(s)
Dec 01 19:29:49 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Acquiring lock "/opt/stack/data/nova/instances/e9a9bf17-1c03-426a-b33e-9d8c458df283/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:29:49 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Lock "/opt/stack/data/nova/instances/e9a9bf17-1c03-426a-b33e-9d8c458df283/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:29:49 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Lock "/opt/stack/data/nova/instances/e9a9bf17-1c03-426a-b33e-9d8c458df283/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:29:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.170s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:49 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Acquiring lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:29:49 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:29:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.220s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/e9a9bf17-1c03-426a-b33e-9d8c458df283/disk 1073741824 {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:49 user nova-compute[75066]: DEBUG nova.network.neutron [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Successfully created port: a517b344-264d-4bf9-8c6a-48c950d4bca0 {{(pid=75066) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 19:29:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/e9a9bf17-1c03-426a-b33e-9d8c458df283/disk 1073741824" returned: 0 in 0.052s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:49 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:29:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.173s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:49 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e9a9bf17-1c03-426a-b33e-9d8c458df283/disk. size=1073741824 {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 19:29:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9a9bf17-1c03-426a-b33e-9d8c458df283/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:29:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9a9bf17-1c03-426a-b33e-9d8c458df283/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:29:49 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Cannot resize image /opt/stack/data/nova/instances/e9a9bf17-1c03-426a-b33e-9d8c458df283/disk to a smaller size. {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 19:29:49 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Created local disks {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 19:29:49 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Ensure instance console log exists: /opt/stack/data/nova/instances/e9a9bf17-1c03-426a-b33e-9d8c458df283/console.log {{(pid=75066) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 19:29:49 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:29:49 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:29:49 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:29:50 user nova-compute[75066]: DEBUG nova.network.neutron [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Successfully updated port: a517b344-264d-4bf9-8c6a-48c950d4bca0 {{(pid=75066) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 19:29:50 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Acquiring lock "refresh_cache-e9a9bf17-1c03-426a-b33e-9d8c458df283" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:29:50 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Acquired lock "refresh_cache-e9a9bf17-1c03-426a-b33e-9d8c458df283" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:29:50 user nova-compute[75066]: DEBUG nova.network.neutron [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:29:50 user nova-compute[75066]: DEBUG nova.compute.manager [req-e48d8d6e-2695-4bcd-85e6-f0837733e204 req-ee02cc2f-b57c-4c5e-b33e-54e302e0a92d service nova] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Received event network-changed-a517b344-264d-4bf9-8c6a-48c950d4bca0 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:29:50 user nova-compute[75066]: DEBUG nova.compute.manager [req-e48d8d6e-2695-4bcd-85e6-f0837733e204 req-ee02cc2f-b57c-4c5e-b33e-54e302e0a92d service nova] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Refreshing instance network info cache due to event network-changed-a517b344-264d-4bf9-8c6a-48c950d4bca0. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:29:50 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-e48d8d6e-2695-4bcd-85e6-f0837733e204 req-ee02cc2f-b57c-4c5e-b33e-54e302e0a92d service nova] Acquiring lock "refresh_cache-e9a9bf17-1c03-426a-b33e-9d8c458df283" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:29:50 user nova-compute[75066]: DEBUG nova.network.neutron [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:29:50 user nova-compute[75066]: DEBUG nova.network.neutron [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Updating instance_info_cache with network_info: [{"id": "a517b344-264d-4bf9-8c6a-48c950d4bca0", "address": "fa:16:3e:37:9e:f3", "network": {"id": "0432709c-c027-41b5-afa1-a9221c85cd4e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1490736568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99b27d42c6c64cf08f74c75717439c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa517b344-26", "ovs_interfaceid": "a517b344-264d-4bf9-8c6a-48c950d4bca0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:29:50 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Releasing lock "refresh_cache-e9a9bf17-1c03-426a-b33e-9d8c458df283" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:29:50 user nova-compute[75066]: DEBUG nova.compute.manager [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Instance network_info: |[{"id": "a517b344-264d-4bf9-8c6a-48c950d4bca0", "address": "fa:16:3e:37:9e:f3", "network": {"id": "0432709c-c027-41b5-afa1-a9221c85cd4e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1490736568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99b27d42c6c64cf08f74c75717439c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa517b344-26", "ovs_interfaceid": "a517b344-264d-4bf9-8c6a-48c950d4bca0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 19:29:50 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-e48d8d6e-2695-4bcd-85e6-f0837733e204 req-ee02cc2f-b57c-4c5e-b33e-54e302e0a92d service nova] Acquired lock "refresh_cache-e9a9bf17-1c03-426a-b33e-9d8c458df283" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:29:50 user nova-compute[75066]: DEBUG nova.network.neutron [req-e48d8d6e-2695-4bcd-85e6-f0837733e204 req-ee02cc2f-b57c-4c5e-b33e-54e302e0a92d service nova] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Refreshing network info cache for port a517b344-264d-4bf9-8c6a-48c950d4bca0 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:29:50 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Start _get_guest_xml network_info=[{"id": "a517b344-264d-4bf9-8c6a-48c950d4bca0", "address": "fa:16:3e:37:9e:f3", "network": {"id": "0432709c-c027-41b5-afa1-a9221c85cd4e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1490736568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99b27d42c6c64cf08f74c75717439c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa517b344-26", "ovs_interfaceid": "a517b344-264d-4bf9-8c6a-48c950d4bca0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'image_id': '900b237b-e99c-4fdd-a44f-dcb7a08baa86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:29:50 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:29:50 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:29:50 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:29:50 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:29:50 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:29:50 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:29:50 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:29:50 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:29:50 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:29:50 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:29:50 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:29:50 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:29:50 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:29:50 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:29:50 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:29:50 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:29:50 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:29:50 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:29:50 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:29:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-774622526',display_name='tempest-TestServerVolumeAttachmentScenario-server-774622526',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-774622526',id=32,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7d6kDBnFyFcNVVXa33UmWf1yW6+6Z/Of2MyQnjw2TaaDlepM5519GYX6arcskIqtNfHVxPZQeGdEgGl5BLrqRzrgs1nV2upD/yucUQTclnWmDXrfJGIHuTQnhHtl93Qw==',key_name='tempest-keypair-823038',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99b27d42c6c64cf08f74c75717439c13',ramdisk_id='',reservation_id='r-r4322m3a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1483328456',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1483328456-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:29:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c263caa90725445e8cf7eb481fc6af3c',uuid=e9a9bf17-1c03-426a-b33e-9d8c458df283,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a517b344-264d-4bf9-8c6a-48c950d4bca0", "address": "fa:16:3e:37:9e:f3", "network": {"id": "0432709c-c027-41b5-afa1-a9221c85cd4e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1490736568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99b27d42c6c64cf08f74c75717439c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa517b344-26", "ovs_interfaceid": "a517b344-264d-4bf9-8c6a-48c950d4bca0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:29:50 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Converting VIF {"id": "a517b344-264d-4bf9-8c6a-48c950d4bca0", "address": "fa:16:3e:37:9e:f3", "network": {"id": "0432709c-c027-41b5-afa1-a9221c85cd4e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1490736568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99b27d42c6c64cf08f74c75717439c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa517b344-26", "ovs_interfaceid": "a517b344-264d-4bf9-8c6a-48c950d4bca0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:29:50 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:9e:f3,bridge_name='br-int',has_traffic_filtering=True,id=a517b344-264d-4bf9-8c6a-48c950d4bca0,network=Network(0432709c-c027-41b5-afa1-a9221c85cd4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa517b344-26') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:29:50 user nova-compute[75066]: DEBUG nova.objects.instance [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Lazy-loading 'pci_devices' on Instance uuid e9a9bf17-1c03-426a-b33e-9d8c458df283 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:29:50 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:29:50 user nova-compute[75066]:   <uuid>e9a9bf17-1c03-426a-b33e-9d8c458df283</uuid>
Dec 01 19:29:50 user nova-compute[75066]:   <name>instance-00000020</name>
Dec 01 19:29:50 user nova-compute[75066]:   <memory>524288</memory>
Dec 01 19:29:50 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:29:50 user nova-compute[75066]:   <metadata>
Dec 01 19:29:50 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:29:50 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:29:50 user nova-compute[75066]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-774622526</nova:name>
Dec 01 19:29:50 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:29:50</nova:creationTime>
Dec 01 19:29:50 user nova-compute[75066]:       <nova:flavor name="m1.tiny">
Dec 01 19:29:50 user nova-compute[75066]:         <nova:memory>512</nova:memory>
Dec 01 19:29:50 user nova-compute[75066]:         <nova:disk>1</nova:disk>
Dec 01 19:29:50 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:29:50 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:29:50 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:29:50 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:29:50 user nova-compute[75066]:       <nova:owner>
Dec 01 19:29:50 user nova-compute[75066]:         <nova:user uuid="c263caa90725445e8cf7eb481fc6af3c">tempest-TestServerVolumeAttachmentScenario-1483328456-project-member</nova:user>
Dec 01 19:29:50 user nova-compute[75066]:         <nova:project uuid="99b27d42c6c64cf08f74c75717439c13">tempest-TestServerVolumeAttachmentScenario-1483328456</nova:project>
Dec 01 19:29:50 user nova-compute[75066]:       </nova:owner>
Dec 01 19:29:50 user nova-compute[75066]:       <nova:root type="image" uuid="900b237b-e99c-4fdd-a44f-dcb7a08baa86"/>
Dec 01 19:29:50 user nova-compute[75066]:       <nova:ports>
Dec 01 19:29:50 user nova-compute[75066]:         <nova:port uuid="a517b344-264d-4bf9-8c6a-48c950d4bca0">
Dec 01 19:29:50 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Dec 01 19:29:50 user nova-compute[75066]:         </nova:port>
Dec 01 19:29:50 user nova-compute[75066]:       </nova:ports>
Dec 01 19:29:50 user nova-compute[75066]:     </nova:instance>
Dec 01 19:29:50 user nova-compute[75066]:   </metadata>
Dec 01 19:29:50 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:29:50 user nova-compute[75066]:     <system>
Dec 01 19:29:50 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:29:50 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:29:50 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:29:50 user nova-compute[75066]:       <entry name="serial">e9a9bf17-1c03-426a-b33e-9d8c458df283</entry>
Dec 01 19:29:50 user nova-compute[75066]:       <entry name="uuid">e9a9bf17-1c03-426a-b33e-9d8c458df283</entry>
Dec 01 19:29:50 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:29:50 user nova-compute[75066]:     </system>
Dec 01 19:29:50 user nova-compute[75066]:   </sysinfo>
Dec 01 19:29:50 user nova-compute[75066]:   <os>
Dec 01 19:29:50 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:29:50 user nova-compute[75066]:     <boot dev="hd"/>
Dec 01 19:29:50 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:29:50 user nova-compute[75066]:   </os>
Dec 01 19:29:50 user nova-compute[75066]:   <features>
Dec 01 19:29:50 user nova-compute[75066]:     <acpi/>
Dec 01 19:29:50 user nova-compute[75066]:     <apic/>
Dec 01 19:29:50 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:29:50 user nova-compute[75066]:   </features>
Dec 01 19:29:50 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:29:50 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:29:50 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:29:50 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:29:50 user nova-compute[75066]:   </clock>
Dec 01 19:29:50 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:29:50 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:29:50 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:29:50 user nova-compute[75066]:   </cpu>
Dec 01 19:29:50 user nova-compute[75066]:   <devices>
Dec 01 19:29:50 user nova-compute[75066]:     <disk type="file" device="disk">
Dec 01 19:29:50 user nova-compute[75066]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 19:29:50 user nova-compute[75066]:       <source file="/opt/stack/data/nova/instances/e9a9bf17-1c03-426a-b33e-9d8c458df283/disk"/>
Dec 01 19:29:50 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:29:50 user nova-compute[75066]:     </disk>
Dec 01 19:29:50 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:29:50 user nova-compute[75066]:       <mac address="fa:16:3e:37:9e:f3"/>
Dec 01 19:29:50 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:29:50 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:29:50 user nova-compute[75066]:       <target dev="tapa517b344-26"/>
Dec 01 19:29:50 user nova-compute[75066]:     </interface>
Dec 01 19:29:50 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:29:50 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/e9a9bf17-1c03-426a-b33e-9d8c458df283/console.log" append="off"/>
Dec 01 19:29:50 user nova-compute[75066]:     </serial>
Dec 01 19:29:50 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:29:50 user nova-compute[75066]:     <video>
Dec 01 19:29:50 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:29:50 user nova-compute[75066]:     </video>
Dec 01 19:29:50 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:29:50 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:29:50 user nova-compute[75066]:     </rng>
Dec 01 19:29:50 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:29:50 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:29:50 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:29:50 user nova-compute[75066]:     </memballoon>
Dec 01 19:29:50 user nova-compute[75066]:   </devices>
Dec 01 19:29:50 user nova-compute[75066]: </domain>
Dec 01 19:29:50 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:29:50 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:29:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-774622526',display_name='tempest-TestServerVolumeAttachmentScenario-server-774622526',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-774622526',id=32,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7d6kDBnFyFcNVVXa33UmWf1yW6+6Z/Of2MyQnjw2TaaDlepM5519GYX6arcskIqtNfHVxPZQeGdEgGl5BLrqRzrgs1nV2upD/yucUQTclnWmDXrfJGIHuTQnhHtl93Qw==',key_name='tempest-keypair-823038',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='99b27d42c6c64cf08f74c75717439c13',ramdisk_id='',reservation_id='r-r4322m3a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1483328456',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1483328456-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:29:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c263caa90725445e8cf7eb481fc6af3c',uuid=e9a9bf17-1c03-426a-b33e-9d8c458df283,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a517b344-264d-4bf9-8c6a-48c950d4bca0", "address": "fa:16:3e:37:9e:f3", "network": {"id": "0432709c-c027-41b5-afa1-a9221c85cd4e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1490736568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99b27d42c6c64cf08f74c75717439c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa517b344-26", "ovs_interfaceid": "a517b344-264d-4bf9-8c6a-48c950d4bca0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:29:50 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Converting VIF {"id": "a517b344-264d-4bf9-8c6a-48c950d4bca0", "address": "fa:16:3e:37:9e:f3", "network": {"id": "0432709c-c027-41b5-afa1-a9221c85cd4e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1490736568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99b27d42c6c64cf08f74c75717439c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa517b344-26", "ovs_interfaceid": "a517b344-264d-4bf9-8c6a-48c950d4bca0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:29:50 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:9e:f3,bridge_name='br-int',has_traffic_filtering=True,id=a517b344-264d-4bf9-8c6a-48c950d4bca0,network=Network(0432709c-c027-41b5-afa1-a9221c85cd4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa517b344-26') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:29:50 user nova-compute[75066]: DEBUG os_vif [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:9e:f3,bridge_name='br-int',has_traffic_filtering=True,id=a517b344-264d-4bf9-8c6a-48c950d4bca0,network=Network(0432709c-c027-41b5-afa1-a9221c85cd4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa517b344-26') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:29:50 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:50 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:29:50 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:29:50 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:50 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '93847a91-c3a6-5fc8-90d1-6d9f9399befb', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:29:50 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:50 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:50 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:50 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa517b344-26, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:29:50 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa517b344-26, col_values=(('qos', UUID('0d4078ac-9931-4d97-b492-08a431f1958d')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:29:50 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa517b344-26, col_values=(('external_ids', {'iface-id': 'a517b344-264d-4bf9-8c6a-48c950d4bca0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:9e:f3', 'vm-uuid': 'e9a9bf17-1c03-426a-b33e-9d8c458df283'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:29:50 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:50 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:29:50 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:50 user nova-compute[75066]: INFO os_vif [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:9e:f3,bridge_name='br-int',has_traffic_filtering=True,id=a517b344-264d-4bf9-8c6a-48c950d4bca0,network=Network(0432709c-c027-41b5-afa1-a9221c85cd4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa517b344-26')
Dec 01 19:29:50 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:29:50 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] No VIF found with MAC fa:16:3e:37:9e:f3, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:29:50 user nova-compute[75066]: DEBUG nova.network.neutron [req-e48d8d6e-2695-4bcd-85e6-f0837733e204 req-ee02cc2f-b57c-4c5e-b33e-54e302e0a92d service nova] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Updated VIF entry in instance network info cache for port a517b344-264d-4bf9-8c6a-48c950d4bca0. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:29:50 user nova-compute[75066]: DEBUG nova.network.neutron [req-e48d8d6e-2695-4bcd-85e6-f0837733e204 req-ee02cc2f-b57c-4c5e-b33e-54e302e0a92d service nova] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Updating instance_info_cache with network_info: [{"id": "a517b344-264d-4bf9-8c6a-48c950d4bca0", "address": "fa:16:3e:37:9e:f3", "network": {"id": "0432709c-c027-41b5-afa1-a9221c85cd4e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1490736568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99b27d42c6c64cf08f74c75717439c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa517b344-26", "ovs_interfaceid": "a517b344-264d-4bf9-8c6a-48c950d4bca0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:29:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-e48d8d6e-2695-4bcd-85e6-f0837733e204 req-ee02cc2f-b57c-4c5e-b33e-54e302e0a92d service nova] Releasing lock "refresh_cache-e9a9bf17-1c03-426a-b33e-9d8c458df283" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:29:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:52 user nova-compute[75066]: DEBUG nova.compute.manager [req-fbd83eef-3561-4346-8b42-591890a16026 req-f60aad78-dde0-4243-a1d4-e05a5b604101 service nova] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Received event network-vif-plugged-a517b344-264d-4bf9-8c6a-48c950d4bca0 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:29:52 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-fbd83eef-3561-4346-8b42-591890a16026 req-f60aad78-dde0-4243-a1d4-e05a5b604101 service nova] Acquiring lock "e9a9bf17-1c03-426a-b33e-9d8c458df283-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:29:52 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-fbd83eef-3561-4346-8b42-591890a16026 req-f60aad78-dde0-4243-a1d4-e05a5b604101 service nova] Lock "e9a9bf17-1c03-426a-b33e-9d8c458df283-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:29:52 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-fbd83eef-3561-4346-8b42-591890a16026 req-f60aad78-dde0-4243-a1d4-e05a5b604101 service nova] Lock "e9a9bf17-1c03-426a-b33e-9d8c458df283-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:29:52 user nova-compute[75066]: DEBUG nova.compute.manager [req-fbd83eef-3561-4346-8b42-591890a16026 req-f60aad78-dde0-4243-a1d4-e05a5b604101 service nova] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] No waiting events found dispatching network-vif-plugged-a517b344-264d-4bf9-8c6a-48c950d4bca0 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:29:52 user nova-compute[75066]: WARNING nova.compute.manager [req-fbd83eef-3561-4346-8b42-591890a16026 req-f60aad78-dde0-4243-a1d4-e05a5b604101 service nova] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Received unexpected event network-vif-plugged-a517b344-264d-4bf9-8c6a-48c950d4bca0 for instance with vm_state building and task_state spawning.
Dec 01 19:29:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:54 user nova-compute[75066]: DEBUG nova.compute.manager [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Instance event wait completed in 0 seconds for  {{(pid=75066) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 19:29:54 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Guest created on hypervisor {{(pid=75066) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 19:29:54 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Instance spawned successfully.
Dec 01 19:29:54 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 19:29:54 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Found default for hw_cdrom_bus of ide {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:29:54 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Found default for hw_disk_bus of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:29:54 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Found default for hw_input_bus of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:29:54 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Found default for hw_pointer_model of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:29:54 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Found default for hw_video_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:29:54 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Found default for hw_vif_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:29:54 user nova-compute[75066]: INFO nova.compute.manager [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Took 5.23 seconds to spawn the instance on the hypervisor.
Dec 01 19:29:54 user nova-compute[75066]: DEBUG nova.compute.manager [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:29:54 user nova-compute[75066]: INFO nova.compute.manager [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Took 6.00 seconds to build instance.
Dec 01 19:29:54 user nova-compute[75066]: DEBUG nova.compute.manager [req-8a335b24-450f-48ff-a14b-ceed196e71d1 req-9861d68f-e12c-42bb-9e91-6f86e8830b9e service nova] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Received event network-vif-plugged-a517b344-264d-4bf9-8c6a-48c950d4bca0 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:29:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-8a335b24-450f-48ff-a14b-ceed196e71d1 req-9861d68f-e12c-42bb-9e91-6f86e8830b9e service nova] Acquiring lock "e9a9bf17-1c03-426a-b33e-9d8c458df283-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:29:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-8a335b24-450f-48ff-a14b-ceed196e71d1 req-9861d68f-e12c-42bb-9e91-6f86e8830b9e service nova] Lock "e9a9bf17-1c03-426a-b33e-9d8c458df283-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:29:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-8a335b24-450f-48ff-a14b-ceed196e71d1 req-9861d68f-e12c-42bb-9e91-6f86e8830b9e service nova] Lock "e9a9bf17-1c03-426a-b33e-9d8c458df283-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:29:54 user nova-compute[75066]: DEBUG nova.compute.manager [req-8a335b24-450f-48ff-a14b-ceed196e71d1 req-9861d68f-e12c-42bb-9e91-6f86e8830b9e service nova] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] No waiting events found dispatching network-vif-plugged-a517b344-264d-4bf9-8c6a-48c950d4bca0 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:29:54 user nova-compute[75066]: WARNING nova.compute.manager [req-8a335b24-450f-48ff-a14b-ceed196e71d1 req-9861d68f-e12c-42bb-9e91-6f86e8830b9e service nova] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Received unexpected event network-vif-plugged-a517b344-264d-4bf9-8c6a-48c950d4bca0 for instance with vm_state active and task_state None.
Dec 01 19:29:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-67e4b6ac-2593-42a8-b24f-cb59ced42d48 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Lock "e9a9bf17-1c03-426a-b33e-9d8c458df283" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.096s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:29:54 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:55 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:29:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:00 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:00 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:04 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Acquiring lock "88850ea1-43cd-4066-8e6f-cfe5de621bc6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:30:04 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Lock "88850ea1-43cd-4066-8e6f-cfe5de621bc6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:30:04 user nova-compute[75066]: DEBUG nova.compute.manager [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] Starting instance... {{(pid=75066) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 19:30:04 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:30:04 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:30:04 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75066) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 19:30:04 user nova-compute[75066]: INFO nova.compute.claims [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] Claim successful on node user
Dec 01 19:30:04 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:30:04 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:30:04 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:30:04 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.458s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:30:04 user nova-compute[75066]: DEBUG nova.compute.manager [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] Start building networks asynchronously for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 19:30:04 user nova-compute[75066]: DEBUG nova.compute.manager [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] Allocating IP information in the background. {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 19:30:04 user nova-compute[75066]: DEBUG nova.network.neutron [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] allocate_for_instance() {{(pid=75066) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 19:30:04 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 19:30:04 user nova-compute[75066]: DEBUG nova.compute.manager [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] Start building block device mappings for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 19:30:04 user nova-compute[75066]: DEBUG nova.policy [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '14735fcf06cb45519d9fd71975871a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f677c9e8c24b7389273db9d82954fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75066) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 19:30:04 user nova-compute[75066]: DEBUG nova.compute.manager [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] Start spawning the instance on the hypervisor. {{(pid=75066) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 19:30:04 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] Creating instance directory {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 19:30:04 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] Creating image(s)
Dec 01 19:30:04 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Acquiring lock "/opt/stack/data/nova/instances/88850ea1-43cd-4066-8e6f-cfe5de621bc6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:30:04 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Lock "/opt/stack/data/nova/instances/88850ea1-43cd-4066-8e6f-cfe5de621bc6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:30:04 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Lock "/opt/stack/data/nova/instances/88850ea1-43cd-4066-8e6f-cfe5de621bc6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:30:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.181s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Acquiring lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:30:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:30:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.180s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/88850ea1-43cd-4066-8e6f-cfe5de621bc6/disk 1073741824 {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/88850ea1-43cd-4066-8e6f-cfe5de621bc6/disk 1073741824" returned: 0 in 0.055s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:30:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.185s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:05 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Checking if we can resize image /opt/stack/data/nova/instances/88850ea1-43cd-4066-8e6f-cfe5de621bc6/disk. size=1073741824 {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 19:30:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88850ea1-43cd-4066-8e6f-cfe5de621bc6/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:05 user nova-compute[75066]: DEBUG nova.network.neutron [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] Successfully created port: b39d66c2-c9c7-4b66-af8e-5ec0c23a997e {{(pid=75066) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 19:30:05 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88850ea1-43cd-4066-8e6f-cfe5de621bc6/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:05 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Cannot resize image /opt/stack/data/nova/instances/88850ea1-43cd-4066-8e6f-cfe5de621bc6/disk to a smaller size. {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 19:30:05 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] Created local disks {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 19:30:05 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] Ensure instance console log exists: /opt/stack/data/nova/instances/88850ea1-43cd-4066-8e6f-cfe5de621bc6/console.log {{(pid=75066) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 19:30:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:30:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:30:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:30:06 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:30:06 user nova-compute[75066]: DEBUG nova.network.neutron [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] Successfully updated port: b39d66c2-c9c7-4b66-af8e-5ec0c23a997e {{(pid=75066) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 19:30:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Acquiring lock "refresh_cache-88850ea1-43cd-4066-8e6f-cfe5de621bc6" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:30:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Acquired lock "refresh_cache-88850ea1-43cd-4066-8e6f-cfe5de621bc6" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:30:06 user nova-compute[75066]: DEBUG nova.network.neutron [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:30:06 user nova-compute[75066]: DEBUG nova.compute.manager [req-61bc5d82-e49a-4681-992c-e348be5f3e3b req-819f5110-86b7-497b-9406-14cbab1b8add service nova] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] Received event network-changed-b39d66c2-c9c7-4b66-af8e-5ec0c23a997e {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:30:06 user nova-compute[75066]: DEBUG nova.compute.manager [req-61bc5d82-e49a-4681-992c-e348be5f3e3b req-819f5110-86b7-497b-9406-14cbab1b8add service nova] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] Refreshing instance network info cache due to event network-changed-b39d66c2-c9c7-4b66-af8e-5ec0c23a997e. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:30:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-61bc5d82-e49a-4681-992c-e348be5f3e3b req-819f5110-86b7-497b-9406-14cbab1b8add service nova] Acquiring lock "refresh_cache-88850ea1-43cd-4066-8e6f-cfe5de621bc6" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:30:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Acquiring lock "f04249c5-0196-455c-ac7a-f1ff8be320d4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:30:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "f04249c5-0196-455c-ac7a-f1ff8be320d4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:30:06 user nova-compute[75066]: DEBUG nova.network.neutron [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:30:06 user nova-compute[75066]: DEBUG nova.compute.manager [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Starting instance... {{(pid=75066) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 19:30:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:30:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:30:06 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75066) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 19:30:06 user nova-compute[75066]: INFO nova.compute.claims [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Claim successful on node user
Dec 01 19:30:06 user nova-compute[75066]: DEBUG nova.network.neutron [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] Updating instance_info_cache with network_info: [{"id": "b39d66c2-c9c7-4b66-af8e-5ec0c23a997e", "address": "fa:16:3e:19:e0:f5", "network": {"id": "884b20a8-4ead-448d-994b-8e714dc32fae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-357575766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9f677c9e8c24b7389273db9d82954fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb39d66c2-c9", "ovs_interfaceid": "b39d66c2-c9c7-4b66-af8e-5ec0c23a997e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:30:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Releasing lock "refresh_cache-88850ea1-43cd-4066-8e6f-cfe5de621bc6" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:30:06 user nova-compute[75066]: DEBUG nova.compute.manager [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] Instance network_info: |[{"id": "b39d66c2-c9c7-4b66-af8e-5ec0c23a997e", "address": "fa:16:3e:19:e0:f5", "network": {"id": "884b20a8-4ead-448d-994b-8e714dc32fae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-357575766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9f677c9e8c24b7389273db9d82954fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb39d66c2-c9", "ovs_interfaceid": "b39d66c2-c9c7-4b66-af8e-5ec0c23a997e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 19:30:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-61bc5d82-e49a-4681-992c-e348be5f3e3b req-819f5110-86b7-497b-9406-14cbab1b8add service nova] Acquired lock "refresh_cache-88850ea1-43cd-4066-8e6f-cfe5de621bc6" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:30:06 user nova-compute[75066]: DEBUG nova.network.neutron [req-61bc5d82-e49a-4681-992c-e348be5f3e3b req-819f5110-86b7-497b-9406-14cbab1b8add service nova] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] Refreshing network info cache for port b39d66c2-c9c7-4b66-af8e-5ec0c23a997e {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:30:06 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] Start _get_guest_xml network_info=[{"id": "b39d66c2-c9c7-4b66-af8e-5ec0c23a997e", "address": "fa:16:3e:19:e0:f5", "network": {"id": "884b20a8-4ead-448d-994b-8e714dc32fae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-357575766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9f677c9e8c24b7389273db9d82954fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb39d66c2-c9", "ovs_interfaceid": "b39d66c2-c9c7-4b66-af8e-5ec0c23a997e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'image_id': '900b237b-e99c-4fdd-a44f-dcb7a08baa86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:30:06 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:30:06 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:30:06 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:30:06 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:30:06 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:30:06 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:30:06 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:30:06 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:30:06 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:30:06 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:30:06 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:30:06 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:30:06 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:30:06 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:30:06 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:30:06 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:30:06 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:30:06 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:30:06 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:30:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-317889789',display_name='tempest-ServersNegativeTestJSON-server-317889789',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-317889789',id=33,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9f677c9e8c24b7389273db9d82954fe',ramdisk_id='',reservation_id='r-0t7eb5c6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1315108451',owner_user_name='tempest-ServersNegativeTestJSON-1315108451-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:30:05Z,user_data=None,user_id='14735fcf06cb45519d9fd71975871a62',uuid=88850ea1-43cd-4066-8e6f-cfe5de621bc6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b39d66c2-c9c7-4b66-af8e-5ec0c23a997e", "address": "fa:16:3e:19:e0:f5", "network": {"id": "884b20a8-4ead-448d-994b-8e714dc32fae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-357575766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9f677c9e8c24b7389273db9d82954fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb39d66c2-c9", "ovs_interfaceid": "b39d66c2-c9c7-4b66-af8e-5ec0c23a997e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:30:06 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Converting VIF {"id": "b39d66c2-c9c7-4b66-af8e-5ec0c23a997e", "address": "fa:16:3e:19:e0:f5", "network": {"id": "884b20a8-4ead-448d-994b-8e714dc32fae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-357575766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9f677c9e8c24b7389273db9d82954fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb39d66c2-c9", "ovs_interfaceid": "b39d66c2-c9c7-4b66-af8e-5ec0c23a997e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:30:06 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:e0:f5,bridge_name='br-int',has_traffic_filtering=True,id=b39d66c2-c9c7-4b66-af8e-5ec0c23a997e,network=Network(884b20a8-4ead-448d-994b-8e714dc32fae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb39d66c2-c9') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:30:06 user nova-compute[75066]: DEBUG nova.objects.instance [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Lazy-loading 'pci_devices' on Instance uuid 88850ea1-43cd-4066-8e6f-cfe5de621bc6 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:30:06 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:30:06 user nova-compute[75066]:   <uuid>88850ea1-43cd-4066-8e6f-cfe5de621bc6</uuid>
Dec 01 19:30:06 user nova-compute[75066]:   <name>instance-00000021</name>
Dec 01 19:30:06 user nova-compute[75066]:   <memory>524288</memory>
Dec 01 19:30:06 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:30:06 user nova-compute[75066]:   <metadata>
Dec 01 19:30:06 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:30:06 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:30:06 user nova-compute[75066]:       <nova:name>tempest-ServersNegativeTestJSON-server-317889789</nova:name>
Dec 01 19:30:06 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:30:06</nova:creationTime>
Dec 01 19:30:06 user nova-compute[75066]:       <nova:flavor name="m1.tiny">
Dec 01 19:30:06 user nova-compute[75066]:         <nova:memory>512</nova:memory>
Dec 01 19:30:06 user nova-compute[75066]:         <nova:disk>1</nova:disk>
Dec 01 19:30:06 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:30:06 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:30:06 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:30:06 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:30:06 user nova-compute[75066]:       <nova:owner>
Dec 01 19:30:06 user nova-compute[75066]:         <nova:user uuid="14735fcf06cb45519d9fd71975871a62">tempest-ServersNegativeTestJSON-1315108451-project-member</nova:user>
Dec 01 19:30:06 user nova-compute[75066]:         <nova:project uuid="c9f677c9e8c24b7389273db9d82954fe">tempest-ServersNegativeTestJSON-1315108451</nova:project>
Dec 01 19:30:06 user nova-compute[75066]:       </nova:owner>
Dec 01 19:30:06 user nova-compute[75066]:       <nova:root type="image" uuid="900b237b-e99c-4fdd-a44f-dcb7a08baa86"/>
Dec 01 19:30:06 user nova-compute[75066]:       <nova:ports>
Dec 01 19:30:06 user nova-compute[75066]:         <nova:port uuid="b39d66c2-c9c7-4b66-af8e-5ec0c23a997e">
Dec 01 19:30:06 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Dec 01 19:30:06 user nova-compute[75066]:         </nova:port>
Dec 01 19:30:06 user nova-compute[75066]:       </nova:ports>
Dec 01 19:30:06 user nova-compute[75066]:     </nova:instance>
Dec 01 19:30:06 user nova-compute[75066]:   </metadata>
Dec 01 19:30:06 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:30:06 user nova-compute[75066]:     <system>
Dec 01 19:30:06 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:30:06 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:30:06 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:30:06 user nova-compute[75066]:       <entry name="serial">88850ea1-43cd-4066-8e6f-cfe5de621bc6</entry>
Dec 01 19:30:06 user nova-compute[75066]:       <entry name="uuid">88850ea1-43cd-4066-8e6f-cfe5de621bc6</entry>
Dec 01 19:30:06 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:30:06 user nova-compute[75066]:     </system>
Dec 01 19:30:06 user nova-compute[75066]:   </sysinfo>
Dec 01 19:30:06 user nova-compute[75066]:   <os>
Dec 01 19:30:06 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:30:06 user nova-compute[75066]:     <boot dev="hd"/>
Dec 01 19:30:06 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:30:06 user nova-compute[75066]:   </os>
Dec 01 19:30:06 user nova-compute[75066]:   <features>
Dec 01 19:30:06 user nova-compute[75066]:     <acpi/>
Dec 01 19:30:06 user nova-compute[75066]:     <apic/>
Dec 01 19:30:06 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:30:06 user nova-compute[75066]:   </features>
Dec 01 19:30:06 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:30:06 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:30:06 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:30:06 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:30:06 user nova-compute[75066]:   </clock>
Dec 01 19:30:06 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:30:06 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:30:06 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:30:06 user nova-compute[75066]:   </cpu>
Dec 01 19:30:06 user nova-compute[75066]:   <devices>
Dec 01 19:30:06 user nova-compute[75066]:     <disk type="file" device="disk">
Dec 01 19:30:06 user nova-compute[75066]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 19:30:06 user nova-compute[75066]:       <source file="/opt/stack/data/nova/instances/88850ea1-43cd-4066-8e6f-cfe5de621bc6/disk"/>
Dec 01 19:30:06 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:30:06 user nova-compute[75066]:     </disk>
Dec 01 19:30:06 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:30:06 user nova-compute[75066]:       <mac address="fa:16:3e:19:e0:f5"/>
Dec 01 19:30:06 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:30:06 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:30:06 user nova-compute[75066]:       <target dev="tapb39d66c2-c9"/>
Dec 01 19:30:06 user nova-compute[75066]:     </interface>
Dec 01 19:30:06 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:30:06 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/88850ea1-43cd-4066-8e6f-cfe5de621bc6/console.log" append="off"/>
Dec 01 19:30:06 user nova-compute[75066]:     </serial>
Dec 01 19:30:06 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:30:06 user nova-compute[75066]:     <video>
Dec 01 19:30:06 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:30:06 user nova-compute[75066]:     </video>
Dec 01 19:30:06 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:30:06 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:30:06 user nova-compute[75066]:     </rng>
Dec 01 19:30:06 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:30:06 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:30:06 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:30:06 user nova-compute[75066]:     </memballoon>
Dec 01 19:30:06 user nova-compute[75066]:   </devices>
Dec 01 19:30:06 user nova-compute[75066]: </domain>
Dec 01 19:30:06 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:30:06 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:30:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-317889789',display_name='tempest-ServersNegativeTestJSON-server-317889789',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-317889789',id=33,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9f677c9e8c24b7389273db9d82954fe',ramdisk_id='',reservation_id='r-0t7eb5c6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1315108451',owner_user_name='tempest-ServersNegativeTestJSON-1315108451-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:30:05Z,user_data=None,user_id='14735fcf06cb45519d9fd71975871a62',uuid=88850ea1-43cd-4066-8e6f-cfe5de621bc6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b39d66c2-c9c7-4b66-af8e-5ec0c23a997e", "address": "fa:16:3e:19:e0:f5", "network": {"id": "884b20a8-4ead-448d-994b-8e714dc32fae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-357575766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9f677c9e8c24b7389273db9d82954fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb39d66c2-c9", "ovs_interfaceid": "b39d66c2-c9c7-4b66-af8e-5ec0c23a997e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:30:06 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Converting VIF {"id": "b39d66c2-c9c7-4b66-af8e-5ec0c23a997e", "address": "fa:16:3e:19:e0:f5", "network": {"id": "884b20a8-4ead-448d-994b-8e714dc32fae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-357575766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9f677c9e8c24b7389273db9d82954fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb39d66c2-c9", "ovs_interfaceid": "b39d66c2-c9c7-4b66-af8e-5ec0c23a997e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:30:06 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:e0:f5,bridge_name='br-int',has_traffic_filtering=True,id=b39d66c2-c9c7-4b66-af8e-5ec0c23a997e,network=Network(884b20a8-4ead-448d-994b-8e714dc32fae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb39d66c2-c9') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:30:06 user nova-compute[75066]: DEBUG os_vif [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:e0:f5,bridge_name='br-int',has_traffic_filtering=True,id=b39d66c2-c9c7-4b66-af8e-5ec0c23a997e,network=Network(884b20a8-4ead-448d-994b-8e714dc32fae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb39d66c2-c9') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:30:06 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:07 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:30:07 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:30:07 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:07 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '794c5ca7-98f1-501a-be0d-b91950499d50', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:30:07 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:07 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:30:07 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:07 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb39d66c2-c9, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:30:07 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb39d66c2-c9, col_values=(('qos', UUID('467d8355-04f4-4ccb-984b-4ed47a9c1d05')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:30:07 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb39d66c2-c9, col_values=(('external_ids', {'iface-id': 'b39d66c2-c9c7-4b66-af8e-5ec0c23a997e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:e0:f5', 'vm-uuid': '88850ea1-43cd-4066-8e6f-cfe5de621bc6'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:30:07 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:07 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:30:07 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:07 user nova-compute[75066]: INFO os_vif [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:e0:f5,bridge_name='br-int',has_traffic_filtering=True,id=b39d66c2-c9c7-4b66-af8e-5ec0c23a997e,network=Network(884b20a8-4ead-448d-994b-8e714dc32fae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb39d66c2-c9')
Dec 01 19:30:07 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:30:07 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] No VIF found with MAC fa:16:3e:19:e0:f5, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:30:07 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:30:07 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:30:07 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:30:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.678s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:30:07 user nova-compute[75066]: DEBUG nova.compute.manager [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Start building networks asynchronously for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 19:30:07 user nova-compute[75066]: DEBUG nova.compute.manager [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Allocating IP information in the background. {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 19:30:07 user nova-compute[75066]: DEBUG nova.network.neutron [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] allocate_for_instance() {{(pid=75066) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 19:30:07 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 19:30:07 user nova-compute[75066]: DEBUG nova.compute.manager [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Start building block device mappings for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 19:30:07 user nova-compute[75066]: DEBUG nova.network.neutron [req-61bc5d82-e49a-4681-992c-e348be5f3e3b req-819f5110-86b7-497b-9406-14cbab1b8add service nova] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] Updated VIF entry in instance network info cache for port b39d66c2-c9c7-4b66-af8e-5ec0c23a997e. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:30:07 user nova-compute[75066]: DEBUG nova.network.neutron [req-61bc5d82-e49a-4681-992c-e348be5f3e3b req-819f5110-86b7-497b-9406-14cbab1b8add service nova] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] Updating instance_info_cache with network_info: [{"id": "b39d66c2-c9c7-4b66-af8e-5ec0c23a997e", "address": "fa:16:3e:19:e0:f5", "network": {"id": "884b20a8-4ead-448d-994b-8e714dc32fae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-357575766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9f677c9e8c24b7389273db9d82954fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb39d66c2-c9", "ovs_interfaceid": "b39d66c2-c9c7-4b66-af8e-5ec0c23a997e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:30:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-61bc5d82-e49a-4681-992c-e348be5f3e3b req-819f5110-86b7-497b-9406-14cbab1b8add service nova] Releasing lock "refresh_cache-88850ea1-43cd-4066-8e6f-cfe5de621bc6" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:30:07 user nova-compute[75066]: DEBUG nova.policy [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '964c1681ca8745d0b3879266d24f507e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e000d89bca44cd8acba504256d8d1f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75066) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 19:30:07 user nova-compute[75066]: INFO nova.virt.block_device [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Booting with volume-backed-image 900b237b-e99c-4fdd-a44f-dcb7a08baa86 at /dev/vda
Dec 01 19:30:07 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:08 user nova-compute[75066]: DEBUG nova.network.neutron [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Successfully created port: bbc4649f-c295-423e-a1c2-be3af706e4de {{(pid=75066) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 19:30:08 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:30:08 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:30:08 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:30:08 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:30:08 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75066) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 19:30:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:09 user nova-compute[75066]: DEBUG nova.compute.manager [req-65338025-f86d-4838-a798-126055f429ba req-3382c3fb-289e-442c-911a-252f400a5e12 service nova] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] Received event network-vif-plugged-b39d66c2-c9c7-4b66-af8e-5ec0c23a997e {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:30:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-65338025-f86d-4838-a798-126055f429ba req-3382c3fb-289e-442c-911a-252f400a5e12 service nova] Acquiring lock "88850ea1-43cd-4066-8e6f-cfe5de621bc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:30:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-65338025-f86d-4838-a798-126055f429ba req-3382c3fb-289e-442c-911a-252f400a5e12 service nova] Lock "88850ea1-43cd-4066-8e6f-cfe5de621bc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:30:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-65338025-f86d-4838-a798-126055f429ba req-3382c3fb-289e-442c-911a-252f400a5e12 service nova] Lock "88850ea1-43cd-4066-8e6f-cfe5de621bc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:30:09 user nova-compute[75066]: DEBUG nova.compute.manager [req-65338025-f86d-4838-a798-126055f429ba req-3382c3fb-289e-442c-911a-252f400a5e12 service nova] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] No waiting events found dispatching network-vif-plugged-b39d66c2-c9c7-4b66-af8e-5ec0c23a997e {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:30:09 user nova-compute[75066]: WARNING nova.compute.manager [req-65338025-f86d-4838-a798-126055f429ba req-3382c3fb-289e-442c-911a-252f400a5e12 service nova] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] Received unexpected event network-vif-plugged-b39d66c2-c9c7-4b66-af8e-5ec0c23a997e for instance with vm_state building and task_state spawning.
Dec 01 19:30:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88850ea1-43cd-4066-8e6f-cfe5de621bc6/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:09 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:09 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88850ea1-43cd-4066-8e6f-cfe5de621bc6/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88850ea1-43cd-4066-8e6f-cfe5de621bc6/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:09 user nova-compute[75066]: DEBUG nova.network.neutron [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Successfully updated port: bbc4649f-c295-423e-a1c2-be3af706e4de {{(pid=75066) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 19:30:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Acquiring lock "refresh_cache-f04249c5-0196-455c-ac7a-f1ff8be320d4" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:30:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Acquired lock "refresh_cache-f04249c5-0196-455c-ac7a-f1ff8be320d4" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:30:09 user nova-compute[75066]: DEBUG nova.network.neutron [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:30:09 user nova-compute[75066]: DEBUG nova.compute.manager [req-40cea066-12ae-48a8-9c82-edf3fec70894 req-14634069-f9b2-4b82-90fd-f3d6d71839a5 service nova] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Received event network-changed-bbc4649f-c295-423e-a1c2-be3af706e4de {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:30:09 user nova-compute[75066]: DEBUG nova.compute.manager [req-40cea066-12ae-48a8-9c82-edf3fec70894 req-14634069-f9b2-4b82-90fd-f3d6d71839a5 service nova] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Refreshing instance network info cache due to event network-changed-bbc4649f-c295-423e-a1c2-be3af706e4de. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:30:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-40cea066-12ae-48a8-9c82-edf3fec70894 req-14634069-f9b2-4b82-90fd-f3d6d71839a5 service nova] Acquiring lock "refresh_cache-f04249c5-0196-455c-ac7a-f1ff8be320d4" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:30:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88850ea1-43cd-4066-8e6f-cfe5de621bc6/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:09 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:30:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:09 user nova-compute[75066]: DEBUG nova.network.neutron [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:30:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:10 user nova-compute[75066]: DEBUG nova.network.neutron [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Updating instance_info_cache with network_info: [{"id": "bbc4649f-c295-423e-a1c2-be3af706e4de", "address": "fa:16:3e:01:63:75", "network": {"id": "6b0f48b7-3db2-49b2-a238-8fd811b52d62", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1688127634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e000d89bca44cd8acba504256d8d1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbc4649f-c2", "ovs_interfaceid": "bbc4649f-c295-423e-a1c2-be3af706e4de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:30:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Releasing lock "refresh_cache-f04249c5-0196-455c-ac7a-f1ff8be320d4" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:30:10 user nova-compute[75066]: DEBUG nova.compute.manager [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Instance network_info: |[{"id": "bbc4649f-c295-423e-a1c2-be3af706e4de", "address": "fa:16:3e:01:63:75", "network": {"id": "6b0f48b7-3db2-49b2-a238-8fd811b52d62", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1688127634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e000d89bca44cd8acba504256d8d1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbc4649f-c2", "ovs_interfaceid": "bbc4649f-c295-423e-a1c2-be3af706e4de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 19:30:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-40cea066-12ae-48a8-9c82-edf3fec70894 req-14634069-f9b2-4b82-90fd-f3d6d71839a5 service nova] Acquired lock "refresh_cache-f04249c5-0196-455c-ac7a-f1ff8be320d4" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:30:10 user nova-compute[75066]: DEBUG nova.network.neutron [req-40cea066-12ae-48a8-9c82-edf3fec70894 req-14634069-f9b2-4b82-90fd-f3d6d71839a5 service nova] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Refreshing network info cache for port bbc4649f-c295-423e-a1c2-be3af706e4de {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:30:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Acquiring lock "f7cc644b-006c-4453-aea2-abe35cfd5ba3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:30:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "f7cc644b-006c-4453-aea2-abe35cfd5ba3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:30:10 user nova-compute[75066]: DEBUG nova.compute.manager [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Starting instance... {{(pid=75066) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 19:30:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:30:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:30:10 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75066) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 19:30:10 user nova-compute[75066]: INFO nova.compute.claims [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Claim successful on node user
Dec 01 19:30:10 user nova-compute[75066]: DEBUG nova.network.neutron [req-40cea066-12ae-48a8-9c82-edf3fec70894 req-14634069-f9b2-4b82-90fd-f3d6d71839a5 service nova] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Updated VIF entry in instance network info cache for port bbc4649f-c295-423e-a1c2-be3af706e4de. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:30:10 user nova-compute[75066]: DEBUG nova.network.neutron [req-40cea066-12ae-48a8-9c82-edf3fec70894 req-14634069-f9b2-4b82-90fd-f3d6d71839a5 service nova] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Updating instance_info_cache with network_info: [{"id": "bbc4649f-c295-423e-a1c2-be3af706e4de", "address": "fa:16:3e:01:63:75", "network": {"id": "6b0f48b7-3db2-49b2-a238-8fd811b52d62", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1688127634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e000d89bca44cd8acba504256d8d1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbc4649f-c2", "ovs_interfaceid": "bbc4649f-c295-423e-a1c2-be3af706e4de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:30:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-40cea066-12ae-48a8-9c82-edf3fec70894 req-14634069-f9b2-4b82-90fd-f3d6d71839a5 service nova] Releasing lock "refresh_cache-f04249c5-0196-455c-ac7a-f1ff8be320d4" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:30:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk.rescue --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:11 user nova-compute[75066]: DEBUG nova.compute.manager [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] Instance event wait completed in 0 seconds for  {{(pid=75066) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 19:30:11 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] Guest created on hypervisor {{(pid=75066) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 19:30:11 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] Instance spawned successfully.
Dec 01 19:30:11 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 19:30:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk.rescue --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:11 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] Found default for hw_cdrom_bus of ide {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:30:11 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] Found default for hw_disk_bus of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:30:11 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] Found default for hw_input_bus of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:30:11 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] Found default for hw_pointer_model of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:30:11 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] Found default for hw_video_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:30:11 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] Found default for hw_vif_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:30:11 user nova-compute[75066]: DEBUG nova.compute.manager [req-227044c8-c87f-456e-955d-990f0d30d734 req-55314ca1-5cc0-453e-9c28-2c30ca358e7f service nova] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] Received event network-vif-plugged-b39d66c2-c9c7-4b66-af8e-5ec0c23a997e {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:30:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-227044c8-c87f-456e-955d-990f0d30d734 req-55314ca1-5cc0-453e-9c28-2c30ca358e7f service nova] Acquiring lock "88850ea1-43cd-4066-8e6f-cfe5de621bc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:30:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-227044c8-c87f-456e-955d-990f0d30d734 req-55314ca1-5cc0-453e-9c28-2c30ca358e7f service nova] Lock "88850ea1-43cd-4066-8e6f-cfe5de621bc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:30:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-227044c8-c87f-456e-955d-990f0d30d734 req-55314ca1-5cc0-453e-9c28-2c30ca358e7f service nova] Lock "88850ea1-43cd-4066-8e6f-cfe5de621bc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:30:11 user nova-compute[75066]: DEBUG nova.compute.manager [req-227044c8-c87f-456e-955d-990f0d30d734 req-55314ca1-5cc0-453e-9c28-2c30ca358e7f service nova] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] No waiting events found dispatching network-vif-plugged-b39d66c2-c9c7-4b66-af8e-5ec0c23a997e {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:30:11 user nova-compute[75066]: WARNING nova.compute.manager [req-227044c8-c87f-456e-955d-990f0d30d734 req-55314ca1-5cc0-453e-9c28-2c30ca358e7f service nova] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] Received unexpected event network-vif-plugged-b39d66c2-c9c7-4b66-af8e-5ec0c23a997e for instance with vm_state building and task_state spawning.
Dec 01 19:30:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:11 user nova-compute[75066]: INFO nova.compute.manager [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] Took 6.66 seconds to spawn the instance on the hypervisor.
Dec 01 19:30:11 user nova-compute[75066]: DEBUG nova.compute.manager [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:30:11 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:30:11 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:30:11 user nova-compute[75066]: INFO nova.compute.manager [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] Took 7.55 seconds to build instance.
Dec 01 19:30:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-6d3b8ba8-a6d3-4915-a526-d9e4fe339c97 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Lock "88850ea1-43cd-4066-8e6f-cfe5de621bc6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.661s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:30:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.975s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:30:11 user nova-compute[75066]: DEBUG nova.compute.manager [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Start building networks asynchronously for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 19:30:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:11 user nova-compute[75066]: DEBUG nova.compute.manager [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Allocating IP information in the background. {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 19:30:11 user nova-compute[75066]: DEBUG nova.network.neutron [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] allocate_for_instance() {{(pid=75066) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 19:30:11 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 19:30:11 user nova-compute[75066]: DEBUG nova.compute.manager [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Start building block device mappings for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 19:30:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:11 user nova-compute[75066]: DEBUG nova.policy [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'eeb6ade6e91541b5b737150a67b6bd39', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d5326c00d464e008337e0dc8577fc2d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75066) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 19:30:11 user nova-compute[75066]: DEBUG nova.compute.manager [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Start spawning the instance on the hypervisor. {{(pid=75066) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 19:30:11 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Creating instance directory {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 19:30:11 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Creating image(s)
Dec 01 19:30:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Acquiring lock "/opt/stack/data/nova/instances/f7cc644b-006c-4453-aea2-abe35cfd5ba3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:30:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "/opt/stack/data/nova/instances/f7cc644b-006c-4453-aea2-abe35cfd5ba3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:30:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "/opt/stack/data/nova/instances/f7cc644b-006c-4453-aea2-abe35cfd5ba3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:30:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Acquiring lock "d9fd308ee2dc1081dec34e7f8d711d2fcf3bbb16" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:30:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "d9fd308ee2dc1081dec34e7f8d711d2fcf3bbb16" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:30:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298/disk --force-share --output=json" returned: 0 in 0.465s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9a9bf17-1c03-426a-b33e-9d8c458df283/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9a9bf17-1c03-426a-b33e-9d8c458df283/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9a9bf17-1c03-426a-b33e-9d8c458df283/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9fd308ee2dc1081dec34e7f8d711d2fcf3bbb16.part --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9a9bf17-1c03-426a-b33e-9d8c458df283/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:13 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:30:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9fd308ee2dc1081dec34e7f8d711d2fcf3bbb16.part --force-share --output=json" returned: 0 in 0.204s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:13 user nova-compute[75066]: DEBUG nova.virt.images [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] f4263b44-262f-41ba-98ca-798c2b9528cd was qcow2, converting to raw {{(pid=75066) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 01 19:30:13 user nova-compute[75066]: DEBUG nova.privsep.utils [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75066) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 01 19:30:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d9fd308ee2dc1081dec34e7f8d711d2fcf3bbb16.part /opt/stack/data/nova/instances/_base/d9fd308ee2dc1081dec34e7f8d711d2fcf3bbb16.converted {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6c900-5d1b-44f8-8435-d9ad88b3a412/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:13 user nova-compute[75066]: DEBUG nova.network.neutron [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Successfully created port: 3b45b67a-805d-4816-ad34-c5266535dd27 {{(pid=75066) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 19:30:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d9fd308ee2dc1081dec34e7f8d711d2fcf3bbb16.part /opt/stack/data/nova/instances/_base/d9fd308ee2dc1081dec34e7f8d711d2fcf3bbb16.converted" returned: 0 in 0.192s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9fd308ee2dc1081dec34e7f8d711d2fcf3bbb16.converted --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6c900-5d1b-44f8-8435-d9ad88b3a412/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6c900-5d1b-44f8-8435-d9ad88b3a412/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9fd308ee2dc1081dec34e7f8d711d2fcf3bbb16.converted --force-share --output=json" returned: 0 in 0.195s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "d9fd308ee2dc1081dec34e7f8d711d2fcf3bbb16" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.659s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:30:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9fd308ee2dc1081dec34e7f8d711d2fcf3bbb16 --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6c900-5d1b-44f8-8435-d9ad88b3a412/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84b8c28-e79e-4945-8f3c-dddd7184a166/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9fd308ee2dc1081dec34e7f8d711d2fcf3bbb16 --force-share --output=json" returned: 0 in 0.203s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Acquiring lock "d9fd308ee2dc1081dec34e7f8d711d2fcf3bbb16" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:30:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "d9fd308ee2dc1081dec34e7f8d711d2fcf3bbb16" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:30:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9fd308ee2dc1081dec34e7f8d711d2fcf3bbb16 --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9fd308ee2dc1081dec34e7f8d711d2fcf3bbb16 --force-share --output=json" returned: 0 in 0.205s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d9fd308ee2dc1081dec34e7f8d711d2fcf3bbb16,backing_fmt=raw /opt/stack/data/nova/instances/f7cc644b-006c-4453-aea2-abe35cfd5ba3/disk 1073741824 {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84b8c28-e79e-4945-8f3c-dddd7184a166/disk --force-share --output=json" returned: 0 in 0.335s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84b8c28-e79e-4945-8f3c-dddd7184a166/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d9fd308ee2dc1081dec34e7f8d711d2fcf3bbb16,backing_fmt=raw /opt/stack/data/nova/instances/f7cc644b-006c-4453-aea2-abe35cfd5ba3/disk 1073741824" returned: 0 in 0.089s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "d9fd308ee2dc1081dec34e7f8d711d2fcf3bbb16" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.303s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:30:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9fd308ee2dc1081dec34e7f8d711d2fcf3bbb16 --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:14 user nova-compute[75066]: DEBUG nova.network.neutron [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Successfully updated port: 3b45b67a-805d-4816-ad34-c5266535dd27 {{(pid=75066) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 19:30:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Acquiring lock "refresh_cache-f7cc644b-006c-4453-aea2-abe35cfd5ba3" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:30:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Acquired lock "refresh_cache-f7cc644b-006c-4453-aea2-abe35cfd5ba3" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:30:14 user nova-compute[75066]: DEBUG nova.network.neutron [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:30:14 user nova-compute[75066]: DEBUG nova.compute.manager [req-634cb2e0-48fd-4074-9fcd-74f986373624 req-81490b97-d714-4320-97b9-c09dddb1201a service nova] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Received event network-changed-3b45b67a-805d-4816-ad34-c5266535dd27 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:30:14 user nova-compute[75066]: DEBUG nova.compute.manager [req-634cb2e0-48fd-4074-9fcd-74f986373624 req-81490b97-d714-4320-97b9-c09dddb1201a service nova] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Refreshing instance network info cache due to event network-changed-3b45b67a-805d-4816-ad34-c5266535dd27. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:30:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-634cb2e0-48fd-4074-9fcd-74f986373624 req-81490b97-d714-4320-97b9-c09dddb1201a service nova] Acquiring lock "refresh_cache-f7cc644b-006c-4453-aea2-abe35cfd5ba3" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:30:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84b8c28-e79e-4945-8f3c-dddd7184a166/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:14 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:30:14 user nova-compute[75066]: DEBUG nova.network.neutron [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:30:14 user nova-compute[75066]: DEBUG nova.compute.manager [req-e58a1a6f-6db0-4d3c-91b9-7768bb1ed0a1 req-2cdae51a-85a1-4708-9197-ac7af4fee414 service nova] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Received event network-changed-5b64624f-4059-4689-83ef-856573e0eab0 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:30:14 user nova-compute[75066]: DEBUG nova.compute.manager [req-e58a1a6f-6db0-4d3c-91b9-7768bb1ed0a1 req-2cdae51a-85a1-4708-9197-ac7af4fee414 service nova] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Refreshing instance network info cache due to event network-changed-5b64624f-4059-4689-83ef-856573e0eab0. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:30:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-e58a1a6f-6db0-4d3c-91b9-7768bb1ed0a1 req-2cdae51a-85a1-4708-9197-ac7af4fee414 service nova] Acquiring lock "refresh_cache-b2c6c900-5d1b-44f8-8435-d9ad88b3a412" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:30:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-e58a1a6f-6db0-4d3c-91b9-7768bb1ed0a1 req-2cdae51a-85a1-4708-9197-ac7af4fee414 service nova] Acquired lock "refresh_cache-b2c6c900-5d1b-44f8-8435-d9ad88b3a412" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:30:14 user nova-compute[75066]: DEBUG nova.network.neutron [req-e58a1a6f-6db0-4d3c-91b9-7768bb1ed0a1 req-2cdae51a-85a1-4708-9197-ac7af4fee414 service nova] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Refreshing network info cache for port 5b64624f-4059-4689-83ef-856573e0eab0 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:30:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d9fd308ee2dc1081dec34e7f8d711d2fcf3bbb16 --force-share --output=json" returned: 0 in 0.706s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:14 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f7cc644b-006c-4453-aea2-abe35cfd5ba3/disk. size=1073741824 {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 19:30:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7cc644b-006c-4453-aea2-abe35cfd5ba3/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b254e999-3f55-4f04-a181-6213654de8e6 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Acquiring lock "b2c6c900-5d1b-44f8-8435-d9ad88b3a412" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:30:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b254e999-3f55-4f04-a181-6213654de8e6 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "b2c6c900-5d1b-44f8-8435-d9ad88b3a412" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.007s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:30:14 user nova-compute[75066]: DEBUG nova.objects.instance [None req-b254e999-3f55-4f04-a181-6213654de8e6 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lazy-loading 'flavor' on Instance uuid b2c6c900-5d1b-44f8-8435-d9ad88b3a412 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:30:14 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:30:14 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:30:14 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Hypervisor/Node resource view: name=user free_ram=7538MB free_disk=24.82199478149414GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75066) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 19:30:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:30:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:30:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b254e999-3f55-4f04-a181-6213654de8e6 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "b2c6c900-5d1b-44f8-8435-d9ad88b3a412" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.088s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7cc644b-006c-4453-aea2-abe35cfd5ba3/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Cannot resize image /opt/stack/data/nova/instances/f7cc644b-006c-4453-aea2-abe35cfd5ba3/disk to a smaller size. {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Created local disks {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Ensure instance console log exists: /opt/stack/data/nova/instances/f7cc644b-006c-4453-aea2-abe35cfd5ba3/console.log {{(pid=75066) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Applying migration context for instance 00506483-8f09-4a3d-938a-31ab1b2dbf83 as it has an incoming, in-progress migration 01d1f16f-013f-4fb4-baca-3d734eb87e84. Migration status is finished {{(pid=75066) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Dec 01 19:30:15 user nova-compute[75066]: INFO nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Updating resource usage from migration 01d1f16f-013f-4fb4-baca-3d734eb87e84
Dec 01 19:30:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b254e999-3f55-4f04-a181-6213654de8e6 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Acquiring lock "b2c6c900-5d1b-44f8-8435-d9ad88b3a412" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b254e999-3f55-4f04-a181-6213654de8e6 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "b2c6c900-5d1b-44f8-8435-d9ad88b3a412" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:30:15 user nova-compute[75066]: INFO nova.compute.manager [None req-b254e999-3f55-4f04-a181-6213654de8e6 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Attaching volume 560d8e6e-8c2b-4d07-9db1-07e025a12db7 to /dev/vdb
Dec 01 19:30:15 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance c223be70-8b9c-46d4-9b5a-3b83dfc05a17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 90c49be6-97aa-45f1-bcbe-b9a3875226a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance d564b128-598b-4ad4-8618-afa4dc8a7347 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 14de9d20-9e66-4517-b904-2967e0a06a97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance b2c6c900-5d1b-44f8-8435-d9ad88b3a412 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Migration 01d1f16f-013f-4fb4-baca-3d734eb87e84 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 00506483-8f09-4a3d-938a-31ab1b2dbf83 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance e84b8c28-e79e-4945-8f3c-dddd7184a166 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance e9a9bf17-1c03-426a-b33e-9d8c458df283 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 88850ea1-43cd-4066-8e6f-cfe5de621bc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance f04249c5-0196-455c-ac7a-f1ff8be320d4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance f7cc644b-006c-4453-aea2-abe35cfd5ba3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG os_brick.utils [None req-b254e999-3f55-4f04-a181-6213654de8e6 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[71561a09-7441-4b88-885d-6d4336086bce]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1959854982f\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG nova.network.neutron [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Updating instance_info_cache with network_info: [{"id": "3b45b67a-805d-4816-ad34-c5266535dd27", "address": "fa:16:3e:43:97:2a", "network": {"id": "4fe4d56e-afe2-42a6-984a-9af8bc5377a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126385357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5326c00d464e008337e0dc8577fc2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b45b67a-80", "ovs_interfaceid": "3b45b67a-805d-4816-ad34-c5266535dd27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aa131d8-c637-421a-a8fc-feb2af3feaa7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Releasing lock "refresh_cache-f7cc644b-006c-4453-aea2-abe35cfd5ba3" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG nova.compute.manager [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Instance network_info: |[{"id": "3b45b67a-805d-4816-ad34-c5266535dd27", "address": "fa:16:3e:43:97:2a", "network": {"id": "4fe4d56e-afe2-42a6-984a-9af8bc5377a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126385357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5326c00d464e008337e0dc8577fc2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b45b67a-80", "ovs_interfaceid": "3b45b67a-805d-4816-ad34-c5266535dd27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-634cb2e0-48fd-4074-9fcd-74f986373624 req-81490b97-d714-4320-97b9-c09dddb1201a service nova] Acquired lock "refresh_cache-f7cc644b-006c-4453-aea2-abe35cfd5ba3" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG nova.network.neutron [req-634cb2e0-48fd-4074-9fcd-74f986373624 req-81490b97-d714-4320-97b9-c09dddb1201a service nova] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Refreshing network info cache for port 3b45b67a-805d-4816-ad34-c5266535dd27 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Start _get_guest_xml network_info=[{"id": "3b45b67a-805d-4816-ad34-c5266535dd27", "address": "fa:16:3e:43:97:2a", "network": {"id": "4fe4d56e-afe2-42a6-984a-9af8bc5377a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126385357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5326c00d464e008337e0dc8577fc2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b45b67a-80", "ovs_interfaceid": "3b45b67a-805d-4816-ad34-c5266535dd27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:30:07Z,direct_url=<?>,disk_format='qcow2',id=f4263b44-262f-41ba-98ca-798c2b9528cd,min_disk=0,min_ram=0,name='tempest-scenario-img--1296001032',owner='1d5326c00d464e008337e0dc8577fc2d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:30:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'image_id': 'f4263b44-262f-41ba-98ca-798c2b9528cd'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46ef66e-fcaf-4324-bdc0-3f67f501fbaa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ebc21dc-82d3-4752-848e-4f2abb6e07a9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-b254e999-3f55-4f04-a181-6213654de8e6 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Running cmd (subprocess): nvme version {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-b254e999-3f55-4f04-a181-6213654de8e6 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] 'nvme version' failed. Not Retrying. {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b254e999-3f55-4f04-a181-6213654de8e6 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] nvme not present on system {{(pid=75066) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:15 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:30:15 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:30:15 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:30:15 user nova-compute[75066]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 19:30:15 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[38925c26-8a49-43b8-a2e8-1ea920dc570c]: (4, '') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-b254e999-3f55-4f04-a181-6213654de8e6 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75066) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-b254e999-3f55-4f04-a181-6213654de8e6 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-b254e999-3f55-4f04-a181-6213654de8e6 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] LIGHTOS: no hostnqn found. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG os_brick.utils [None req-b254e999-3f55-4f04-a181-6213654de8e6 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] <== get_connector_properties: return (207ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1959854982f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG nova.virt.block_device [None req-b254e999-3f55-4f04-a181-6213654de8e6 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Updating existing volume attachment record: 4ceb05bc-eb8f-408e-a31e-ceebdea24f2c {{(pid=75066) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:30:07Z,direct_url=<?>,disk_format='qcow2',id=f4263b44-262f-41ba-98ca-798c2b9528cd,min_disk=0,min_ram=0,name='tempest-scenario-img--1296001032',owner='1d5326c00d464e008337e0dc8577fc2d',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:30:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:30:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-263014517',display_name='tempest-TestMinimumBasicScenario-server-263014517',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-263014517',id=35,image_ref='f4263b44-262f-41ba-98ca-798c2b9528cd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdQJ2Yd21MdDeENp/SwylCgJAxC+OIAR+3elTs82WcN1jckBES8xf1wNF6MakHI6yBBDOMxYH8McmLKAZqgUpbHCUQRWesrbGs50mVoMEK4sAsvG/PV4ux6EkW7hI2H0w==',key_name='tempest-TestMinimumBasicScenario-1846437349',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d5326c00d464e008337e0dc8577fc2d',ramdisk_id='',reservation_id='r-au36ziic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f4263b44-262f-41ba-98ca-798c2b9528cd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-555382044',owner_user_name='tempest-TestMinimumBasicScenario-555382044-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:30:12Z,user_data=None,user_id='eeb6ade6e91541b5b737150a67b6bd39',uuid=f7cc644b-006c-4453-aea2-abe35cfd5ba3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b45b67a-805d-4816-ad34-c5266535dd27", "address": "fa:16:3e:43:97:2a", "network": {"id": "4fe4d56e-afe2-42a6-984a-9af8bc5377a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126385357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5326c00d464e008337e0dc8577fc2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b45b67a-80", "ovs_interfaceid": "3b45b67a-805d-4816-ad34-c5266535dd27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Converting VIF {"id": "3b45b67a-805d-4816-ad34-c5266535dd27", "address": "fa:16:3e:43:97:2a", "network": {"id": "4fe4d56e-afe2-42a6-984a-9af8bc5377a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126385357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5326c00d464e008337e0dc8577fc2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b45b67a-80", "ovs_interfaceid": "3b45b67a-805d-4816-ad34-c5266535dd27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:97:2a,bridge_name='br-int',has_traffic_filtering=True,id=3b45b67a-805d-4816-ad34-c5266535dd27,network=Network(4fe4d56e-afe2-42a6-984a-9af8bc5377a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b45b67a-80') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG nova.objects.instance [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lazy-loading 'pci_devices' on Instance uuid f7cc644b-006c-4453-aea2-abe35cfd5ba3 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG nova.network.neutron [req-e58a1a6f-6db0-4d3c-91b9-7768bb1ed0a1 req-2cdae51a-85a1-4708-9197-ac7af4fee414 service nova] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Updated VIF entry in instance network info cache for port 5b64624f-4059-4689-83ef-856573e0eab0. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG nova.network.neutron [req-e58a1a6f-6db0-4d3c-91b9-7768bb1ed0a1 req-2cdae51a-85a1-4708-9197-ac7af4fee414 service nova] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Updating instance_info_cache with network_info: [{"id": "5b64624f-4059-4689-83ef-856573e0eab0", "address": "fa:16:3e:3f:cc:a8", "network": {"id": "47c850ae-6dcb-4977-a02a-e32cd3df4749", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-475363603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "943324a514a84cb4947dbab93abc4f6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b64624f-40", "ovs_interfaceid": "5b64624f-4059-4689-83ef-856573e0eab0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:30:15 user nova-compute[75066]:   <uuid>f7cc644b-006c-4453-aea2-abe35cfd5ba3</uuid>
Dec 01 19:30:15 user nova-compute[75066]:   <name>instance-00000023</name>
Dec 01 19:30:15 user nova-compute[75066]:   <memory>524288</memory>
Dec 01 19:30:15 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:30:15 user nova-compute[75066]:   <metadata>
Dec 01 19:30:15 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:30:15 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:30:15 user nova-compute[75066]:       <nova:name>tempest-TestMinimumBasicScenario-server-263014517</nova:name>
Dec 01 19:30:15 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:30:15</nova:creationTime>
Dec 01 19:30:15 user nova-compute[75066]:       <nova:flavor name="m1.tiny">
Dec 01 19:30:15 user nova-compute[75066]:         <nova:memory>512</nova:memory>
Dec 01 19:30:15 user nova-compute[75066]:         <nova:disk>1</nova:disk>
Dec 01 19:30:15 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:30:15 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:30:15 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:30:15 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:30:15 user nova-compute[75066]:       <nova:owner>
Dec 01 19:30:15 user nova-compute[75066]:         <nova:user uuid="eeb6ade6e91541b5b737150a67b6bd39">tempest-TestMinimumBasicScenario-555382044-project-member</nova:user>
Dec 01 19:30:15 user nova-compute[75066]:         <nova:project uuid="1d5326c00d464e008337e0dc8577fc2d">tempest-TestMinimumBasicScenario-555382044</nova:project>
Dec 01 19:30:15 user nova-compute[75066]:       </nova:owner>
Dec 01 19:30:15 user nova-compute[75066]:       <nova:root type="image" uuid="f4263b44-262f-41ba-98ca-798c2b9528cd"/>
Dec 01 19:30:15 user nova-compute[75066]:       <nova:ports>
Dec 01 19:30:15 user nova-compute[75066]:         <nova:port uuid="3b45b67a-805d-4816-ad34-c5266535dd27">
Dec 01 19:30:15 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Dec 01 19:30:15 user nova-compute[75066]:         </nova:port>
Dec 01 19:30:15 user nova-compute[75066]:       </nova:ports>
Dec 01 19:30:15 user nova-compute[75066]:     </nova:instance>
Dec 01 19:30:15 user nova-compute[75066]:   </metadata>
Dec 01 19:30:15 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:30:15 user nova-compute[75066]:     <system>
Dec 01 19:30:15 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:30:15 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:30:15 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:30:15 user nova-compute[75066]:       <entry name="serial">f7cc644b-006c-4453-aea2-abe35cfd5ba3</entry>
Dec 01 19:30:15 user nova-compute[75066]:       <entry name="uuid">f7cc644b-006c-4453-aea2-abe35cfd5ba3</entry>
Dec 01 19:30:15 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:30:15 user nova-compute[75066]:     </system>
Dec 01 19:30:15 user nova-compute[75066]:   </sysinfo>
Dec 01 19:30:15 user nova-compute[75066]:   <os>
Dec 01 19:30:15 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:30:15 user nova-compute[75066]:     <boot dev="hd"/>
Dec 01 19:30:15 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:30:15 user nova-compute[75066]:   </os>
Dec 01 19:30:15 user nova-compute[75066]:   <features>
Dec 01 19:30:15 user nova-compute[75066]:     <acpi/>
Dec 01 19:30:15 user nova-compute[75066]:     <apic/>
Dec 01 19:30:15 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:30:15 user nova-compute[75066]:   </features>
Dec 01 19:30:15 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:30:15 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:30:15 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:30:15 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:30:15 user nova-compute[75066]:   </clock>
Dec 01 19:30:15 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:30:15 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:30:15 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:30:15 user nova-compute[75066]:   </cpu>
Dec 01 19:30:15 user nova-compute[75066]:   <devices>
Dec 01 19:30:15 user nova-compute[75066]:     <disk type="file" device="disk">
Dec 01 19:30:15 user nova-compute[75066]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 19:30:15 user nova-compute[75066]:       <source file="/opt/stack/data/nova/instances/f7cc644b-006c-4453-aea2-abe35cfd5ba3/disk"/>
Dec 01 19:30:15 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:30:15 user nova-compute[75066]:     </disk>
Dec 01 19:30:15 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:30:15 user nova-compute[75066]:       <mac address="fa:16:3e:43:97:2a"/>
Dec 01 19:30:15 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:30:15 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:30:15 user nova-compute[75066]:       <target dev="tap3b45b67a-80"/>
Dec 01 19:30:15 user nova-compute[75066]:     </interface>
Dec 01 19:30:15 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:30:15 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/f7cc644b-006c-4453-aea2-abe35cfd5ba3/console.log" append="off"/>
Dec 01 19:30:15 user nova-compute[75066]:     </serial>
Dec 01 19:30:15 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:30:15 user nova-compute[75066]:     <video>
Dec 01 19:30:15 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:30:15 user nova-compute[75066]:     </video>
Dec 01 19:30:15 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:30:15 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:30:15 user nova-compute[75066]:     </rng>
Dec 01 19:30:15 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:30:15 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:30:15 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:30:15 user nova-compute[75066]:     </memballoon>
Dec 01 19:30:15 user nova-compute[75066]:   </devices>
Dec 01 19:30:15 user nova-compute[75066]: </domain>
Dec 01 19:30:15 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:30:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-263014517',display_name='tempest-TestMinimumBasicScenario-server-263014517',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-263014517',id=35,image_ref='f4263b44-262f-41ba-98ca-798c2b9528cd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdQJ2Yd21MdDeENp/SwylCgJAxC+OIAR+3elTs82WcN1jckBES8xf1wNF6MakHI6yBBDOMxYH8McmLKAZqgUpbHCUQRWesrbGs50mVoMEK4sAsvG/PV4ux6EkW7hI2H0w==',key_name='tempest-TestMinimumBasicScenario-1846437349',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d5326c00d464e008337e0dc8577fc2d',ramdisk_id='',reservation_id='r-au36ziic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f4263b44-262f-41ba-98ca-798c2b9528cd',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-555382044',owner_user_name='tempest-TestMinimumBasicScenario-555382044-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:30:12Z,user_data=None,user_id='eeb6ade6e91541b5b737150a67b6bd39',uuid=f7cc644b-006c-4453-aea2-abe35cfd5ba3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b45b67a-805d-4816-ad34-c5266535dd27", "address": "fa:16:3e:43:97:2a", "network": {"id": "4fe4d56e-afe2-42a6-984a-9af8bc5377a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126385357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5326c00d464e008337e0dc8577fc2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b45b67a-80", "ovs_interfaceid": "3b45b67a-805d-4816-ad34-c5266535dd27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Converting VIF {"id": "3b45b67a-805d-4816-ad34-c5266535dd27", "address": "fa:16:3e:43:97:2a", "network": {"id": "4fe4d56e-afe2-42a6-984a-9af8bc5377a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126385357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5326c00d464e008337e0dc8577fc2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b45b67a-80", "ovs_interfaceid": "3b45b67a-805d-4816-ad34-c5266535dd27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:97:2a,bridge_name='br-int',has_traffic_filtering=True,id=3b45b67a-805d-4816-ad34-c5266535dd27,network=Network(4fe4d56e-afe2-42a6-984a-9af8bc5377a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b45b67a-80') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG os_vif [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:97:2a,bridge_name='br-int',has_traffic_filtering=True,id=3b45b67a-805d-4816-ad34-c5266535dd27,network=Network(4fe4d56e-afe2-42a6-984a-9af8bc5377a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b45b67a-80') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '991323a5-93b9-5c32-900e-fe147ad1708c', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-e58a1a6f-6db0-4d3c-91b9-7768bb1ed0a1 req-2cdae51a-85a1-4708-9197-ac7af4fee414 service nova] Releasing lock "refresh_cache-b2c6c900-5d1b-44f8-8435-d9ad88b3a412" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3b45b67a-80, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3b45b67a-80, col_values=(('qos', UUID('7e8d8934-ba4a-4247-8277-1ec288622288')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3b45b67a-80, col_values=(('external_ids', {'iface-id': '3b45b67a-805d-4816-ad34-c5266535dd27', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:97:2a', 'vm-uuid': 'f7cc644b-006c-4453-aea2-abe35cfd5ba3'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:15 user nova-compute[75066]: INFO os_vif [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:97:2a,bridge_name='br-int',has_traffic_filtering=True,id=3b45b67a-805d-4816-ad34-c5266535dd27,network=Network(4fe4d56e-afe2-42a6-984a-9af8bc5377a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b45b67a-80')
Dec 01 19:30:15 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] No VIF found with MAC fa:16:3e:43:97:2a, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Compute_service record updated for user:user {{(pid=75066) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 19:30:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.005s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:30:16 user nova-compute[75066]: DEBUG nova.network.neutron [req-634cb2e0-48fd-4074-9fcd-74f986373624 req-81490b97-d714-4320-97b9-c09dddb1201a service nova] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Updated VIF entry in instance network info cache for port 3b45b67a-805d-4816-ad34-c5266535dd27. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:30:16 user nova-compute[75066]: DEBUG nova.network.neutron [req-634cb2e0-48fd-4074-9fcd-74f986373624 req-81490b97-d714-4320-97b9-c09dddb1201a service nova] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Updating instance_info_cache with network_info: [{"id": "3b45b67a-805d-4816-ad34-c5266535dd27", "address": "fa:16:3e:43:97:2a", "network": {"id": "4fe4d56e-afe2-42a6-984a-9af8bc5377a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126385357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5326c00d464e008337e0dc8577fc2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b45b67a-80", "ovs_interfaceid": "3b45b67a-805d-4816-ad34-c5266535dd27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:30:16 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-634cb2e0-48fd-4074-9fcd-74f986373624 req-81490b97-d714-4320-97b9-c09dddb1201a service nova] Releasing lock "refresh_cache-f7cc644b-006c-4453-aea2-abe35cfd5ba3" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:30:17 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:17 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:17 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:17 user nova-compute[75066]: DEBUG nova.compute.manager [req-7222b549-010c-4fba-acdf-d4b85cca40a9 req-0be4d4e8-a477-4a16-987b-23ec37a2b0c5 service nova] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Received event network-vif-plugged-3b45b67a-805d-4816-ad34-c5266535dd27 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:30:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-7222b549-010c-4fba-acdf-d4b85cca40a9 req-0be4d4e8-a477-4a16-987b-23ec37a2b0c5 service nova] Acquiring lock "f7cc644b-006c-4453-aea2-abe35cfd5ba3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:30:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-7222b549-010c-4fba-acdf-d4b85cca40a9 req-0be4d4e8-a477-4a16-987b-23ec37a2b0c5 service nova] Lock "f7cc644b-006c-4453-aea2-abe35cfd5ba3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:30:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-7222b549-010c-4fba-acdf-d4b85cca40a9 req-0be4d4e8-a477-4a16-987b-23ec37a2b0c5 service nova] Lock "f7cc644b-006c-4453-aea2-abe35cfd5ba3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:30:17 user nova-compute[75066]: DEBUG nova.compute.manager [req-7222b549-010c-4fba-acdf-d4b85cca40a9 req-0be4d4e8-a477-4a16-987b-23ec37a2b0c5 service nova] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] No waiting events found dispatching network-vif-plugged-3b45b67a-805d-4816-ad34-c5266535dd27 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:30:17 user nova-compute[75066]: WARNING nova.compute.manager [req-7222b549-010c-4fba-acdf-d4b85cca40a9 req-0be4d4e8-a477-4a16-987b-23ec37a2b0c5 service nova] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Received unexpected event network-vif-plugged-3b45b67a-805d-4816-ad34-c5266535dd27 for instance with vm_state building and task_state spawning.
Dec 01 19:30:17 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:17 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:17 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:17 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:18 user nova-compute[75066]: DEBUG os_brick.utils [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:30:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:18 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[32866411-1429-4a62-b2be-4107c41647d4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1959854982f\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:30:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:18 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa1a32f-48ce-4193-8eac-34276866f29a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:30:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:18 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc7f9036-7796-4a13-a9b6-f7430f0ab516]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:30:18 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[1543eefa-0c63-42ff-b245-b140add400f4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:30:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Running cmd (subprocess): nvme version {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] 'nvme version' failed. Not Retrying. {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:30:18 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.nvmeof [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] nvme not present on system {{(pid=75066) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 19:30:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:30:18 user nova-compute[75066]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 19:30:18 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[47911c6c-6ee4-4afb-99c9-3ea092354066]: (4, '') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:30:18 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75066) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 19:30:18 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 19:30:18 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] LIGHTOS: no hostnqn found. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 19:30:18 user nova-compute[75066]: DEBUG os_brick.utils [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1959854982f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:30:18 user nova-compute[75066]: DEBUG nova.virt.block_device [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Updating existing volume attachment record: 25783605-e1f2-4171-92bf-4c764a4f0a96 {{(pid=75066) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 19:30:19 user nova-compute[75066]: DEBUG nova.compute.manager [req-636affb9-30f2-45bb-b827-6340e0d0d949 req-35057c18-f144-49a0-9873-3d96856c9dbc service nova] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Received event network-vif-plugged-3b45b67a-805d-4816-ad34-c5266535dd27 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:30:19 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-636affb9-30f2-45bb-b827-6340e0d0d949 req-35057c18-f144-49a0-9873-3d96856c9dbc service nova] Acquiring lock "f7cc644b-006c-4453-aea2-abe35cfd5ba3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:30:19 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-636affb9-30f2-45bb-b827-6340e0d0d949 req-35057c18-f144-49a0-9873-3d96856c9dbc service nova] Lock "f7cc644b-006c-4453-aea2-abe35cfd5ba3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:30:19 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-636affb9-30f2-45bb-b827-6340e0d0d949 req-35057c18-f144-49a0-9873-3d96856c9dbc service nova] Lock "f7cc644b-006c-4453-aea2-abe35cfd5ba3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:30:19 user nova-compute[75066]: DEBUG nova.compute.manager [req-636affb9-30f2-45bb-b827-6340e0d0d949 req-35057c18-f144-49a0-9873-3d96856c9dbc service nova] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] No waiting events found dispatching network-vif-plugged-3b45b67a-805d-4816-ad34-c5266535dd27 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:30:19 user nova-compute[75066]: WARNING nova.compute.manager [req-636affb9-30f2-45bb-b827-6340e0d0d949 req-35057c18-f144-49a0-9873-3d96856c9dbc service nova] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Received unexpected event network-vif-plugged-3b45b67a-805d-4816-ad34-c5266535dd27 for instance with vm_state building and task_state spawning.
Dec 01 19:30:19 user nova-compute[75066]: DEBUG nova.compute.manager [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Instance event wait completed in 0 seconds for  {{(pid=75066) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 19:30:19 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Guest created on hypervisor {{(pid=75066) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 19:30:19 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Instance spawned successfully.
Dec 01 19:30:19 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 19:30:19 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Found default for hw_cdrom_bus of ide {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:30:19 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Found default for hw_disk_bus of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:30:19 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Found default for hw_input_bus of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:30:19 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Found default for hw_pointer_model of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:30:19 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Found default for hw_video_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:30:19 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Found default for hw_vif_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:30:19 user nova-compute[75066]: INFO nova.compute.manager [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Took 7.95 seconds to spawn the instance on the hypervisor.
Dec 01 19:30:19 user nova-compute[75066]: DEBUG nova.compute.manager [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:30:19 user nova-compute[75066]: INFO nova.compute.manager [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Took 9.34 seconds to build instance.
Dec 01 19:30:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d64741e8-e94d-40e5-8347-e809ab0c312a tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "f7cc644b-006c-4453-aea2-abe35cfd5ba3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.475s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:30:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:20 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:30:20 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:30:20 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Starting heal instance info cache {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 19:30:20 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Rebuilding the list of instances to heal {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 19:30:21 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Skipping network cache update for instance because it is Building. {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Dec 01 19:30:21 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "refresh_cache-c223be70-8b9c-46d4-9b5a-3b83dfc05a17" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:30:21 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquired lock "refresh_cache-c223be70-8b9c-46d4-9b5a-3b83dfc05a17" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:30:21 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Forcefully refreshing network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 19:30:21 user nova-compute[75066]: DEBUG nova.objects.instance [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lazy-loading 'info_cache' on Instance uuid c223be70-8b9c-46d4-9b5a-3b83dfc05a17 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:30:21 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Updating instance_info_cache with network_info: [{"id": "2698607a-e8b6-4da8-bfc7-90dc528ade6b", "address": "fa:16:3e:52:d6:e9", "network": {"id": "9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-696310557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0f7516d1db4dd5bc7d77a0bd1d44d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2698607a-e8", "ovs_interfaceid": "2698607a-e8b6-4da8-bfc7-90dc528ade6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:30:21 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Releasing lock "refresh_cache-c223be70-8b9c-46d4-9b5a-3b83dfc05a17" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:30:21 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Updated the network info_cache for instance {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 19:30:21 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:30:21 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:30:21 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:30:21 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75066) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 19:30:22 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:25 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-95e86adb-346f-40e5-b658-31aa9d60a5a4 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Acquiring lock "00506483-8f09-4a3d-938a-31ab1b2dbf83" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:30:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-95e86adb-346f-40e5-b658-31aa9d60a5a4 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "00506483-8f09-4a3d-938a-31ab1b2dbf83" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:30:27 user nova-compute[75066]: DEBUG nova.compute.manager [None req-95e86adb-346f-40e5-b658-31aa9d60a5a4 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Going to confirm migration 2 {{(pid=75066) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Dec 01 19:30:27 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b254e999-3f55-4f04-a181-6213654de8e6 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Calling os-brick to attach iSCSI Volume {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 19:30:27 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b254e999-3f55-4f04-a181-6213654de8e6 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'snEOyWIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:30:27 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-b254e999-3f55-4f04-a181-6213654de8e6 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:30:27 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-b254e999-3f55-4f04-a181-6213654de8e6 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:30:27 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-b254e999-3f55-4f04-a181-6213654de8e6 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:30:27 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-b254e999-3f55-4f04-a181-6213654de8e6 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:30:27 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-b254e999-3f55-4f04-a181-6213654de8e6 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:30:27 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-b254e999-3f55-4f04-a181-6213654de8e6 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:30:27 user nova-compute[75066]: INFO os_brick.initiator.connectors.iscsi [None req-b254e999-3f55-4f04-a181-6213654de8e6 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 19:30:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 -p 172.16.0.220:3260 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:27 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe80b51-05c4-41f8-bf38-47739cb850fb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:30:27 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b254e999-3f55-4f04-a181-6213654de8e6 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 19:30:27 user nova-compute[75066]:  {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:30:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:27 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[a151fef2-1c67-45c0-86ab-b75da19dfdb4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7] added\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:30:27 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b254e999-3f55-4f04-a181-6213654de8e6 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7] added
Dec 01 19:30:27 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:30:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-95e86adb-346f-40e5-b658-31aa9d60a5a4 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Acquiring lock "refresh_cache-00506483-8f09-4a3d-938a-31ab1b2dbf83" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:30:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-95e86adb-346f-40e5-b658-31aa9d60a5a4 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Acquired lock "refresh_cache-00506483-8f09-4a3d-938a-31ab1b2dbf83" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:30:27 user nova-compute[75066]: DEBUG nova.network.neutron [None req-95e86adb-346f-40e5-b658-31aa9d60a5a4 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:30:27 user nova-compute[75066]: DEBUG nova.objects.instance [None req-95e86adb-346f-40e5-b658-31aa9d60a5a4 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lazy-loading 'info_cache' on Instance uuid 00506483-8f09-4a3d-938a-31ab1b2dbf83 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:30:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:27 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc3ba14-149b-420e-9898-2265f553fab8]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:30:27 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b254e999-3f55-4f04-a181-6213654de8e6 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:30:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:27 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb693d69-3edd-4f90-8f9e-c0e8d786e329]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:30:27 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b254e999-3f55-4f04-a181-6213654de8e6 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:30:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v snEOyWIq {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v snEOyWIq" returned: 0 in 0.023s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:27 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[72570d08-c943-42d2-9bba-78c143bfd98a]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:30:27 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b254e999-3f55-4f04-a181-6213654de8e6 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'snEOyWIq'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:30:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:27 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b08bfa-fdc2-4021-b032-5d4d6f6a0776]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:30:27 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b254e999-3f55-4f04-a181-6213654de8e6 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:30:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:27 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a653dae-2f6b-446a-a727-437356a84e85]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:30:27 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b254e999-3f55-4f04-a181-6213654de8e6 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:30:27 user nova-compute[75066]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a (non-flash)
Dec 01 19:30:27 user nova-compute[75066]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)
Dec 01 19:30:27 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:30:27 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b254e999-3f55-4f04-a181-6213654de8e6 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:30:27 user nova-compute[75066]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a (non-flash)
Dec 01 19:30:27 user nova-compute[75066]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)
Dec 01 19:30:27 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:30:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 -p 172.16.0.220:3260 --login {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:27 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecec2e57-8d61-4fad-8a7e-4162bbb3272d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:30:27 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b254e999-3f55-4f04-a181-6213654de8e6 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7, portal: 172.16.0.220,3260]
Dec 01 19:30:27 user nova-compute[75066]: Login to [iface: default, target: iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7, portal: 172.16.0.220,3260] successful.
Dec 01 19:30:27 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:30:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:27 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a6cad3-65e0-4b23-9f1b-74210abab3ef]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:30:27 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b254e999-3f55-4f04-a181-6213654de8e6 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:30:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:27 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[661c3453-efa1-49f1-924f-05f789678703]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:30:27 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b254e999-3f55-4f04-a181-6213654de8e6 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:30:27 user nova-compute[75066]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a (non-flash)
Dec 01 19:30:27 user nova-compute[75066]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)
Dec 01 19:30:27 user nova-compute[75066]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 (non-flash)
Dec 01 19:30:27 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:30:27 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b254e999-3f55-4f04-a181-6213654de8e6 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:30:27 user nova-compute[75066]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a (non-flash)
Dec 01 19:30:27 user nova-compute[75066]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)
Dec 01 19:30:27 user nova-compute[75066]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 (non-flash)
Dec 01 19:30:27 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:30:27 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-b254e999-3f55-4f04-a181-6213654de8e6 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.350s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:30:27 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b254e999-3f55-4f04-a181-6213654de8e6 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Connected to 172.16.0.220:3260 {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 19:30:27 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-b254e999-3f55-4f04-a181-6213654de8e6 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] HCTL ('35', '-', '-', 0) found on session 38 with lun 0 {{(pid=75066) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 19:30:27 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-b254e999-3f55-4f04-a181-6213654de8e6 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75066) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 19:30:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:27 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0cdedda-86b2-46af-8045-17a97973d3a3]: (4, ('- - 0', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:30:27 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-b254e999-3f55-4f04-a181-6213654de8e6 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Searching for a device in session 38 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:30:27 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b254e999-3f55-4f04-a181-6213654de8e6 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'snEOyWIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 19:30:28 user nova-compute[75066]: DEBUG nova.network.neutron [None req-95e86adb-346f-40e5-b658-31aa9d60a5a4 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Updating instance_info_cache with network_info: [{"id": "b0528c8d-a14c-4420-a248-fda3f0a92893", "address": "fa:16:3e:a6:1a:51", "network": {"id": "9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-696310557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0f7516d1db4dd5bc7d77a0bd1d44d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0528c8d-a1", "ovs_interfaceid": "b0528c8d-a14c-4420-a248-fda3f0a92893", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:30:28 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-95e86adb-346f-40e5-b658-31aa9d60a5a4 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Releasing lock "refresh_cache-00506483-8f09-4a3d-938a-31ab1b2dbf83" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:30:28 user nova-compute[75066]: DEBUG nova.objects.instance [None req-95e86adb-346f-40e5-b658-31aa9d60a5a4 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lazy-loading 'migration_context' on Instance uuid 00506483-8f09-4a3d-938a-31ab1b2dbf83 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:30:28 user nova-compute[75066]: DEBUG nova.objects.base [None req-95e86adb-346f-40e5-b658-31aa9d60a5a4 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Object Instance<00506483-8f09-4a3d-938a-31ab1b2dbf83> lazy-loaded attributes: info_cache,migration_context {{(pid=75066) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 19:30:28 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-95e86adb-346f-40e5-b658-31aa9d60a5a4 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:30:28 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-95e86adb-346f-40e5-b658-31aa9d60a5a4 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:30:28 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-b254e999-3f55-4f04-a181-6213654de8e6 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.392s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:30:28 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b254e999-3f55-4f04-a181-6213654de8e6 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] <== connect_volume: return (1395ms) {'type': 'block', 'scsi_wwn': '26535666534383932', 'path': '/dev/sdd'} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:30:28 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b254e999-3f55-4f04-a181-6213654de8e6 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26535666534383932', 'path': '/dev/sdd'} {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 19:30:28 user nova-compute[75066]: DEBUG nova.objects.instance [None req-b254e999-3f55-4f04-a181-6213654de8e6 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lazy-loading 'flavor' on Instance uuid b2c6c900-5d1b-44f8-8435-d9ad88b3a412 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:30:28 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-95e86adb-346f-40e5-b658-31aa9d60a5a4 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:30:28 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-95e86adb-346f-40e5-b658-31aa9d60a5a4 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:30:28 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-b254e999-3f55-4f04-a181-6213654de8e6 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 19:30:28 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:30:28 user nova-compute[75066]:   <source dev="/dev/sdd"/>
Dec 01 19:30:28 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:30:28 user nova-compute[75066]:   <serial>560d8e6e-8c2b-4d07-9db1-07e025a12db7</serial>
Dec 01 19:30:28 user nova-compute[75066]: </disk>
Dec 01 19:30:28 user nova-compute[75066]:  {{(pid=75066) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 19:30:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-95e86adb-346f-40e5-b658-31aa9d60a5a4 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.866s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:30:29 user nova-compute[75066]: INFO nova.scheduler.client.report [None req-95e86adb-346f-40e5-b658-31aa9d60a5a4 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Deleted allocation for migration 01d1f16f-013f-4fb4-baca-3d734eb87e84
Dec 01 19:30:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-95e86adb-346f-40e5-b658-31aa9d60a5a4 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "00506483-8f09-4a3d-938a-31ab1b2dbf83" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 2.315s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:30:29 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b254e999-3f55-4f04-a181-6213654de8e6 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:30:29 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b254e999-3f55-4f04-a181-6213654de8e6 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:30:29 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b254e999-3f55-4f04-a181-6213654de8e6 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] No VIF found with MAC fa:16:3e:3f:cc:a8, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:30:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b254e999-3f55-4f04-a181-6213654de8e6 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "b2c6c900-5d1b-44f8-8435-d9ad88b3a412" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 14.508s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:30:30 user nova-compute[75066]: INFO nova.compute.manager [None req-84f2aed7-ef5b-4339-a2ec-de4b50773aa1 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Rescuing
Dec 01 19:30:30 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-84f2aed7-ef5b-4339-a2ec-de4b50773aa1 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Acquiring lock "refresh_cache-b2c6c900-5d1b-44f8-8435-d9ad88b3a412" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:30:30 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-84f2aed7-ef5b-4339-a2ec-de4b50773aa1 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Acquired lock "refresh_cache-b2c6c900-5d1b-44f8-8435-d9ad88b3a412" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:30:30 user nova-compute[75066]: DEBUG nova.network.neutron [None req-84f2aed7-ef5b-4339-a2ec-de4b50773aa1 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:30:30 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-60624956-fc45-4305-851d-2e8d15ad6435 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Acquiring lock "e84b8c28-e79e-4945-8f3c-dddd7184a166" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:30:30 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-60624956-fc45-4305-851d-2e8d15ad6435 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "e84b8c28-e79e-4945-8f3c-dddd7184a166" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:30:30 user nova-compute[75066]: INFO nova.compute.manager [None req-60624956-fc45-4305-851d-2e8d15ad6435 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Detaching volume 6a9ece83-f1e6-4f8c-914e-85de45be4e1a
Dec 01 19:30:30 user nova-compute[75066]: INFO nova.virt.block_device [None req-60624956-fc45-4305-851d-2e8d15ad6435 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Attempting to driver detach volume 6a9ece83-f1e6-4f8c-914e-85de45be4e1a from mountpoint /dev/vdc
Dec 01 19:30:30 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-60624956-fc45-4305-851d-2e8d15ad6435 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Attempting to detach device vdc from instance e84b8c28-e79e-4945-8f3c-dddd7184a166 from the persistent domain config. {{(pid=75066) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 19:30:30 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-60624956-fc45-4305-851d-2e8d15ad6435 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 19:30:30 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:30:30 user nova-compute[75066]:   <source dev="/dev/sdc"/>
Dec 01 19:30:30 user nova-compute[75066]:   <target dev="vdc" bus="virtio"/>
Dec 01 19:30:30 user nova-compute[75066]:   <serial>6a9ece83-f1e6-4f8c-914e-85de45be4e1a</serial>
Dec 01 19:30:30 user nova-compute[75066]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 01 19:30:30 user nova-compute[75066]: </disk>
Dec 01 19:30:30 user nova-compute[75066]:  {{(pid=75066) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 19:30:30 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-60624956-fc45-4305-851d-2e8d15ad6435 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Successfully detached device vdc from instance e84b8c28-e79e-4945-8f3c-dddd7184a166 from the persistent domain config.
Dec 01 19:30:30 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-60624956-fc45-4305-851d-2e8d15ad6435 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance e84b8c28-e79e-4945-8f3c-dddd7184a166 from the live domain config. {{(pid=75066) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 19:30:30 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-60624956-fc45-4305-851d-2e8d15ad6435 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 19:30:30 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:30:30 user nova-compute[75066]:   <source dev="/dev/sdc"/>
Dec 01 19:30:30 user nova-compute[75066]:   <target dev="vdc" bus="virtio"/>
Dec 01 19:30:30 user nova-compute[75066]:   <serial>6a9ece83-f1e6-4f8c-914e-85de45be4e1a</serial>
Dec 01 19:30:30 user nova-compute[75066]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Dec 01 19:30:30 user nova-compute[75066]: </disk>
Dec 01 19:30:30 user nova-compute[75066]:  {{(pid=75066) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 19:30:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:30:30 user nova-compute[75066]: DEBUG nova.network.neutron [None req-84f2aed7-ef5b-4339-a2ec-de4b50773aa1 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Updating instance_info_cache with network_info: [{"id": "5b64624f-4059-4689-83ef-856573e0eab0", "address": "fa:16:3e:3f:cc:a8", "network": {"id": "47c850ae-6dcb-4977-a02a-e32cd3df4749", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-475363603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "943324a514a84cb4947dbab93abc4f6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b64624f-40", "ovs_interfaceid": "5b64624f-4059-4689-83ef-856573e0eab0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:30:30 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-84f2aed7-ef5b-4339-a2ec-de4b50773aa1 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Releasing lock "refresh_cache-b2c6c900-5d1b-44f8-8435-d9ad88b3a412" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:30:30 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-60624956-fc45-4305-851d-2e8d15ad6435 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance e84b8c28-e79e-4945-8f3c-dddd7184a166 {{(pid=75066) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 19:30:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG nova.compute.manager [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Start spawning the instance on the hypervisor. {{(pid=75066) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Creating instance directory {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 19:30:31 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Creating image(s)
Dec 01 19:30:31 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Did not create local disks {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Ensure instance console log exists: /opt/stack/data/nova/instances/f04249c5-0196-455c-ac7a-f1ff8be320d4/console.log {{(pid=75066) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Start _get_guest_xml network_info=[{"id": "bbc4649f-c295-423e-a1c2-be3af706e4de", "address": "fa:16:3e:01:63:75", "network": {"id": "6b0f48b7-3db2-49b2-a238-8fd811b52d62", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1688127634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e000d89bca44cd8acba504256d8d1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbc4649f-c2", "ovs_interfaceid": "bbc4649f-c295-423e-a1c2-be3af706e4de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': False, 'attachment_id': '25783605-e1f2-4171-92bf-4c764a4f0a96', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YDMXrRvi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f04249c5-0196-455c-ac7a-f1ff8be320d4', 'attached_at': '', 'detached_at': '', 'volume_id': '00a9a62a-bf5a-4a84-869d-3aea7a75f571', 'serial': '00a9a62a-bf5a-4a84-869d-3aea7a75f571'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:30:31 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:30:31 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:30:31 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Calling os-brick to attach iSCSI Volume {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YDMXrRvi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:30:31 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:30:31 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:30:31 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:30:31 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:30:31 user nova-compute[75066]: INFO os_brick.initiator.connectors.iscsi [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 19:30:31 user nova-compute[75066]: DEBUG nova.compute.manager [req-b676e437-0875-4ec1-badf-b14af4d4ec5a req-9b314f1c-f222-49e9-8b96-557377065395 service nova] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Received event network-vif-unplugged-5b64624f-4059-4689-83ef-856573e0eab0 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-b676e437-0875-4ec1-badf-b14af4d4ec5a req-9b314f1c-f222-49e9-8b96-557377065395 service nova] Acquiring lock "b2c6c900-5d1b-44f8-8435-d9ad88b3a412-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-b676e437-0875-4ec1-badf-b14af4d4ec5a req-9b314f1c-f222-49e9-8b96-557377065395 service nova] Lock "b2c6c900-5d1b-44f8-8435-d9ad88b3a412-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-b676e437-0875-4ec1-badf-b14af4d4ec5a req-9b314f1c-f222-49e9-8b96-557377065395 service nova] Lock "b2c6c900-5d1b-44f8-8435-d9ad88b3a412-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG nova.compute.manager [req-b676e437-0875-4ec1-badf-b14af4d4ec5a req-9b314f1c-f222-49e9-8b96-557377065395 service nova] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] No waiting events found dispatching network-vif-unplugged-5b64624f-4059-4689-83ef-856573e0eab0 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:30:31 user nova-compute[75066]: WARNING nova.compute.manager [req-b676e437-0875-4ec1-badf-b14af4d4ec5a req-9b314f1c-f222-49e9-8b96-557377065395 service nova] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Received unexpected event network-vif-unplugged-5b64624f-4059-4689-83ef-856573e0eab0 for instance with vm_state active and task_state rescuing.
Dec 01 19:30:31 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 -p 172.16.0.220:3260 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[10be07ac-cdaf-43d3-98a3-bf01a24273a5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 19:30:31 user nova-compute[75066]:  {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 -p 172.16.0.220:3260 --interface default --op new {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e0c08d-2f00-467c-bae5-f0dc7b027378]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571] added\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571] added
Dec 01 19:30:31 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[916db849-0793-4b14-bf63-08f870199a84]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a3eead-cbea-4f4e-89fb-14e9316a4c29]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YDMXrRvi {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YDMXrRvi" returned: 0 in 0.023s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c7ac10-f489-4a6d-8447-d4243d685e19]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YDMXrRvi'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[71da6307-4c09-4ee7-bf5b-f488dc56daab]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b1af66-6804-4ef1-8c87-4490e401f708]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:30:31 user nova-compute[75066]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a (non-flash)
Dec 01 19:30:31 user nova-compute[75066]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)
Dec 01 19:30:31 user nova-compute[75066]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 (non-flash)
Dec 01 19:30:31 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:30:31 user nova-compute[75066]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a (non-flash)
Dec 01 19:30:31 user nova-compute[75066]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)
Dec 01 19:30:31 user nova-compute[75066]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 (non-flash)
Dec 01 19:30:31 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 -p 172.16.0.220:3260 --login {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e29f29b-5550-40c6-aa88-9fa65a510d34]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571, portal: 172.16.0.220,3260]
Dec 01 19:30:31 user nova-compute[75066]: Login to [iface: default, target: iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571, portal: 172.16.0.220,3260] successful.
Dec 01 19:30:31 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[975a0c43-02af-4de6-9014-190358f02424]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:31 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Instance destroyed successfully.
Dec 01 19:30:31 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-84f2aed7-ef5b-4339-a2ec-de4b50773aa1 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Attempting rescue
Dec 01 19:30:31 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-84f2aed7-ef5b-4339-a2ec-de4b50773aa1 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75066) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4314}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-84f2aed7-ef5b-4339-a2ec-de4b50773aa1 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Instance directory exists: not creating {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4719}}
Dec 01 19:30:31 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-84f2aed7-ef5b-4339-a2ec-de4b50773aa1 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Creating image(s)
Dec 01 19:30:31 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-84f2aed7-ef5b-4339-a2ec-de4b50773aa1 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Acquiring lock "/opt/stack/data/nova/instances/b2c6c900-5d1b-44f8-8435-d9ad88b3a412/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-84f2aed7-ef5b-4339-a2ec-de4b50773aa1 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "/opt/stack/data/nova/instances/b2c6c900-5d1b-44f8-8435-d9ad88b3a412/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-84f2aed7-ef5b-4339-a2ec-de4b50773aa1 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "/opt/stack/data/nova/instances/b2c6c900-5d1b-44f8-8435-d9ad88b3a412/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG nova.objects.instance [None req-84f2aed7-ef5b-4339-a2ec-de4b50773aa1 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lazy-loading 'trusted_certs' on Instance uuid b2c6c900-5d1b-44f8-8435-d9ad88b3a412 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[936e1cd0-2226-429f-8923-811b343dbd40]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:30:31 user nova-compute[75066]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a (non-flash)
Dec 01 19:30:31 user nova-compute[75066]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)
Dec 01 19:30:31 user nova-compute[75066]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 (non-flash)
Dec 01 19:30:31 user nova-compute[75066]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 (non-flash)
Dec 01 19:30:31 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:30:31 user nova-compute[75066]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a (non-flash)
Dec 01 19:30:31 user nova-compute[75066]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)
Dec 01 19:30:31 user nova-compute[75066]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 (non-flash)
Dec 01 19:30:31 user nova-compute[75066]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 (non-flash)
Dec 01 19:30:31 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.341s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Connected to 172.16.0.220:3260 {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] HCTL ('36', '-', '-', 0) found on session 39 with lun 0 {{(pid=75066) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75066) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-84f2aed7-ef5b-4339-a2ec-de4b50773aa1 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Acquiring lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-84f2aed7-ef5b-4339-a2ec-de4b50773aa1 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-84f2aed7-ef5b-4339-a2ec-de4b50773aa1 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a94ed2-eae8-44e6-8c49-ccf33d0718bd]: (4, ('- - 0', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YDMXrRvi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.747s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] <== connect_volume: return (748ms) {'type': 'block', 'scsi_wwn': '26262323331663530', 'path': '/dev/sde'} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262323331663530', 'path': '/dev/sde'} {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-84f2aed7-ef5b-4339-a2ec-de4b50773aa1 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.392s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:31 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-84f2aed7-ef5b-4339-a2ec-de4b50773aa1 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/b2c6c900-5d1b-44f8-8435-d9ad88b3a412/disk.rescue {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:32 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-84f2aed7-ef5b-4339-a2ec-de4b50773aa1 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/b2c6c900-5d1b-44f8-8435-d9ad88b3a412/disk.rescue" returned: 0 in 0.055s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:32 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-84f2aed7-ef5b-4339-a2ec-de4b50773aa1 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.451s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:30:32 user nova-compute[75066]: DEBUG nova.objects.instance [None req-84f2aed7-ef5b-4339-a2ec-de4b50773aa1 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lazy-loading 'migration_context' on Instance uuid b2c6c900-5d1b-44f8-8435-d9ad88b3a412 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:30:32 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:30:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2133252280',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2133252280',id=34,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e000d89bca44cd8acba504256d8d1f1',ramdisk_id='',reservation_id='r-1ouukm88',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-454493649',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:30:08Z,user_data=None,user_id='964c1681ca8745d0b3879266d24f507e',uuid=f04249c5-0196-455c-ac7a-f1ff8be320d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bbc4649f-c295-423e-a1c2-be3af706e4de", "address": "fa:16:3e:01:63:75", "network": {"id": "6b0f48b7-3db2-49b2-a238-8fd811b52d62", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1688127634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e000d89bca44cd8acba504256d8d1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbc4649f-c2", "ovs_interfaceid": "bbc4649f-c295-423e-a1c2-be3af706e4de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:30:32 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Converting VIF {"id": "bbc4649f-c295-423e-a1c2-be3af706e4de", "address": "fa:16:3e:01:63:75", "network": {"id": "6b0f48b7-3db2-49b2-a238-8fd811b52d62", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1688127634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e000d89bca44cd8acba504256d8d1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbc4649f-c2", "ovs_interfaceid": "bbc4649f-c295-423e-a1c2-be3af706e4de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:30:32 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:63:75,bridge_name='br-int',has_traffic_filtering=True,id=bbc4649f-c295-423e-a1c2-be3af706e4de,network=Network(6b0f48b7-3db2-49b2-a238-8fd811b52d62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbc4649f-c2') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:30:32 user nova-compute[75066]: DEBUG nova.objects.instance [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lazy-loading 'pci_devices' on Instance uuid f04249c5-0196-455c-ac7a-f1ff8be320d4 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:30:32 user nova-compute[75066]: DEBUG nova.objects.base [None req-84f2aed7-ef5b-4339-a2ec-de4b50773aa1 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Object Instance<b2c6c900-5d1b-44f8-8435-d9ad88b3a412> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75066) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 19:30:32 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-84f2aed7-ef5b-4339-a2ec-de4b50773aa1 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Created local disks {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 19:30:32 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-84f2aed7-ef5b-4339-a2ec-de4b50773aa1 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Start _get_guest_xml network_info=[{"id": "5b64624f-4059-4689-83ef-856573e0eab0", "address": "fa:16:3e:3f:cc:a8", "network": {"id": "47c850ae-6dcb-4977-a02a-e32cd3df4749", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-475363603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-475363603-network", "vif_mac": "fa:16:3e:3f:cc:a8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "943324a514a84cb4947dbab93abc4f6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b64624f-40", "ovs_interfaceid": "5b64624f-4059-4689-83ef-856573e0eab0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '900b237b-e99c-4fdd-a44f-dcb7a08baa86', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:30:32 user nova-compute[75066]: DEBUG nova.objects.instance [None req-84f2aed7-ef5b-4339-a2ec-de4b50773aa1 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lazy-loading 'resources' on Instance uuid b2c6c900-5d1b-44f8-8435-d9ad88b3a412 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:30:32 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:30:32 user nova-compute[75066]:   <uuid>f04249c5-0196-455c-ac7a-f1ff8be320d4</uuid>
Dec 01 19:30:32 user nova-compute[75066]:   <name>instance-00000022</name>
Dec 01 19:30:32 user nova-compute[75066]:   <memory>524288</memory>
Dec 01 19:30:32 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:30:32 user nova-compute[75066]:   <metadata>
Dec 01 19:30:32 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:30:32 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:30:32 user nova-compute[75066]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2133252280</nova:name>
Dec 01 19:30:32 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:30:31</nova:creationTime>
Dec 01 19:30:32 user nova-compute[75066]:       <nova:flavor name="m1.tiny">
Dec 01 19:30:32 user nova-compute[75066]:         <nova:memory>512</nova:memory>
Dec 01 19:30:32 user nova-compute[75066]:         <nova:disk>1</nova:disk>
Dec 01 19:30:32 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:30:32 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:30:32 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:30:32 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:30:32 user nova-compute[75066]:       <nova:owner>
Dec 01 19:30:32 user nova-compute[75066]:         <nova:user uuid="964c1681ca8745d0b3879266d24f507e">tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member</nova:user>
Dec 01 19:30:32 user nova-compute[75066]:         <nova:project uuid="2e000d89bca44cd8acba504256d8d1f1">tempest-ServerBootFromVolumeStableRescueTest-454493649</nova:project>
Dec 01 19:30:32 user nova-compute[75066]:       </nova:owner>
Dec 01 19:30:32 user nova-compute[75066]:       <nova:root type="image" uuid="900b237b-e99c-4fdd-a44f-dcb7a08baa86"/>
Dec 01 19:30:32 user nova-compute[75066]:       <nova:ports>
Dec 01 19:30:32 user nova-compute[75066]:         <nova:port uuid="bbc4649f-c295-423e-a1c2-be3af706e4de">
Dec 01 19:30:32 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 01 19:30:32 user nova-compute[75066]:         </nova:port>
Dec 01 19:30:32 user nova-compute[75066]:       </nova:ports>
Dec 01 19:30:32 user nova-compute[75066]:     </nova:instance>
Dec 01 19:30:32 user nova-compute[75066]:   </metadata>
Dec 01 19:30:32 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:30:32 user nova-compute[75066]:     <system>
Dec 01 19:30:32 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:30:32 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:30:32 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:30:32 user nova-compute[75066]:       <entry name="serial">f04249c5-0196-455c-ac7a-f1ff8be320d4</entry>
Dec 01 19:30:32 user nova-compute[75066]:       <entry name="uuid">f04249c5-0196-455c-ac7a-f1ff8be320d4</entry>
Dec 01 19:30:32 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:30:32 user nova-compute[75066]:     </system>
Dec 01 19:30:32 user nova-compute[75066]:   </sysinfo>
Dec 01 19:30:32 user nova-compute[75066]:   <os>
Dec 01 19:30:32 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:30:32 user nova-compute[75066]:     <boot dev="hd"/>
Dec 01 19:30:32 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:30:32 user nova-compute[75066]:   </os>
Dec 01 19:30:32 user nova-compute[75066]:   <features>
Dec 01 19:30:32 user nova-compute[75066]:     <acpi/>
Dec 01 19:30:32 user nova-compute[75066]:     <apic/>
Dec 01 19:30:32 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:30:32 user nova-compute[75066]:   </features>
Dec 01 19:30:32 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:30:32 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:30:32 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:30:32 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:30:32 user nova-compute[75066]:   </clock>
Dec 01 19:30:32 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:30:32 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:30:32 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:30:32 user nova-compute[75066]:   </cpu>
Dec 01 19:30:32 user nova-compute[75066]:   <devices>
Dec 01 19:30:32 user nova-compute[75066]:     <disk type="block" device="disk">
Dec 01 19:30:32 user nova-compute[75066]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:30:32 user nova-compute[75066]:       <source dev="/dev/sde"/>
Dec 01 19:30:32 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:30:32 user nova-compute[75066]:       <serial>00a9a62a-bf5a-4a84-869d-3aea7a75f571</serial>
Dec 01 19:30:32 user nova-compute[75066]:     </disk>
Dec 01 19:30:32 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:30:32 user nova-compute[75066]:       <mac address="fa:16:3e:01:63:75"/>
Dec 01 19:30:32 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:30:32 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:30:32 user nova-compute[75066]:       <target dev="tapbbc4649f-c2"/>
Dec 01 19:30:32 user nova-compute[75066]:     </interface>
Dec 01 19:30:32 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:30:32 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/f04249c5-0196-455c-ac7a-f1ff8be320d4/console.log" append="off"/>
Dec 01 19:30:32 user nova-compute[75066]:     </serial>
Dec 01 19:30:32 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:30:32 user nova-compute[75066]:     <video>
Dec 01 19:30:32 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:30:32 user nova-compute[75066]:     </video>
Dec 01 19:30:32 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:30:32 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:30:32 user nova-compute[75066]:     </rng>
Dec 01 19:30:32 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:30:32 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:30:32 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:30:32 user nova-compute[75066]:     </memballoon>
Dec 01 19:30:32 user nova-compute[75066]:   </devices>
Dec 01 19:30:32 user nova-compute[75066]: </domain>
Dec 01 19:30:32 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:30:32 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:30:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2133252280',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2133252280',id=34,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2e000d89bca44cd8acba504256d8d1f1',ramdisk_id='',reservation_id='r-1ouukm88',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-454493649',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:30:08Z,user_data=None,user_id='964c1681ca8745d0b3879266d24f507e',uuid=f04249c5-0196-455c-ac7a-f1ff8be320d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bbc4649f-c295-423e-a1c2-be3af706e4de", "address": "fa:16:3e:01:63:75", "network": {"id": "6b0f48b7-3db2-49b2-a238-8fd811b52d62", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1688127634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e000d89bca44cd8acba504256d8d1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbc4649f-c2", "ovs_interfaceid": "bbc4649f-c295-423e-a1c2-be3af706e4de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:30:32 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Converting VIF {"id": "bbc4649f-c295-423e-a1c2-be3af706e4de", "address": "fa:16:3e:01:63:75", "network": {"id": "6b0f48b7-3db2-49b2-a238-8fd811b52d62", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1688127634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e000d89bca44cd8acba504256d8d1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbc4649f-c2", "ovs_interfaceid": "bbc4649f-c295-423e-a1c2-be3af706e4de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:30:32 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:63:75,bridge_name='br-int',has_traffic_filtering=True,id=bbc4649f-c295-423e-a1c2-be3af706e4de,network=Network(6b0f48b7-3db2-49b2-a238-8fd811b52d62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbc4649f-c2') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:30:32 user nova-compute[75066]: DEBUG os_vif [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:63:75,bridge_name='br-int',has_traffic_filtering=True,id=bbc4649f-c295-423e-a1c2-be3af706e4de,network=Network(6b0f48b7-3db2-49b2-a238-8fd811b52d62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbc4649f-c2') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:30:32 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:32 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:30:32 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:30:32 user nova-compute[75066]: DEBUG nova.objects.base [None req-84f2aed7-ef5b-4339-a2ec-de4b50773aa1 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Object Instance<b2c6c900-5d1b-44f8-8435-d9ad88b3a412> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75066) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 19:30:32 user nova-compute[75066]: DEBUG nova.objects.instance [None req-84f2aed7-ef5b-4339-a2ec-de4b50773aa1 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lazy-loading 'numa_topology' on Instance uuid b2c6c900-5d1b-44f8-8435-d9ad88b3a412 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:30:32 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:32 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c7e07ce9-7aa2-5cab-ad5d-382a5dbb9925', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:30:32 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:32 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:30:32 user nova-compute[75066]: DEBUG nova.objects.base [None req-84f2aed7-ef5b-4339-a2ec-de4b50773aa1 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Object Instance<b2c6c900-5d1b-44f8-8435-d9ad88b3a412> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75066) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 19:30:32 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-84f2aed7-ef5b-4339-a2ec-de4b50773aa1 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:30:32 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-84f2aed7-ef5b-4339-a2ec-de4b50773aa1 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:30:32 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:32 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-84f2aed7-ef5b-4339-a2ec-de4b50773aa1 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:30:32 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-84f2aed7-ef5b-4339-a2ec-de4b50773aa1 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:30:32 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:32 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbbc4649f-c2, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:30:32 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbbc4649f-c2, col_values=(('qos', UUID('498d67b7-fa28-4385-b3b8-11990812c3c1')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:30:32 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbbc4649f-c2, col_values=(('external_ids', {'iface-id': 'bbc4649f-c295-423e-a1c2-be3af706e4de', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:63:75', 'vm-uuid': 'f04249c5-0196-455c-ac7a-f1ff8be320d4'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:30:32 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:32 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:30:32 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-84f2aed7-ef5b-4339-a2ec-de4b50773aa1 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:30:32 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-84f2aed7-ef5b-4339-a2ec-de4b50773aa1 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:30:32 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-84f2aed7-ef5b-4339-a2ec-de4b50773aa1 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:30:32 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-84f2aed7-ef5b-4339-a2ec-de4b50773aa1 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:30:32 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-84f2aed7-ef5b-4339-a2ec-de4b50773aa1 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:30:32 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-84f2aed7-ef5b-4339-a2ec-de4b50773aa1 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:30:32 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-84f2aed7-ef5b-4339-a2ec-de4b50773aa1 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:30:32 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-84f2aed7-ef5b-4339-a2ec-de4b50773aa1 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:30:32 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-84f2aed7-ef5b-4339-a2ec-de4b50773aa1 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:30:32 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-84f2aed7-ef5b-4339-a2ec-de4b50773aa1 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:30:32 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-84f2aed7-ef5b-4339-a2ec-de4b50773aa1 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:30:32 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-84f2aed7-ef5b-4339-a2ec-de4b50773aa1 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:30:32 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-84f2aed7-ef5b-4339-a2ec-de4b50773aa1 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:30:32 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-84f2aed7-ef5b-4339-a2ec-de4b50773aa1 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:30:32 user nova-compute[75066]: DEBUG nova.objects.instance [None req-84f2aed7-ef5b-4339-a2ec-de4b50773aa1 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lazy-loading 'vcpu_model' on Instance uuid b2c6c900-5d1b-44f8-8435-d9ad88b3a412 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:30:32 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:32 user nova-compute[75066]: INFO os_vif [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:63:75,bridge_name='br-int',has_traffic_filtering=True,id=bbc4649f-c295-423e-a1c2-be3af706e4de,network=Network(6b0f48b7-3db2-49b2-a238-8fd811b52d62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbc4649f-c2')
Dec 01 19:30:32 user nova-compute[75066]: DEBUG nova.objects.base [None req-84f2aed7-ef5b-4339-a2ec-de4b50773aa1 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Object Instance<b2c6c900-5d1b-44f8-8435-d9ad88b3a412> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75066) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 19:30:32 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-84f2aed7-ef5b-4339-a2ec-de4b50773aa1 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:28:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1435487615',display_name='tempest-ServerRescueNegativeTestJSON-server-1435487615',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1435487615',id=31,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDCNeprmgnfVxogNGgOlPPfFndhuZOSmJ9cRoqBokaw77D1VjF05n80FVq2sXbC1g2yqvZwE0g/0YU+PBmyhkD7PWUIyoZLPPecgdaLZA1vtC7lvG4JylIPIbZvcQHhUPw==',key_name='tempest-keypair-645274599',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:28:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='943324a514a84cb4947dbab93abc4f6c',ramdisk_id='',reservation_id='r-c4an3hxc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-146516797',owner_user_name='tempest-ServerRescueNegativeTestJSON-146516797-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:28:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6ee9ed4a8d8418082a59be8db20cf2e',uuid=b2c6c900-5d1b-44f8-8435-d9ad88b3a412,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b64624f-4059-4689-83ef-856573e0eab0", "address": "fa:16:3e:3f:cc:a8", "network": {"id": "47c850ae-6dcb-4977-a02a-e32cd3df4749", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-475363603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-475363603-network", "vif_mac": "fa:16:3e:3f:cc:a8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "943324a514a84cb4947dbab93abc4f6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b64624f-40", "ovs_interfaceid": "5b64624f-4059-4689-83ef-856573e0eab0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:30:32 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-84f2aed7-ef5b-4339-a2ec-de4b50773aa1 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Converting VIF {"id": "5b64624f-4059-4689-83ef-856573e0eab0", "address": "fa:16:3e:3f:cc:a8", "network": {"id": "47c850ae-6dcb-4977-a02a-e32cd3df4749", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-475363603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-475363603-network", "vif_mac": "fa:16:3e:3f:cc:a8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "943324a514a84cb4947dbab93abc4f6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b64624f-40", "ovs_interfaceid": "5b64624f-4059-4689-83ef-856573e0eab0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:30:32 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-84f2aed7-ef5b-4339-a2ec-de4b50773aa1 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3f:cc:a8,bridge_name='br-int',has_traffic_filtering=True,id=5b64624f-4059-4689-83ef-856573e0eab0,network=Network(47c850ae-6dcb-4977-a02a-e32cd3df4749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b64624f-40') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:30:32 user nova-compute[75066]: DEBUG nova.objects.instance [None req-84f2aed7-ef5b-4339-a2ec-de4b50773aa1 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lazy-loading 'pci_devices' on Instance uuid b2c6c900-5d1b-44f8-8435-d9ad88b3a412 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:30:32 user nova-compute[75066]: DEBUG nova.objects.base [None req-84f2aed7-ef5b-4339-a2ec-de4b50773aa1 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Object Instance<b2c6c900-5d1b-44f8-8435-d9ad88b3a412> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75066) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 19:30:32 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-84f2aed7-ef5b-4339-a2ec-de4b50773aa1 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:30:32 user nova-compute[75066]:   <uuid>b2c6c900-5d1b-44f8-8435-d9ad88b3a412</uuid>
Dec 01 19:30:32 user nova-compute[75066]:   <name>instance-0000001f</name>
Dec 01 19:30:32 user nova-compute[75066]:   <memory>524288</memory>
Dec 01 19:30:32 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:30:32 user nova-compute[75066]:   <metadata>
Dec 01 19:30:32 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:30:32 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:30:32 user nova-compute[75066]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1435487615</nova:name>
Dec 01 19:30:32 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:30:32</nova:creationTime>
Dec 01 19:30:32 user nova-compute[75066]:       <nova:flavor name="m1.tiny">
Dec 01 19:30:32 user nova-compute[75066]:         <nova:memory>512</nova:memory>
Dec 01 19:30:32 user nova-compute[75066]:         <nova:disk>1</nova:disk>
Dec 01 19:30:32 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:30:32 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:30:32 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:30:32 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:30:32 user nova-compute[75066]:       <nova:owner>
Dec 01 19:30:32 user nova-compute[75066]:         <nova:user uuid="e6ee9ed4a8d8418082a59be8db20cf2e">tempest-ServerRescueNegativeTestJSON-146516797-project-member</nova:user>
Dec 01 19:30:32 user nova-compute[75066]:         <nova:project uuid="943324a514a84cb4947dbab93abc4f6c">tempest-ServerRescueNegativeTestJSON-146516797</nova:project>
Dec 01 19:30:32 user nova-compute[75066]:       </nova:owner>
Dec 01 19:30:32 user nova-compute[75066]:       <nova:root type="image" uuid="900b237b-e99c-4fdd-a44f-dcb7a08baa86"/>
Dec 01 19:30:32 user nova-compute[75066]:       <nova:ports>
Dec 01 19:30:32 user nova-compute[75066]:         <nova:port uuid="5b64624f-4059-4689-83ef-856573e0eab0">
Dec 01 19:30:32 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Dec 01 19:30:32 user nova-compute[75066]:         </nova:port>
Dec 01 19:30:32 user nova-compute[75066]:       </nova:ports>
Dec 01 19:30:32 user nova-compute[75066]:     </nova:instance>
Dec 01 19:30:32 user nova-compute[75066]:   </metadata>
Dec 01 19:30:32 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:30:32 user nova-compute[75066]:     <system>
Dec 01 19:30:32 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:30:32 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:30:32 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:30:32 user nova-compute[75066]:       <entry name="serial">b2c6c900-5d1b-44f8-8435-d9ad88b3a412</entry>
Dec 01 19:30:32 user nova-compute[75066]:       <entry name="uuid">b2c6c900-5d1b-44f8-8435-d9ad88b3a412</entry>
Dec 01 19:30:32 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:30:32 user nova-compute[75066]:     </system>
Dec 01 19:30:32 user nova-compute[75066]:   </sysinfo>
Dec 01 19:30:32 user nova-compute[75066]:   <os>
Dec 01 19:30:32 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:30:32 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:30:32 user nova-compute[75066]:   </os>
Dec 01 19:30:32 user nova-compute[75066]:   <features>
Dec 01 19:30:32 user nova-compute[75066]:     <acpi/>
Dec 01 19:30:32 user nova-compute[75066]:     <apic/>
Dec 01 19:30:32 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:30:32 user nova-compute[75066]:   </features>
Dec 01 19:30:32 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:30:32 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:30:32 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:30:32 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:30:32 user nova-compute[75066]:   </clock>
Dec 01 19:30:32 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:30:32 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:30:32 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:30:32 user nova-compute[75066]:   </cpu>
Dec 01 19:30:32 user nova-compute[75066]:   <devices>
Dec 01 19:30:32 user nova-compute[75066]:     <disk type="file" device="disk">
Dec 01 19:30:32 user nova-compute[75066]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 19:30:32 user nova-compute[75066]:       <source file="/opt/stack/data/nova/instances/b2c6c900-5d1b-44f8-8435-d9ad88b3a412/disk.rescue"/>
Dec 01 19:30:32 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:30:32 user nova-compute[75066]:     </disk>
Dec 01 19:30:32 user nova-compute[75066]:     <disk type="file" device="disk">
Dec 01 19:30:32 user nova-compute[75066]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 19:30:32 user nova-compute[75066]:       <source file="/opt/stack/data/nova/instances/b2c6c900-5d1b-44f8-8435-d9ad88b3a412/disk"/>
Dec 01 19:30:32 user nova-compute[75066]:       <target dev="vdb" bus="virtio"/>
Dec 01 19:30:32 user nova-compute[75066]:     </disk>
Dec 01 19:30:32 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:30:32 user nova-compute[75066]:       <mac address="fa:16:3e:3f:cc:a8"/>
Dec 01 19:30:32 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:30:32 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:30:32 user nova-compute[75066]:       <target dev="tap5b64624f-40"/>
Dec 01 19:30:32 user nova-compute[75066]:     </interface>
Dec 01 19:30:32 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:30:32 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/b2c6c900-5d1b-44f8-8435-d9ad88b3a412/console.log" append="off"/>
Dec 01 19:30:32 user nova-compute[75066]:     </serial>
Dec 01 19:30:32 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:30:32 user nova-compute[75066]:     <video>
Dec 01 19:30:32 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:30:32 user nova-compute[75066]:     </video>
Dec 01 19:30:32 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:30:32 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:30:32 user nova-compute[75066]:     </rng>
Dec 01 19:30:32 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:30:32 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:30:32 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:30:32 user nova-compute[75066]:     </memballoon>
Dec 01 19:30:32 user nova-compute[75066]:   </devices>
Dec 01 19:30:32 user nova-compute[75066]: </domain>
Dec 01 19:30:32 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:30:32 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Instance destroyed successfully.
Dec 01 19:30:32 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:30:32 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] No VIF found with MAC fa:16:3e:01:63:75, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:30:32 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-84f2aed7-ef5b-4339-a2ec-de4b50773aa1 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:30:32 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-84f2aed7-ef5b-4339-a2ec-de4b50773aa1 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:30:32 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-84f2aed7-ef5b-4339-a2ec-de4b50773aa1 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] No VIF found with MAC fa:16:3e:3f:cc:a8, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:30:32 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:33 user nova-compute[75066]: DEBUG nova.compute.manager [req-80f5c763-7748-4674-bb36-9d0819d4a4f9 req-b5a978e3-d5f2-4eaf-8e44-e560d7c51c7a service nova] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Received event network-vif-plugged-5b64624f-4059-4689-83ef-856573e0eab0 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:30:33 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-80f5c763-7748-4674-bb36-9d0819d4a4f9 req-b5a978e3-d5f2-4eaf-8e44-e560d7c51c7a service nova] Acquiring lock "b2c6c900-5d1b-44f8-8435-d9ad88b3a412-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:30:33 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-80f5c763-7748-4674-bb36-9d0819d4a4f9 req-b5a978e3-d5f2-4eaf-8e44-e560d7c51c7a service nova] Lock "b2c6c900-5d1b-44f8-8435-d9ad88b3a412-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:30:33 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-80f5c763-7748-4674-bb36-9d0819d4a4f9 req-b5a978e3-d5f2-4eaf-8e44-e560d7c51c7a service nova] Lock "b2c6c900-5d1b-44f8-8435-d9ad88b3a412-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:30:33 user nova-compute[75066]: DEBUG nova.compute.manager [req-80f5c763-7748-4674-bb36-9d0819d4a4f9 req-b5a978e3-d5f2-4eaf-8e44-e560d7c51c7a service nova] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] No waiting events found dispatching network-vif-plugged-5b64624f-4059-4689-83ef-856573e0eab0 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:30:33 user nova-compute[75066]: WARNING nova.compute.manager [req-80f5c763-7748-4674-bb36-9d0819d4a4f9 req-b5a978e3-d5f2-4eaf-8e44-e560d7c51c7a service nova] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Received unexpected event network-vif-plugged-5b64624f-4059-4689-83ef-856573e0eab0 for instance with vm_state active and task_state rescuing.
Dec 01 19:30:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:34 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:34 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:34 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:34 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:34 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:34 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:34 user nova-compute[75066]: DEBUG nova.compute.manager [req-9f948141-52ee-4715-90c2-3debdb3f0003 req-8b315a12-f8d9-4322-8ac5-2924553e27cb service nova] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Received event network-vif-plugged-bbc4649f-c295-423e-a1c2-be3af706e4de {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:30:34 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-9f948141-52ee-4715-90c2-3debdb3f0003 req-8b315a12-f8d9-4322-8ac5-2924553e27cb service nova] Acquiring lock "f04249c5-0196-455c-ac7a-f1ff8be320d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:30:34 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-9f948141-52ee-4715-90c2-3debdb3f0003 req-8b315a12-f8d9-4322-8ac5-2924553e27cb service nova] Lock "f04249c5-0196-455c-ac7a-f1ff8be320d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:30:34 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-9f948141-52ee-4715-90c2-3debdb3f0003 req-8b315a12-f8d9-4322-8ac5-2924553e27cb service nova] Lock "f04249c5-0196-455c-ac7a-f1ff8be320d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:30:34 user nova-compute[75066]: DEBUG nova.compute.manager [req-9f948141-52ee-4715-90c2-3debdb3f0003 req-8b315a12-f8d9-4322-8ac5-2924553e27cb service nova] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] No waiting events found dispatching network-vif-plugged-bbc4649f-c295-423e-a1c2-be3af706e4de {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:30:34 user nova-compute[75066]: WARNING nova.compute.manager [req-9f948141-52ee-4715-90c2-3debdb3f0003 req-8b315a12-f8d9-4322-8ac5-2924553e27cb service nova] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Received unexpected event network-vif-plugged-bbc4649f-c295-423e-a1c2-be3af706e4de for instance with vm_state building and task_state spawning.
Dec 01 19:30:34 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:35 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:35 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:35 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:35 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:35 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:35 user nova-compute[75066]: DEBUG nova.compute.manager [req-9a15a669-60c8-485a-a6c3-5ad5eaa6470d req-f296173b-9a17-4d5b-a7d7-23bf80b5ea1f service nova] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Received event network-vif-plugged-5b64624f-4059-4689-83ef-856573e0eab0 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:30:35 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-9a15a669-60c8-485a-a6c3-5ad5eaa6470d req-f296173b-9a17-4d5b-a7d7-23bf80b5ea1f service nova] Acquiring lock "b2c6c900-5d1b-44f8-8435-d9ad88b3a412-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:30:35 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-9a15a669-60c8-485a-a6c3-5ad5eaa6470d req-f296173b-9a17-4d5b-a7d7-23bf80b5ea1f service nova] Lock "b2c6c900-5d1b-44f8-8435-d9ad88b3a412-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:30:35 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-9a15a669-60c8-485a-a6c3-5ad5eaa6470d req-f296173b-9a17-4d5b-a7d7-23bf80b5ea1f service nova] Lock "b2c6c900-5d1b-44f8-8435-d9ad88b3a412-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:30:35 user nova-compute[75066]: DEBUG nova.compute.manager [req-9a15a669-60c8-485a-a6c3-5ad5eaa6470d req-f296173b-9a17-4d5b-a7d7-23bf80b5ea1f service nova] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] No waiting events found dispatching network-vif-plugged-5b64624f-4059-4689-83ef-856573e0eab0 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:30:35 user nova-compute[75066]: WARNING nova.compute.manager [req-9a15a669-60c8-485a-a6c3-5ad5eaa6470d req-f296173b-9a17-4d5b-a7d7-23bf80b5ea1f service nova] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Received unexpected event network-vif-plugged-5b64624f-4059-4689-83ef-856573e0eab0 for instance with vm_state active and task_state rescuing.
Dec 01 19:30:36 user nova-compute[75066]: DEBUG nova.compute.manager [req-82ca2430-6b44-42d1-8ad2-c62723cc59ed req-d33439e5-8742-49be-bd22-45d2d573ff41 service nova] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Received event network-vif-plugged-bbc4649f-c295-423e-a1c2-be3af706e4de {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:30:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-82ca2430-6b44-42d1-8ad2-c62723cc59ed req-d33439e5-8742-49be-bd22-45d2d573ff41 service nova] Acquiring lock "f04249c5-0196-455c-ac7a-f1ff8be320d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:30:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-82ca2430-6b44-42d1-8ad2-c62723cc59ed req-d33439e5-8742-49be-bd22-45d2d573ff41 service nova] Lock "f04249c5-0196-455c-ac7a-f1ff8be320d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:30:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-82ca2430-6b44-42d1-8ad2-c62723cc59ed req-d33439e5-8742-49be-bd22-45d2d573ff41 service nova] Lock "f04249c5-0196-455c-ac7a-f1ff8be320d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:30:36 user nova-compute[75066]: DEBUG nova.compute.manager [req-82ca2430-6b44-42d1-8ad2-c62723cc59ed req-d33439e5-8742-49be-bd22-45d2d573ff41 service nova] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] No waiting events found dispatching network-vif-plugged-bbc4649f-c295-423e-a1c2-be3af706e4de {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:30:36 user nova-compute[75066]: WARNING nova.compute.manager [req-82ca2430-6b44-42d1-8ad2-c62723cc59ed req-d33439e5-8742-49be-bd22-45d2d573ff41 service nova] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Received unexpected event network-vif-plugged-bbc4649f-c295-423e-a1c2-be3af706e4de for instance with vm_state building and task_state spawning.
Dec 01 19:30:37 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:37 user nova-compute[75066]: DEBUG nova.compute.manager [req-b8725f60-8a60-46d7-b9ea-17e2bf8956bb req-faf159c6-cfc4-42e3-9599-a7011c202657 service nova] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Received event network-vif-plugged-5b64624f-4059-4689-83ef-856573e0eab0 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:30:37 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-b8725f60-8a60-46d7-b9ea-17e2bf8956bb req-faf159c6-cfc4-42e3-9599-a7011c202657 service nova] Acquiring lock "b2c6c900-5d1b-44f8-8435-d9ad88b3a412-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:30:37 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-b8725f60-8a60-46d7-b9ea-17e2bf8956bb req-faf159c6-cfc4-42e3-9599-a7011c202657 service nova] Lock "b2c6c900-5d1b-44f8-8435-d9ad88b3a412-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:30:37 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-b8725f60-8a60-46d7-b9ea-17e2bf8956bb req-faf159c6-cfc4-42e3-9599-a7011c202657 service nova] Lock "b2c6c900-5d1b-44f8-8435-d9ad88b3a412-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:30:37 user nova-compute[75066]: DEBUG nova.compute.manager [req-b8725f60-8a60-46d7-b9ea-17e2bf8956bb req-faf159c6-cfc4-42e3-9599-a7011c202657 service nova] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] No waiting events found dispatching network-vif-plugged-5b64624f-4059-4689-83ef-856573e0eab0 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:30:37 user nova-compute[75066]: WARNING nova.compute.manager [req-b8725f60-8a60-46d7-b9ea-17e2bf8956bb req-faf159c6-cfc4-42e3-9599-a7011c202657 service nova] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Received unexpected event network-vif-plugged-5b64624f-4059-4689-83ef-856573e0eab0 for instance with vm_state active and task_state rescuing.
Dec 01 19:30:37 user nova-compute[75066]: DEBUG nova.compute.manager [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Instance event wait completed in 0 seconds for  {{(pid=75066) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 19:30:37 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Guest created on hypervisor {{(pid=75066) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 19:30:37 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Instance spawned successfully.
Dec 01 19:30:37 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 19:30:37 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Found default for hw_cdrom_bus of ide {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:30:37 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Found default for hw_disk_bus of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:30:37 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Found default for hw_input_bus of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:30:37 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Found default for hw_pointer_model of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:30:37 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Found default for hw_video_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:30:37 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Found default for hw_vif_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:30:37 user nova-compute[75066]: DEBUG nova.compute.manager [None req-84f2aed7-ef5b-4339-a2ec-de4b50773aa1 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:30:37 user nova-compute[75066]: INFO nova.compute.manager [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Took 6.59 seconds to spawn the instance on the hypervisor.
Dec 01 19:30:37 user nova-compute[75066]: DEBUG nova.compute.manager [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:30:37 user nova-compute[75066]: INFO nova.compute.manager [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Took 31.21 seconds to build instance.
Dec 01 19:30:37 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-34a25218-772a-4620-905d-5c30b789f4c3 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "f04249c5-0196-455c-ac7a-f1ff8be320d4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 31.326s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:30:37 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:42 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:42 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:47 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:47 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:50 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-60624956-fc45-4305-851d-2e8d15ad6435 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance e84b8c28-e79e-4945-8f3c-dddd7184a166 is timed out.
Dec 01 19:30:50 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-60624956-fc45-4305-851d-2e8d15ad6435 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Successfully detached device vdc from instance e84b8c28-e79e-4945-8f3c-dddd7184a166 from the live domain config.
Dec 01 19:30:50 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60624956-fc45-4305-851d-2e8d15ad6435 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] calling os-brick to detach iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 19:30:50 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-60624956-fc45-4305-851d-2e8d15ad6435 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, {'target_iqn': 'iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jzdkhQag', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:30:50 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-60624956-fc45-4305-851d-2e8d15ad6435 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:30:50 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-60624956-fc45-4305-851d-2e8d15ad6435 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:30:50 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-60624956-fc45-4305-851d-2e8d15ad6435 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:30:50 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:50 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:50 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa23b764-935d-45a7-9efc-fb09082770be]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:30:50 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-60624956-fc45-4305-851d-2e8d15ad6435 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 19:30:50 user nova-compute[75066]: No targets found.
Dec 01 19:30:50 user nova-compute[75066]: iSNS:
Dec 01 19:30:50 user nova-compute[75066]: No targets found.
Dec 01 19:30:50 user nova-compute[75066]: STATIC:
Dec 01 19:30:50 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9
Dec 01 19:30:50 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:30:50 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:30:50 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a
Dec 01 19:30:50 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:30:50 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:30:50 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571
Dec 01 19:30:50 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:30:50 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:30:50 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7
Dec 01 19:30:50 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:30:50 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:30:50 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb
Dec 01 19:30:50 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:30:50 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:30:50 user nova-compute[75066]: FIRMWARE:
Dec 01 19:30:50 user nova-compute[75066]: No targets found.
Dec 01 19:30:50 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:30:50 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-60624956-fc45-4305-851d-2e8d15ad6435 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 19:30:50 user nova-compute[75066]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 19:30:50 user nova-compute[75066]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75066) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 19:30:50 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-60624956-fc45-4305-851d-2e8d15ad6435 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a', 0)] {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 19:30:50 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:50 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:50 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aac7607-766d-40ff-940e-099cf9ccd7e6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:30:50 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:50 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:50 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[452face7-0a8b-4782-85ad-d711bed2f635]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:30:50 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-60624956-fc45-4305-851d-2e8d15ad6435 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:30:50 user nova-compute[75066]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a (non-flash)
Dec 01 19:30:50 user nova-compute[75066]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)
Dec 01 19:30:50 user nova-compute[75066]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 (non-flash)
Dec 01 19:30:50 user nova-compute[75066]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 (non-flash)
Dec 01 19:30:50 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:30:50 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-60624956-fc45-4305-851d-2e8d15ad6435 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:30:50 user nova-compute[75066]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a (non-flash)
Dec 01 19:30:50 user nova-compute[75066]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)
Dec 01 19:30:50 user nova-compute[75066]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 (non-flash)
Dec 01 19:30:50 user nova-compute[75066]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 (non-flash)
Dec 01 19:30:50 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:30:50 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-60624956-fc45-4305-851d-2e8d15ad6435 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9190530790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a'): ({'sdc'}, set())}) {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 19:30:50 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-60624956-fc45-4305-851d-2e8d15ad6435 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Removing single pathed devices sdc {{(pid=75066) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 19:30:50 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:50 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:50 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[a575e680-d52a-4ef9-901e-2e2de5b5669e]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:30:50 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:50 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.028s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:50 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b2e458-1888-4127-92be-dd24e4a842ec]: (4, ('ok\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:30:50 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-60624956-fc45-4305-851d-2e8d15ad6435 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Flushing IO for device /dev/sdc {{(pid=75066) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 19:30:50 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:50 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:50 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a1640ff-0d29-40c7-a563-5873a5b34296]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:30:50 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-60624956-fc45-4305-851d-2e8d15ad6435 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75066) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 19:30:50 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:51 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:51 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[a177c650-4c54-43d8-a23f-9da27c88487d]: (4, ('1', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:30:51 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-60624956-fc45-4305-851d-2e8d15ad6435 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 19:30:51 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-60624956-fc45-4305-851d-2e8d15ad6435 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] SCSI volumes sdc have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 19:30:51 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-60624956-fc45-4305-851d-2e8d15ad6435 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a')] {{(pid=75066) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 19:30:51 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:51 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:51 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[e635c595-d9f2-4012-afaf-c17eeef10c29]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:30:51 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-60624956-fc45-4305-851d-2e8d15ad6435 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:30:51 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a -p 172.16.0.220:3260 --logout {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:51 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:51 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d364e3-9d1a-4c2b-a7f4-f3c9846b9f62]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:30:51 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-60624956-fc45-4305-851d-2e8d15ad6435 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a, portal: 172.16.0.220,3260]
Dec 01 19:30:51 user nova-compute[75066]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a, portal: 172.16.0.220,3260] successful.
Dec 01 19:30:51 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:30:51 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a -p 172.16.0.220:3260 --op delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:30:51 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6a9ece83-f1e6-4f8c-914e-85de45be4e1a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:30:51 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f58a35-b442-4d02-8e98-feddf3330941]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:30:51 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-60624956-fc45-4305-851d-2e8d15ad6435 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:30:51 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-60624956-fc45-4305-851d-2e8d15ad6435 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:30:51 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-60624956-fc45-4305-851d-2e8d15ad6435 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] <== disconnect_volume: return (352ms) None {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:30:51 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60624956-fc45-4305-851d-2e8d15ad6435 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Disconnected iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 19:30:52 user nova-compute[75066]: DEBUG nova.objects.instance [None req-60624956-fc45-4305-851d-2e8d15ad6435 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lazy-loading 'flavor' on Instance uuid e84b8c28-e79e-4945-8f3c-dddd7184a166 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:30:52 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-60624956-fc45-4305-851d-2e8d15ad6435 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "e84b8c28-e79e-4945-8f3c-dddd7184a166" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.901s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:30:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:30:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:31:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:31:03 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:31:05 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:31:07 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:31:07 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:31:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:31:09 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:31:10 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:31:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:31:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:31:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:31:10 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75066) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 19:31:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88850ea1-43cd-4066-8e6f-cfe5de621bc6/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:31:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88850ea1-43cd-4066-8e6f-cfe5de621bc6/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:31:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88850ea1-43cd-4066-8e6f-cfe5de621bc6/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:31:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88850ea1-43cd-4066-8e6f-cfe5de621bc6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:31:10 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:31:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:31:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:31:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:31:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:31:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7cc644b-006c-4453-aea2-abe35cfd5ba3/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:31:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7cc644b-006c-4453-aea2-abe35cfd5ba3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:31:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7cc644b-006c-4453-aea2-abe35cfd5ba3/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:31:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7cc644b-006c-4453-aea2-abe35cfd5ba3/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:31:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:31:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:31:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:31:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:31:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:31:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:31:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:31:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:31:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:31:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk.rescue --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:31:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:31:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk.rescue --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:31:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:31:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:31:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:31:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:31:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:31:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:31:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:31:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:31:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:31:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:31:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9a9bf17-1c03-426a-b33e-9d8c458df283/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:31:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9a9bf17-1c03-426a-b33e-9d8c458df283/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:31:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9a9bf17-1c03-426a-b33e-9d8c458df283/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:31:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9a9bf17-1c03-426a-b33e-9d8c458df283/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:31:14 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:31:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6c900-5d1b-44f8-8435-d9ad88b3a412/disk.rescue --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:31:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6c900-5d1b-44f8-8435-d9ad88b3a412/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:31:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6c900-5d1b-44f8-8435-d9ad88b3a412/disk.rescue --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:31:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6c900-5d1b-44f8-8435-d9ad88b3a412/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:31:14 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /opt/stack/data/nova/instances/b2c6c900-5d1b-44f8-8435-d9ad88b3a412/disk (vdb) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:31:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84b8c28-e79e-4945-8f3c-dddd7184a166/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:31:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84b8c28-e79e-4945-8f3c-dddd7184a166/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:31:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84b8c28-e79e-4945-8f3c-dddd7184a166/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:31:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e84b8c28-e79e-4945-8f3c-dddd7184a166/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:31:14 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:31:15 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:31:15 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:31:15 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Hypervisor/Node resource view: name=user free_ram=7111MB free_disk=24.68917465209961GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75066) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 19:31:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:31:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:31:15 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance c223be70-8b9c-46d4-9b5a-3b83dfc05a17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:31:15 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 90c49be6-97aa-45f1-bcbe-b9a3875226a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:31:15 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance d564b128-598b-4ad4-8618-afa4dc8a7347 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:31:15 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 14de9d20-9e66-4517-b904-2967e0a06a97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:31:15 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:31:15 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:31:15 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance b2c6c900-5d1b-44f8-8435-d9ad88b3a412 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:31:15 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 00506483-8f09-4a3d-938a-31ab1b2dbf83 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:31:15 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance e84b8c28-e79e-4945-8f3c-dddd7184a166 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:31:15 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance e9a9bf17-1c03-426a-b33e-9d8c458df283 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:31:15 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 88850ea1-43cd-4066-8e6f-cfe5de621bc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:31:15 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance f04249c5-0196-455c-ac7a-f1ff8be320d4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:31:15 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance f7cc644b-006c-4453-aea2-abe35cfd5ba3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:31:15 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 19:31:15 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 19:31:15 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Refreshing inventories for resource provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 01 19:31:15 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Updating ProviderTree inventory for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 01 19:31:15 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Updating inventory in ProviderTree for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 01 19:31:15 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Refreshing aggregate associations for resource provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62, aggregates: None {{(pid=75066) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 01 19:31:15 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Refreshing trait associations for resource provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62, traits: COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SECURITY_UEFI_SECURE_BOOT {{(pid=75066) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 01 19:31:16 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:31:16 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:31:16 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Compute_service record updated for user:user {{(pid=75066) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 19:31:16 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.969s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:31:16 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:31:17 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:31:17 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:31:17 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:31:17 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:31:17 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Starting heal instance info cache {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 19:31:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "refresh_cache-90c49be6-97aa-45f1-bcbe-b9a3875226a7" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:31:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquired lock "refresh_cache-90c49be6-97aa-45f1-bcbe-b9a3875226a7" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:31:17 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Forcefully refreshing network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 19:31:18 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Updating instance_info_cache with network_info: [{"id": "5ccc5509-ab48-4e15-96b2-5757927fa168", "address": "fa:16:3e:eb:66:d7", "network": {"id": "6b0f48b7-3db2-49b2-a238-8fd811b52d62", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1688127634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e000d89bca44cd8acba504256d8d1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccc5509-ab", "ovs_interfaceid": "5ccc5509-ab48-4e15-96b2-5757927fa168", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:31:18 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Releasing lock "refresh_cache-90c49be6-97aa-45f1-bcbe-b9a3875226a7" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:31:18 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Updated the network info_cache for instance {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 19:31:18 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:31:18 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:31:18 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:31:18 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75066) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 19:31:18 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:31:18 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75066) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 01 19:31:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5b6123af-dbfb-4b1d-a1bc-98c0f48541b1 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Acquiring lock "e84b8c28-e79e-4945-8f3c-dddd7184a166" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:31:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5b6123af-dbfb-4b1d-a1bc-98c0f48541b1 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "e84b8c28-e79e-4945-8f3c-dddd7184a166" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:31:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5b6123af-dbfb-4b1d-a1bc-98c0f48541b1 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Acquiring lock "e84b8c28-e79e-4945-8f3c-dddd7184a166-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:31:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5b6123af-dbfb-4b1d-a1bc-98c0f48541b1 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "e84b8c28-e79e-4945-8f3c-dddd7184a166-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:31:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5b6123af-dbfb-4b1d-a1bc-98c0f48541b1 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "e84b8c28-e79e-4945-8f3c-dddd7184a166-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:31:20 user nova-compute[75066]: INFO nova.compute.manager [None req-5b6123af-dbfb-4b1d-a1bc-98c0f48541b1 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Terminating instance
Dec 01 19:31:20 user nova-compute[75066]: DEBUG nova.compute.manager [None req-5b6123af-dbfb-4b1d-a1bc-98c0f48541b1 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Start destroying the instance on the hypervisor. {{(pid=75066) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 19:31:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:31:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:31:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:31:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:31:21 user nova-compute[75066]: DEBUG nova.compute.manager [req-7bf9f7de-89ed-4a2c-8abb-3565a2b16669 req-9994411e-e85a-44ea-9ddb-0418055da6a7 service nova] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Received event network-vif-unplugged-abe9d4d1-5a93-4071-bb76-8723bf6ec62c {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:31:21 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-7bf9f7de-89ed-4a2c-8abb-3565a2b16669 req-9994411e-e85a-44ea-9ddb-0418055da6a7 service nova] Acquiring lock "e84b8c28-e79e-4945-8f3c-dddd7184a166-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:31:21 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-7bf9f7de-89ed-4a2c-8abb-3565a2b16669 req-9994411e-e85a-44ea-9ddb-0418055da6a7 service nova] Lock "e84b8c28-e79e-4945-8f3c-dddd7184a166-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:31:21 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-7bf9f7de-89ed-4a2c-8abb-3565a2b16669 req-9994411e-e85a-44ea-9ddb-0418055da6a7 service nova] Lock "e84b8c28-e79e-4945-8f3c-dddd7184a166-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:31:21 user nova-compute[75066]: DEBUG nova.compute.manager [req-7bf9f7de-89ed-4a2c-8abb-3565a2b16669 req-9994411e-e85a-44ea-9ddb-0418055da6a7 service nova] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] No waiting events found dispatching network-vif-unplugged-abe9d4d1-5a93-4071-bb76-8723bf6ec62c {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:31:21 user nova-compute[75066]: DEBUG nova.compute.manager [req-7bf9f7de-89ed-4a2c-8abb-3565a2b16669 req-9994411e-e85a-44ea-9ddb-0418055da6a7 service nova] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Received event network-vif-unplugged-abe9d4d1-5a93-4071-bb76-8723bf6ec62c for instance with task_state deleting. {{(pid=75066) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 19:31:21 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Instance destroyed successfully.
Dec 01 19:31:21 user nova-compute[75066]: DEBUG nova.objects.instance [None req-5b6123af-dbfb-4b1d-a1bc-98c0f48541b1 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lazy-loading 'resources' on Instance uuid e84b8c28-e79e-4945-8f3c-dddd7184a166 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:31:21 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-5b6123af-dbfb-4b1d-a1bc-98c0f48541b1 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-01T19:24:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-496690915',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-496690915',id=24,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEFm2fFTSILfeIc9T3aY6YY8ccEuM6T+EqbJVd9fDG+xmK7EqkqBSUEppgYTvwk5yuAt9kwnhrxfnKArtNsaxvKGjkXi1W9s0Vf9iTjlWyxyXjkzBg/S3rJKLyO34An9Qw==',key_name='tempest-keypair-20573267',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:29:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='879678dca7054c178839f56e66a6e0ce',ramdisk_id='',reservation_id='r-frzqz3qo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1680443764',owner_user_name='tempest-AttachVolumeShelveTestJSON-1680443764-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:29:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90e207044c0741e99c4a83b2c4746cd3',uuid=e84b8c28-e79e-4945-8f3c-dddd7184a166,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "abe9d4d1-5a93-4071-bb76-8723bf6ec62c", "address": "fa:16:3e:8c:32:99", "network": {"id": "49dd72ae-ec07-46a6-8463-e38bdfe1eba0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-738739404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879678dca7054c178839f56e66a6e0ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabe9d4d1-5a", "ovs_interfaceid": "abe9d4d1-5a93-4071-bb76-8723bf6ec62c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:31:21 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-5b6123af-dbfb-4b1d-a1bc-98c0f48541b1 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Converting VIF {"id": "abe9d4d1-5a93-4071-bb76-8723bf6ec62c", "address": "fa:16:3e:8c:32:99", "network": {"id": "49dd72ae-ec07-46a6-8463-e38bdfe1eba0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-738739404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.183", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879678dca7054c178839f56e66a6e0ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapabe9d4d1-5a", "ovs_interfaceid": "abe9d4d1-5a93-4071-bb76-8723bf6ec62c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:31:21 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-5b6123af-dbfb-4b1d-a1bc-98c0f48541b1 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:32:99,bridge_name='br-int',has_traffic_filtering=True,id=abe9d4d1-5a93-4071-bb76-8723bf6ec62c,network=Network(49dd72ae-ec07-46a6-8463-e38bdfe1eba0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabe9d4d1-5a') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:31:21 user nova-compute[75066]: DEBUG os_vif [None req-5b6123af-dbfb-4b1d-a1bc-98c0f48541b1 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:32:99,bridge_name='br-int',has_traffic_filtering=True,id=abe9d4d1-5a93-4071-bb76-8723bf6ec62c,network=Network(49dd72ae-ec07-46a6-8463-e38bdfe1eba0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabe9d4d1-5a') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:31:21 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:31:21 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapabe9d4d1-5a, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:31:21 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:31:21 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:31:21 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:31:21 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4621a068-60f7-4861-b08a-b10063c35d32) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:31:21 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:31:21 user nova-compute[75066]: INFO os_vif [None req-5b6123af-dbfb-4b1d-a1bc-98c0f48541b1 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:32:99,bridge_name='br-int',has_traffic_filtering=True,id=abe9d4d1-5a93-4071-bb76-8723bf6ec62c,network=Network(49dd72ae-ec07-46a6-8463-e38bdfe1eba0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapabe9d4d1-5a')
Dec 01 19:31:21 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-5b6123af-dbfb-4b1d-a1bc-98c0f48541b1 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Deleting instance files /opt/stack/data/nova/instances/e84b8c28-e79e-4945-8f3c-dddd7184a166_del
Dec 01 19:31:21 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-5b6123af-dbfb-4b1d-a1bc-98c0f48541b1 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Deletion of /opt/stack/data/nova/instances/e84b8c28-e79e-4945-8f3c-dddd7184a166_del complete
Dec 01 19:31:21 user nova-compute[75066]: INFO nova.compute.manager [None req-5b6123af-dbfb-4b1d-a1bc-98c0f48541b1 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Took 0.92 seconds to destroy the instance on the hypervisor.
Dec 01 19:31:21 user nova-compute[75066]: DEBUG oslo.service.loopingcall [None req-5b6123af-dbfb-4b1d-a1bc-98c0f48541b1 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75066) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 19:31:21 user nova-compute[75066]: DEBUG nova.compute.manager [-] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Deallocating network for instance {{(pid=75066) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 19:31:21 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] deallocate_for_instance() {{(pid=75066) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 19:31:22 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:31:22 user nova-compute[75066]: INFO nova.compute.manager [-] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Took 0.92 seconds to deallocate network for instance.
Dec 01 19:31:22 user nova-compute[75066]: DEBUG nova.compute.manager [req-e75dac7a-4080-454e-85b6-67a2be603257 req-9fad54cb-1251-4e95-85bc-e2e7c4419920 service nova] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Received event network-vif-deleted-abe9d4d1-5a93-4071-bb76-8723bf6ec62c {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:31:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5b6123af-dbfb-4b1d-a1bc-98c0f48541b1 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:31:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5b6123af-dbfb-4b1d-a1bc-98c0f48541b1 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:31:22 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-5b6123af-dbfb-4b1d-a1bc-98c0f48541b1 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:31:22 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-5b6123af-dbfb-4b1d-a1bc-98c0f48541b1 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:31:23 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5b6123af-dbfb-4b1d-a1bc-98c0f48541b1 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.508s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:31:23 user nova-compute[75066]: INFO nova.scheduler.client.report [None req-5b6123af-dbfb-4b1d-a1bc-98c0f48541b1 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Deleted allocations for instance e84b8c28-e79e-4945-8f3c-dddd7184a166
Dec 01 19:31:23 user nova-compute[75066]: DEBUG nova.compute.manager [req-3fb1dcec-3a06-4ba6-972c-c692e441799d req-f73af6cd-87a9-4789-906e-5024335fb3b1 service nova] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Received event network-vif-plugged-abe9d4d1-5a93-4071-bb76-8723bf6ec62c {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:31:23 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-3fb1dcec-3a06-4ba6-972c-c692e441799d req-f73af6cd-87a9-4789-906e-5024335fb3b1 service nova] Acquiring lock "e84b8c28-e79e-4945-8f3c-dddd7184a166-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:31:23 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-3fb1dcec-3a06-4ba6-972c-c692e441799d req-f73af6cd-87a9-4789-906e-5024335fb3b1 service nova] Lock "e84b8c28-e79e-4945-8f3c-dddd7184a166-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:31:23 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-3fb1dcec-3a06-4ba6-972c-c692e441799d req-f73af6cd-87a9-4789-906e-5024335fb3b1 service nova] Lock "e84b8c28-e79e-4945-8f3c-dddd7184a166-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:31:23 user nova-compute[75066]: DEBUG nova.compute.manager [req-3fb1dcec-3a06-4ba6-972c-c692e441799d req-f73af6cd-87a9-4789-906e-5024335fb3b1 service nova] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] No waiting events found dispatching network-vif-plugged-abe9d4d1-5a93-4071-bb76-8723bf6ec62c {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:31:23 user nova-compute[75066]: WARNING nova.compute.manager [req-3fb1dcec-3a06-4ba6-972c-c692e441799d req-f73af6cd-87a9-4789-906e-5024335fb3b1 service nova] [instance: e84b8c28-e79e-4945-8f3c-dddd7184a166] Received unexpected event network-vif-plugged-abe9d4d1-5a93-4071-bb76-8723bf6ec62c for instance with vm_state deleted and task_state None.
Dec 01 19:31:23 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5b6123af-dbfb-4b1d-a1bc-98c0f48541b1 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "e84b8c28-e79e-4945-8f3c-dddd7184a166" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.659s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:31:26 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:31:26 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Cleaning up deleted instances {{(pid=75066) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 01 19:31:26 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] There are 0 instances to clean {{(pid=75066) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 01 19:31:26 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:31:26 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:31:31 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:31:36 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:31:39 user nova-compute[75066]: DEBUG nova.compute.manager [req-cd8506cd-36af-47aa-b24d-b0feee395710 req-0b4cfa28-d750-471f-9481-5eeac10b6ed2 service nova] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Received event network-changed-a517b344-264d-4bf9-8c6a-48c950d4bca0 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:31:39 user nova-compute[75066]: DEBUG nova.compute.manager [req-cd8506cd-36af-47aa-b24d-b0feee395710 req-0b4cfa28-d750-471f-9481-5eeac10b6ed2 service nova] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Refreshing instance network info cache due to event network-changed-a517b344-264d-4bf9-8c6a-48c950d4bca0. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:31:39 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-cd8506cd-36af-47aa-b24d-b0feee395710 req-0b4cfa28-d750-471f-9481-5eeac10b6ed2 service nova] Acquiring lock "refresh_cache-e9a9bf17-1c03-426a-b33e-9d8c458df283" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:31:39 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-cd8506cd-36af-47aa-b24d-b0feee395710 req-0b4cfa28-d750-471f-9481-5eeac10b6ed2 service nova] Acquired lock "refresh_cache-e9a9bf17-1c03-426a-b33e-9d8c458df283" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:31:39 user nova-compute[75066]: DEBUG nova.network.neutron [req-cd8506cd-36af-47aa-b24d-b0feee395710 req-0b4cfa28-d750-471f-9481-5eeac10b6ed2 service nova] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Refreshing network info cache for port a517b344-264d-4bf9-8c6a-48c950d4bca0 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:31:39 user nova-compute[75066]: DEBUG nova.network.neutron [req-cd8506cd-36af-47aa-b24d-b0feee395710 req-0b4cfa28-d750-471f-9481-5eeac10b6ed2 service nova] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Updated VIF entry in instance network info cache for port a517b344-264d-4bf9-8c6a-48c950d4bca0. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:31:39 user nova-compute[75066]: DEBUG nova.network.neutron [req-cd8506cd-36af-47aa-b24d-b0feee395710 req-0b4cfa28-d750-471f-9481-5eeac10b6ed2 service nova] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Updating instance_info_cache with network_info: [{"id": "a517b344-264d-4bf9-8c6a-48c950d4bca0", "address": "fa:16:3e:37:9e:f3", "network": {"id": "0432709c-c027-41b5-afa1-a9221c85cd4e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1490736568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99b27d42c6c64cf08f74c75717439c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa517b344-26", "ovs_interfaceid": "a517b344-264d-4bf9-8c6a-48c950d4bca0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:31:39 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-cd8506cd-36af-47aa-b24d-b0feee395710 req-0b4cfa28-d750-471f-9481-5eeac10b6ed2 service nova] Releasing lock "refresh_cache-e9a9bf17-1c03-426a-b33e-9d8c458df283" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:31:41 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c5d2b5fd-a269-4d53-9f76-0fcfd24bbd5f tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Acquiring lock "e9a9bf17-1c03-426a-b33e-9d8c458df283" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:31:41 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c5d2b5fd-a269-4d53-9f76-0fcfd24bbd5f tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Lock "e9a9bf17-1c03-426a-b33e-9d8c458df283" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:31:41 user nova-compute[75066]: DEBUG nova.objects.instance [None req-c5d2b5fd-a269-4d53-9f76-0fcfd24bbd5f tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Lazy-loading 'flavor' on Instance uuid e9a9bf17-1c03-426a-b33e-9d8c458df283 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:31:41 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c5d2b5fd-a269-4d53-9f76-0fcfd24bbd5f tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Lock "e9a9bf17-1c03-426a-b33e-9d8c458df283" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:31:41 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c5d2b5fd-a269-4d53-9f76-0fcfd24bbd5f tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Acquiring lock "e9a9bf17-1c03-426a-b33e-9d8c458df283" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:31:41 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c5d2b5fd-a269-4d53-9f76-0fcfd24bbd5f tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Lock "e9a9bf17-1c03-426a-b33e-9d8c458df283" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:31:41 user nova-compute[75066]: INFO nova.compute.manager [None req-c5d2b5fd-a269-4d53-9f76-0fcfd24bbd5f tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Attaching volume 5755ff17-79cf-4b3c-8ee0-5303b9a18236 to /dev/vdb
Dec 01 19:31:41 user nova-compute[75066]: DEBUG os_brick.utils [None req-c5d2b5fd-a269-4d53-9f76-0fcfd24bbd5f tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:31:41 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:31:41 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:31:41 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[445c73ca-5746-4fbc-9659-099f3dc0d3d3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1959854982f\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:31:41 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:31:41 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:31:41 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:31:41 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5e5ffb-0296-4e1d-bcca-dbcd8d679121]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:31:41 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:31:41 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:31:41 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8d54e0-85f1-47a3-9e48-668811d9d398]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:31:41 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6aff6a-3f89-4b07-8002-249dc9b46a41]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:31:41 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-c5d2b5fd-a269-4d53-9f76-0fcfd24bbd5f tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Running cmd (subprocess): nvme version {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:31:41 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-c5d2b5fd-a269-4d53-9f76-0fcfd24bbd5f tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] 'nvme version' failed. Not Retrying. {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:31:41 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c5d2b5fd-a269-4d53-9f76-0fcfd24bbd5f tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] nvme not present on system {{(pid=75066) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 19:31:41 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:31:41 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:31:41 user nova-compute[75066]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 19:31:41 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e098df9-ba63-4034-a640-bd1f65d46097]: (4, '') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:31:41 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-c5d2b5fd-a269-4d53-9f76-0fcfd24bbd5f tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75066) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 19:31:41 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-c5d2b5fd-a269-4d53-9f76-0fcfd24bbd5f tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 19:31:41 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-c5d2b5fd-a269-4d53-9f76-0fcfd24bbd5f tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] LIGHTOS: no hostnqn found. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 19:31:41 user nova-compute[75066]: DEBUG os_brick.utils [None req-c5d2b5fd-a269-4d53-9f76-0fcfd24bbd5f tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1959854982f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:31:41 user nova-compute[75066]: DEBUG nova.virt.block_device [None req-c5d2b5fd-a269-4d53-9f76-0fcfd24bbd5f tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Updating existing volume attachment record: bb59bb54-1729-4fcc-b764-7ea74512477c {{(pid=75066) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 19:31:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:31:46 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:31:48 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:31:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:31:55 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Acquiring lock "479bf6d9-ffec-4417-99c5-3af0dafc0881" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:31:55 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Lock "479bf6d9-ffec-4417-99c5-3af0dafc0881" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:31:55 user nova-compute[75066]: DEBUG nova.compute.manager [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 479bf6d9-ffec-4417-99c5-3af0dafc0881] Starting instance... {{(pid=75066) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 19:31:55 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:31:55 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:31:55 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75066) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 19:31:55 user nova-compute[75066]: INFO nova.compute.claims [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 479bf6d9-ffec-4417-99c5-3af0dafc0881] Claim successful on node user
Dec 01 19:31:55 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:31:55 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:31:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.493s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:31:56 user nova-compute[75066]: DEBUG nova.compute.manager [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 479bf6d9-ffec-4417-99c5-3af0dafc0881] Start building networks asynchronously for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 19:31:56 user nova-compute[75066]: DEBUG nova.compute.manager [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 479bf6d9-ffec-4417-99c5-3af0dafc0881] Allocating IP information in the background. {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 19:31:56 user nova-compute[75066]: DEBUG nova.network.neutron [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 479bf6d9-ffec-4417-99c5-3af0dafc0881] allocate_for_instance() {{(pid=75066) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 19:31:56 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 479bf6d9-ffec-4417-99c5-3af0dafc0881] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 19:31:56 user nova-compute[75066]: DEBUG nova.compute.manager [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 479bf6d9-ffec-4417-99c5-3af0dafc0881] Start building block device mappings for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 19:31:56 user nova-compute[75066]: DEBUG nova.policy [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '14735fcf06cb45519d9fd71975871a62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9f677c9e8c24b7389273db9d82954fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75066) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 19:31:56 user nova-compute[75066]: DEBUG nova.compute.manager [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 479bf6d9-ffec-4417-99c5-3af0dafc0881] Start spawning the instance on the hypervisor. {{(pid=75066) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 19:31:56 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 479bf6d9-ffec-4417-99c5-3af0dafc0881] Creating instance directory {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 19:31:56 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 479bf6d9-ffec-4417-99c5-3af0dafc0881] Creating image(s)
Dec 01 19:31:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Acquiring lock "/opt/stack/data/nova/instances/479bf6d9-ffec-4417-99c5-3af0dafc0881/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:31:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Lock "/opt/stack/data/nova/instances/479bf6d9-ffec-4417-99c5-3af0dafc0881/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:31:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Lock "/opt/stack/data/nova/instances/479bf6d9-ffec-4417-99c5-3af0dafc0881/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:31:56 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:31:56 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:31:56 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.197s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:31:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Acquiring lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:31:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:31:56 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:31:56 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.176s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:31:56 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/479bf6d9-ffec-4417-99c5-3af0dafc0881/disk 1073741824 {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:31:56 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/479bf6d9-ffec-4417-99c5-3af0dafc0881/disk 1073741824" returned: 0 in 0.068s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:31:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:31:56 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:31:56 user nova-compute[75066]: DEBUG nova.network.neutron [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 479bf6d9-ffec-4417-99c5-3af0dafc0881] Successfully created port: 73fd5302-db93-4304-97c6-735fd59227c0 {{(pid=75066) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 19:31:56 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5d2b5fd-a269-4d53-9f76-0fcfd24bbd5f tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Calling os-brick to attach iSCSI Volume {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 19:31:56 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5d2b5fd-a269-4d53-9f76-0fcfd24bbd5f tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iOdoapDf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:31:56 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-c5d2b5fd-a269-4d53-9f76-0fcfd24bbd5f tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:31:56 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-c5d2b5fd-a269-4d53-9f76-0fcfd24bbd5f tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:31:56 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-c5d2b5fd-a269-4d53-9f76-0fcfd24bbd5f tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:31:56 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-c5d2b5fd-a269-4d53-9f76-0fcfd24bbd5f tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:31:56 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-c5d2b5fd-a269-4d53-9f76-0fcfd24bbd5f tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:31:56 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-c5d2b5fd-a269-4d53-9f76-0fcfd24bbd5f tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:31:56 user nova-compute[75066]: INFO os_brick.initiator.connectors.iscsi [None req-c5d2b5fd-a269-4d53-9f76-0fcfd24bbd5f tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 19:31:56 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236 -p 172.16.0.220:3260 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:31:56 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:31:56 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82690b2-51fe-4314-9f43-ffcd5d0c60ce]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:31:56 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5d2b5fd-a269-4d53-9f76-0fcfd24bbd5f tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 19:31:56 user nova-compute[75066]:  {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:31:56 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236 -p 172.16.0.220:3260 --interface default --op new {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:31:56 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:31:56 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e0c4f7-7ee9-4691-bbb8-844f59f38136]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236] added\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:31:56 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5d2b5fd-a269-4d53-9f76-0fcfd24bbd5f tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236] added
Dec 01 19:31:56 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:31:56 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:31:56 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.195s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:31:56 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Checking if we can resize image /opt/stack/data/nova/instances/479bf6d9-ffec-4417-99c5-3af0dafc0881/disk. size=1073741824 {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 19:31:56 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/479bf6d9-ffec-4417-99c5-3af0dafc0881/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:31:56 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.035s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:31:56 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[82968d71-31dd-43f9-a476-056030675e35]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:31:56 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5d2b5fd-a269-4d53-9f76-0fcfd24bbd5f tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:31:56 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7bf255-2ae8-403d-8677-bdf93fc5c031]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5d2b5fd-a269-4d53-9f76-0fcfd24bbd5f tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iOdoapDf {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iOdoapDf" returned: 0 in 0.028s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[206413ff-d92a-4f32-ac8e-47d9ef253616]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5d2b5fd-a269-4d53-9f76-0fcfd24bbd5f tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iOdoapDf'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.035s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9a9aef-f6f7-4e60-b640-398b42d92a1b]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5d2b5fd-a269-4d53-9f76-0fcfd24bbd5f tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8b5fa6-bd4d-4c0e-aa90-8698ee3ec3c0]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5d2b5fd-a269-4d53-9f76-0fcfd24bbd5f tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:31:57 user nova-compute[75066]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)
Dec 01 19:31:57 user nova-compute[75066]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 (non-flash)
Dec 01 19:31:57 user nova-compute[75066]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 (non-flash)
Dec 01 19:31:57 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5d2b5fd-a269-4d53-9f76-0fcfd24bbd5f tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:31:57 user nova-compute[75066]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)
Dec 01 19:31:57 user nova-compute[75066]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 (non-flash)
Dec 01 19:31:57 user nova-compute[75066]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 (non-flash)
Dec 01 19:31:57 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236 -p 172.16.0.220:3260 --login {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/479bf6d9-ffec-4417-99c5-3af0dafc0881/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Cannot resize image /opt/stack/data/nova/instances/479bf6d9-ffec-4417-99c5-3af0dafc0881/disk to a smaller size. {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 479bf6d9-ffec-4417-99c5-3af0dafc0881] Created local disks {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 479bf6d9-ffec-4417-99c5-3af0dafc0881] Ensure instance console log exists: /opt/stack/data/nova/instances/479bf6d9-ffec-4417-99c5-3af0dafc0881/console.log {{(pid=75066) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1a7bc2-5072-4846-b600-064d6242b067]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5d2b5fd-a269-4d53-9f76-0fcfd24bbd5f tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236, portal: 172.16.0.220,3260]
Dec 01 19:31:57 user nova-compute[75066]: Login to [iface: default, target: iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236, portal: 172.16.0.220,3260] successful.
Dec 01 19:31:57 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea98a31-6eba-494f-9473-a1477288e6d3]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5d2b5fd-a269-4d53-9f76-0fcfd24bbd5f tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab205e5e-232e-4025-b721-9cee8ec97e3e]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5d2b5fd-a269-4d53-9f76-0fcfd24bbd5f tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:31:57 user nova-compute[75066]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)
Dec 01 19:31:57 user nova-compute[75066]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 (non-flash)
Dec 01 19:31:57 user nova-compute[75066]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 (non-flash)
Dec 01 19:31:57 user nova-compute[75066]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236 (non-flash)
Dec 01 19:31:57 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5d2b5fd-a269-4d53-9f76-0fcfd24bbd5f tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:31:57 user nova-compute[75066]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)
Dec 01 19:31:57 user nova-compute[75066]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 (non-flash)
Dec 01 19:31:57 user nova-compute[75066]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 (non-flash)
Dec 01 19:31:57 user nova-compute[75066]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236 (non-flash)
Dec 01 19:31:57 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-c5d2b5fd-a269-4d53-9f76-0fcfd24bbd5f tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.391s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5d2b5fd-a269-4d53-9f76-0fcfd24bbd5f tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Connected to 172.16.0.220:3260 {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-c5d2b5fd-a269-4d53-9f76-0fcfd24bbd5f tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] HCTL ('34', '-', '-', 0) found on session 42 with lun 0 {{(pid=75066) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-c5d2b5fd-a269-4d53-9f76-0fcfd24bbd5f tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75066) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe79949f-0cea-423d-9195-05a049beca85]: (4, ('- - 0', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-c5d2b5fd-a269-4d53-9f76-0fcfd24bbd5f tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5d2b5fd-a269-4d53-9f76-0fcfd24bbd5f tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iOdoapDf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 19:31:57 user nova-compute[75066]: INFO nova.compute.manager [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Rescuing
Dec 01 19:31:57 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Acquiring lock "refresh_cache-f04249c5-0196-455c-ac7a-f1ff8be320d4" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Acquired lock "refresh_cache-f04249c5-0196-455c-ac7a-f1ff8be320d4" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG nova.network.neutron [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG nova.network.neutron [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 479bf6d9-ffec-4417-99c5-3af0dafc0881] Successfully updated port: 73fd5302-db93-4304-97c6-735fd59227c0 {{(pid=75066) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Acquiring lock "refresh_cache-479bf6d9-ffec-4417-99c5-3af0dafc0881" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Acquired lock "refresh_cache-479bf6d9-ffec-4417-99c5-3af0dafc0881" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG nova.network.neutron [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 479bf6d9-ffec-4417-99c5-3af0dafc0881] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG nova.compute.manager [req-dd1e5951-7c85-41e3-b44d-f0ca6ed064e8 req-c4db56ab-4c30-4685-99b8-ce4539e862e5 service nova] [instance: 479bf6d9-ffec-4417-99c5-3af0dafc0881] Received event network-changed-73fd5302-db93-4304-97c6-735fd59227c0 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG nova.compute.manager [req-dd1e5951-7c85-41e3-b44d-f0ca6ed064e8 req-c4db56ab-4c30-4685-99b8-ce4539e862e5 service nova] [instance: 479bf6d9-ffec-4417-99c5-3af0dafc0881] Refreshing instance network info cache due to event network-changed-73fd5302-db93-4304-97c6-735fd59227c0. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-dd1e5951-7c85-41e3-b44d-f0ca6ed064e8 req-c4db56ab-4c30-4685-99b8-ce4539e862e5 service nova] Acquiring lock "refresh_cache-479bf6d9-ffec-4417-99c5-3af0dafc0881" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG nova.network.neutron [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 479bf6d9-ffec-4417-99c5-3af0dafc0881] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG nova.network.neutron [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 479bf6d9-ffec-4417-99c5-3af0dafc0881] Updating instance_info_cache with network_info: [{"id": "73fd5302-db93-4304-97c6-735fd59227c0", "address": "fa:16:3e:d0:5c:75", "network": {"id": "884b20a8-4ead-448d-994b-8e714dc32fae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-357575766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9f677c9e8c24b7389273db9d82954fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73fd5302-db", "ovs_interfaceid": "73fd5302-db93-4304-97c6-735fd59227c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Releasing lock "refresh_cache-479bf6d9-ffec-4417-99c5-3af0dafc0881" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG nova.compute.manager [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 479bf6d9-ffec-4417-99c5-3af0dafc0881] Instance network_info: |[{"id": "73fd5302-db93-4304-97c6-735fd59227c0", "address": "fa:16:3e:d0:5c:75", "network": {"id": "884b20a8-4ead-448d-994b-8e714dc32fae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-357575766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9f677c9e8c24b7389273db9d82954fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73fd5302-db", "ovs_interfaceid": "73fd5302-db93-4304-97c6-735fd59227c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-dd1e5951-7c85-41e3-b44d-f0ca6ed064e8 req-c4db56ab-4c30-4685-99b8-ce4539e862e5 service nova] Acquired lock "refresh_cache-479bf6d9-ffec-4417-99c5-3af0dafc0881" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG nova.network.neutron [req-dd1e5951-7c85-41e3-b44d-f0ca6ed064e8 req-c4db56ab-4c30-4685-99b8-ce4539e862e5 service nova] [instance: 479bf6d9-ffec-4417-99c5-3af0dafc0881] Refreshing network info cache for port 73fd5302-db93-4304-97c6-735fd59227c0 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 479bf6d9-ffec-4417-99c5-3af0dafc0881] Start _get_guest_xml network_info=[{"id": "73fd5302-db93-4304-97c6-735fd59227c0", "address": "fa:16:3e:d0:5c:75", "network": {"id": "884b20a8-4ead-448d-994b-8e714dc32fae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-357575766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9f677c9e8c24b7389273db9d82954fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73fd5302-db", "ovs_interfaceid": "73fd5302-db93-4304-97c6-735fd59227c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'image_id': '900b237b-e99c-4fdd-a44f-dcb7a08baa86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:31:57 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:31:57 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:31:57 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:31:57 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:31:58 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:31:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-909713826',display_name='tempest-ServersNegativeTestJSON-server-909713826',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-909713826',id=36,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9f677c9e8c24b7389273db9d82954fe',ramdisk_id='',reservation_id='r-ioskpdp0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1315108451',owner_user_name='tempest-ServersNegativeTestJSON-1315108451-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:31:56Z,user_data=None,user_id='14735fcf06cb45519d9fd71975871a62',uuid=479bf6d9-ffec-4417-99c5-3af0dafc0881,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73fd5302-db93-4304-97c6-735fd59227c0", "address": "fa:16:3e:d0:5c:75", "network": {"id": "884b20a8-4ead-448d-994b-8e714dc32fae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-357575766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9f677c9e8c24b7389273db9d82954fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73fd5302-db", "ovs_interfaceid": "73fd5302-db93-4304-97c6-735fd59227c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:31:58 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Converting VIF {"id": "73fd5302-db93-4304-97c6-735fd59227c0", "address": "fa:16:3e:d0:5c:75", "network": {"id": "884b20a8-4ead-448d-994b-8e714dc32fae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-357575766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9f677c9e8c24b7389273db9d82954fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73fd5302-db", "ovs_interfaceid": "73fd5302-db93-4304-97c6-735fd59227c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:31:58 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:5c:75,bridge_name='br-int',has_traffic_filtering=True,id=73fd5302-db93-4304-97c6-735fd59227c0,network=Network(884b20a8-4ead-448d-994b-8e714dc32fae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73fd5302-db') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:31:58 user nova-compute[75066]: DEBUG nova.objects.instance [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Lazy-loading 'pci_devices' on Instance uuid 479bf6d9-ffec-4417-99c5-3af0dafc0881 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:31:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:31:58 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 479bf6d9-ffec-4417-99c5-3af0dafc0881] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:31:58 user nova-compute[75066]:   <uuid>479bf6d9-ffec-4417-99c5-3af0dafc0881</uuid>
Dec 01 19:31:58 user nova-compute[75066]:   <name>instance-00000024</name>
Dec 01 19:31:58 user nova-compute[75066]:   <memory>524288</memory>
Dec 01 19:31:58 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:31:58 user nova-compute[75066]:   <metadata>
Dec 01 19:31:58 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:31:58 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:31:58 user nova-compute[75066]:       <nova:name>tempest-ServersNegativeTestJSON-server-909713826</nova:name>
Dec 01 19:31:58 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:31:57</nova:creationTime>
Dec 01 19:31:58 user nova-compute[75066]:       <nova:flavor name="m1.tiny">
Dec 01 19:31:58 user nova-compute[75066]:         <nova:memory>512</nova:memory>
Dec 01 19:31:58 user nova-compute[75066]:         <nova:disk>1</nova:disk>
Dec 01 19:31:58 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:31:58 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:31:58 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:31:58 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:31:58 user nova-compute[75066]:       <nova:owner>
Dec 01 19:31:58 user nova-compute[75066]:         <nova:user uuid="14735fcf06cb45519d9fd71975871a62">tempest-ServersNegativeTestJSON-1315108451-project-member</nova:user>
Dec 01 19:31:58 user nova-compute[75066]:         <nova:project uuid="c9f677c9e8c24b7389273db9d82954fe">tempest-ServersNegativeTestJSON-1315108451</nova:project>
Dec 01 19:31:58 user nova-compute[75066]:       </nova:owner>
Dec 01 19:31:58 user nova-compute[75066]:       <nova:root type="image" uuid="900b237b-e99c-4fdd-a44f-dcb7a08baa86"/>
Dec 01 19:31:58 user nova-compute[75066]:       <nova:ports>
Dec 01 19:31:58 user nova-compute[75066]:         <nova:port uuid="73fd5302-db93-4304-97c6-735fd59227c0">
Dec 01 19:31:58 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Dec 01 19:31:58 user nova-compute[75066]:         </nova:port>
Dec 01 19:31:58 user nova-compute[75066]:       </nova:ports>
Dec 01 19:31:58 user nova-compute[75066]:     </nova:instance>
Dec 01 19:31:58 user nova-compute[75066]:   </metadata>
Dec 01 19:31:58 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:31:58 user nova-compute[75066]:     <system>
Dec 01 19:31:58 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:31:58 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:31:58 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:31:58 user nova-compute[75066]:       <entry name="serial">479bf6d9-ffec-4417-99c5-3af0dafc0881</entry>
Dec 01 19:31:58 user nova-compute[75066]:       <entry name="uuid">479bf6d9-ffec-4417-99c5-3af0dafc0881</entry>
Dec 01 19:31:58 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:31:58 user nova-compute[75066]:     </system>
Dec 01 19:31:58 user nova-compute[75066]:   </sysinfo>
Dec 01 19:31:58 user nova-compute[75066]:   <os>
Dec 01 19:31:58 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:31:58 user nova-compute[75066]:     <boot dev="hd"/>
Dec 01 19:31:58 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:31:58 user nova-compute[75066]:   </os>
Dec 01 19:31:58 user nova-compute[75066]:   <features>
Dec 01 19:31:58 user nova-compute[75066]:     <acpi/>
Dec 01 19:31:58 user nova-compute[75066]:     <apic/>
Dec 01 19:31:58 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:31:58 user nova-compute[75066]:   </features>
Dec 01 19:31:58 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:31:58 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:31:58 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:31:58 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:31:58 user nova-compute[75066]:   </clock>
Dec 01 19:31:58 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:31:58 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:31:58 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:31:58 user nova-compute[75066]:   </cpu>
Dec 01 19:31:58 user nova-compute[75066]:   <devices>
Dec 01 19:31:58 user nova-compute[75066]:     <disk type="file" device="disk">
Dec 01 19:31:58 user nova-compute[75066]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 19:31:58 user nova-compute[75066]:       <source file="/opt/stack/data/nova/instances/479bf6d9-ffec-4417-99c5-3af0dafc0881/disk"/>
Dec 01 19:31:58 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:31:58 user nova-compute[75066]:     </disk>
Dec 01 19:31:58 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:31:58 user nova-compute[75066]:       <mac address="fa:16:3e:d0:5c:75"/>
Dec 01 19:31:58 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:31:58 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:31:58 user nova-compute[75066]:       <target dev="tap73fd5302-db"/>
Dec 01 19:31:58 user nova-compute[75066]:     </interface>
Dec 01 19:31:58 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:31:58 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/479bf6d9-ffec-4417-99c5-3af0dafc0881/console.log" append="off"/>
Dec 01 19:31:58 user nova-compute[75066]:     </serial>
Dec 01 19:31:58 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:31:58 user nova-compute[75066]:     <video>
Dec 01 19:31:58 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:31:58 user nova-compute[75066]:     </video>
Dec 01 19:31:58 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:31:58 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:31:58 user nova-compute[75066]:     </rng>
Dec 01 19:31:58 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:31:58 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:31:58 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:31:58 user nova-compute[75066]:     </memballoon>
Dec 01 19:31:58 user nova-compute[75066]:   </devices>
Dec 01 19:31:58 user nova-compute[75066]: </domain>
Dec 01 19:31:58 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:31:58 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:31:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-909713826',display_name='tempest-ServersNegativeTestJSON-server-909713826',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-909713826',id=36,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c9f677c9e8c24b7389273db9d82954fe',ramdisk_id='',reservation_id='r-ioskpdp0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1315108451',owner_user_name='tempest-ServersNegativeTestJSON-1315108451-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:31:56Z,user_data=None,user_id='14735fcf06cb45519d9fd71975871a62',uuid=479bf6d9-ffec-4417-99c5-3af0dafc0881,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73fd5302-db93-4304-97c6-735fd59227c0", "address": "fa:16:3e:d0:5c:75", "network": {"id": "884b20a8-4ead-448d-994b-8e714dc32fae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-357575766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9f677c9e8c24b7389273db9d82954fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73fd5302-db", "ovs_interfaceid": "73fd5302-db93-4304-97c6-735fd59227c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:31:58 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Converting VIF {"id": "73fd5302-db93-4304-97c6-735fd59227c0", "address": "fa:16:3e:d0:5c:75", "network": {"id": "884b20a8-4ead-448d-994b-8e714dc32fae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-357575766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9f677c9e8c24b7389273db9d82954fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73fd5302-db", "ovs_interfaceid": "73fd5302-db93-4304-97c6-735fd59227c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:31:58 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:5c:75,bridge_name='br-int',has_traffic_filtering=True,id=73fd5302-db93-4304-97c6-735fd59227c0,network=Network(884b20a8-4ead-448d-994b-8e714dc32fae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73fd5302-db') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:31:58 user nova-compute[75066]: DEBUG os_vif [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:5c:75,bridge_name='br-int',has_traffic_filtering=True,id=73fd5302-db93-4304-97c6-735fd59227c0,network=Network(884b20a8-4ead-448d-994b-8e714dc32fae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73fd5302-db') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:31:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:31:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:31:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:31:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:31:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7a5337d6-5d4e-5d6c-ab9a-7e5b525e0ccb', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:31:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:31:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:31:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:31:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap73fd5302-db, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:31:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap73fd5302-db, col_values=(('qos', UUID('25b175af-fce7-4605-99d7-8dbc2aa5848a')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:31:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap73fd5302-db, col_values=(('external_ids', {'iface-id': '73fd5302-db93-4304-97c6-735fd59227c0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:5c:75', 'vm-uuid': '479bf6d9-ffec-4417-99c5-3af0dafc0881'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:31:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:31:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:31:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:31:58 user nova-compute[75066]: INFO os_vif [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:5c:75,bridge_name='br-int',has_traffic_filtering=True,id=73fd5302-db93-4304-97c6-735fd59227c0,network=Network(884b20a8-4ead-448d-994b-8e714dc32fae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73fd5302-db')
Dec 01 19:31:58 user nova-compute[75066]: DEBUG nova.network.neutron [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Updating instance_info_cache with network_info: [{"id": "bbc4649f-c295-423e-a1c2-be3af706e4de", "address": "fa:16:3e:01:63:75", "network": {"id": "6b0f48b7-3db2-49b2-a238-8fd811b52d62", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1688127634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e000d89bca44cd8acba504256d8d1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbc4649f-c2", "ovs_interfaceid": "bbc4649f-c295-423e-a1c2-be3af706e4de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:31:58 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Releasing lock "refresh_cache-f04249c5-0196-455c-ac7a-f1ff8be320d4" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:31:58 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:31:58 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] No VIF found with MAC fa:16:3e:d0:5c:75, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:31:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:31:58 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-c5d2b5fd-a269-4d53-9f76-0fcfd24bbd5f tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.433s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:31:58 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5d2b5fd-a269-4d53-9f76-0fcfd24bbd5f tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] <== connect_volume: return (1435ms) {'type': 'block', 'scsi_wwn': '23539343464306164', 'path': '/dev/sdc'} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:31:58 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5d2b5fd-a269-4d53-9f76-0fcfd24bbd5f tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539343464306164', 'path': '/dev/sdc'} {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 19:31:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:31:58 user nova-compute[75066]: DEBUG nova.objects.instance [None req-c5d2b5fd-a269-4d53-9f76-0fcfd24bbd5f tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Lazy-loading 'flavor' on Instance uuid e9a9bf17-1c03-426a-b33e-9d8c458df283 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:31:58 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-c5d2b5fd-a269-4d53-9f76-0fcfd24bbd5f tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 19:31:58 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:31:58 user nova-compute[75066]:   <source dev="/dev/sdc"/>
Dec 01 19:31:58 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:31:58 user nova-compute[75066]:   <serial>5755ff17-79cf-4b3c-8ee0-5303b9a18236</serial>
Dec 01 19:31:58 user nova-compute[75066]: </disk>
Dec 01 19:31:58 user nova-compute[75066]:  {{(pid=75066) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 19:31:58 user nova-compute[75066]: DEBUG nova.network.neutron [req-dd1e5951-7c85-41e3-b44d-f0ca6ed064e8 req-c4db56ab-4c30-4685-99b8-ce4539e862e5 service nova] [instance: 479bf6d9-ffec-4417-99c5-3af0dafc0881] Updated VIF entry in instance network info cache for port 73fd5302-db93-4304-97c6-735fd59227c0. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:31:58 user nova-compute[75066]: DEBUG nova.network.neutron [req-dd1e5951-7c85-41e3-b44d-f0ca6ed064e8 req-c4db56ab-4c30-4685-99b8-ce4539e862e5 service nova] [instance: 479bf6d9-ffec-4417-99c5-3af0dafc0881] Updating instance_info_cache with network_info: [{"id": "73fd5302-db93-4304-97c6-735fd59227c0", "address": "fa:16:3e:d0:5c:75", "network": {"id": "884b20a8-4ead-448d-994b-8e714dc32fae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-357575766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9f677c9e8c24b7389273db9d82954fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73fd5302-db", "ovs_interfaceid": "73fd5302-db93-4304-97c6-735fd59227c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:31:58 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-dd1e5951-7c85-41e3-b44d-f0ca6ed064e8 req-c4db56ab-4c30-4685-99b8-ce4539e862e5 service nova] Releasing lock "refresh_cache-479bf6d9-ffec-4417-99c5-3af0dafc0881" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:31:58 user nova-compute[75066]: DEBUG nova.compute.manager [req-d40405f7-5fa8-421c-81b9-a7c0c99d4d6a req-de3f49db-b28d-423c-93a2-405610ad5250 service nova] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Received event network-vif-unplugged-bbc4649f-c295-423e-a1c2-be3af706e4de {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:31:58 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d40405f7-5fa8-421c-81b9-a7c0c99d4d6a req-de3f49db-b28d-423c-93a2-405610ad5250 service nova] Acquiring lock "f04249c5-0196-455c-ac7a-f1ff8be320d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:31:58 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d40405f7-5fa8-421c-81b9-a7c0c99d4d6a req-de3f49db-b28d-423c-93a2-405610ad5250 service nova] Lock "f04249c5-0196-455c-ac7a-f1ff8be320d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:31:58 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d40405f7-5fa8-421c-81b9-a7c0c99d4d6a req-de3f49db-b28d-423c-93a2-405610ad5250 service nova] Lock "f04249c5-0196-455c-ac7a-f1ff8be320d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:31:58 user nova-compute[75066]: DEBUG nova.compute.manager [req-d40405f7-5fa8-421c-81b9-a7c0c99d4d6a req-de3f49db-b28d-423c-93a2-405610ad5250 service nova] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] No waiting events found dispatching network-vif-unplugged-bbc4649f-c295-423e-a1c2-be3af706e4de {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:31:58 user nova-compute[75066]: WARNING nova.compute.manager [req-d40405f7-5fa8-421c-81b9-a7c0c99d4d6a req-de3f49db-b28d-423c-93a2-405610ad5250 service nova] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Received unexpected event network-vif-unplugged-bbc4649f-c295-423e-a1c2-be3af706e4de for instance with vm_state active and task_state rescuing.
Dec 01 19:31:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:31:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:31:59 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:31:59 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:31:59 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:31:59 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:31:59 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:31:59 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:31:59 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:31:59 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Instance destroyed successfully.
Dec 01 19:31:59 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Attempting a stable device rescue
Dec 01 19:31:59 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75066) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4314}}
Dec 01 19:31:59 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Instance directory exists: not creating {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4719}}
Dec 01 19:31:59 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Creating image(s)
Dec 01 19:31:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Acquiring lock "/opt/stack/data/nova/instances/f04249c5-0196-455c-ac7a-f1ff8be320d4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:31:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "/opt/stack/data/nova/instances/f04249c5-0196-455c-ac7a-f1ff8be320d4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:31:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "/opt/stack/data/nova/instances/f04249c5-0196-455c-ac7a-f1ff8be320d4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:31:59 user nova-compute[75066]: DEBUG nova.objects.instance [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lazy-loading 'trusted_certs' on Instance uuid f04249c5-0196-455c-ac7a-f1ff8be320d4 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:31:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Acquiring lock "6b039bc37a2a1b30c380ace1654e1b26ad7ae3d0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:31:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "6b039bc37a2a1b30c380ace1654e1b26ad7ae3d0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:32:00 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:32:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6b039bc37a2a1b30c380ace1654e1b26ad7ae3d0.part --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:01 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:32:01 user nova-compute[75066]: DEBUG nova.compute.manager [req-20d7808b-1b8f-4d94-a7a0-82bdfea1a62c req-84d2e3b6-507c-46d1-bc94-ea4f3b78e40a service nova] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Received event network-vif-plugged-bbc4649f-c295-423e-a1c2-be3af706e4de {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:32:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-20d7808b-1b8f-4d94-a7a0-82bdfea1a62c req-84d2e3b6-507c-46d1-bc94-ea4f3b78e40a service nova] Acquiring lock "f04249c5-0196-455c-ac7a-f1ff8be320d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:32:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-20d7808b-1b8f-4d94-a7a0-82bdfea1a62c req-84d2e3b6-507c-46d1-bc94-ea4f3b78e40a service nova] Lock "f04249c5-0196-455c-ac7a-f1ff8be320d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:32:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-20d7808b-1b8f-4d94-a7a0-82bdfea1a62c req-84d2e3b6-507c-46d1-bc94-ea4f3b78e40a service nova] Lock "f04249c5-0196-455c-ac7a-f1ff8be320d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:32:01 user nova-compute[75066]: DEBUG nova.compute.manager [req-20d7808b-1b8f-4d94-a7a0-82bdfea1a62c req-84d2e3b6-507c-46d1-bc94-ea4f3b78e40a service nova] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] No waiting events found dispatching network-vif-plugged-bbc4649f-c295-423e-a1c2-be3af706e4de {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:32:01 user nova-compute[75066]: WARNING nova.compute.manager [req-20d7808b-1b8f-4d94-a7a0-82bdfea1a62c req-84d2e3b6-507c-46d1-bc94-ea4f3b78e40a service nova] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Received unexpected event network-vif-plugged-bbc4649f-c295-423e-a1c2-be3af706e4de for instance with vm_state active and task_state rescuing.
Dec 01 19:32:01 user nova-compute[75066]: DEBUG nova.compute.manager [req-20d7808b-1b8f-4d94-a7a0-82bdfea1a62c req-84d2e3b6-507c-46d1-bc94-ea4f3b78e40a service nova] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Received event network-vif-plugged-bbc4649f-c295-423e-a1c2-be3af706e4de {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:32:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-20d7808b-1b8f-4d94-a7a0-82bdfea1a62c req-84d2e3b6-507c-46d1-bc94-ea4f3b78e40a service nova] Acquiring lock "f04249c5-0196-455c-ac7a-f1ff8be320d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:32:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-20d7808b-1b8f-4d94-a7a0-82bdfea1a62c req-84d2e3b6-507c-46d1-bc94-ea4f3b78e40a service nova] Lock "f04249c5-0196-455c-ac7a-f1ff8be320d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:32:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-20d7808b-1b8f-4d94-a7a0-82bdfea1a62c req-84d2e3b6-507c-46d1-bc94-ea4f3b78e40a service nova] Lock "f04249c5-0196-455c-ac7a-f1ff8be320d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:32:01 user nova-compute[75066]: DEBUG nova.compute.manager [req-20d7808b-1b8f-4d94-a7a0-82bdfea1a62c req-84d2e3b6-507c-46d1-bc94-ea4f3b78e40a service nova] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] No waiting events found dispatching network-vif-plugged-bbc4649f-c295-423e-a1c2-be3af706e4de {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:32:01 user nova-compute[75066]: WARNING nova.compute.manager [req-20d7808b-1b8f-4d94-a7a0-82bdfea1a62c req-84d2e3b6-507c-46d1-bc94-ea4f3b78e40a service nova] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Received unexpected event network-vif-plugged-bbc4649f-c295-423e-a1c2-be3af706e4de for instance with vm_state active and task_state rescuing.
Dec 01 19:32:01 user nova-compute[75066]: DEBUG nova.compute.manager [req-20d7808b-1b8f-4d94-a7a0-82bdfea1a62c req-84d2e3b6-507c-46d1-bc94-ea4f3b78e40a service nova] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Received event network-vif-plugged-bbc4649f-c295-423e-a1c2-be3af706e4de {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:32:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-20d7808b-1b8f-4d94-a7a0-82bdfea1a62c req-84d2e3b6-507c-46d1-bc94-ea4f3b78e40a service nova] Acquiring lock "f04249c5-0196-455c-ac7a-f1ff8be320d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:32:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-20d7808b-1b8f-4d94-a7a0-82bdfea1a62c req-84d2e3b6-507c-46d1-bc94-ea4f3b78e40a service nova] Lock "f04249c5-0196-455c-ac7a-f1ff8be320d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:32:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-20d7808b-1b8f-4d94-a7a0-82bdfea1a62c req-84d2e3b6-507c-46d1-bc94-ea4f3b78e40a service nova] Lock "f04249c5-0196-455c-ac7a-f1ff8be320d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:32:01 user nova-compute[75066]: DEBUG nova.compute.manager [req-20d7808b-1b8f-4d94-a7a0-82bdfea1a62c req-84d2e3b6-507c-46d1-bc94-ea4f3b78e40a service nova] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] No waiting events found dispatching network-vif-plugged-bbc4649f-c295-423e-a1c2-be3af706e4de {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:32:01 user nova-compute[75066]: WARNING nova.compute.manager [req-20d7808b-1b8f-4d94-a7a0-82bdfea1a62c req-84d2e3b6-507c-46d1-bc94-ea4f3b78e40a service nova] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Received unexpected event network-vif-plugged-bbc4649f-c295-423e-a1c2-be3af706e4de for instance with vm_state active and task_state rescuing.
Dec 01 19:32:01 user nova-compute[75066]: DEBUG nova.compute.manager [req-20d7808b-1b8f-4d94-a7a0-82bdfea1a62c req-84d2e3b6-507c-46d1-bc94-ea4f3b78e40a service nova] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Received event network-vif-unplugged-bbc4649f-c295-423e-a1c2-be3af706e4de {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:32:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-20d7808b-1b8f-4d94-a7a0-82bdfea1a62c req-84d2e3b6-507c-46d1-bc94-ea4f3b78e40a service nova] Acquiring lock "f04249c5-0196-455c-ac7a-f1ff8be320d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:32:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-20d7808b-1b8f-4d94-a7a0-82bdfea1a62c req-84d2e3b6-507c-46d1-bc94-ea4f3b78e40a service nova] Lock "f04249c5-0196-455c-ac7a-f1ff8be320d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:32:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-20d7808b-1b8f-4d94-a7a0-82bdfea1a62c req-84d2e3b6-507c-46d1-bc94-ea4f3b78e40a service nova] Lock "f04249c5-0196-455c-ac7a-f1ff8be320d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:32:01 user nova-compute[75066]: DEBUG nova.compute.manager [req-20d7808b-1b8f-4d94-a7a0-82bdfea1a62c req-84d2e3b6-507c-46d1-bc94-ea4f3b78e40a service nova] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] No waiting events found dispatching network-vif-unplugged-bbc4649f-c295-423e-a1c2-be3af706e4de {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:32:01 user nova-compute[75066]: WARNING nova.compute.manager [req-20d7808b-1b8f-4d94-a7a0-82bdfea1a62c req-84d2e3b6-507c-46d1-bc94-ea4f3b78e40a service nova] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Received unexpected event network-vif-unplugged-bbc4649f-c295-423e-a1c2-be3af706e4de for instance with vm_state active and task_state rescuing.
Dec 01 19:32:01 user nova-compute[75066]: DEBUG nova.compute.manager [req-20d7808b-1b8f-4d94-a7a0-82bdfea1a62c req-84d2e3b6-507c-46d1-bc94-ea4f3b78e40a service nova] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Received event network-vif-plugged-bbc4649f-c295-423e-a1c2-be3af706e4de {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:32:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-20d7808b-1b8f-4d94-a7a0-82bdfea1a62c req-84d2e3b6-507c-46d1-bc94-ea4f3b78e40a service nova] Acquiring lock "f04249c5-0196-455c-ac7a-f1ff8be320d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:32:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-20d7808b-1b8f-4d94-a7a0-82bdfea1a62c req-84d2e3b6-507c-46d1-bc94-ea4f3b78e40a service nova] Lock "f04249c5-0196-455c-ac7a-f1ff8be320d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:32:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-20d7808b-1b8f-4d94-a7a0-82bdfea1a62c req-84d2e3b6-507c-46d1-bc94-ea4f3b78e40a service nova] Lock "f04249c5-0196-455c-ac7a-f1ff8be320d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:32:01 user nova-compute[75066]: DEBUG nova.compute.manager [req-20d7808b-1b8f-4d94-a7a0-82bdfea1a62c req-84d2e3b6-507c-46d1-bc94-ea4f3b78e40a service nova] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] No waiting events found dispatching network-vif-plugged-bbc4649f-c295-423e-a1c2-be3af706e4de {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:32:01 user nova-compute[75066]: WARNING nova.compute.manager [req-20d7808b-1b8f-4d94-a7a0-82bdfea1a62c req-84d2e3b6-507c-46d1-bc94-ea4f3b78e40a service nova] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Received unexpected event network-vif-plugged-bbc4649f-c295-423e-a1c2-be3af706e4de for instance with vm_state active and task_state rescuing.
Dec 01 19:32:01 user nova-compute[75066]: DEBUG nova.compute.manager [req-a5db36fb-1ea6-4ee3-88d2-673e2c21a1ff req-f9a4f01b-e406-4627-aa16-f1a1a2ce1299 service nova] [instance: 479bf6d9-ffec-4417-99c5-3af0dafc0881] Received event network-vif-plugged-73fd5302-db93-4304-97c6-735fd59227c0 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:32:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a5db36fb-1ea6-4ee3-88d2-673e2c21a1ff req-f9a4f01b-e406-4627-aa16-f1a1a2ce1299 service nova] Acquiring lock "479bf6d9-ffec-4417-99c5-3af0dafc0881-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:32:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a5db36fb-1ea6-4ee3-88d2-673e2c21a1ff req-f9a4f01b-e406-4627-aa16-f1a1a2ce1299 service nova] Lock "479bf6d9-ffec-4417-99c5-3af0dafc0881-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:32:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a5db36fb-1ea6-4ee3-88d2-673e2c21a1ff req-f9a4f01b-e406-4627-aa16-f1a1a2ce1299 service nova] Lock "479bf6d9-ffec-4417-99c5-3af0dafc0881-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:32:01 user nova-compute[75066]: DEBUG nova.compute.manager [req-a5db36fb-1ea6-4ee3-88d2-673e2c21a1ff req-f9a4f01b-e406-4627-aa16-f1a1a2ce1299 service nova] [instance: 479bf6d9-ffec-4417-99c5-3af0dafc0881] No waiting events found dispatching network-vif-plugged-73fd5302-db93-4304-97c6-735fd59227c0 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:32:01 user nova-compute[75066]: WARNING nova.compute.manager [req-a5db36fb-1ea6-4ee3-88d2-673e2c21a1ff req-f9a4f01b-e406-4627-aa16-f1a1a2ce1299 service nova] [instance: 479bf6d9-ffec-4417-99c5-3af0dafc0881] Received unexpected event network-vif-plugged-73fd5302-db93-4304-97c6-735fd59227c0 for instance with vm_state building and task_state spawning.
Dec 01 19:32:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c5d2b5fd-a269-4d53-9f76-0fcfd24bbd5f tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:32:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c5d2b5fd-a269-4d53-9f76-0fcfd24bbd5f tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:32:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-c5d2b5fd-a269-4d53-9f76-0fcfd24bbd5f tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] No VIF found with MAC fa:16:3e:37:9e:f3, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:32:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6b039bc37a2a1b30c380ace1654e1b26ad7ae3d0.part --force-share --output=json" returned: 0 in 0.271s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:01 user nova-compute[75066]: DEBUG nova.virt.images [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] 079e75d7-d4a2-4654-bb4b-d9900769b3f8 was qcow2, converting to raw {{(pid=75066) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 01 19:32:01 user nova-compute[75066]: DEBUG nova.privsep.utils [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75066) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 01 19:32:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6b039bc37a2a1b30c380ace1654e1b26ad7ae3d0.part /opt/stack/data/nova/instances/_base/6b039bc37a2a1b30c380ace1654e1b26ad7ae3d0.converted {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c5d2b5fd-a269-4d53-9f76-0fcfd24bbd5f tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Lock "e9a9bf17-1c03-426a-b33e-9d8c458df283" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.016s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:32:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6b039bc37a2a1b30c380ace1654e1b26ad7ae3d0.part /opt/stack/data/nova/instances/_base/6b039bc37a2a1b30c380ace1654e1b26ad7ae3d0.converted" returned: 0 in 0.463s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6b039bc37a2a1b30c380ace1654e1b26ad7ae3d0.converted --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6b039bc37a2a1b30c380ace1654e1b26ad7ae3d0.converted --force-share --output=json" returned: 0 in 0.189s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "6b039bc37a2a1b30c380ace1654e1b26ad7ae3d0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.215s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:32:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Acquiring lock "6b039bc37a2a1b30c380ace1654e1b26ad7ae3d0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:32:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "6b039bc37a2a1b30c380ace1654e1b26ad7ae3d0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:32:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6b039bc37a2a1b30c380ace1654e1b26ad7ae3d0 --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6b039bc37a2a1b30c380ace1654e1b26ad7ae3d0 --force-share --output=json" returned: 0 in 0.177s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6b039bc37a2a1b30c380ace1654e1b26ad7ae3d0,backing_fmt=raw /opt/stack/data/nova/instances/f04249c5-0196-455c-ac7a-f1ff8be320d4/disk.rescue {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6b039bc37a2a1b30c380ace1654e1b26ad7ae3d0,backing_fmt=raw /opt/stack/data/nova/instances/f04249c5-0196-455c-ac7a-f1ff8be320d4/disk.rescue" returned: 0 in 0.066s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "6b039bc37a2a1b30c380ace1654e1b26ad7ae3d0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG nova.objects.instance [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lazy-loading 'migration_context' on Instance uuid f04249c5-0196-455c-ac7a-f1ff8be320d4 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG nova.objects.base [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Object Instance<f04249c5-0196-455c-ac7a-f1ff8be320d4> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75066) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Created local disks {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Start _get_guest_xml network_info=[{"id": "bbc4649f-c295-423e-a1c2-be3af706e4de", "address": "fa:16:3e:01:63:75", "network": {"id": "6b0f48b7-3db2-49b2-a238-8fd811b52d62", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1688127634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1688127634-network", "vif_mac": "fa:16:3e:01:63:75"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e000d89bca44cd8acba504256d8d1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbc4649f-c2", "ovs_interfaceid": "bbc4649f-c295-423e-a1c2-be3af706e4de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '079e75d7-d4a2-4654-bb4b-d9900769b3f8', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': False, 'attachment_id': '25783605-e1f2-4171-92bf-4c764a4f0a96', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YDMXrRvi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'f04249c5-0196-455c-ac7a-f1ff8be320d4', 'attached_at': '', 'detached_at': '', 'volume_id': '00a9a62a-bf5a-4a84-869d-3aea7a75f571', 'serial': '00a9a62a-bf5a-4a84-869d-3aea7a75f571'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG nova.objects.instance [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lazy-loading 'resources' on Instance uuid f04249c5-0196-455c-ac7a-f1ff8be320d4 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG nova.objects.base [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Object Instance<f04249c5-0196-455c-ac7a-f1ff8be320d4> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75066) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG nova.objects.instance [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lazy-loading 'numa_topology' on Instance uuid f04249c5-0196-455c-ac7a-f1ff8be320d4 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG nova.objects.base [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Object Instance<f04249c5-0196-455c-ac7a-f1ff8be320d4> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75066) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 19:32:02 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:32:02 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:32:02 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG nova.objects.instance [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lazy-loading 'vcpu_model' on Instance uuid f04249c5-0196-455c-ac7a-f1ff8be320d4 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG nova.objects.base [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Object Instance<f04249c5-0196-455c-ac7a-f1ff8be320d4> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75066) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Calling os-brick to attach iSCSI Volume {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YDMXrRvi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:32:02 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:32:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:32:02 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:32:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:32:02 user nova-compute[75066]: INFO os_brick.initiator.connectors.iscsi [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 19:32:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 -p 172.16.0.220:3260 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 -p 172.16.0.220:3260" returned: 0 in 0.023s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebc51da2-65f2-4772-92c7-37b6415170d2]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = YDMXrRvi\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Dec 01 19:32:02 user nova-compute[75066]: node.name = iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571
Dec 01 19:32:02 user nova-compute[75066]: node.tpgt = -1
Dec 01 19:32:02 user nova-compute[75066]: node.startup = automatic
Dec 01 19:32:02 user nova-compute[75066]: node.leading_login = No
Dec 01 19:32:02 user nova-compute[75066]: iface.iscsi_ifacename = default
Dec 01 19:32:02 user nova-compute[75066]: iface.net_ifacename = <empty>
Dec 01 19:32:02 user nova-compute[75066]: iface.ipaddress = <empty>
Dec 01 19:32:02 user nova-compute[75066]: iface.prefix_len = 0
Dec 01 19:32:02 user nova-compute[75066]: iface.hwaddress = <empty>
Dec 01 19:32:02 user nova-compute[75066]: iface.transport_name = tcp
Dec 01 19:32:02 user nova-compute[75066]: iface.initiatorname = <empty>
Dec 01 19:32:02 user nova-compute[75066]: iface.state = <empty>
Dec 01 19:32:02 user nova-compute[75066]: iface.vlan_id = 0
Dec 01 19:32:02 user nova-compute[75066]: iface.vlan_priority = 0
Dec 01 19:32:02 user nova-compute[75066]: iface.vlan_state = <empty>
Dec 01 19:32:02 user nova-compute[75066]: iface.iface_num = 0
Dec 01 19:32:02 user nova-compute[75066]: iface.mtu = 0
Dec 01 19:32:02 user nova-compute[75066]: iface.port = 0
Dec 01 19:32:02 user nova-compute[75066]: iface.bootproto = <empty>
Dec 01 19:32:02 user nova-compute[75066]: iface.subnet_mask = <empty>
Dec 01 19:32:02 user nova-compute[75066]: iface.gateway = <empty>
Dec 01 19:32:02 user nova-compute[75066]: iface.dhcp_alt_client_id_state = <empty>
Dec 01 19:32:02 user nova-compute[75066]: iface.dhcp_alt_client_id = <empty>
Dec 01 19:32:02 user nova-compute[75066]: iface.dhcp_dns = <empty>
Dec 01 19:32:02 user nova-compute[75066]: iface.dhcp_learn_iqn = <empty>
Dec 01 19:32:02 user nova-compute[75066]: iface.dhcp_req_vendor_id_state = <empty>
Dec 01 19:32:02 user nova-compute[75066]: iface.dhcp_vendor_id_state = <empty>
Dec 01 19:32:02 user nova-compute[75066]: iface.dhcp_vendor_id = <empty>
Dec 01 19:32:02 user nova-compute[75066]: iface.dhcp_slp_da = <empty>
Dec 01 19:32:02 user nova-compute[75066]: iface.fragmentation = <empty>
Dec 01 19:32:02 user nova-compute[75066]: iface.gratuitous_arp = <empty>
Dec 01 19:32:02 user nova-compute[75066]: iface.incoming_forwarding = <empty>
Dec 01 19:32:02 user nova-compute[75066]: iface.tos_state = <empty>
Dec 01 19:32:02 user nova-compute[75066]: iface.tos = 0
Dec 01 19:32:02 user nova-compute[75066]: iface.ttl = 0
Dec 01 19:32:02 user nova-compute[75066]: iface.delayed_ack = <empty>
Dec 01 19:32:02 user nova-compute[75066]: iface.tcp_nagle = <empty>
Dec 01 19:32:02 user nova-compute[75066]: iface.tcp_wsf_state = <empty>
Dec 01 19:32:02 user nova-compute[75066]: iface.tcp_wsf = 0
Dec 01 19:32:02 user nova-compute[75066]: iface.tcp_timer_scale = 0
Dec 01 19:32:02 user nova-compute[75066]: iface.tcp_timestamp = <empty>
Dec 01 19:32:02 user nova-compute[75066]: iface.redirect = <empty>
Dec 01 19:32:02 user nova-compute[75066]: iface.def_task_mgmt_timeout = 0
Dec 01 19:32:02 user nova-compute[75066]: iface.header_digest = <empty>
Dec 01 19:32:02 user nova-compute[75066]: iface.data_digest = <empty>
Dec 01 19:32:02 user nova-compute[75066]: iface.immediate_data = <empty>
Dec 01 19:32:02 user nova-compute[75066]: iface.initial_r2t = <empty>
Dec 01 19:32:02 user nova-compute[75066]: iface.data_seq_inorder = <empty>
Dec 01 19:32:02 user nova-compute[75066]: iface.data_pdu_inorder = <empty>
Dec 01 19:32:02 user nova-compute[75066]: iface.erl = 0
Dec 01 19:32:02 user nova-compute[75066]: iface.max_receive_data_len = 0
Dec 01 19:32:02 user nova-compute[75066]: iface.first_burst_len = 0
Dec 01 19:32:02 user nova-compute[75066]: iface.max_outstanding_r2t = 0
Dec 01 19:32:02 user nova-compute[75066]: iface.max_burst_len = 0
Dec 01 19:32:02 user nova-compute[75066]: iface.chap_auth = <empty>
Dec 01 19:32:02 user nova-compute[75066]: iface.bidi_chap = <empty>
Dec 01 19:32:02 user nova-compute[75066]: iface.strict_login_compliance = <empty>
Dec 01 19:32:02 user nova-compute[75066]: iface.discovery_auth = <empty>
Dec 01 19:32:02 user nova-compute[75066]: iface.discovery_logout = <empty>
Dec 01 19:32:02 user nova-compute[75066]: node.discovery_address = <empty>
Dec 01 19:32:02 user nova-compute[75066]: node.discovery_port = 0
Dec 01 19:32:02 user nova-compute[75066]: node.discovery_type = static
Dec 01 19:32:02 user nova-compute[75066]: node.session.initial_cmdsn = 0
Dec 01 19:32:02 user nova-compute[75066]: node.session.initial_login_retry_max = 8
Dec 01 19:32:02 user nova-compute[75066]: node.session.xmit_thread_priority = -20
Dec 01 19:32:02 user nova-compute[75066]: node.session.cmds_max = 128
Dec 01 19:32:02 user nova-compute[75066]: node.session.queue_depth = 32
Dec 01 19:32:02 user nova-compute[75066]: node.session.nr_sessions = 1
Dec 01 19:32:02 user nova-compute[75066]: node.session.auth.authmethod = CHAP
Dec 01 19:32:02 user nova-compute[75066]: node.session.auth.username = YDMXrRvi
Dec 01 19:32:02 user nova-compute[75066]: node.session.auth.password = ***
Dec 01 19:32:02 user nova-compute[75066]: node.session.auth.username_in = <empty>
Dec 01 19:32:02 user nova-compute[75066]: node.session.auth.password_in = <empty>
Dec 01 19:32:02 user nova-compute[75066]: node.session.auth.chap_algs = MD5
Dec 01 19:32:02 user nova-compute[75066]: node.session.timeo.replacement_timeout = 120
Dec 01 19:32:02 user nova-compute[75066]: node.session.err_timeo.abort_timeout = 15
Dec 01 19:32:02 user nova-compute[75066]: node.session.err_timeo.lu_reset_timeout = 30
Dec 01 19:32:02 user nova-compute[75066]: node.session.err_timeo.tgt_reset_timeout = 30
Dec 01 19:32:02 user nova-compute[75066]: node.session.err_timeo.host_reset_timeout = 60
Dec 01 19:32:02 user nova-compute[75066]: node.session.iscsi.FastAbort = Yes
Dec 01 19:32:02 user nova-compute[75066]: node.session.iscsi.InitialR2T = No
Dec 01 19:32:02 user nova-compute[75066]: node.session.iscsi.ImmediateData = Yes
Dec 01 19:32:02 user nova-compute[75066]: node.session.iscsi.FirstBurstLength = 262144
Dec 01 19:32:02 user nova-compute[75066]: node.session.iscsi.MaxBurstLength = 16776192
Dec 01 19:32:02 user nova-compute[75066]: node.session.iscsi.DefaultTime2Retain = 0
Dec 01 19:32:02 user nova-compute[75066]: node.session.iscsi.DefaultTime2Wait = 2
Dec 01 19:32:02 user nova-compute[75066]: node.session.iscsi.MaxConnections = 1
Dec 01 19:32:02 user nova-compute[75066]: node.session.iscsi.MaxOutstandingR2T = 1
Dec 01 19:32:02 user nova-compute[75066]: node.session.iscsi.ERL = 0
Dec 01 19:32:02 user nova-compute[75066]: node.session.scan = manual
Dec 01 19:32:02 user nova-compute[75066]: node.session.reopen_max = 0
Dec 01 19:32:02 user nova-compute[75066]: node.conn[0].address = 172.16.0.220
Dec 01 19:32:02 user nova-compute[75066]: node.conn[0].port = 3260
Dec 01 19:32:02 user nova-compute[75066]: node.conn[0].startup = manual
Dec 01 19:32:02 user nova-compute[75066]: node.conn[0].tcp.window_size = 524288
Dec 01 19:32:02 user nova-compute[75066]: node.conn[0].tcp.type_of_service = 0
Dec 01 19:32:02 user nova-compute[75066]: node.conn[0].timeo.logout_timeout = 15
Dec 01 19:32:02 user nova-compute[75066]: node.conn[0].timeo.login_timeout = 15
Dec 01 19:32:02 user nova-compute[75066]: node.conn[0].timeo.auth_timeout = 45
Dec 01 19:32:02 user nova-compute[75066]: node.conn[0].timeo.noop_out_interval = 5
Dec 01 19:32:02 user nova-compute[75066]: node.conn[0].timeo.noop_out_timeout = 5
Dec 01 19:32:02 user nova-compute[75066]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Dec 01 19:32:02 user nova-compute[75066]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Dec 01 19:32:02 user nova-compute[75066]: node.conn[0].iscsi.HeaderDigest = None
Dec 01 19:32:02 user nova-compute[75066]: node.conn[0].iscsi.DataDigest = None
Dec 01 19:32:02 user nova-compute[75066]: node.conn[0].iscsi.IFMarker = No
Dec 01 19:32:02 user nova-compute[75066]: node.conn[0].iscsi.OFMarker = No
Dec 01 19:32:02 user nova-compute[75066]: # END RECORD
Dec 01 19:32:02 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[e956905a-f962-472c-9e6d-d94d76b08b19]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[121404f8-4af4-49ce-bbf8-f4428e29fc72]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YDMXrRvi {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YDMXrRvi" returned: 0 in 0.025s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[eabfc4bb-ac02-4fd3-9f4d-9c0da2aa20b2]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YDMXrRvi'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[3926a073-514a-4df8-a6f4-a9440b16dc46]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[9109edf5-2337-41f0-9db9-80e9af80aa32]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:32:02 user nova-compute[75066]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)
Dec 01 19:32:02 user nova-compute[75066]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 (non-flash)
Dec 01 19:32:02 user nova-compute[75066]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 (non-flash)
Dec 01 19:32:02 user nova-compute[75066]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236 (non-flash)
Dec 01 19:32:02 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:32:02 user nova-compute[75066]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)
Dec 01 19:32:02 user nova-compute[75066]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 (non-flash)
Dec 01 19:32:02 user nova-compute[75066]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 (non-flash)
Dec 01 19:32:02 user nova-compute[75066]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236 (non-flash)
Dec 01 19:32:02 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.177s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Connected to 172.16.0.220:3260 {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] HCTL ('36', '0', '0', 0) found on session 39 with lun 0 {{(pid=75066) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=75066) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe149587-1159-4b78-8b96-a406407c267c]: (4, ('0 0 0', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Searching for a device in session 39 and hctl ('36', '0', '0', 0) yield: sde {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YDMXrRvi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.204s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] <== connect_volume: return (206ms) {'type': 'block', 'scsi_wwn': '26262323331663530', 'path': '/dev/sde'} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262323331663530', 'path': '/dev/sde'} {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:30:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2133252280',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2133252280',id=34,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:30:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e000d89bca44cd8acba504256d8d1f1',ramdisk_id='',reservation_id='r-1ouukm88',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-454493649',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:30:38Z,user_data=None,user_id='964c1681ca8745d0b3879266d24f507e',uuid=f04249c5-0196-455c-ac7a-f1ff8be320d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bbc4649f-c295-423e-a1c2-be3af706e4de", "address": "fa:16:3e:01:63:75", "network": {"id": "6b0f48b7-3db2-49b2-a238-8fd811b52d62", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1688127634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1688127634-network", "vif_mac": "fa:16:3e:01:63:75"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e000d89bca44cd8acba504256d8d1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbc4649f-c2", "ovs_interfaceid": "bbc4649f-c295-423e-a1c2-be3af706e4de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Converting VIF {"id": "bbc4649f-c295-423e-a1c2-be3af706e4de", "address": "fa:16:3e:01:63:75", "network": {"id": "6b0f48b7-3db2-49b2-a238-8fd811b52d62", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1688127634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1688127634-network", "vif_mac": "fa:16:3e:01:63:75"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e000d89bca44cd8acba504256d8d1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbc4649f-c2", "ovs_interfaceid": "bbc4649f-c295-423e-a1c2-be3af706e4de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:63:75,bridge_name='br-int',has_traffic_filtering=True,id=bbc4649f-c295-423e-a1c2-be3af706e4de,network=Network(6b0f48b7-3db2-49b2-a238-8fd811b52d62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbc4649f-c2') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG nova.objects.instance [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lazy-loading 'pci_devices' on Instance uuid f04249c5-0196-455c-ac7a-f1ff8be320d4 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG nova.objects.base [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Object Instance<f04249c5-0196-455c-ac7a-f1ff8be320d4> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75066) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:32:02 user nova-compute[75066]:   <uuid>f04249c5-0196-455c-ac7a-f1ff8be320d4</uuid>
Dec 01 19:32:02 user nova-compute[75066]:   <name>instance-00000022</name>
Dec 01 19:32:02 user nova-compute[75066]:   <memory>524288</memory>
Dec 01 19:32:02 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:32:02 user nova-compute[75066]:   <metadata>
Dec 01 19:32:02 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:32:02 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:32:02 user nova-compute[75066]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2133252280</nova:name>
Dec 01 19:32:02 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:32:02</nova:creationTime>
Dec 01 19:32:02 user nova-compute[75066]:       <nova:flavor name="m1.tiny">
Dec 01 19:32:02 user nova-compute[75066]:         <nova:memory>512</nova:memory>
Dec 01 19:32:02 user nova-compute[75066]:         <nova:disk>1</nova:disk>
Dec 01 19:32:02 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:32:02 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:32:02 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:32:02 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:32:02 user nova-compute[75066]:       <nova:owner>
Dec 01 19:32:02 user nova-compute[75066]:         <nova:user uuid="964c1681ca8745d0b3879266d24f507e">tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member</nova:user>
Dec 01 19:32:02 user nova-compute[75066]:         <nova:project uuid="2e000d89bca44cd8acba504256d8d1f1">tempest-ServerBootFromVolumeStableRescueTest-454493649</nova:project>
Dec 01 19:32:02 user nova-compute[75066]:       </nova:owner>
Dec 01 19:32:02 user nova-compute[75066]:       <nova:root type="image" uuid="900b237b-e99c-4fdd-a44f-dcb7a08baa86"/>
Dec 01 19:32:02 user nova-compute[75066]:       <nova:ports>
Dec 01 19:32:02 user nova-compute[75066]:         <nova:port uuid="bbc4649f-c295-423e-a1c2-be3af706e4de">
Dec 01 19:32:02 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 01 19:32:02 user nova-compute[75066]:         </nova:port>
Dec 01 19:32:02 user nova-compute[75066]:       </nova:ports>
Dec 01 19:32:02 user nova-compute[75066]:     </nova:instance>
Dec 01 19:32:02 user nova-compute[75066]:   </metadata>
Dec 01 19:32:02 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:32:02 user nova-compute[75066]:     <system>
Dec 01 19:32:02 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:32:02 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:32:02 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:32:02 user nova-compute[75066]:       <entry name="serial">f04249c5-0196-455c-ac7a-f1ff8be320d4</entry>
Dec 01 19:32:02 user nova-compute[75066]:       <entry name="uuid">f04249c5-0196-455c-ac7a-f1ff8be320d4</entry>
Dec 01 19:32:02 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:32:02 user nova-compute[75066]:     </system>
Dec 01 19:32:02 user nova-compute[75066]:   </sysinfo>
Dec 01 19:32:02 user nova-compute[75066]:   <os>
Dec 01 19:32:02 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:32:02 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:32:02 user nova-compute[75066]:   </os>
Dec 01 19:32:02 user nova-compute[75066]:   <features>
Dec 01 19:32:02 user nova-compute[75066]:     <acpi/>
Dec 01 19:32:02 user nova-compute[75066]:     <apic/>
Dec 01 19:32:02 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:32:02 user nova-compute[75066]:   </features>
Dec 01 19:32:02 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:32:02 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:32:02 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:32:02 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:32:02 user nova-compute[75066]:   </clock>
Dec 01 19:32:02 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:32:02 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:32:02 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:32:02 user nova-compute[75066]:   </cpu>
Dec 01 19:32:02 user nova-compute[75066]:   <devices>
Dec 01 19:32:02 user nova-compute[75066]:     <disk type="block" device="disk">
Dec 01 19:32:02 user nova-compute[75066]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:32:02 user nova-compute[75066]:       <source dev="/dev/sde"/>
Dec 01 19:32:02 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:32:02 user nova-compute[75066]:       <serial>00a9a62a-bf5a-4a84-869d-3aea7a75f571</serial>
Dec 01 19:32:02 user nova-compute[75066]:     </disk>
Dec 01 19:32:02 user nova-compute[75066]:     <disk type="file" device="disk">
Dec 01 19:32:02 user nova-compute[75066]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 19:32:02 user nova-compute[75066]:       <source file="/opt/stack/data/nova/instances/f04249c5-0196-455c-ac7a-f1ff8be320d4/disk.rescue"/>
Dec 01 19:32:02 user nova-compute[75066]:       <target dev="vdb" bus="virtio"/>
Dec 01 19:32:02 user nova-compute[75066]:       <boot order="1"/>
Dec 01 19:32:02 user nova-compute[75066]:     </disk>
Dec 01 19:32:02 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:32:02 user nova-compute[75066]:       <mac address="fa:16:3e:01:63:75"/>
Dec 01 19:32:02 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:32:02 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:32:02 user nova-compute[75066]:       <target dev="tapbbc4649f-c2"/>
Dec 01 19:32:02 user nova-compute[75066]:     </interface>
Dec 01 19:32:02 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:32:02 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/f04249c5-0196-455c-ac7a-f1ff8be320d4/console.log" append="off"/>
Dec 01 19:32:02 user nova-compute[75066]:     </serial>
Dec 01 19:32:02 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:32:02 user nova-compute[75066]:     <video>
Dec 01 19:32:02 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:32:02 user nova-compute[75066]:     </video>
Dec 01 19:32:02 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:32:02 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:32:02 user nova-compute[75066]:     </rng>
Dec 01 19:32:02 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:32:02 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:32:02 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:32:02 user nova-compute[75066]:     </memballoon>
Dec 01 19:32:02 user nova-compute[75066]:   </devices>
Dec 01 19:32:02 user nova-compute[75066]: </domain>
Dec 01 19:32:02 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:32:02 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Instance destroyed successfully.
Dec 01 19:32:02 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:32:02 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] No VIF found with MAC fa:16:3e:01:63:75, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:32:03 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:32:03 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:32:03 user nova-compute[75066]: DEBUG nova.compute.manager [req-b3cda6b5-f8f2-47ba-8a54-a2a4af833a52 req-003e68cf-685a-490b-966e-58a189b58fcd service nova] [instance: 479bf6d9-ffec-4417-99c5-3af0dafc0881] Received event network-vif-plugged-73fd5302-db93-4304-97c6-735fd59227c0 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:32:03 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-b3cda6b5-f8f2-47ba-8a54-a2a4af833a52 req-003e68cf-685a-490b-966e-58a189b58fcd service nova] Acquiring lock "479bf6d9-ffec-4417-99c5-3af0dafc0881-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:32:03 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-b3cda6b5-f8f2-47ba-8a54-a2a4af833a52 req-003e68cf-685a-490b-966e-58a189b58fcd service nova] Lock "479bf6d9-ffec-4417-99c5-3af0dafc0881-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:32:03 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-b3cda6b5-f8f2-47ba-8a54-a2a4af833a52 req-003e68cf-685a-490b-966e-58a189b58fcd service nova] Lock "479bf6d9-ffec-4417-99c5-3af0dafc0881-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:32:03 user nova-compute[75066]: DEBUG nova.compute.manager [req-b3cda6b5-f8f2-47ba-8a54-a2a4af833a52 req-003e68cf-685a-490b-966e-58a189b58fcd service nova] [instance: 479bf6d9-ffec-4417-99c5-3af0dafc0881] No waiting events found dispatching network-vif-plugged-73fd5302-db93-4304-97c6-735fd59227c0 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:32:03 user nova-compute[75066]: WARNING nova.compute.manager [req-b3cda6b5-f8f2-47ba-8a54-a2a4af833a52 req-003e68cf-685a-490b-966e-58a189b58fcd service nova] [instance: 479bf6d9-ffec-4417-99c5-3af0dafc0881] Received unexpected event network-vif-plugged-73fd5302-db93-4304-97c6-735fd59227c0 for instance with vm_state building and task_state spawning.
Dec 01 19:32:03 user nova-compute[75066]: DEBUG nova.compute.manager [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 479bf6d9-ffec-4417-99c5-3af0dafc0881] Instance event wait completed in 0 seconds for  {{(pid=75066) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 19:32:03 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 479bf6d9-ffec-4417-99c5-3af0dafc0881] Guest created on hypervisor {{(pid=75066) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 19:32:03 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 479bf6d9-ffec-4417-99c5-3af0dafc0881] Instance spawned successfully.
Dec 01 19:32:03 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 479bf6d9-ffec-4417-99c5-3af0dafc0881] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 19:32:03 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 479bf6d9-ffec-4417-99c5-3af0dafc0881] Found default for hw_cdrom_bus of ide {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:32:03 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 479bf6d9-ffec-4417-99c5-3af0dafc0881] Found default for hw_disk_bus of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:32:03 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 479bf6d9-ffec-4417-99c5-3af0dafc0881] Found default for hw_input_bus of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:32:03 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 479bf6d9-ffec-4417-99c5-3af0dafc0881] Found default for hw_pointer_model of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:32:03 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 479bf6d9-ffec-4417-99c5-3af0dafc0881] Found default for hw_video_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:32:03 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 479bf6d9-ffec-4417-99c5-3af0dafc0881] Found default for hw_vif_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:32:03 user nova-compute[75066]: INFO nova.compute.manager [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 479bf6d9-ffec-4417-99c5-3af0dafc0881] Took 7.04 seconds to spawn the instance on the hypervisor.
Dec 01 19:32:03 user nova-compute[75066]: DEBUG nova.compute.manager [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 479bf6d9-ffec-4417-99c5-3af0dafc0881] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:32:03 user nova-compute[75066]: INFO nova.compute.manager [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 479bf6d9-ffec-4417-99c5-3af0dafc0881] Took 7.93 seconds to build instance.
Dec 01 19:32:03 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-70d542cd-bfde-40ed-b910-ff6bd050f25a tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Lock "479bf6d9-ffec-4417-99c5-3af0dafc0881" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.074s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:32:04 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:32:04 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:32:04 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:32:04 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:32:04 user nova-compute[75066]: DEBUG nova.compute.manager [req-a70e8068-1786-4ae7-87eb-adabc8db3f30 req-b0ec3999-60b1-47aa-a369-ee5360460a4c service nova] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Received event network-vif-plugged-bbc4649f-c295-423e-a1c2-be3af706e4de {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:32:04 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a70e8068-1786-4ae7-87eb-adabc8db3f30 req-b0ec3999-60b1-47aa-a369-ee5360460a4c service nova] Acquiring lock "f04249c5-0196-455c-ac7a-f1ff8be320d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:32:04 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a70e8068-1786-4ae7-87eb-adabc8db3f30 req-b0ec3999-60b1-47aa-a369-ee5360460a4c service nova] Lock "f04249c5-0196-455c-ac7a-f1ff8be320d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:32:04 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a70e8068-1786-4ae7-87eb-adabc8db3f30 req-b0ec3999-60b1-47aa-a369-ee5360460a4c service nova] Lock "f04249c5-0196-455c-ac7a-f1ff8be320d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:32:04 user nova-compute[75066]: DEBUG nova.compute.manager [req-a70e8068-1786-4ae7-87eb-adabc8db3f30 req-b0ec3999-60b1-47aa-a369-ee5360460a4c service nova] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] No waiting events found dispatching network-vif-plugged-bbc4649f-c295-423e-a1c2-be3af706e4de {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:32:04 user nova-compute[75066]: WARNING nova.compute.manager [req-a70e8068-1786-4ae7-87eb-adabc8db3f30 req-b0ec3999-60b1-47aa-a369-ee5360460a4c service nova] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Received unexpected event network-vif-plugged-bbc4649f-c295-423e-a1c2-be3af706e4de for instance with vm_state active and task_state rescuing.
Dec 01 19:32:04 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:32:04 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b94ed219-14ab-43f5-8015-10760b43e926 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Acquiring lock "f7cc644b-006c-4453-aea2-abe35cfd5ba3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:32:04 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b94ed219-14ab-43f5-8015-10760b43e926 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "f7cc644b-006c-4453-aea2-abe35cfd5ba3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:32:04 user nova-compute[75066]: DEBUG nova.objects.instance [None req-b94ed219-14ab-43f5-8015-10760b43e926 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lazy-loading 'flavor' on Instance uuid f7cc644b-006c-4453-aea2-abe35cfd5ba3 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:32:04 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b94ed219-14ab-43f5-8015-10760b43e926 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "f7cc644b-006c-4453-aea2-abe35cfd5ba3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.202s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:32:04 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b94ed219-14ab-43f5-8015-10760b43e926 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Acquiring lock "f7cc644b-006c-4453-aea2-abe35cfd5ba3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:32:04 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b94ed219-14ab-43f5-8015-10760b43e926 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "f7cc644b-006c-4453-aea2-abe35cfd5ba3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:32:04 user nova-compute[75066]: INFO nova.compute.manager [None req-b94ed219-14ab-43f5-8015-10760b43e926 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Attaching volume 0898e25d-8549-401f-ab22-17b3d142f711 to /dev/vdb
Dec 01 19:32:04 user nova-compute[75066]: DEBUG os_brick.utils [None req-b94ed219-14ab-43f5-8015-10760b43e926 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:32:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:04 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3a85ab-d1e2-42d5-a9be-7a3d7d7db9e5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1959854982f\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:32:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.046s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[890be53a-8369-4c1b-9029-c320c41414cc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[c962d22f-9335-4edd-88a6-8ac8763437a9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc585334-d91c-4646-93b8-457669e530d3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-b94ed219-14ab-43f5-8015-10760b43e926 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Running cmd (subprocess): nvme version {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-b94ed219-14ab-43f5-8015-10760b43e926 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] 'nvme version' failed. Not Retrying. {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b94ed219-14ab-43f5-8015-10760b43e926 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] nvme not present on system {{(pid=75066) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:32:05 user nova-compute[75066]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 19:32:05 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[dffc3cdb-3531-4265-b87e-afd665d97ac4]: (4, '') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-b94ed219-14ab-43f5-8015-10760b43e926 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75066) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-b94ed219-14ab-43f5-8015-10760b43e926 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-b94ed219-14ab-43f5-8015-10760b43e926 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] LIGHTOS: no hostnqn found. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG os_brick.utils [None req-b94ed219-14ab-43f5-8015-10760b43e926 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] <== get_connector_properties: return (186ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1959854982f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG nova.virt.block_device [None req-b94ed219-14ab-43f5-8015-10760b43e926 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Updating existing volume attachment record: e4e01f7d-ef03-45af-bc10-ef0baf3fe5ba {{(pid=75066) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Triggering sync for uuid c223be70-8b9c-46d4-9b5a-3b83dfc05a17 {{(pid=75066) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Triggering sync for uuid 90c49be6-97aa-45f1-bcbe-b9a3875226a7 {{(pid=75066) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Triggering sync for uuid d564b128-598b-4ad4-8618-afa4dc8a7347 {{(pid=75066) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Triggering sync for uuid 14de9d20-9e66-4517-b904-2967e0a06a97 {{(pid=75066) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Triggering sync for uuid 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436 {{(pid=75066) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Triggering sync for uuid 00506483-8f09-4a3d-938a-31ab1b2dbf83 {{(pid=75066) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Triggering sync for uuid 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298 {{(pid=75066) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Triggering sync for uuid b2c6c900-5d1b-44f8-8435-d9ad88b3a412 {{(pid=75066) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Triggering sync for uuid e9a9bf17-1c03-426a-b33e-9d8c458df283 {{(pid=75066) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Triggering sync for uuid 88850ea1-43cd-4066-8e6f-cfe5de621bc6 {{(pid=75066) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Triggering sync for uuid f04249c5-0196-455c-ac7a-f1ff8be320d4 {{(pid=75066) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Triggering sync for uuid f7cc644b-006c-4453-aea2-abe35cfd5ba3 {{(pid=75066) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Triggering sync for uuid 479bf6d9-ffec-4417-99c5-3af0dafc0881 {{(pid=75066) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "c223be70-8b9c-46d4-9b5a-3b83dfc05a17" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "c223be70-8b9c-46d4-9b5a-3b83dfc05a17" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "90c49be6-97aa-45f1-bcbe-b9a3875226a7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "90c49be6-97aa-45f1-bcbe-b9a3875226a7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "d564b128-598b-4ad4-8618-afa4dc8a7347" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "d564b128-598b-4ad4-8618-afa4dc8a7347" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "14de9d20-9e66-4517-b904-2967e0a06a97" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "14de9d20-9e66-4517-b904-2967e0a06a97" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "00506483-8f09-4a3d-938a-31ab1b2dbf83" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "00506483-8f09-4a3d-938a-31ab1b2dbf83" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "b2c6c900-5d1b-44f8-8435-d9ad88b3a412" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "b2c6c900-5d1b-44f8-8435-d9ad88b3a412" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "e9a9bf17-1c03-426a-b33e-9d8c458df283" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "e9a9bf17-1c03-426a-b33e-9d8c458df283" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "88850ea1-43cd-4066-8e6f-cfe5de621bc6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "88850ea1-43cd-4066-8e6f-cfe5de621bc6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "f04249c5-0196-455c-ac7a-f1ff8be320d4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "f04249c5-0196-455c-ac7a-f1ff8be320d4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:32:05 user nova-compute[75066]: INFO nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] During sync_power_state the instance has a pending task (rescuing). Skip.
Dec 01 19:32:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "f04249c5-0196-455c-ac7a-f1ff8be320d4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "f7cc644b-006c-4453-aea2-abe35cfd5ba3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "479bf6d9-ffec-4417-99c5-3af0dafc0881" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "479bf6d9-ffec-4417-99c5-3af0dafc0881" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "c223be70-8b9c-46d4-9b5a-3b83dfc05a17" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "90c49be6-97aa-45f1-bcbe-b9a3875226a7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "14de9d20-9e66-4517-b904-2967e0a06a97" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.057s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "d564b128-598b-4ad4-8618-afa4dc8a7347" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "00506483-8f09-4a3d-938a-31ab1b2dbf83" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.087s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.091s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "e9a9bf17-1c03-426a-b33e-9d8c458df283" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.108s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "b2c6c900-5d1b-44f8-8435-d9ad88b3a412" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.109s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "88850ea1-43cd-4066-8e6f-cfe5de621bc6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.108s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:32:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "479bf6d9-ffec-4417-99c5-3af0dafc0881" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.120s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:32:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-1adea349-59c3-4051-8849-bc5b465ecc75 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Acquiring lock "e9a9bf17-1c03-426a-b33e-9d8c458df283" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:32:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-1adea349-59c3-4051-8849-bc5b465ecc75 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Lock "e9a9bf17-1c03-426a-b33e-9d8c458df283" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:32:06 user nova-compute[75066]: DEBUG nova.objects.instance [None req-1adea349-59c3-4051-8849-bc5b465ecc75 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Lazy-loading 'flavor' on Instance uuid e9a9bf17-1c03-426a-b33e-9d8c458df283 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:32:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-1adea349-59c3-4051-8849-bc5b465ecc75 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Lock "e9a9bf17-1c03-426a-b33e-9d8c458df283" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:32:06 user nova-compute[75066]: DEBUG nova.compute.manager [req-309f53bb-b52a-490c-9026-f5ae937772ed req-04107e87-a1bf-41e7-888a-dca2d9b73f94 service nova] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Received event network-vif-plugged-bbc4649f-c295-423e-a1c2-be3af706e4de {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:32:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-309f53bb-b52a-490c-9026-f5ae937772ed req-04107e87-a1bf-41e7-888a-dca2d9b73f94 service nova] Acquiring lock "f04249c5-0196-455c-ac7a-f1ff8be320d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:32:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-309f53bb-b52a-490c-9026-f5ae937772ed req-04107e87-a1bf-41e7-888a-dca2d9b73f94 service nova] Lock "f04249c5-0196-455c-ac7a-f1ff8be320d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:32:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-309f53bb-b52a-490c-9026-f5ae937772ed req-04107e87-a1bf-41e7-888a-dca2d9b73f94 service nova] Lock "f04249c5-0196-455c-ac7a-f1ff8be320d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:32:06 user nova-compute[75066]: DEBUG nova.compute.manager [req-309f53bb-b52a-490c-9026-f5ae937772ed req-04107e87-a1bf-41e7-888a-dca2d9b73f94 service nova] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] No waiting events found dispatching network-vif-plugged-bbc4649f-c295-423e-a1c2-be3af706e4de {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:32:06 user nova-compute[75066]: WARNING nova.compute.manager [req-309f53bb-b52a-490c-9026-f5ae937772ed req-04107e87-a1bf-41e7-888a-dca2d9b73f94 service nova] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Received unexpected event network-vif-plugged-bbc4649f-c295-423e-a1c2-be3af706e4de for instance with vm_state active and task_state rescuing.
Dec 01 19:32:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-1adea349-59c3-4051-8849-bc5b465ecc75 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Acquiring lock "e9a9bf17-1c03-426a-b33e-9d8c458df283" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:32:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-1adea349-59c3-4051-8849-bc5b465ecc75 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Lock "e9a9bf17-1c03-426a-b33e-9d8c458df283" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:32:06 user nova-compute[75066]: INFO nova.compute.manager [None req-1adea349-59c3-4051-8849-bc5b465ecc75 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Attaching volume b52f6b8f-3f77-4dab-b058-0ebb865007b3 to /dev/vdc
Dec 01 19:32:06 user nova-compute[75066]: DEBUG os_brick.utils [None req-1adea349-59c3-4051-8849-bc5b465ecc75 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:32:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:06 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a4e2a1-fdc4-48d9-b5c4-18bc49d3eb53]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1959854982f\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:32:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:06 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[13327759-c496-4c87-a9bf-020847077e7a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:32:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:06 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1aa046b-c340-464a-8c5e-b69c6902898b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:32:06 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[a056405b-2fc1-4c1c-a7e4-f434713203e7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:32:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-1adea349-59c3-4051-8849-bc5b465ecc75 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Running cmd (subprocess): nvme version {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-1adea349-59c3-4051-8849-bc5b465ecc75 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] 'nvme version' failed. Not Retrying. {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:32:06 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1adea349-59c3-4051-8849-bc5b465ecc75 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] nvme not present on system {{(pid=75066) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 19:32:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:32:06 user nova-compute[75066]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 19:32:06 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[09852e10-d38f-41e3-a1c5-b8c20c8c0f65]: (4, '') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:32:06 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-1adea349-59c3-4051-8849-bc5b465ecc75 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75066) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 19:32:06 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-1adea349-59c3-4051-8849-bc5b465ecc75 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 19:32:06 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-1adea349-59c3-4051-8849-bc5b465ecc75 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] LIGHTOS: no hostnqn found. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 19:32:06 user nova-compute[75066]: DEBUG os_brick.utils [None req-1adea349-59c3-4051-8849-bc5b465ecc75 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1959854982f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:32:06 user nova-compute[75066]: DEBUG nova.virt.block_device [None req-1adea349-59c3-4051-8849-bc5b465ecc75 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Updating existing volume attachment record: 4d2c5935-d4c1-4897-9a75-2b8a534582aa {{(pid=75066) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 19:32:07 user nova-compute[75066]: DEBUG nova.compute.manager [None req-78ff2ba3-b504-45fb-9a63-fabbdd6865f4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:32:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:32:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:32:09 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:32:11 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:32:11 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:32:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:32:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:32:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:32:11 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75066) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 19:32:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88850ea1-43cd-4066-8e6f-cfe5de621bc6/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88850ea1-43cd-4066-8e6f-cfe5de621bc6/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88850ea1-43cd-4066-8e6f-cfe5de621bc6/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88850ea1-43cd-4066-8e6f-cfe5de621bc6/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:12 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:32:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/479bf6d9-ffec-4417-99c5-3af0dafc0881/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/479bf6d9-ffec-4417-99c5-3af0dafc0881/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/479bf6d9-ffec-4417-99c5-3af0dafc0881/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/479bf6d9-ffec-4417-99c5-3af0dafc0881/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7cc644b-006c-4453-aea2-abe35cfd5ba3/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:32:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:32:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7cc644b-006c-4453-aea2-abe35cfd5ba3/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7cc644b-006c-4453-aea2-abe35cfd5ba3/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7cc644b-006c-4453-aea2-abe35cfd5ba3/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk.rescue --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk.rescue --force-share --output=json" returned: 0 in 0.269s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk.rescue --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Acquiring lock "409478f4-7921-4a15-89b0-82c26fa39de7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:32:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "409478f4-7921-4a15-89b0-82c26fa39de7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:32:14 user nova-compute[75066]: DEBUG nova.compute.manager [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Starting instance... {{(pid=75066) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 19:32:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:32:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:32:14 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75066) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 19:32:14 user nova-compute[75066]: INFO nova.compute.claims [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Claim successful on node user
Dec 01 19:32:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:15 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:32:15 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:32:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9a9bf17-1c03-426a-b33e-9d8c458df283/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.774s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:32:15 user nova-compute[75066]: DEBUG nova.compute.manager [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Start building networks asynchronously for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 19:32:15 user nova-compute[75066]: DEBUG nova.compute.manager [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Allocating IP information in the background. {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 19:32:15 user nova-compute[75066]: DEBUG nova.network.neutron [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] allocate_for_instance() {{(pid=75066) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 19:32:15 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 19:32:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9a9bf17-1c03-426a-b33e-9d8c458df283/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9a9bf17-1c03-426a-b33e-9d8c458df283/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:15 user nova-compute[75066]: DEBUG nova.compute.manager [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Start building block device mappings for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 19:32:15 user nova-compute[75066]: DEBUG nova.policy [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '90e207044c0741e99c4a83b2c4746cd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '879678dca7054c178839f56e66a6e0ce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75066) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 19:32:15 user nova-compute[75066]: DEBUG nova.compute.manager [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Start spawning the instance on the hypervisor. {{(pid=75066) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 19:32:15 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Creating instance directory {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 19:32:15 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Creating image(s)
Dec 01 19:32:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Acquiring lock "/opt/stack/data/nova/instances/409478f4-7921-4a15-89b0-82c26fa39de7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:32:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "/opt/stack/data/nova/instances/409478f4-7921-4a15-89b0-82c26fa39de7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:32:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "/opt/stack/data/nova/instances/409478f4-7921-4a15-89b0-82c26fa39de7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:32:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9a9bf17-1c03-426a-b33e-9d8c458df283/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:15 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:32:15 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:32:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6c900-5d1b-44f8-8435-d9ad88b3a412/disk.rescue --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.188s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:16 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Acquiring lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:32:16 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:32:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6c900-5d1b-44f8-8435-d9ad88b3a412/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6c900-5d1b-44f8-8435-d9ad88b3a412/disk.rescue --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.173s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/409478f4-7921-4a15-89b0-82c26fa39de7/disk 1073741824 {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/409478f4-7921-4a15-89b0-82c26fa39de7/disk 1073741824" returned: 0 in 0.072s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:16 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:32:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:16 user nova-compute[75066]: DEBUG nova.network.neutron [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Successfully created port: 6d709e03-0f37-43f6-ab89-61e12ae93b48 {{(pid=75066) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 19:32:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6c900-5d1b-44f8-8435-d9ad88b3a412/disk.rescue --force-share --output=json" returned: 0 in 0.245s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:16 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /opt/stack/data/nova/instances/b2c6c900-5d1b-44f8-8435-d9ad88b3a412/disk (vdb) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:32:16 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:32:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f04249c5-0196-455c-ac7a-f1ff8be320d4/disk.rescue --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.175s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:16 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Checking if we can resize image /opt/stack/data/nova/instances/409478f4-7921-4a15-89b0-82c26fa39de7/disk. size=1073741824 {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 19:32:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/409478f4-7921-4a15-89b0-82c26fa39de7/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f04249c5-0196-455c-ac7a-f1ff8be320d4/disk.rescue --force-share --output=json" returned: 0 in 0.271s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f04249c5-0196-455c-ac7a-f1ff8be320d4/disk.rescue --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/409478f4-7921-4a15-89b0-82c26fa39de7/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:16 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Cannot resize image /opt/stack/data/nova/instances/409478f4-7921-4a15-89b0-82c26fa39de7/disk to a smaller size. {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 19:32:16 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Created local disks {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 19:32:16 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Ensure instance console log exists: /opt/stack/data/nova/instances/409478f4-7921-4a15-89b0-82c26fa39de7/console.log {{(pid=75066) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 19:32:16 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:32:16 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:32:16 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:32:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f04249c5-0196-455c-ac7a-f1ff8be320d4/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:17 user nova-compute[75066]: DEBUG nova.network.neutron [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Successfully updated port: 6d709e03-0f37-43f6-ab89-61e12ae93b48 {{(pid=75066) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 19:32:17 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:32:17 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:32:17 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Hypervisor/Node resource view: name=user free_ram=7533MB free_disk=24.601165771484375GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75066) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 19:32:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:32:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:32:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Acquiring lock "refresh_cache-409478f4-7921-4a15-89b0-82c26fa39de7" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:32:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Acquired lock "refresh_cache-409478f4-7921-4a15-89b0-82c26fa39de7" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:32:17 user nova-compute[75066]: DEBUG nova.network.neutron [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:32:17 user nova-compute[75066]: DEBUG nova.compute.manager [req-a99957f7-58fe-4acf-8b2f-0bce33117f2d req-1473543d-2aa6-4eae-8e4a-e751a2da09e6 service nova] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Received event network-changed-6d709e03-0f37-43f6-ab89-61e12ae93b48 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:32:17 user nova-compute[75066]: DEBUG nova.compute.manager [req-a99957f7-58fe-4acf-8b2f-0bce33117f2d req-1473543d-2aa6-4eae-8e4a-e751a2da09e6 service nova] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Refreshing instance network info cache due to event network-changed-6d709e03-0f37-43f6-ab89-61e12ae93b48. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:32:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a99957f7-58fe-4acf-8b2f-0bce33117f2d req-1473543d-2aa6-4eae-8e4a-e751a2da09e6 service nova] Acquiring lock "refresh_cache-409478f4-7921-4a15-89b0-82c26fa39de7" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:32:17 user nova-compute[75066]: DEBUG nova.network.neutron [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:32:17 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance c223be70-8b9c-46d4-9b5a-3b83dfc05a17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:32:17 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 90c49be6-97aa-45f1-bcbe-b9a3875226a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:32:17 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance d564b128-598b-4ad4-8618-afa4dc8a7347 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:32:17 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 14de9d20-9e66-4517-b904-2967e0a06a97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:32:17 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:32:17 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:32:17 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance b2c6c900-5d1b-44f8-8435-d9ad88b3a412 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:32:17 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 00506483-8f09-4a3d-938a-31ab1b2dbf83 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:32:17 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance e9a9bf17-1c03-426a-b33e-9d8c458df283 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:32:17 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 88850ea1-43cd-4066-8e6f-cfe5de621bc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:32:17 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance f04249c5-0196-455c-ac7a-f1ff8be320d4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:32:17 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance f7cc644b-006c-4453-aea2-abe35cfd5ba3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:32:17 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 479bf6d9-ffec-4417-99c5-3af0dafc0881 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:32:17 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 409478f4-7921-4a15-89b0-82c26fa39de7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:32:17 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 19:32:17 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG nova.network.neutron [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Updating instance_info_cache with network_info: [{"id": "6d709e03-0f37-43f6-ab89-61e12ae93b48", "address": "fa:16:3e:39:17:c8", "network": {"id": "49dd72ae-ec07-46a6-8463-e38bdfe1eba0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-738739404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879678dca7054c178839f56e66a6e0ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d709e03-0f", "ovs_interfaceid": "6d709e03-0f37-43f6-ab89-61e12ae93b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Releasing lock "refresh_cache-409478f4-7921-4a15-89b0-82c26fa39de7" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG nova.compute.manager [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Instance network_info: |[{"id": "6d709e03-0f37-43f6-ab89-61e12ae93b48", "address": "fa:16:3e:39:17:c8", "network": {"id": "49dd72ae-ec07-46a6-8463-e38bdfe1eba0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-738739404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879678dca7054c178839f56e66a6e0ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d709e03-0f", "ovs_interfaceid": "6d709e03-0f37-43f6-ab89-61e12ae93b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a99957f7-58fe-4acf-8b2f-0bce33117f2d req-1473543d-2aa6-4eae-8e4a-e751a2da09e6 service nova] Acquired lock "refresh_cache-409478f4-7921-4a15-89b0-82c26fa39de7" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG nova.network.neutron [req-a99957f7-58fe-4acf-8b2f-0bce33117f2d req-1473543d-2aa6-4eae-8e4a-e751a2da09e6 service nova] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Refreshing network info cache for port 6d709e03-0f37-43f6-ab89-61e12ae93b48 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Start _get_guest_xml network_info=[{"id": "6d709e03-0f37-43f6-ab89-61e12ae93b48", "address": "fa:16:3e:39:17:c8", "network": {"id": "49dd72ae-ec07-46a6-8463-e38bdfe1eba0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-738739404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879678dca7054c178839f56e66a6e0ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d709e03-0f", "ovs_interfaceid": "6d709e03-0f37-43f6-ab89-61e12ae93b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'image_id': '900b237b-e99c-4fdd-a44f-dcb7a08baa86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:32:18 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:32:18 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:32:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b94ed219-14ab-43f5-8015-10760b43e926 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Calling os-brick to attach iSCSI Volume {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94ed219-14ab-43f5-8015-10760b43e926 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HCUlAhzO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:32:18 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-b94ed219-14ab-43f5-8015-10760b43e926 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:32:18 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-b94ed219-14ab-43f5-8015-10760b43e926 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-b94ed219-14ab-43f5-8015-10760b43e926 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:32:18 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-b94ed219-14ab-43f5-8015-10760b43e926 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:32:18 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-b94ed219-14ab-43f5-8015-10760b43e926 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-b94ed219-14ab-43f5-8015-10760b43e926 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:32:18 user nova-compute[75066]: INFO os_brick.initiator.connectors.iscsi [None req-b94ed219-14ab-43f5-8015-10760b43e926 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 19:32:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711 -p 172.16.0.220:3260 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:32:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1093900305',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1093900305',id=37,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgqDSADCKIleBb+Rg1GEKVJGSrQo6Qd+GU89QRtb0lxLByFIoFjjq1Yx9XawcMp2fp+Dic5G4y8aiEZFbJzFY905Tc5W+gwtIgnquQavTd1u+xCi3/ZclYfjcIcKZPxRw==',key_name='tempest-keypair-1679278784',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='879678dca7054c178839f56e66a6e0ce',ramdisk_id='',reservation_id='r-1sjmbvuo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1680443764',owner_user_name='tempest-AttachVolumeShelveTestJSON-1680443764-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:32:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90e207044c0741e99c4a83b2c4746cd3',uuid=409478f4-7921-4a15-89b0-82c26fa39de7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d709e03-0f37-43f6-ab89-61e12ae93b48", "address": "fa:16:3e:39:17:c8", "network": {"id": "49dd72ae-ec07-46a6-8463-e38bdfe1eba0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-738739404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879678dca7054c178839f56e66a6e0ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d709e03-0f", "ovs_interfaceid": "6d709e03-0f37-43f6-ab89-61e12ae93b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Converting VIF {"id": "6d709e03-0f37-43f6-ab89-61e12ae93b48", "address": "fa:16:3e:39:17:c8", "network": {"id": "49dd72ae-ec07-46a6-8463-e38bdfe1eba0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-738739404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879678dca7054c178839f56e66a6e0ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d709e03-0f", "ovs_interfaceid": "6d709e03-0f37-43f6-ab89-61e12ae93b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:17:c8,bridge_name='br-int',has_traffic_filtering=True,id=6d709e03-0f37-43f6-ab89-61e12ae93b48,network=Network(49dd72ae-ec07-46a6-8463-e38bdfe1eba0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d709e03-0f') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG nova.objects.instance [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lazy-loading 'pci_devices' on Instance uuid 409478f4-7921-4a15-89b0-82c26fa39de7 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff400000-1082-417b-9399-bb2975f1d77a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94ed219-14ab-43f5-8015-10760b43e926 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 19:32:18 user nova-compute[75066]:  {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1adea349-59c3-4051-8849-bc5b465ecc75 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Calling os-brick to attach iSCSI Volume {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1adea349-59c3-4051-8849-bc5b465ecc75 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b52f6b8f-3f77-4dab-b058-0ebb865007b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tHifJjhT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:32:18 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-1adea349-59c3-4051-8849-bc5b465ecc75 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:32:18 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-1adea349-59c3-4051-8849-bc5b465ecc75 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711 -p 172.16.0.220:3260 --interface default --op new {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:32:18 user nova-compute[75066]:   <uuid>409478f4-7921-4a15-89b0-82c26fa39de7</uuid>
Dec 01 19:32:18 user nova-compute[75066]:   <name>instance-00000025</name>
Dec 01 19:32:18 user nova-compute[75066]:   <memory>524288</memory>
Dec 01 19:32:18 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:32:18 user nova-compute[75066]:   <metadata>
Dec 01 19:32:18 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:32:18 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:32:18 user nova-compute[75066]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1093900305</nova:name>
Dec 01 19:32:18 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:32:18</nova:creationTime>
Dec 01 19:32:18 user nova-compute[75066]:       <nova:flavor name="m1.tiny">
Dec 01 19:32:18 user nova-compute[75066]:         <nova:memory>512</nova:memory>
Dec 01 19:32:18 user nova-compute[75066]:         <nova:disk>1</nova:disk>
Dec 01 19:32:18 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:32:18 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:32:18 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:32:18 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:32:18 user nova-compute[75066]:       <nova:owner>
Dec 01 19:32:18 user nova-compute[75066]:         <nova:user uuid="90e207044c0741e99c4a83b2c4746cd3">tempest-AttachVolumeShelveTestJSON-1680443764-project-member</nova:user>
Dec 01 19:32:18 user nova-compute[75066]:         <nova:project uuid="879678dca7054c178839f56e66a6e0ce">tempest-AttachVolumeShelveTestJSON-1680443764</nova:project>
Dec 01 19:32:18 user nova-compute[75066]:       </nova:owner>
Dec 01 19:32:18 user nova-compute[75066]:       <nova:root type="image" uuid="900b237b-e99c-4fdd-a44f-dcb7a08baa86"/>
Dec 01 19:32:18 user nova-compute[75066]:       <nova:ports>
Dec 01 19:32:18 user nova-compute[75066]:         <nova:port uuid="6d709e03-0f37-43f6-ab89-61e12ae93b48">
Dec 01 19:32:18 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 01 19:32:18 user nova-compute[75066]:         </nova:port>
Dec 01 19:32:18 user nova-compute[75066]:       </nova:ports>
Dec 01 19:32:18 user nova-compute[75066]:     </nova:instance>
Dec 01 19:32:18 user nova-compute[75066]:   </metadata>
Dec 01 19:32:18 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:32:18 user nova-compute[75066]:     <system>
Dec 01 19:32:18 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:32:18 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:32:18 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:32:18 user nova-compute[75066]:       <entry name="serial">409478f4-7921-4a15-89b0-82c26fa39de7</entry>
Dec 01 19:32:18 user nova-compute[75066]:       <entry name="uuid">409478f4-7921-4a15-89b0-82c26fa39de7</entry>
Dec 01 19:32:18 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:32:18 user nova-compute[75066]:     </system>
Dec 01 19:32:18 user nova-compute[75066]:   </sysinfo>
Dec 01 19:32:18 user nova-compute[75066]:   <os>
Dec 01 19:32:18 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:32:18 user nova-compute[75066]:     <boot dev="hd"/>
Dec 01 19:32:18 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:32:18 user nova-compute[75066]:   </os>
Dec 01 19:32:18 user nova-compute[75066]:   <features>
Dec 01 19:32:18 user nova-compute[75066]:     <acpi/>
Dec 01 19:32:18 user nova-compute[75066]:     <apic/>
Dec 01 19:32:18 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:32:18 user nova-compute[75066]:   </features>
Dec 01 19:32:18 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:32:18 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:32:18 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:32:18 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:32:18 user nova-compute[75066]:   </clock>
Dec 01 19:32:18 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:32:18 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:32:18 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:32:18 user nova-compute[75066]:   </cpu>
Dec 01 19:32:18 user nova-compute[75066]:   <devices>
Dec 01 19:32:18 user nova-compute[75066]:     <disk type="file" device="disk">
Dec 01 19:32:18 user nova-compute[75066]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 19:32:18 user nova-compute[75066]:       <source file="/opt/stack/data/nova/instances/409478f4-7921-4a15-89b0-82c26fa39de7/disk"/>
Dec 01 19:32:18 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:32:18 user nova-compute[75066]:     </disk>
Dec 01 19:32:18 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:32:18 user nova-compute[75066]:       <mac address="fa:16:3e:39:17:c8"/>
Dec 01 19:32:18 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:32:18 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:32:18 user nova-compute[75066]:       <target dev="tap6d709e03-0f"/>
Dec 01 19:32:18 user nova-compute[75066]:     </interface>
Dec 01 19:32:18 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:32:18 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/409478f4-7921-4a15-89b0-82c26fa39de7/console.log" append="off"/>
Dec 01 19:32:18 user nova-compute[75066]:     </serial>
Dec 01 19:32:18 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:32:18 user nova-compute[75066]:     <video>
Dec 01 19:32:18 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:32:18 user nova-compute[75066]:     </video>
Dec 01 19:32:18 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:32:18 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:32:18 user nova-compute[75066]:     </rng>
Dec 01 19:32:18 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:32:18 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:32:18 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:32:18 user nova-compute[75066]:     </memballoon>
Dec 01 19:32:18 user nova-compute[75066]:   </devices>
Dec 01 19:32:18 user nova-compute[75066]: </domain>
Dec 01 19:32:18 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:32:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1093900305',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1093900305',id=37,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgqDSADCKIleBb+Rg1GEKVJGSrQo6Qd+GU89QRtb0lxLByFIoFjjq1Yx9XawcMp2fp+Dic5G4y8aiEZFbJzFY905Tc5W+gwtIgnquQavTd1u+xCi3/ZclYfjcIcKZPxRw==',key_name='tempest-keypair-1679278784',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='879678dca7054c178839f56e66a6e0ce',ramdisk_id='',reservation_id='r-1sjmbvuo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1680443764',owner_user_name='tempest-AttachVolumeShelveTestJSON-1680443764-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:32:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90e207044c0741e99c4a83b2c4746cd3',uuid=409478f4-7921-4a15-89b0-82c26fa39de7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d709e03-0f37-43f6-ab89-61e12ae93b48", "address": "fa:16:3e:39:17:c8", "network": {"id": "49dd72ae-ec07-46a6-8463-e38bdfe1eba0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-738739404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879678dca7054c178839f56e66a6e0ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d709e03-0f", "ovs_interfaceid": "6d709e03-0f37-43f6-ab89-61e12ae93b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Converting VIF {"id": "6d709e03-0f37-43f6-ab89-61e12ae93b48", "address": "fa:16:3e:39:17:c8", "network": {"id": "49dd72ae-ec07-46a6-8463-e38bdfe1eba0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-738739404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879678dca7054c178839f56e66a6e0ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d709e03-0f", "ovs_interfaceid": "6d709e03-0f37-43f6-ab89-61e12ae93b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:17:c8,bridge_name='br-int',has_traffic_filtering=True,id=6d709e03-0f37-43f6-ab89-61e12ae93b48,network=Network(49dd72ae-ec07-46a6-8463-e38bdfe1eba0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d709e03-0f') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG os_vif [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:17:c8,bridge_name='br-int',has_traffic_filtering=True,id=6d709e03-0f37-43f6-ab89-61e12ae93b48,network=Network(49dd72ae-ec07-46a6-8463-e38bdfe1eba0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d709e03-0f') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0457aee9-7d9f-571b-86e3-474b41a4d1df', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ad623c-1e42-4470-9a4a-659e23473df2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711] added\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94ed219-14ab-43f5-8015-10760b43e926 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711] added
Dec 01 19:32:18 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e96ff5d-605c-468f-9a3c-a9d5b6e4196f]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94ed219-14ab-43f5-8015-10760b43e926 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6d709e03-0f, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6d709e03-0f, col_values=(('qos', UUID('66d3ae89-4ecb-461c-9df0-3d659a4ef650')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6d709e03-0f, col_values=(('external_ids', {'iface-id': '6d709e03-0f37-43f6-ab89-61e12ae93b48', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:17:c8', 'vm-uuid': '409478f4-7921-4a15-89b0-82c26fa39de7'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:32:18 user nova-compute[75066]: INFO os_vif [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:17:c8,bridge_name='br-int',has_traffic_filtering=True,id=6d709e03-0f37-43f6-ab89-61e12ae93b48,network=Network(49dd72ae-ec07-46a6-8463-e38bdfe1eba0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d709e03-0f')
Dec 01 19:32:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.109s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e98c605-f4d6-4828-b6ae-6f78f818dd53]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94ed219-14ab-43f5-8015-10760b43e926 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HCUlAhzO {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HCUlAhzO" returned: 0 in 0.023s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a7349b-0df5-450a-918c-8514a9c41750]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94ed219-14ab-43f5-8015-10760b43e926 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HCUlAhzO'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] No VIF found with MAC fa:16:3e:39:17:c8, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9fb90c-8800-4765-8503-a0728c653549]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94ed219-14ab-43f5-8015-10760b43e926 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6aced1-9e23-4e68-8fa7-9c53f3a49c7e]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94ed219-14ab-43f5-8015-10760b43e926 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:32:18 user nova-compute[75066]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)
Dec 01 19:32:18 user nova-compute[75066]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 (non-flash)
Dec 01 19:32:18 user nova-compute[75066]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 (non-flash)
Dec 01 19:32:18 user nova-compute[75066]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236 (non-flash)
Dec 01 19:32:18 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94ed219-14ab-43f5-8015-10760b43e926 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:32:18 user nova-compute[75066]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)
Dec 01 19:32:18 user nova-compute[75066]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 (non-flash)
Dec 01 19:32:18 user nova-compute[75066]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 (non-flash)
Dec 01 19:32:18 user nova-compute[75066]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236 (non-flash)
Dec 01 19:32:18 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711 -p 172.16.0.220:3260 --login {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Compute_service record updated for user:user {{(pid=75066) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.861s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f93de5a-275a-467d-b526-0f781879ad06]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94ed219-14ab-43f5-8015-10760b43e926 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711, portal: 172.16.0.220,3260]
Dec 01 19:32:18 user nova-compute[75066]: Login to [iface: default, target: iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711, portal: 172.16.0.220,3260] successful.
Dec 01 19:32:18 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG nova.network.neutron [req-a99957f7-58fe-4acf-8b2f-0bce33117f2d req-1473543d-2aa6-4eae-8e4a-e751a2da09e6 service nova] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Updated VIF entry in instance network info cache for port 6d709e03-0f37-43f6-ab89-61e12ae93b48. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG nova.network.neutron [req-a99957f7-58fe-4acf-8b2f-0bce33117f2d req-1473543d-2aa6-4eae-8e4a-e751a2da09e6 service nova] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Updating instance_info_cache with network_info: [{"id": "6d709e03-0f37-43f6-ab89-61e12ae93b48", "address": "fa:16:3e:39:17:c8", "network": {"id": "49dd72ae-ec07-46a6-8463-e38bdfe1eba0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-738739404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879678dca7054c178839f56e66a6e0ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d709e03-0f", "ovs_interfaceid": "6d709e03-0f37-43f6-ab89-61e12ae93b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8c4ea0-3cd7-4cdb-94f4-a9ed3ef6ecc6]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94ed219-14ab-43f5-8015-10760b43e926 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a99957f7-58fe-4acf-8b2f-0bce33117f2d req-1473543d-2aa6-4eae-8e4a-e751a2da09e6 service nova] Releasing lock "refresh_cache-409478f4-7921-4a15-89b0-82c26fa39de7" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5f7c34-6f85-423e-8bec-88af0103de07]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94ed219-14ab-43f5-8015-10760b43e926 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:32:18 user nova-compute[75066]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)
Dec 01 19:32:18 user nova-compute[75066]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 (non-flash)
Dec 01 19:32:18 user nova-compute[75066]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 (non-flash)
Dec 01 19:32:18 user nova-compute[75066]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236 (non-flash)
Dec 01 19:32:18 user nova-compute[75066]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711 (non-flash)
Dec 01 19:32:18 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94ed219-14ab-43f5-8015-10760b43e926 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:32:18 user nova-compute[75066]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)
Dec 01 19:32:18 user nova-compute[75066]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 (non-flash)
Dec 01 19:32:18 user nova-compute[75066]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 (non-flash)
Dec 01 19:32:18 user nova-compute[75066]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236 (non-flash)
Dec 01 19:32:18 user nova-compute[75066]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711 (non-flash)
Dec 01 19:32:18 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-b94ed219-14ab-43f5-8015-10760b43e926 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.476s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94ed219-14ab-43f5-8015-10760b43e926 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Connected to 172.16.0.220:3260 {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-b94ed219-14ab-43f5-8015-10760b43e926 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] HCTL ('38', '-', '-', 0) found on session 43 with lun 0 {{(pid=75066) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-b94ed219-14ab-43f5-8015-10760b43e926 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75066) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.036s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2d3a79-3c3b-4296-8829-080e3406b285]: (4, ('- - 0', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-b94ed219-14ab-43f5-8015-10760b43e926 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Searching for a device in session 43 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:32:18 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94ed219-14ab-43f5-8015-10760b43e926 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HCUlAhzO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 19:32:19 user nova-compute[75066]: INFO nova.compute.manager [None req-b2d0b967-8326-44f0-b405-fe4b313463bb tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Get console output
Dec 01 19:32:19 user nova-compute[75066]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Dec 01 19:32:19 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-b94ed219-14ab-43f5-8015-10760b43e926 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.538s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:32:19 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b94ed219-14ab-43f5-8015-10760b43e926 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] <== connect_volume: return (1541ms) {'type': 'block', 'scsi_wwn': '23435386136626236', 'path': '/dev/sdg'} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:32:19 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b94ed219-14ab-43f5-8015-10760b43e926 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23435386136626236', 'path': '/dev/sdg'} {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 19:32:19 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-1adea349-59c3-4051-8849-bc5b465ecc75 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.477s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:32:19 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-1adea349-59c3-4051-8849-bc5b465ecc75 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:32:19 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-1adea349-59c3-4051-8849-bc5b465ecc75 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b52f6b8f-3f77-4dab-b058-0ebb865007b3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:32:19 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-1adea349-59c3-4051-8849-bc5b465ecc75 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b52f6b8f-3f77-4dab-b058-0ebb865007b3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:32:19 user nova-compute[75066]: INFO os_brick.initiator.connectors.iscsi [None req-1adea349-59c3-4051-8849-bc5b465ecc75 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 19:32:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b52f6b8f-3f77-4dab-b058-0ebb865007b3 -p 172.16.0.220:3260 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:19 user nova-compute[75066]: DEBUG nova.objects.instance [None req-b94ed219-14ab-43f5-8015-10760b43e926 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lazy-loading 'flavor' on Instance uuid f7cc644b-006c-4453-aea2-abe35cfd5ba3 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:32:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b52f6b8f-3f77-4dab-b058-0ebb865007b3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:19 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a857d40-a191-4a2d-815d-0f9ed60783cb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:32:19 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1adea349-59c3-4051-8849-bc5b465ecc75 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 19:32:19 user nova-compute[75066]:  {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:32:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b52f6b8f-3f77-4dab-b058-0ebb865007b3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b52f6b8f-3f77-4dab-b058-0ebb865007b3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:19 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[78257a56-54f8-49c9-b61f-527a3dd055d5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b52f6b8f-3f77-4dab-b058-0ebb865007b3] added\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:32:19 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1adea349-59c3-4051-8849-bc5b465ecc75 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b52f6b8f-3f77-4dab-b058-0ebb865007b3] added
Dec 01 19:32:19 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:32:19 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-b94ed219-14ab-43f5-8015-10760b43e926 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 19:32:19 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:32:19 user nova-compute[75066]:   <source dev="/dev/sdg"/>
Dec 01 19:32:19 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:32:19 user nova-compute[75066]:   <serial>0898e25d-8549-401f-ab22-17b3d142f711</serial>
Dec 01 19:32:19 user nova-compute[75066]: </disk>
Dec 01 19:32:19 user nova-compute[75066]:  {{(pid=75066) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 19:32:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b52f6b8f-3f77-4dab-b058-0ebb865007b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b52f6b8f-3f77-4dab-b058-0ebb865007b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:19 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[325a92cf-801f-44d5-8d16-4c5454a5a02c]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:32:19 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1adea349-59c3-4051-8849-bc5b465ecc75 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:32:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b52f6b8f-3f77-4dab-b058-0ebb865007b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:19 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:32:19 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:32:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b52f6b8f-3f77-4dab-b058-0ebb865007b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:19 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[9712d8de-ae5a-40c8-b942-5de45e449fb1]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:32:19 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1adea349-59c3-4051-8849-bc5b465ecc75 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:32:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b52f6b8f-3f77-4dab-b058-0ebb865007b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tHifJjhT {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b52f6b8f-3f77-4dab-b058-0ebb865007b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tHifJjhT" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:19 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93151f1-822a-4c9b-9bb5-028fcf06bea4]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:32:19 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1adea349-59c3-4051-8849-bc5b465ecc75 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tHifJjhT'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:32:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b52f6b8f-3f77-4dab-b058-0ebb865007b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:19 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:32:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b52f6b8f-3f77-4dab-b058-0ebb865007b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.030s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:19 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[b49f8a3e-dda5-4917-8fb6-dd7694def28c]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:32:19 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1adea349-59c3-4051-8849-bc5b465ecc75 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:32:19 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:32:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:19 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1a85e0-0b72-49a0-8b42-4c8ac574ba69]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:32:19 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1adea349-59c3-4051-8849-bc5b465ecc75 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:32:19 user nova-compute[75066]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)
Dec 01 19:32:19 user nova-compute[75066]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 (non-flash)
Dec 01 19:32:19 user nova-compute[75066]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 (non-flash)
Dec 01 19:32:19 user nova-compute[75066]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236 (non-flash)
Dec 01 19:32:19 user nova-compute[75066]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711 (non-flash)
Dec 01 19:32:19 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:32:19 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1adea349-59c3-4051-8849-bc5b465ecc75 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:32:19 user nova-compute[75066]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)
Dec 01 19:32:19 user nova-compute[75066]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 (non-flash)
Dec 01 19:32:19 user nova-compute[75066]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 (non-flash)
Dec 01 19:32:19 user nova-compute[75066]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236 (non-flash)
Dec 01 19:32:19 user nova-compute[75066]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711 (non-flash)
Dec 01 19:32:19 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:32:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b52f6b8f-3f77-4dab-b058-0ebb865007b3 -p 172.16.0.220:3260 --login {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b52f6b8f-3f77-4dab-b058-0ebb865007b3 -p 172.16.0.220:3260 --login" returned: 0 in 0.110s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:19 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[70584d7d-89a5-4385-99bc-00c1900aadfd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b52f6b8f-3f77-4dab-b058-0ebb865007b3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b52f6b8f-3f77-4dab-b058-0ebb865007b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:32:19 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1adea349-59c3-4051-8849-bc5b465ecc75 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b52f6b8f-3f77-4dab-b058-0ebb865007b3, portal: 172.16.0.220,3260]
Dec 01 19:32:19 user nova-compute[75066]: Login to [iface: default, target: iqn.2010-10.org.openstack:b52f6b8f-3f77-4dab-b058-0ebb865007b3, portal: 172.16.0.220,3260] successful.
Dec 01 19:32:19 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:32:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b52f6b8f-3f77-4dab-b058-0ebb865007b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b52f6b8f-3f77-4dab-b058-0ebb865007b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.033s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:20 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[74a8aa5b-2331-4654-be16-e1add9996717]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:32:20 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1adea349-59c3-4051-8849-bc5b465ecc75 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:32:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.056s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:20 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41acaec-6b3b-48f4-bf08-9870a9248efc]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b52f6b8f-3f77-4dab-b058-0ebb865007b3 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:32:20 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1adea349-59c3-4051-8849-bc5b465ecc75 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:32:20 user nova-compute[75066]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)
Dec 01 19:32:20 user nova-compute[75066]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 (non-flash)
Dec 01 19:32:20 user nova-compute[75066]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 (non-flash)
Dec 01 19:32:20 user nova-compute[75066]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236 (non-flash)
Dec 01 19:32:20 user nova-compute[75066]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711 (non-flash)
Dec 01 19:32:20 user nova-compute[75066]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b52f6b8f-3f77-4dab-b058-0ebb865007b3 (non-flash)
Dec 01 19:32:20 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:32:20 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1adea349-59c3-4051-8849-bc5b465ecc75 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:32:20 user nova-compute[75066]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)
Dec 01 19:32:20 user nova-compute[75066]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 (non-flash)
Dec 01 19:32:20 user nova-compute[75066]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 (non-flash)
Dec 01 19:32:20 user nova-compute[75066]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236 (non-flash)
Dec 01 19:32:20 user nova-compute[75066]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711 (non-flash)
Dec 01 19:32:20 user nova-compute[75066]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b52f6b8f-3f77-4dab-b058-0ebb865007b3 (non-flash)
Dec 01 19:32:20 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:32:20 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-1adea349-59c3-4051-8849-bc5b465ecc75 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b52f6b8f-3f77-4dab-b058-0ebb865007b3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.433s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:32:20 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1adea349-59c3-4051-8849-bc5b465ecc75 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Connected to 172.16.0.220:3260 {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 19:32:20 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-1adea349-59c3-4051-8849-bc5b465ecc75 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] HCTL ('39', '-', '-', 0) found on session 44 with lun 0 {{(pid=75066) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 19:32:20 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-1adea349-59c3-4051-8849-bc5b465ecc75 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75066) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 19:32:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.034s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:20 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[57617dec-b7f7-4ec0-8d88-6ad3d9e172c7]: (4, ('- - 0', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:32:20 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-1adea349-59c3-4051-8849-bc5b465ecc75 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Searching for a device in session 44 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:32:20 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1adea349-59c3-4051-8849-bc5b465ecc75 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:b52f6b8f-3f77-4dab-b058-0ebb865007b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tHifJjhT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 19:32:20 user nova-compute[75066]: DEBUG nova.compute.manager [req-45c92e31-3847-481e-bd18-8e290e08d74d req-532a45e9-30b0-4a0b-9d8a-b738701ce684 service nova] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Received event network-vif-plugged-6d709e03-0f37-43f6-ab89-61e12ae93b48 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:32:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-45c92e31-3847-481e-bd18-8e290e08d74d req-532a45e9-30b0-4a0b-9d8a-b738701ce684 service nova] Acquiring lock "409478f4-7921-4a15-89b0-82c26fa39de7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:32:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-45c92e31-3847-481e-bd18-8e290e08d74d req-532a45e9-30b0-4a0b-9d8a-b738701ce684 service nova] Lock "409478f4-7921-4a15-89b0-82c26fa39de7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:32:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-45c92e31-3847-481e-bd18-8e290e08d74d req-532a45e9-30b0-4a0b-9d8a-b738701ce684 service nova] Lock "409478f4-7921-4a15-89b0-82c26fa39de7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:32:20 user nova-compute[75066]: DEBUG nova.compute.manager [req-45c92e31-3847-481e-bd18-8e290e08d74d req-532a45e9-30b0-4a0b-9d8a-b738701ce684 service nova] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] No waiting events found dispatching network-vif-plugged-6d709e03-0f37-43f6-ab89-61e12ae93b48 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:32:20 user nova-compute[75066]: WARNING nova.compute.manager [req-45c92e31-3847-481e-bd18-8e290e08d74d req-532a45e9-30b0-4a0b-9d8a-b738701ce684 service nova] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Received unexpected event network-vif-plugged-6d709e03-0f37-43f6-ab89-61e12ae93b48 for instance with vm_state building and task_state spawning.
Dec 01 19:32:20 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b94ed219-14ab-43f5-8015-10760b43e926 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:32:20 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b94ed219-14ab-43f5-8015-10760b43e926 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:32:20 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b94ed219-14ab-43f5-8015-10760b43e926 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] No VIF found with MAC fa:16:3e:43:97:2a, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:32:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b94ed219-14ab-43f5-8015-10760b43e926 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "f7cc644b-006c-4453-aea2-abe35cfd5ba3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.514s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:32:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "f7cc644b-006c-4453-aea2-abe35cfd5ba3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 14.537s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:32:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "f7cc644b-006c-4453-aea2-abe35cfd5ba3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:32:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:32:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:32:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:32:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:32:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-1adea349-59c3-4051-8849-bc5b465ecc75 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.489s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:32:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1adea349-59c3-4051-8849-bc5b465ecc75 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] <== connect_volume: return (2968ms) {'type': 'block', 'scsi_wwn': '26438336138383537', 'path': '/dev/sdh'} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:32:21 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1adea349-59c3-4051-8849-bc5b465ecc75 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26438336138383537', 'path': '/dev/sdh'} {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 19:32:21 user nova-compute[75066]: DEBUG nova.objects.instance [None req-1adea349-59c3-4051-8849-bc5b465ecc75 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Lazy-loading 'flavor' on Instance uuid e9a9bf17-1c03-426a-b33e-9d8c458df283 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:32:21 user nova-compute[75066]: INFO nova.compute.manager [None req-6a876069-0911-4348-9c69-adc89b1eb028 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Unrescuing
Dec 01 19:32:21 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-6a876069-0911-4348-9c69-adc89b1eb028 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Acquiring lock "refresh_cache-b2c6c900-5d1b-44f8-8435-d9ad88b3a412" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:32:21 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-6a876069-0911-4348-9c69-adc89b1eb028 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Acquired lock "refresh_cache-b2c6c900-5d1b-44f8-8435-d9ad88b3a412" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:32:21 user nova-compute[75066]: DEBUG nova.network.neutron [None req-6a876069-0911-4348-9c69-adc89b1eb028 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:32:21 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-1adea349-59c3-4051-8849-bc5b465ecc75 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 19:32:21 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:32:21 user nova-compute[75066]:   <source dev="/dev/sdh"/>
Dec 01 19:32:21 user nova-compute[75066]:   <target dev="vdc" bus="virtio"/>
Dec 01 19:32:21 user nova-compute[75066]:   <serial>b52f6b8f-3f77-4dab-b058-0ebb865007b3</serial>
Dec 01 19:32:21 user nova-compute[75066]: </disk>
Dec 01 19:32:21 user nova-compute[75066]:  {{(pid=75066) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 19:32:21 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:32:21 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:32:21 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Starting heal instance info cache {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 19:32:21 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "refresh_cache-d564b128-598b-4ad4-8618-afa4dc8a7347" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:32:21 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquired lock "refresh_cache-d564b128-598b-4ad4-8618-afa4dc8a7347" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:32:21 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Forcefully refreshing network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 19:32:21 user nova-compute[75066]: DEBUG nova.network.neutron [None req-6a876069-0911-4348-9c69-adc89b1eb028 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Updating instance_info_cache with network_info: [{"id": "5b64624f-4059-4689-83ef-856573e0eab0", "address": "fa:16:3e:3f:cc:a8", "network": {"id": "47c850ae-6dcb-4977-a02a-e32cd3df4749", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-475363603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "943324a514a84cb4947dbab93abc4f6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b64624f-40", "ovs_interfaceid": "5b64624f-4059-4689-83ef-856573e0eab0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:32:21 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-6a876069-0911-4348-9c69-adc89b1eb028 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Releasing lock "refresh_cache-b2c6c900-5d1b-44f8-8435-d9ad88b3a412" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:32:21 user nova-compute[75066]: DEBUG nova.objects.instance [None req-6a876069-0911-4348-9c69-adc89b1eb028 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lazy-loading 'flavor' on Instance uuid b2c6c900-5d1b-44f8-8435-d9ad88b3a412 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:32:21 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-1adea349-59c3-4051-8849-bc5b465ecc75 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:32:21 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-1adea349-59c3-4051-8849-bc5b465ecc75 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:32:21 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-1adea349-59c3-4051-8849-bc5b465ecc75 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:32:21 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-1adea349-59c3-4051-8849-bc5b465ecc75 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] No VIF found with MAC fa:16:3e:37:9e:f3, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:32:22 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:32:22 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:32:22 user nova-compute[75066]: DEBUG nova.compute.manager [req-4e985b48-d048-40e7-a254-4df152f8853e req-c3c10763-5c23-4ac4-9f5a-9ebd9aad3303 service nova] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Received event network-vif-plugged-6d709e03-0f37-43f6-ab89-61e12ae93b48 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:32:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-4e985b48-d048-40e7-a254-4df152f8853e req-c3c10763-5c23-4ac4-9f5a-9ebd9aad3303 service nova] Acquiring lock "409478f4-7921-4a15-89b0-82c26fa39de7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:32:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-4e985b48-d048-40e7-a254-4df152f8853e req-c3c10763-5c23-4ac4-9f5a-9ebd9aad3303 service nova] Lock "409478f4-7921-4a15-89b0-82c26fa39de7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:32:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-4e985b48-d048-40e7-a254-4df152f8853e req-c3c10763-5c23-4ac4-9f5a-9ebd9aad3303 service nova] Lock "409478f4-7921-4a15-89b0-82c26fa39de7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:32:22 user nova-compute[75066]: DEBUG nova.compute.manager [req-4e985b48-d048-40e7-a254-4df152f8853e req-c3c10763-5c23-4ac4-9f5a-9ebd9aad3303 service nova] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] No waiting events found dispatching network-vif-plugged-6d709e03-0f37-43f6-ab89-61e12ae93b48 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:32:22 user nova-compute[75066]: WARNING nova.compute.manager [req-4e985b48-d048-40e7-a254-4df152f8853e req-c3c10763-5c23-4ac4-9f5a-9ebd9aad3303 service nova] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Received unexpected event network-vif-plugged-6d709e03-0f37-43f6-ab89-61e12ae93b48 for instance with vm_state building and task_state spawning.
Dec 01 19:32:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-1adea349-59c3-4051-8849-bc5b465ecc75 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Lock "e9a9bf17-1c03-426a-b33e-9d8c458df283" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.835s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:32:22 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Updating instance_info_cache with network_info: [{"id": "4850dc75-0d93-4536-abc1-a981dd385d96", "address": "fa:16:3e:fc:d1:96", "network": {"id": "47c850ae-6dcb-4977-a02a-e32cd3df4749", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-475363603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "943324a514a84cb4947dbab93abc4f6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4850dc75-0d", "ovs_interfaceid": "4850dc75-0d93-4536-abc1-a981dd385d96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:32:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Releasing lock "refresh_cache-d564b128-598b-4ad4-8618-afa4dc8a7347" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:32:22 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Updated the network info_cache for instance {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 19:32:22 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:32:22 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:32:22 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:32:22 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75066) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 19:32:22 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:32:22 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:32:22 user nova-compute[75066]: DEBUG nova.compute.manager [req-4e62bcbc-c0e4-4462-ad55-bd31dbab359f req-d9294928-9623-4f02-a637-07204a1d0524 service nova] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Received event network-vif-unplugged-5b64624f-4059-4689-83ef-856573e0eab0 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:32:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-4e62bcbc-c0e4-4462-ad55-bd31dbab359f req-d9294928-9623-4f02-a637-07204a1d0524 service nova] Acquiring lock "b2c6c900-5d1b-44f8-8435-d9ad88b3a412-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:32:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-4e62bcbc-c0e4-4462-ad55-bd31dbab359f req-d9294928-9623-4f02-a637-07204a1d0524 service nova] Lock "b2c6c900-5d1b-44f8-8435-d9ad88b3a412-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:32:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-4e62bcbc-c0e4-4462-ad55-bd31dbab359f req-d9294928-9623-4f02-a637-07204a1d0524 service nova] Lock "b2c6c900-5d1b-44f8-8435-d9ad88b3a412-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:32:22 user nova-compute[75066]: DEBUG nova.compute.manager [req-4e62bcbc-c0e4-4462-ad55-bd31dbab359f req-d9294928-9623-4f02-a637-07204a1d0524 service nova] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] No waiting events found dispatching network-vif-unplugged-5b64624f-4059-4689-83ef-856573e0eab0 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:32:22 user nova-compute[75066]: WARNING nova.compute.manager [req-4e62bcbc-c0e4-4462-ad55-bd31dbab359f req-d9294928-9623-4f02-a637-07204a1d0524 service nova] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Received unexpected event network-vif-unplugged-5b64624f-4059-4689-83ef-856573e0eab0 for instance with vm_state rescued and task_state unrescuing.
Dec 01 19:32:22 user nova-compute[75066]: DEBUG nova.compute.manager [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Instance event wait completed in 0 seconds for  {{(pid=75066) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 19:32:22 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Guest created on hypervisor {{(pid=75066) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 19:32:22 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Instance spawned successfully.
Dec 01 19:32:22 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 19:32:22 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Found default for hw_cdrom_bus of ide {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:32:22 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Found default for hw_disk_bus of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:32:22 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Found default for hw_input_bus of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:32:22 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Found default for hw_pointer_model of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:32:22 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Found default for hw_video_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:32:22 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Found default for hw_vif_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:32:22 user nova-compute[75066]: INFO nova.compute.manager [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Took 6.95 seconds to spawn the instance on the hypervisor.
Dec 01 19:32:22 user nova-compute[75066]: DEBUG nova.compute.manager [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:32:22 user nova-compute[75066]: INFO nova.compute.manager [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Took 8.24 seconds to build instance.
Dec 01 19:32:22 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Instance destroyed successfully.
Dec 01 19:32:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-da935ec4-37a3-4e86-b52d-d1c8fee13e09 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "409478f4-7921-4a15-89b0-82c26fa39de7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.405s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:32:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:32:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:32:23 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-05e98ebb-dfa4-4361-ac5e-252adfb93e89 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Acquiring lock "e9a9bf17-1c03-426a-b33e-9d8c458df283" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:32:23 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-05e98ebb-dfa4-4361-ac5e-252adfb93e89 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Lock "e9a9bf17-1c03-426a-b33e-9d8c458df283" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:32:23 user nova-compute[75066]: INFO nova.compute.manager [None req-05e98ebb-dfa4-4361-ac5e-252adfb93e89 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Detaching volume b52f6b8f-3f77-4dab-b058-0ebb865007b3
Dec 01 19:32:23 user nova-compute[75066]: INFO nova.virt.block_device [None req-05e98ebb-dfa4-4361-ac5e-252adfb93e89 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Attempting to driver detach volume b52f6b8f-3f77-4dab-b058-0ebb865007b3 from mountpoint /dev/vdc
Dec 01 19:32:23 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-05e98ebb-dfa4-4361-ac5e-252adfb93e89 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Attempting to detach device vdc from instance e9a9bf17-1c03-426a-b33e-9d8c458df283 from the persistent domain config. {{(pid=75066) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 19:32:23 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-05e98ebb-dfa4-4361-ac5e-252adfb93e89 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 19:32:23 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:32:23 user nova-compute[75066]:   <source dev="/dev/sdh"/>
Dec 01 19:32:23 user nova-compute[75066]:   <target dev="vdc" bus="virtio"/>
Dec 01 19:32:23 user nova-compute[75066]:   <serial>b52f6b8f-3f77-4dab-b058-0ebb865007b3</serial>
Dec 01 19:32:23 user nova-compute[75066]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Dec 01 19:32:23 user nova-compute[75066]: </disk>
Dec 01 19:32:23 user nova-compute[75066]:  {{(pid=75066) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 19:32:23 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-05e98ebb-dfa4-4361-ac5e-252adfb93e89 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Successfully detached device vdc from instance e9a9bf17-1c03-426a-b33e-9d8c458df283 from the persistent domain config.
Dec 01 19:32:23 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-05e98ebb-dfa4-4361-ac5e-252adfb93e89 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance e9a9bf17-1c03-426a-b33e-9d8c458df283 from the live domain config. {{(pid=75066) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 19:32:23 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-05e98ebb-dfa4-4361-ac5e-252adfb93e89 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 19:32:23 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:32:23 user nova-compute[75066]:   <source dev="/dev/sdh"/>
Dec 01 19:32:23 user nova-compute[75066]:   <target dev="vdc" bus="virtio"/>
Dec 01 19:32:23 user nova-compute[75066]:   <serial>b52f6b8f-3f77-4dab-b058-0ebb865007b3</serial>
Dec 01 19:32:23 user nova-compute[75066]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Dec 01 19:32:23 user nova-compute[75066]: </disk>
Dec 01 19:32:23 user nova-compute[75066]:  {{(pid=75066) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 19:32:24 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-05e98ebb-dfa4-4361-ac5e-252adfb93e89 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance e9a9bf17-1c03-426a-b33e-9d8c458df283 {{(pid=75066) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 19:32:24 user nova-compute[75066]: DEBUG nova.compute.manager [req-4325c12c-f6e6-44dd-9823-92b44911e70c req-88dfb2d4-aea7-4302-ba00-5b44fbbcc93d service nova] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Received event network-changed-3b45b67a-805d-4816-ad34-c5266535dd27 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:32:24 user nova-compute[75066]: DEBUG nova.compute.manager [req-4325c12c-f6e6-44dd-9823-92b44911e70c req-88dfb2d4-aea7-4302-ba00-5b44fbbcc93d service nova] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Refreshing instance network info cache due to event network-changed-3b45b67a-805d-4816-ad34-c5266535dd27. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:32:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-4325c12c-f6e6-44dd-9823-92b44911e70c req-88dfb2d4-aea7-4302-ba00-5b44fbbcc93d service nova] Acquiring lock "refresh_cache-f7cc644b-006c-4453-aea2-abe35cfd5ba3" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:32:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-4325c12c-f6e6-44dd-9823-92b44911e70c req-88dfb2d4-aea7-4302-ba00-5b44fbbcc93d service nova] Acquired lock "refresh_cache-f7cc644b-006c-4453-aea2-abe35cfd5ba3" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:32:24 user nova-compute[75066]: DEBUG nova.network.neutron [req-4325c12c-f6e6-44dd-9823-92b44911e70c req-88dfb2d4-aea7-4302-ba00-5b44fbbcc93d service nova] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Refreshing network info cache for port 3b45b67a-805d-4816-ad34-c5266535dd27 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:32:24 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:32:24 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:32:24 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:32:24 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:32:24 user nova-compute[75066]: DEBUG nova.compute.manager [req-97fb5d47-0c1f-4892-b7f9-be330b8ca93e req-694bc7e2-e6de-4c63-aeda-a72b98a15f41 service nova] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Received event network-vif-plugged-5b64624f-4059-4689-83ef-856573e0eab0 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:32:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-97fb5d47-0c1f-4892-b7f9-be330b8ca93e req-694bc7e2-e6de-4c63-aeda-a72b98a15f41 service nova] Acquiring lock "b2c6c900-5d1b-44f8-8435-d9ad88b3a412-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:32:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-97fb5d47-0c1f-4892-b7f9-be330b8ca93e req-694bc7e2-e6de-4c63-aeda-a72b98a15f41 service nova] Lock "b2c6c900-5d1b-44f8-8435-d9ad88b3a412-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:32:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-97fb5d47-0c1f-4892-b7f9-be330b8ca93e req-694bc7e2-e6de-4c63-aeda-a72b98a15f41 service nova] Lock "b2c6c900-5d1b-44f8-8435-d9ad88b3a412-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:32:24 user nova-compute[75066]: DEBUG nova.compute.manager [req-97fb5d47-0c1f-4892-b7f9-be330b8ca93e req-694bc7e2-e6de-4c63-aeda-a72b98a15f41 service nova] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] No waiting events found dispatching network-vif-plugged-5b64624f-4059-4689-83ef-856573e0eab0 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:32:24 user nova-compute[75066]: WARNING nova.compute.manager [req-97fb5d47-0c1f-4892-b7f9-be330b8ca93e req-694bc7e2-e6de-4c63-aeda-a72b98a15f41 service nova] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Received unexpected event network-vif-plugged-5b64624f-4059-4689-83ef-856573e0eab0 for instance with vm_state rescued and task_state unrescuing.
Dec 01 19:32:24 user nova-compute[75066]: DEBUG nova.network.neutron [req-4325c12c-f6e6-44dd-9823-92b44911e70c req-88dfb2d4-aea7-4302-ba00-5b44fbbcc93d service nova] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Updated VIF entry in instance network info cache for port 3b45b67a-805d-4816-ad34-c5266535dd27. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:32:24 user nova-compute[75066]: DEBUG nova.network.neutron [req-4325c12c-f6e6-44dd-9823-92b44911e70c req-88dfb2d4-aea7-4302-ba00-5b44fbbcc93d service nova] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Updating instance_info_cache with network_info: [{"id": "3b45b67a-805d-4816-ad34-c5266535dd27", "address": "fa:16:3e:43:97:2a", "network": {"id": "4fe4d56e-afe2-42a6-984a-9af8bc5377a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126385357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5326c00d464e008337e0dc8577fc2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b45b67a-80", "ovs_interfaceid": "3b45b67a-805d-4816-ad34-c5266535dd27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:32:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-4325c12c-f6e6-44dd-9823-92b44911e70c req-88dfb2d4-aea7-4302-ba00-5b44fbbcc93d service nova] Releasing lock "refresh_cache-f7cc644b-006c-4453-aea2-abe35cfd5ba3" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:32:24 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:32:26 user nova-compute[75066]: DEBUG nova.compute.manager [req-d53c27c6-d8fa-44bf-8c52-8d45f89440cb req-b3d9bf54-3dc7-44af-9588-2fdbbd2e51ec service nova] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Received event network-changed-3b45b67a-805d-4816-ad34-c5266535dd27 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:32:26 user nova-compute[75066]: DEBUG nova.compute.manager [req-d53c27c6-d8fa-44bf-8c52-8d45f89440cb req-b3d9bf54-3dc7-44af-9588-2fdbbd2e51ec service nova] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Refreshing instance network info cache due to event network-changed-3b45b67a-805d-4816-ad34-c5266535dd27. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:32:26 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d53c27c6-d8fa-44bf-8c52-8d45f89440cb req-b3d9bf54-3dc7-44af-9588-2fdbbd2e51ec service nova] Acquiring lock "refresh_cache-f7cc644b-006c-4453-aea2-abe35cfd5ba3" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:32:26 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d53c27c6-d8fa-44bf-8c52-8d45f89440cb req-b3d9bf54-3dc7-44af-9588-2fdbbd2e51ec service nova] Acquired lock "refresh_cache-f7cc644b-006c-4453-aea2-abe35cfd5ba3" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:32:26 user nova-compute[75066]: DEBUG nova.network.neutron [req-d53c27c6-d8fa-44bf-8c52-8d45f89440cb req-b3d9bf54-3dc7-44af-9588-2fdbbd2e51ec service nova] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Refreshing network info cache for port 3b45b67a-805d-4816-ad34-c5266535dd27 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:32:26 user nova-compute[75066]: DEBUG nova.compute.manager [req-79cc23b3-eb9a-451c-8ed6-76999844f471 req-ddd82905-46f9-49e1-adc9-c5e491b7ec29 service nova] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Received event network-vif-plugged-5b64624f-4059-4689-83ef-856573e0eab0 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:32:26 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-79cc23b3-eb9a-451c-8ed6-76999844f471 req-ddd82905-46f9-49e1-adc9-c5e491b7ec29 service nova] Acquiring lock "b2c6c900-5d1b-44f8-8435-d9ad88b3a412-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:32:26 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-79cc23b3-eb9a-451c-8ed6-76999844f471 req-ddd82905-46f9-49e1-adc9-c5e491b7ec29 service nova] Lock "b2c6c900-5d1b-44f8-8435-d9ad88b3a412-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:32:26 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-79cc23b3-eb9a-451c-8ed6-76999844f471 req-ddd82905-46f9-49e1-adc9-c5e491b7ec29 service nova] Lock "b2c6c900-5d1b-44f8-8435-d9ad88b3a412-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:32:26 user nova-compute[75066]: DEBUG nova.compute.manager [req-79cc23b3-eb9a-451c-8ed6-76999844f471 req-ddd82905-46f9-49e1-adc9-c5e491b7ec29 service nova] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] No waiting events found dispatching network-vif-plugged-5b64624f-4059-4689-83ef-856573e0eab0 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:32:26 user nova-compute[75066]: WARNING nova.compute.manager [req-79cc23b3-eb9a-451c-8ed6-76999844f471 req-ddd82905-46f9-49e1-adc9-c5e491b7ec29 service nova] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Received unexpected event network-vif-plugged-5b64624f-4059-4689-83ef-856573e0eab0 for instance with vm_state rescued and task_state unrescuing.
Dec 01 19:32:26 user nova-compute[75066]: DEBUG nova.compute.manager [req-79cc23b3-eb9a-451c-8ed6-76999844f471 req-ddd82905-46f9-49e1-adc9-c5e491b7ec29 service nova] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Received event network-vif-plugged-5b64624f-4059-4689-83ef-856573e0eab0 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:32:26 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-79cc23b3-eb9a-451c-8ed6-76999844f471 req-ddd82905-46f9-49e1-adc9-c5e491b7ec29 service nova] Acquiring lock "b2c6c900-5d1b-44f8-8435-d9ad88b3a412-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:32:26 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-79cc23b3-eb9a-451c-8ed6-76999844f471 req-ddd82905-46f9-49e1-adc9-c5e491b7ec29 service nova] Lock "b2c6c900-5d1b-44f8-8435-d9ad88b3a412-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:32:26 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-79cc23b3-eb9a-451c-8ed6-76999844f471 req-ddd82905-46f9-49e1-adc9-c5e491b7ec29 service nova] Lock "b2c6c900-5d1b-44f8-8435-d9ad88b3a412-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:32:26 user nova-compute[75066]: DEBUG nova.compute.manager [req-79cc23b3-eb9a-451c-8ed6-76999844f471 req-ddd82905-46f9-49e1-adc9-c5e491b7ec29 service nova] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] No waiting events found dispatching network-vif-plugged-5b64624f-4059-4689-83ef-856573e0eab0 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:32:26 user nova-compute[75066]: WARNING nova.compute.manager [req-79cc23b3-eb9a-451c-8ed6-76999844f471 req-ddd82905-46f9-49e1-adc9-c5e491b7ec29 service nova] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Received unexpected event network-vif-plugged-5b64624f-4059-4689-83ef-856573e0eab0 for instance with vm_state rescued and task_state unrescuing.
Dec 01 19:32:27 user nova-compute[75066]: DEBUG nova.network.neutron [req-d53c27c6-d8fa-44bf-8c52-8d45f89440cb req-b3d9bf54-3dc7-44af-9588-2fdbbd2e51ec service nova] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Updated VIF entry in instance network info cache for port 3b45b67a-805d-4816-ad34-c5266535dd27. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:32:27 user nova-compute[75066]: DEBUG nova.network.neutron [req-d53c27c6-d8fa-44bf-8c52-8d45f89440cb req-b3d9bf54-3dc7-44af-9588-2fdbbd2e51ec service nova] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Updating instance_info_cache with network_info: [{"id": "3b45b67a-805d-4816-ad34-c5266535dd27", "address": "fa:16:3e:43:97:2a", "network": {"id": "4fe4d56e-afe2-42a6-984a-9af8bc5377a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126385357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5326c00d464e008337e0dc8577fc2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b45b67a-80", "ovs_interfaceid": "3b45b67a-805d-4816-ad34-c5266535dd27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:32:27 user nova-compute[75066]: DEBUG nova.compute.manager [None req-6a876069-0911-4348-9c69-adc89b1eb028 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:32:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d53c27c6-d8fa-44bf-8c52-8d45f89440cb req-b3d9bf54-3dc7-44af-9588-2fdbbd2e51ec service nova] Releasing lock "refresh_cache-f7cc644b-006c-4453-aea2-abe35cfd5ba3" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:32:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-8f6baf70-d4cb-443d-999f-fc7bc83330ae tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Acquiring lock "f7cc644b-006c-4453-aea2-abe35cfd5ba3" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:32:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-8f6baf70-d4cb-443d-999f-fc7bc83330ae tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "f7cc644b-006c-4453-aea2-abe35cfd5ba3" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:32:27 user nova-compute[75066]: INFO nova.compute.manager [None req-8f6baf70-d4cb-443d-999f-fc7bc83330ae tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Rebooting instance
Dec 01 19:32:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-8f6baf70-d4cb-443d-999f-fc7bc83330ae tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Acquiring lock "refresh_cache-f7cc644b-006c-4453-aea2-abe35cfd5ba3" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:32:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-8f6baf70-d4cb-443d-999f-fc7bc83330ae tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Acquired lock "refresh_cache-f7cc644b-006c-4453-aea2-abe35cfd5ba3" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:32:27 user nova-compute[75066]: DEBUG nova.network.neutron [None req-8f6baf70-d4cb-443d-999f-fc7bc83330ae tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:32:27 user nova-compute[75066]: DEBUG nova.network.neutron [None req-8f6baf70-d4cb-443d-999f-fc7bc83330ae tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Updating instance_info_cache with network_info: [{"id": "3b45b67a-805d-4816-ad34-c5266535dd27", "address": "fa:16:3e:43:97:2a", "network": {"id": "4fe4d56e-afe2-42a6-984a-9af8bc5377a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126385357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5326c00d464e008337e0dc8577fc2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b45b67a-80", "ovs_interfaceid": "3b45b67a-805d-4816-ad34-c5266535dd27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:32:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-8f6baf70-d4cb-443d-999f-fc7bc83330ae tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Releasing lock "refresh_cache-f7cc644b-006c-4453-aea2-abe35cfd5ba3" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:32:27 user nova-compute[75066]: DEBUG nova.compute.manager [None req-8f6baf70-d4cb-443d-999f-fc7bc83330ae tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:32:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:32:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:32:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:32:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:32:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:32:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:32:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:32:30 user nova-compute[75066]: DEBUG nova.compute.manager [req-4964a9e9-33f7-426f-b95b-d679671a3862 req-4804f937-35e3-46d4-aba8-3af1e9acec1d service nova] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Received event network-vif-unplugged-3b45b67a-805d-4816-ad34-c5266535dd27 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:32:30 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-4964a9e9-33f7-426f-b95b-d679671a3862 req-4804f937-35e3-46d4-aba8-3af1e9acec1d service nova] Acquiring lock "f7cc644b-006c-4453-aea2-abe35cfd5ba3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:32:30 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-4964a9e9-33f7-426f-b95b-d679671a3862 req-4804f937-35e3-46d4-aba8-3af1e9acec1d service nova] Lock "f7cc644b-006c-4453-aea2-abe35cfd5ba3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:32:30 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-4964a9e9-33f7-426f-b95b-d679671a3862 req-4804f937-35e3-46d4-aba8-3af1e9acec1d service nova] Lock "f7cc644b-006c-4453-aea2-abe35cfd5ba3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:32:30 user nova-compute[75066]: DEBUG nova.compute.manager [req-4964a9e9-33f7-426f-b95b-d679671a3862 req-4804f937-35e3-46d4-aba8-3af1e9acec1d service nova] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] No waiting events found dispatching network-vif-unplugged-3b45b67a-805d-4816-ad34-c5266535dd27 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:32:30 user nova-compute[75066]: WARNING nova.compute.manager [req-4964a9e9-33f7-426f-b95b-d679671a3862 req-4804f937-35e3-46d4-aba8-3af1e9acec1d service nova] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Received unexpected event network-vif-unplugged-3b45b67a-805d-4816-ad34-c5266535dd27 for instance with vm_state active and task_state reboot_started.
Dec 01 19:32:30 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-8f6baf70-d4cb-443d-999f-fc7bc83330ae tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Instance shutdown successfully.
Dec 01 19:32:32 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:32:32 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:32:32 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:32:32 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:32:32 user nova-compute[75066]: DEBUG nova.compute.manager [req-a6150fbf-2a9d-4a01-8940-1d0deabfc1d5 req-fae752cd-1deb-4267-b7f3-027aeeeea7b4 service nova] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Received event network-vif-plugged-3b45b67a-805d-4816-ad34-c5266535dd27 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:32:32 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a6150fbf-2a9d-4a01-8940-1d0deabfc1d5 req-fae752cd-1deb-4267-b7f3-027aeeeea7b4 service nova] Acquiring lock "f7cc644b-006c-4453-aea2-abe35cfd5ba3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:32:32 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a6150fbf-2a9d-4a01-8940-1d0deabfc1d5 req-fae752cd-1deb-4267-b7f3-027aeeeea7b4 service nova] Lock "f7cc644b-006c-4453-aea2-abe35cfd5ba3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:32:32 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a6150fbf-2a9d-4a01-8940-1d0deabfc1d5 req-fae752cd-1deb-4267-b7f3-027aeeeea7b4 service nova] Lock "f7cc644b-006c-4453-aea2-abe35cfd5ba3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:32:32 user nova-compute[75066]: DEBUG nova.compute.manager [req-a6150fbf-2a9d-4a01-8940-1d0deabfc1d5 req-fae752cd-1deb-4267-b7f3-027aeeeea7b4 service nova] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] No waiting events found dispatching network-vif-plugged-3b45b67a-805d-4816-ad34-c5266535dd27 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:32:32 user nova-compute[75066]: WARNING nova.compute.manager [req-a6150fbf-2a9d-4a01-8940-1d0deabfc1d5 req-fae752cd-1deb-4267-b7f3-027aeeeea7b4 service nova] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Received unexpected event network-vif-plugged-3b45b67a-805d-4816-ad34-c5266535dd27 for instance with vm_state active and task_state reboot_started.
Dec 01 19:32:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:32:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:32:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:32:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:32:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:32:34 user nova-compute[75066]: DEBUG nova.compute.manager [req-391e3c53-6c28-4af7-8951-56275df1cdb9 req-ad4ebaaf-25e9-47c2-a0f8-f9be251ec493 service nova] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Received event network-vif-plugged-3b45b67a-805d-4816-ad34-c5266535dd27 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:32:34 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-391e3c53-6c28-4af7-8951-56275df1cdb9 req-ad4ebaaf-25e9-47c2-a0f8-f9be251ec493 service nova] Acquiring lock "f7cc644b-006c-4453-aea2-abe35cfd5ba3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:32:34 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-391e3c53-6c28-4af7-8951-56275df1cdb9 req-ad4ebaaf-25e9-47c2-a0f8-f9be251ec493 service nova] Lock "f7cc644b-006c-4453-aea2-abe35cfd5ba3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:32:34 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-391e3c53-6c28-4af7-8951-56275df1cdb9 req-ad4ebaaf-25e9-47c2-a0f8-f9be251ec493 service nova] Lock "f7cc644b-006c-4453-aea2-abe35cfd5ba3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:32:34 user nova-compute[75066]: DEBUG nova.compute.manager [req-391e3c53-6c28-4af7-8951-56275df1cdb9 req-ad4ebaaf-25e9-47c2-a0f8-f9be251ec493 service nova] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] No waiting events found dispatching network-vif-plugged-3b45b67a-805d-4816-ad34-c5266535dd27 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:32:34 user nova-compute[75066]: WARNING nova.compute.manager [req-391e3c53-6c28-4af7-8951-56275df1cdb9 req-ad4ebaaf-25e9-47c2-a0f8-f9be251ec493 service nova] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Received unexpected event network-vif-plugged-3b45b67a-805d-4816-ad34-c5266535dd27 for instance with vm_state active and task_state reboot_started.
Dec 01 19:32:34 user nova-compute[75066]: DEBUG nova.compute.manager [req-391e3c53-6c28-4af7-8951-56275df1cdb9 req-ad4ebaaf-25e9-47c2-a0f8-f9be251ec493 service nova] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Received event network-vif-plugged-3b45b67a-805d-4816-ad34-c5266535dd27 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:32:34 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-391e3c53-6c28-4af7-8951-56275df1cdb9 req-ad4ebaaf-25e9-47c2-a0f8-f9be251ec493 service nova] Acquiring lock "f7cc644b-006c-4453-aea2-abe35cfd5ba3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:32:34 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-391e3c53-6c28-4af7-8951-56275df1cdb9 req-ad4ebaaf-25e9-47c2-a0f8-f9be251ec493 service nova] Lock "f7cc644b-006c-4453-aea2-abe35cfd5ba3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:32:34 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-391e3c53-6c28-4af7-8951-56275df1cdb9 req-ad4ebaaf-25e9-47c2-a0f8-f9be251ec493 service nova] Lock "f7cc644b-006c-4453-aea2-abe35cfd5ba3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:32:34 user nova-compute[75066]: DEBUG nova.compute.manager [req-391e3c53-6c28-4af7-8951-56275df1cdb9 req-ad4ebaaf-25e9-47c2-a0f8-f9be251ec493 service nova] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] No waiting events found dispatching network-vif-plugged-3b45b67a-805d-4816-ad34-c5266535dd27 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:32:34 user nova-compute[75066]: WARNING nova.compute.manager [req-391e3c53-6c28-4af7-8951-56275df1cdb9 req-ad4ebaaf-25e9-47c2-a0f8-f9be251ec493 service nova] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Received unexpected event network-vif-plugged-3b45b67a-805d-4816-ad34-c5266535dd27 for instance with vm_state active and task_state reboot_started.
Dec 01 19:32:34 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Instance running successfully.
Dec 01 19:32:34 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-8f6baf70-d4cb-443d-999f-fc7bc83330ae tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Instance soft rebooted successfully.
Dec 01 19:32:34 user nova-compute[75066]: DEBUG nova.compute.manager [None req-8f6baf70-d4cb-443d-999f-fc7bc83330ae tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:32:34 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-8f6baf70-d4cb-443d-999f-fc7bc83330ae tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "f7cc644b-006c-4453-aea2-abe35cfd5ba3" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.625s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:32:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:32:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:32:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:32:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:32:44 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-05e98ebb-dfa4-4361-ac5e-252adfb93e89 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance e9a9bf17-1c03-426a-b33e-9d8c458df283 is timed out.
Dec 01 19:32:44 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-05e98ebb-dfa4-4361-ac5e-252adfb93e89 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Successfully detached device vdc from instance e9a9bf17-1c03-426a-b33e-9d8c458df283 from the live domain config.
Dec 01 19:32:44 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05e98ebb-dfa4-4361-ac5e-252adfb93e89 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] calling os-brick to detach iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 19:32:44 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e98ebb-dfa4-4361-ac5e-252adfb93e89 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, {'target_iqn': 'iqn.2010-10.org.openstack:b52f6b8f-3f77-4dab-b058-0ebb865007b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tHifJjhT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:32:44 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-05e98ebb-dfa4-4361-ac5e-252adfb93e89 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:32:44 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-05e98ebb-dfa4-4361-ac5e-252adfb93e89 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:32:44 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-05e98ebb-dfa4-4361-ac5e-252adfb93e89 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:32:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:44 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd391f1-41ff-444e-888f-6ee42b8e7ccc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b52f6b8f-3f77-4dab-b058-0ebb865007b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:32:44 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e98ebb-dfa4-4361-ac5e-252adfb93e89 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 19:32:44 user nova-compute[75066]: No targets found.
Dec 01 19:32:44 user nova-compute[75066]: iSNS:
Dec 01 19:32:44 user nova-compute[75066]: No targets found.
Dec 01 19:32:44 user nova-compute[75066]: STATIC:
Dec 01 19:32:44 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9
Dec 01 19:32:44 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:32:44 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:32:44 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:b52f6b8f-3f77-4dab-b058-0ebb865007b3
Dec 01 19:32:44 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:32:44 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:32:44 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571
Dec 01 19:32:44 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:32:44 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:32:44 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7
Dec 01 19:32:44 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:32:44 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:32:44 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711
Dec 01 19:32:44 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:32:44 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:32:44 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb
Dec 01 19:32:44 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:32:44 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:32:44 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236
Dec 01 19:32:44 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:32:44 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:32:44 user nova-compute[75066]: FIRMWARE:
Dec 01 19:32:44 user nova-compute[75066]: No targets found.
Dec 01 19:32:44 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:32:44 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e98ebb-dfa4-4361-ac5e-252adfb93e89 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 19:32:44 user nova-compute[75066]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 19:32:44 user nova-compute[75066]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75066) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 19:32:44 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e98ebb-dfa4-4361-ac5e-252adfb93e89 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b52f6b8f-3f77-4dab-b058-0ebb865007b3', 0)] {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 19:32:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:44 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a765da0-2ae8-4314-a9b1-093749cbb2e0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b52f6b8f-3f77-4dab-b058-0ebb865007b3\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:32:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:44 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e5e41f-d1a8-4fea-a98f-ebdf380697f0]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b52f6b8f-3f77-4dab-b058-0ebb865007b3 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:32:44 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e98ebb-dfa4-4361-ac5e-252adfb93e89 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:32:44 user nova-compute[75066]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)
Dec 01 19:32:44 user nova-compute[75066]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 (non-flash)
Dec 01 19:32:44 user nova-compute[75066]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 (non-flash)
Dec 01 19:32:44 user nova-compute[75066]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236 (non-flash)
Dec 01 19:32:44 user nova-compute[75066]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711 (non-flash)
Dec 01 19:32:44 user nova-compute[75066]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b52f6b8f-3f77-4dab-b058-0ebb865007b3 (non-flash)
Dec 01 19:32:44 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:32:44 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e98ebb-dfa4-4361-ac5e-252adfb93e89 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:32:44 user nova-compute[75066]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)
Dec 01 19:32:44 user nova-compute[75066]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 (non-flash)
Dec 01 19:32:44 user nova-compute[75066]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 (non-flash)
Dec 01 19:32:44 user nova-compute[75066]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236 (non-flash)
Dec 01 19:32:44 user nova-compute[75066]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711 (non-flash)
Dec 01 19:32:44 user nova-compute[75066]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b52f6b8f-3f77-4dab-b058-0ebb865007b3 (non-flash)
Dec 01 19:32:44 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:32:44 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e98ebb-dfa4-4361-ac5e-252adfb93e89 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91707237f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b52f6b8f-3f77-4dab-b058-0ebb865007b3'): ({'sdh'}, set())}) {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 19:32:44 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-05e98ebb-dfa4-4361-ac5e-252adfb93e89 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Removing single pathed devices sdh {{(pid=75066) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 19:32:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:44 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c976366-2ce9-44d0-ad69-2b41bcc3219f]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:32:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:44 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bcea368-76a3-4e4b-a4b9-5ab9947ee21e]: (4, ('ok\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:32:44 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-05e98ebb-dfa4-4361-ac5e-252adfb93e89 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Flushing IO for device /dev/sdh {{(pid=75066) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 19:32:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.012s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:44 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f20a1a-1ff5-4d6a-a22c-1896dc421c6b]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:32:44 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-05e98ebb-dfa4-4361-ac5e-252adfb93e89 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75066) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 19:32:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.047s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:44 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d53e686-a41f-407c-8640-77a212603c40]: (4, ('1', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:32:44 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-05e98ebb-dfa4-4361-ac5e-252adfb93e89 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 19:32:44 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-05e98ebb-dfa4-4361-ac5e-252adfb93e89 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] SCSI volumes sdh have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 19:32:44 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e98ebb-dfa4-4361-ac5e-252adfb93e89 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b52f6b8f-3f77-4dab-b058-0ebb865007b3')] {{(pid=75066) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 19:32:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b52f6b8f-3f77-4dab-b058-0ebb865007b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b52f6b8f-3f77-4dab-b058-0ebb865007b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:44 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2ce771-71da-4fd7-b44b-169ecb0e3adb]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:32:44 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e98ebb-dfa4-4361-ac5e-252adfb93e89 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:32:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b52f6b8f-3f77-4dab-b058-0ebb865007b3 -p 172.16.0.220:3260 --logout {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b52f6b8f-3f77-4dab-b058-0ebb865007b3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:44 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[8075a365-e4ef-42b2-bbaf-60302c332a05]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:b52f6b8f-3f77-4dab-b058-0ebb865007b3, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:b52f6b8f-3f77-4dab-b058-0ebb865007b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:32:44 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e98ebb-dfa4-4361-ac5e-252adfb93e89 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:b52f6b8f-3f77-4dab-b058-0ebb865007b3, portal: 172.16.0.220,3260]
Dec 01 19:32:44 user nova-compute[75066]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:b52f6b8f-3f77-4dab-b058-0ebb865007b3, portal: 172.16.0.220,3260] successful.
Dec 01 19:32:44 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:32:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b52f6b8f-3f77-4dab-b058-0ebb865007b3 -p 172.16.0.220:3260 --op delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:32:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b52f6b8f-3f77-4dab-b058-0ebb865007b3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:32:44 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[14393258-f066-45cf-a1e2-954229d52a70]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:32:44 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e98ebb-dfa4-4361-ac5e-252adfb93e89 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:32:44 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-05e98ebb-dfa4-4361-ac5e-252adfb93e89 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:32:44 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-05e98ebb-dfa4-4361-ac5e-252adfb93e89 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] <== disconnect_volume: return (320ms) None {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:32:44 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05e98ebb-dfa4-4361-ac5e-252adfb93e89 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Disconnected iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 19:32:45 user nova-compute[75066]: DEBUG nova.objects.instance [None req-05e98ebb-dfa4-4361-ac5e-252adfb93e89 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Lazy-loading 'flavor' on Instance uuid e9a9bf17-1c03-426a-b33e-9d8c458df283 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:32:45 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-05e98ebb-dfa4-4361-ac5e-252adfb93e89 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Lock "e9a9bf17-1c03-426a-b33e-9d8c458df283" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.074s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:32:48 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:32:48 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:32:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:32:53 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:32:53 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:32:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:32:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:33:03 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:33:03 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:33:05 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:33:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:33:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:33:10 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:33:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:33:13 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:33:13 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:33:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:33:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:33:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:33:13 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75066) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 19:33:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88850ea1-43cd-4066-8e6f-cfe5de621bc6/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:33:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88850ea1-43cd-4066-8e6f-cfe5de621bc6/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:33:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88850ea1-43cd-4066-8e6f-cfe5de621bc6/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:33:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-eb6a8cf8-cede-4746-aa80-a11ddb5cd83b tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Acquiring lock "e9a9bf17-1c03-426a-b33e-9d8c458df283" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:33:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-eb6a8cf8-cede-4746-aa80-a11ddb5cd83b tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Lock "e9a9bf17-1c03-426a-b33e-9d8c458df283" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:33:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88850ea1-43cd-4066-8e6f-cfe5de621bc6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:33:13 user nova-compute[75066]: INFO nova.compute.manager [None req-eb6a8cf8-cede-4746-aa80-a11ddb5cd83b tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Detaching volume 5755ff17-79cf-4b3c-8ee0-5303b9a18236
Dec 01 19:33:13 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:33:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/479bf6d9-ffec-4417-99c5-3af0dafc0881/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:33:13 user nova-compute[75066]: INFO nova.virt.block_device [None req-eb6a8cf8-cede-4746-aa80-a11ddb5cd83b tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Attempting to driver detach volume 5755ff17-79cf-4b3c-8ee0-5303b9a18236 from mountpoint /dev/vdb
Dec 01 19:33:14 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-eb6a8cf8-cede-4746-aa80-a11ddb5cd83b tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Attempting to detach device vdb from instance e9a9bf17-1c03-426a-b33e-9d8c458df283 from the persistent domain config. {{(pid=75066) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 19:33:14 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-eb6a8cf8-cede-4746-aa80-a11ddb5cd83b tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 19:33:14 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:33:14 user nova-compute[75066]:   <source dev="/dev/sdc"/>
Dec 01 19:33:14 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:33:14 user nova-compute[75066]:   <serial>5755ff17-79cf-4b3c-8ee0-5303b9a18236</serial>
Dec 01 19:33:14 user nova-compute[75066]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 19:33:14 user nova-compute[75066]: </disk>
Dec 01 19:33:14 user nova-compute[75066]:  {{(pid=75066) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 19:33:14 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-eb6a8cf8-cede-4746-aa80-a11ddb5cd83b tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Successfully detached device vdb from instance e9a9bf17-1c03-426a-b33e-9d8c458df283 from the persistent domain config.
Dec 01 19:33:14 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-eb6a8cf8-cede-4746-aa80-a11ddb5cd83b tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e9a9bf17-1c03-426a-b33e-9d8c458df283 from the live domain config. {{(pid=75066) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 19:33:14 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-eb6a8cf8-cede-4746-aa80-a11ddb5cd83b tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 19:33:14 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:33:14 user nova-compute[75066]:   <source dev="/dev/sdc"/>
Dec 01 19:33:14 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:33:14 user nova-compute[75066]:   <serial>5755ff17-79cf-4b3c-8ee0-5303b9a18236</serial>
Dec 01 19:33:14 user nova-compute[75066]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 19:33:14 user nova-compute[75066]: </disk>
Dec 01 19:33:14 user nova-compute[75066]:  {{(pid=75066) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 19:33:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/479bf6d9-ffec-4417-99c5-3af0dafc0881/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:33:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/479bf6d9-ffec-4417-99c5-3af0dafc0881/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:33:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/479bf6d9-ffec-4417-99c5-3af0dafc0881/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:33:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:33:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:33:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:33:14 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-eb6a8cf8-cede-4746-aa80-a11ddb5cd83b tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e9a9bf17-1c03-426a-b33e-9d8c458df283 {{(pid=75066) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 19:33:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:33:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7cc644b-006c-4453-aea2-abe35cfd5ba3/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:33:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7cc644b-006c-4453-aea2-abe35cfd5ba3/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:33:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7cc644b-006c-4453-aea2-abe35cfd5ba3/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:33:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7cc644b-006c-4453-aea2-abe35cfd5ba3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:33:15 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:33:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:33:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:33:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:33:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:33:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:33:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:33:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:33:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:33:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk.rescue --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:33:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:33:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk.rescue --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:33:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:33:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:33:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:33:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:33:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:33:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:33:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:33:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:33:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:33:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9a9bf17-1c03-426a-b33e-9d8c458df283/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:33:17 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9a9bf17-1c03-426a-b33e-9d8c458df283/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:33:17 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9a9bf17-1c03-426a-b33e-9d8c458df283/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:33:17 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e9a9bf17-1c03-426a-b33e-9d8c458df283/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:33:17 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:33:17 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6c900-5d1b-44f8-8435-d9ad88b3a412/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:33:17 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6c900-5d1b-44f8-8435-d9ad88b3a412/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:33:17 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6c900-5d1b-44f8-8435-d9ad88b3a412/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:33:17 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6c900-5d1b-44f8-8435-d9ad88b3a412/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:33:17 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:33:17 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/409478f4-7921-4a15-89b0-82c26fa39de7/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:33:17 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/409478f4-7921-4a15-89b0-82c26fa39de7/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:33:17 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/409478f4-7921-4a15-89b0-82c26fa39de7/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:33:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/409478f4-7921-4a15-89b0-82c26fa39de7/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:33:18 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:33:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f04249c5-0196-455c-ac7a-f1ff8be320d4/disk.rescue --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:33:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f04249c5-0196-455c-ac7a-f1ff8be320d4/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:33:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f04249c5-0196-455c-ac7a-f1ff8be320d4/disk.rescue --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:33:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:33:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f04249c5-0196-455c-ac7a-f1ff8be320d4/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:33:18 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:33:18 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:33:18 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Hypervisor/Node resource view: name=user free_ram=7160MB free_disk=24.531604766845703GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75066) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 19:33:18 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:33:18 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:33:19 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance c223be70-8b9c-46d4-9b5a-3b83dfc05a17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:33:19 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 90c49be6-97aa-45f1-bcbe-b9a3875226a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:33:19 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance d564b128-598b-4ad4-8618-afa4dc8a7347 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:33:19 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 14de9d20-9e66-4517-b904-2967e0a06a97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:33:19 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:33:19 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:33:19 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance b2c6c900-5d1b-44f8-8435-d9ad88b3a412 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:33:19 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 00506483-8f09-4a3d-938a-31ab1b2dbf83 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:33:19 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance e9a9bf17-1c03-426a-b33e-9d8c458df283 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:33:19 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 88850ea1-43cd-4066-8e6f-cfe5de621bc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:33:19 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance f04249c5-0196-455c-ac7a-f1ff8be320d4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:33:19 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance f7cc644b-006c-4453-aea2-abe35cfd5ba3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:33:19 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 479bf6d9-ffec-4417-99c5-3af0dafc0881 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:33:19 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 409478f4-7921-4a15-89b0-82c26fa39de7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:33:19 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 19:33:19 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 19:33:19 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:33:19 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:33:19 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Compute_service record updated for user:user {{(pid=75066) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 19:33:19 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.606s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:33:19 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a5e3e08f-df6a-4d40-9e5a-ec61c2427cf6 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Acquiring lock "00506483-8f09-4a3d-938a-31ab1b2dbf83" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:33:19 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a5e3e08f-df6a-4d40-9e5a-ec61c2427cf6 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "00506483-8f09-4a3d-938a-31ab1b2dbf83" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:33:19 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a5e3e08f-df6a-4d40-9e5a-ec61c2427cf6 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Acquiring lock "00506483-8f09-4a3d-938a-31ab1b2dbf83-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:33:19 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a5e3e08f-df6a-4d40-9e5a-ec61c2427cf6 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "00506483-8f09-4a3d-938a-31ab1b2dbf83-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:33:19 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a5e3e08f-df6a-4d40-9e5a-ec61c2427cf6 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "00506483-8f09-4a3d-938a-31ab1b2dbf83-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:33:19 user nova-compute[75066]: INFO nova.compute.manager [None req-a5e3e08f-df6a-4d40-9e5a-ec61c2427cf6 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Terminating instance
Dec 01 19:33:19 user nova-compute[75066]: DEBUG nova.compute.manager [None req-a5e3e08f-df6a-4d40-9e5a-ec61c2427cf6 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Start destroying the instance on the hypervisor. {{(pid=75066) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 19:33:19 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG nova.compute.manager [req-1c3d4887-6920-4854-bbc7-121abbdaa74f req-f3388fdc-d4a7-41e3-be7f-49a31635a10e service nova] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Received event network-vif-unplugged-b0528c8d-a14c-4420-a248-fda3f0a92893 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-1c3d4887-6920-4854-bbc7-121abbdaa74f req-f3388fdc-d4a7-41e3-be7f-49a31635a10e service nova] Acquiring lock "00506483-8f09-4a3d-938a-31ab1b2dbf83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-1c3d4887-6920-4854-bbc7-121abbdaa74f req-f3388fdc-d4a7-41e3-be7f-49a31635a10e service nova] Lock "00506483-8f09-4a3d-938a-31ab1b2dbf83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-1c3d4887-6920-4854-bbc7-121abbdaa74f req-f3388fdc-d4a7-41e3-be7f-49a31635a10e service nova] Lock "00506483-8f09-4a3d-938a-31ab1b2dbf83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG nova.compute.manager [req-1c3d4887-6920-4854-bbc7-121abbdaa74f req-f3388fdc-d4a7-41e3-be7f-49a31635a10e service nova] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] No waiting events found dispatching network-vif-unplugged-b0528c8d-a14c-4420-a248-fda3f0a92893 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG nova.compute.manager [req-1c3d4887-6920-4854-bbc7-121abbdaa74f req-f3388fdc-d4a7-41e3-be7f-49a31635a10e service nova] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Received event network-vif-unplugged-b0528c8d-a14c-4420-a248-fda3f0a92893 for instance with task_state deleting. {{(pid=75066) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Starting heal instance info cache {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "refresh_cache-14de9d20-9e66-4517-b904-2967e0a06a97" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquired lock "refresh_cache-14de9d20-9e66-4517-b904-2967e0a06a97" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Forcefully refreshing network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 19:33:20 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Instance destroyed successfully.
Dec 01 19:33:20 user nova-compute[75066]: DEBUG nova.objects.instance [None req-a5e3e08f-df6a-4d40-9e5a-ec61c2427cf6 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lazy-loading 'resources' on Instance uuid 00506483-8f09-4a3d-938a-31ab1b2dbf83 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-a5e3e08f-df6a-4d40-9e5a-ec61c2427cf6 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:26:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1664862107',display_name='tempest-ServerActionsTestOtherA-server-1664862107',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1664862107',id=28,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAjcDJi5RJTCazFFAj7dx2qLuKSEoyASrqNDKgiQGRQPewzJhIu6lQd3yuH2207H2lpqZiyuqBj2lXvz5vQM52pZXpO90p/UH43nVMO2RrMH5S7NUl16+at0nkGQGj24ng==',key_name='tempest-keypair-1092575275',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:29:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fb0f7516d1db4dd5bc7d77a0bd1d44d7',ramdisk_id='',reservation_id='r-5u7ef9p2',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1700253921',owner_user_name='tempest-ServerActionsTestOtherA-1700253921-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:30:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfb3e7b4b0444223af282b16da9bd919',uuid=00506483-8f09-4a3d-938a-31ab1b2dbf83,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b0528c8d-a14c-4420-a248-fda3f0a92893", "address": "fa:16:3e:a6:1a:51", "network": {"id": "9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-696310557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0f7516d1db4dd5bc7d77a0bd1d44d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0528c8d-a1", "ovs_interfaceid": "b0528c8d-a14c-4420-a248-fda3f0a92893", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-a5e3e08f-df6a-4d40-9e5a-ec61c2427cf6 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Converting VIF {"id": "b0528c8d-a14c-4420-a248-fda3f0a92893", "address": "fa:16:3e:a6:1a:51", "network": {"id": "9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-696310557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.158", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0f7516d1db4dd5bc7d77a0bd1d44d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0528c8d-a1", "ovs_interfaceid": "b0528c8d-a14c-4420-a248-fda3f0a92893", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-a5e3e08f-df6a-4d40-9e5a-ec61c2427cf6 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a6:1a:51,bridge_name='br-int',has_traffic_filtering=True,id=b0528c8d-a14c-4420-a248-fda3f0a92893,network=Network(9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0528c8d-a1') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG os_vif [None req-a5e3e08f-df6a-4d40-9e5a-ec61c2427cf6 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:1a:51,bridge_name='br-int',has_traffic_filtering=True,id=b0528c8d-a14c-4420-a248-fda3f0a92893,network=Network(9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0528c8d-a1') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb0528c8d-a1, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b3f1b2fa-761f-4035-968f-75dc10b4c527) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:33:20 user nova-compute[75066]: INFO os_vif [None req-a5e3e08f-df6a-4d40-9e5a-ec61c2427cf6 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:1a:51,bridge_name='br-int',has_traffic_filtering=True,id=b0528c8d-a14c-4420-a248-fda3f0a92893,network=Network(9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb0528c8d-a1')
Dec 01 19:33:20 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5e3e08f-df6a-4d40-9e5a-ec61c2427cf6 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] calling os-brick to detach iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e3e08f-df6a-4d40-9e5a-ec61c2427cf6 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, {'target_iqn': 'iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gLtkPwAS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:33:20 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-a5e3e08f-df6a-4d40-9e5a-ec61c2427cf6 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:33:20 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-a5e3e08f-df6a-4d40-9e5a-ec61c2427cf6 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-a5e3e08f-df6a-4d40-9e5a-ec61c2427cf6 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec07c6f-9e7c-4b6d-8c67-1b3952653d36]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e3e08f-df6a-4d40-9e5a-ec61c2427cf6 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 19:33:20 user nova-compute[75066]: No targets found.
Dec 01 19:33:20 user nova-compute[75066]: iSNS:
Dec 01 19:33:20 user nova-compute[75066]: No targets found.
Dec 01 19:33:20 user nova-compute[75066]: STATIC:
Dec 01 19:33:20 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9
Dec 01 19:33:20 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:33:20 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:33:20 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571
Dec 01 19:33:20 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:33:20 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:33:20 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7
Dec 01 19:33:20 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:33:20 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:33:20 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711
Dec 01 19:33:20 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:33:20 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:33:20 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb
Dec 01 19:33:20 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:33:20 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:33:20 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236
Dec 01 19:33:20 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:33:20 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:33:20 user nova-compute[75066]: FIRMWARE:
Dec 01 19:33:20 user nova-compute[75066]: No targets found.
Dec 01 19:33:20 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e3e08f-df6a-4d40-9e5a-ec61c2427cf6 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 19:33:20 user nova-compute[75066]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 19:33:20 user nova-compute[75066]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75066) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e3e08f-df6a-4d40-9e5a-ec61c2427cf6 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9', 0)] {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[39501549-8a40-442c-bd41-8bb79d3dae57]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6f6aae-a7eb-4925-9746-2c5c36b1917b]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e3e08f-df6a-4d40-9e5a-ec61c2427cf6 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:33:20 user nova-compute[75066]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)
Dec 01 19:33:20 user nova-compute[75066]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 (non-flash)
Dec 01 19:33:20 user nova-compute[75066]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 (non-flash)
Dec 01 19:33:20 user nova-compute[75066]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236 (non-flash)
Dec 01 19:33:20 user nova-compute[75066]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711 (non-flash)
Dec 01 19:33:20 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e3e08f-df6a-4d40-9e5a-ec61c2427cf6 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:33:20 user nova-compute[75066]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 (non-flash)
Dec 01 19:33:20 user nova-compute[75066]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 (non-flash)
Dec 01 19:33:20 user nova-compute[75066]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 (non-flash)
Dec 01 19:33:20 user nova-compute[75066]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236 (non-flash)
Dec 01 19:33:20 user nova-compute[75066]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711 (non-flash)
Dec 01 19:33:20 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e3e08f-df6a-4d40-9e5a-ec61c2427cf6 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f919017c790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9'): ({'sdb'}, set())}) {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-a5e3e08f-df6a-4d40-9e5a-ec61c2427cf6 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Removing single pathed devices sdb {{(pid=75066) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[683c68f4-22c4-42c1-8738-38f763a9e1ae]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.028s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[14fd0664-a3d6-4a4d-8d0b-e96f416e2e02]: (4, ('ok\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-a5e3e08f-df6a-4d40-9e5a-ec61c2427cf6 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Flushing IO for device /dev/sdb {{(pid=75066) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d2eb09-b9e0-494e-919e-384fe6d9160b]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-a5e3e08f-df6a-4d40-9e5a-ec61c2427cf6 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75066) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40bbe47-7108-4bf4-8ec7-82a5c3ff0ff9]: (4, ('1', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-a5e3e08f-df6a-4d40-9e5a-ec61c2427cf6 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-a5e3e08f-df6a-4d40-9e5a-ec61c2427cf6 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] SCSI volumes sdb have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_2fe16681', '/dev/disk/by-id/scsi-1SCST_BIO2fe16681-ce282d8c7df6b6a0', '/dev/disk/by-id/scsi-26365323832643863') {{(pid=86136) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8cc3b2-6713-40da-ba91-368c98511b79]: (4, None) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e3e08f-df6a-4d40-9e5a-ec61c2427cf6 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9')] {{(pid=75066) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Updating instance_info_cache with network_info: [{"id": "4ab99734-a7a9-43f9-b75e-f02d33a7a50d", "address": "fa:16:3e:54:2d:24", "network": {"id": "47c850ae-6dcb-4977-a02a-e32cd3df4749", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-475363603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "943324a514a84cb4947dbab93abc4f6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ab99734-a7", "ovs_interfaceid": "4ab99734-a7a9-43f9-b75e-f02d33a7a50d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c4261b-d2c7-4d9d-9dd7-177bd15debb6]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e3e08f-df6a-4d40-9e5a-ec61c2427cf6 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Releasing lock "refresh_cache-14de9d20-9e66-4517-b904-2967e0a06a97" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Updated the network info_cache for instance {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 -p 172.16.0.220:3260 --logout {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:33:20 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:33:21 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75066) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 19:33:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:33:21 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[8151971d-c804-4577-8060-0c23c2d88f0d]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:33:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e3e08f-df6a-4d40-9e5a-ec61c2427cf6 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9, portal: 172.16.0.220,3260]
Dec 01 19:33:21 user nova-compute[75066]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9, portal: 172.16.0.220,3260] successful.
Dec 01 19:33:21 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:33:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 -p 172.16.0.220:3260 --op delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:33:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:333c6d2d-5a25-42f1-8a9b-9366196fd6f9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:33:21 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[67cba994-bea5-486e-b248-bdff4db913d9]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:33:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e3e08f-df6a-4d40-9e5a-ec61c2427cf6 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:33:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-a5e3e08f-df6a-4d40-9e5a-ec61c2427cf6 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:33:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5e3e08f-df6a-4d40-9e5a-ec61c2427cf6 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] <== disconnect_volume: return (359ms) None {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:33:21 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5e3e08f-df6a-4d40-9e5a-ec61c2427cf6 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Disconnected iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 19:33:21 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-a5e3e08f-df6a-4d40-9e5a-ec61c2427cf6 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Deleting instance files /opt/stack/data/nova/instances/00506483-8f09-4a3d-938a-31ab1b2dbf83_del
Dec 01 19:33:21 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-a5e3e08f-df6a-4d40-9e5a-ec61c2427cf6 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Deletion of /opt/stack/data/nova/instances/00506483-8f09-4a3d-938a-31ab1b2dbf83_del complete
Dec 01 19:33:21 user nova-compute[75066]: INFO nova.compute.manager [None req-a5e3e08f-df6a-4d40-9e5a-ec61c2427cf6 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Took 1.27 seconds to destroy the instance on the hypervisor.
Dec 01 19:33:21 user nova-compute[75066]: DEBUG oslo.service.loopingcall [None req-a5e3e08f-df6a-4d40-9e5a-ec61c2427cf6 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75066) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 19:33:21 user nova-compute[75066]: DEBUG nova.compute.manager [-] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Deallocating network for instance {{(pid=75066) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 19:33:21 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] deallocate_for_instance() {{(pid=75066) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 19:33:21 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:33:21 user nova-compute[75066]: INFO nova.compute.manager [-] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Took 0.74 seconds to deallocate network for instance.
Dec 01 19:33:21 user nova-compute[75066]: DEBUG nova.compute.manager [req-1ff138b0-be9f-442e-af02-364c1bc721ce req-b6e90cec-086c-4e23-99fa-a999646ebbbe service nova] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Received event network-vif-deleted-b0528c8d-a14c-4420-a248-fda3f0a92893 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:33:22 user nova-compute[75066]: DEBUG nova.compute.manager [req-de414941-3dd7-454c-b0c1-0ad624470b09 req-1df7ecc6-ef8f-49ca-b312-cfb65bd483d3 service nova] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Received event network-vif-plugged-b0528c8d-a14c-4420-a248-fda3f0a92893 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:33:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-de414941-3dd7-454c-b0c1-0ad624470b09 req-1df7ecc6-ef8f-49ca-b312-cfb65bd483d3 service nova] Acquiring lock "00506483-8f09-4a3d-938a-31ab1b2dbf83-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:33:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-de414941-3dd7-454c-b0c1-0ad624470b09 req-1df7ecc6-ef8f-49ca-b312-cfb65bd483d3 service nova] Lock "00506483-8f09-4a3d-938a-31ab1b2dbf83-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:33:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-de414941-3dd7-454c-b0c1-0ad624470b09 req-1df7ecc6-ef8f-49ca-b312-cfb65bd483d3 service nova] Lock "00506483-8f09-4a3d-938a-31ab1b2dbf83-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:33:22 user nova-compute[75066]: DEBUG nova.compute.manager [req-de414941-3dd7-454c-b0c1-0ad624470b09 req-1df7ecc6-ef8f-49ca-b312-cfb65bd483d3 service nova] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] No waiting events found dispatching network-vif-plugged-b0528c8d-a14c-4420-a248-fda3f0a92893 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:33:22 user nova-compute[75066]: WARNING nova.compute.manager [req-de414941-3dd7-454c-b0c1-0ad624470b09 req-1df7ecc6-ef8f-49ca-b312-cfb65bd483d3 service nova] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Received unexpected event network-vif-plugged-b0528c8d-a14c-4420-a248-fda3f0a92893 for instance with vm_state active and task_state deleting.
Dec 01 19:33:22 user nova-compute[75066]: INFO nova.compute.manager [None req-a5e3e08f-df6a-4d40-9e5a-ec61c2427cf6 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Took 0.81 seconds to detach 1 volumes for instance.
Dec 01 19:33:22 user nova-compute[75066]: DEBUG nova.compute.manager [None req-a5e3e08f-df6a-4d40-9e5a-ec61c2427cf6 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: 00506483-8f09-4a3d-938a-31ab1b2dbf83] Deleting volume: 333c6d2d-5a25-42f1-8a9b-9366196fd6f9 {{(pid=75066) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Dec 01 19:33:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a5e3e08f-df6a-4d40-9e5a-ec61c2427cf6 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:33:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a5e3e08f-df6a-4d40-9e5a-ec61c2427cf6 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:33:23 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-a5e3e08f-df6a-4d40-9e5a-ec61c2427cf6 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:33:23 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-a5e3e08f-df6a-4d40-9e5a-ec61c2427cf6 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:33:23 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a5e3e08f-df6a-4d40-9e5a-ec61c2427cf6 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.397s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:33:23 user nova-compute[75066]: INFO nova.scheduler.client.report [None req-a5e3e08f-df6a-4d40-9e5a-ec61c2427cf6 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Deleted allocations for instance 00506483-8f09-4a3d-938a-31ab1b2dbf83
Dec 01 19:33:23 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a5e3e08f-df6a-4d40-9e5a-ec61c2427cf6 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "00506483-8f09-4a3d-938a-31ab1b2dbf83" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.450s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:33:25 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:33:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:33:34 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-eb6a8cf8-cede-4746-aa80-a11ddb5cd83b tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e9a9bf17-1c03-426a-b33e-9d8c458df283 is timed out.
Dec 01 19:33:34 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-eb6a8cf8-cede-4746-aa80-a11ddb5cd83b tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Successfully detached device vdb from instance e9a9bf17-1c03-426a-b33e-9d8c458df283 from the live domain config.
Dec 01 19:33:34 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb6a8cf8-cede-4746-aa80-a11ddb5cd83b tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] calling os-brick to detach iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 19:33:34 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6a8cf8-cede-4746-aa80-a11ddb5cd83b tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, {'target_iqn': 'iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iOdoapDf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:33:34 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-eb6a8cf8-cede-4746-aa80-a11ddb5cd83b tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:33:34 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-eb6a8cf8-cede-4746-aa80-a11ddb5cd83b tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:33:34 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-eb6a8cf8-cede-4746-aa80-a11ddb5cd83b tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:33:34 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:33:34 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:33:34 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[284c33df-f30b-4154-b7a9-571f183d4d50]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:33:34 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6a8cf8-cede-4746-aa80-a11ddb5cd83b tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 19:33:34 user nova-compute[75066]: No targets found.
Dec 01 19:33:34 user nova-compute[75066]: iSNS:
Dec 01 19:33:34 user nova-compute[75066]: No targets found.
Dec 01 19:33:34 user nova-compute[75066]: STATIC:
Dec 01 19:33:34 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571
Dec 01 19:33:34 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:33:34 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:33:34 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7
Dec 01 19:33:34 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:33:34 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:33:34 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711
Dec 01 19:33:34 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:33:34 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:33:34 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb
Dec 01 19:33:34 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:33:34 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:33:34 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236
Dec 01 19:33:34 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:33:34 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:33:34 user nova-compute[75066]: FIRMWARE:
Dec 01 19:33:34 user nova-compute[75066]: No targets found.
Dec 01 19:33:34 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:33:34 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6a8cf8-cede-4746-aa80-a11ddb5cd83b tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 19:33:34 user nova-compute[75066]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 19:33:34 user nova-compute[75066]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75066) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 19:33:34 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6a8cf8-cede-4746-aa80-a11ddb5cd83b tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236', 0)] {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 19:33:34 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:33:34 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:33:34 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[544c7881-d8c3-4de4-8fc7-b51d96b2134a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:33:34 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:33:34 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:33:34 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c89765-2d72-4e31-ab7e-0ee80337ebad]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:33:34 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6a8cf8-cede-4746-aa80-a11ddb5cd83b tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:33:34 user nova-compute[75066]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 (non-flash)
Dec 01 19:33:34 user nova-compute[75066]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 (non-flash)
Dec 01 19:33:34 user nova-compute[75066]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236 (non-flash)
Dec 01 19:33:34 user nova-compute[75066]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711 (non-flash)
Dec 01 19:33:34 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:33:34 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6a8cf8-cede-4746-aa80-a11ddb5cd83b tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:33:34 user nova-compute[75066]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 (non-flash)
Dec 01 19:33:34 user nova-compute[75066]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 (non-flash)
Dec 01 19:33:34 user nova-compute[75066]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236 (non-flash)
Dec 01 19:33:34 user nova-compute[75066]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711 (non-flash)
Dec 01 19:33:34 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:33:34 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6a8cf8-cede-4746-aa80-a11ddb5cd83b tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91707f1510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236'): ({'sdc'}, set())}) {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 19:33:34 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-eb6a8cf8-cede-4746-aa80-a11ddb5cd83b tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Removing single pathed devices sdc {{(pid=75066) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 19:33:34 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:33:34 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:33:34 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c9c656-e2a1-4e42-99b9-e9dc23b8bd3c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:33:34 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:33:34 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:33:34 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6eb4f0-1880-4cb7-9f68-dcd35dc84e80]: (4, ('ok\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:33:34 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-eb6a8cf8-cede-4746-aa80-a11ddb5cd83b tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Flushing IO for device /dev/sdc {{(pid=75066) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 19:33:34 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:33:34 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:33:34 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6cb1aed-3164-42a9-b21a-fc97d3823064]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:33:34 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-eb6a8cf8-cede-4746-aa80-a11ddb5cd83b tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75066) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 19:33:34 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:33:34 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:33:34 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7416c80-1cb2-4577-91a3-610544564bb6]: (4, ('1', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:33:34 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-eb6a8cf8-cede-4746-aa80-a11ddb5cd83b tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 19:33:34 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-eb6a8cf8-cede-4746-aa80-a11ddb5cd83b tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] SCSI volumes sdc have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 19:33:34 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6a8cf8-cede-4746-aa80-a11ddb5cd83b tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236')] {{(pid=75066) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 19:33:34 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:33:34 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:33:34 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[841b9324-6d86-41eb-8f8e-66cc770d66ed]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:33:34 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6a8cf8-cede-4746-aa80-a11ddb5cd83b tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:33:34 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236 -p 172.16.0.220:3260 --logout {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:33:34 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:33:34 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cf3ff29-416e-484b-ad4a-84d211ea6090]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:33:34 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6a8cf8-cede-4746-aa80-a11ddb5cd83b tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236, portal: 172.16.0.220,3260]
Dec 01 19:33:34 user nova-compute[75066]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236, portal: 172.16.0.220,3260] successful.
Dec 01 19:33:34 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:33:34 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236 -p 172.16.0.220:3260 --op delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:33:34 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5755ff17-79cf-4b3c-8ee0-5303b9a18236 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:33:34 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[f325dc2c-692a-40be-9a76-79407af37e06]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:33:34 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6a8cf8-cede-4746-aa80-a11ddb5cd83b tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:33:34 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-eb6a8cf8-cede-4746-aa80-a11ddb5cd83b tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:33:34 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb6a8cf8-cede-4746-aa80-a11ddb5cd83b tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] <== disconnect_volume: return (318ms) None {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:33:34 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb6a8cf8-cede-4746-aa80-a11ddb5cd83b tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Disconnected iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 19:33:35 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:33:35 user nova-compute[75066]: DEBUG nova.objects.instance [None req-eb6a8cf8-cede-4746-aa80-a11ddb5cd83b tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Lazy-loading 'flavor' on Instance uuid e9a9bf17-1c03-426a-b33e-9d8c458df283 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:33:35 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-eb6a8cf8-cede-4746-aa80-a11ddb5cd83b tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Lock "e9a9bf17-1c03-426a-b33e-9d8c458df283" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.949s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:33:40 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:33:45 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-fe6a0078-2198-4d86-9d6f-d299b6324819 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Acquiring lock "479bf6d9-ffec-4417-99c5-3af0dafc0881" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:33:45 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-fe6a0078-2198-4d86-9d6f-d299b6324819 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Lock "479bf6d9-ffec-4417-99c5-3af0dafc0881" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:33:45 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-fe6a0078-2198-4d86-9d6f-d299b6324819 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Acquiring lock "479bf6d9-ffec-4417-99c5-3af0dafc0881-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:33:45 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-fe6a0078-2198-4d86-9d6f-d299b6324819 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Lock "479bf6d9-ffec-4417-99c5-3af0dafc0881-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:33:45 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-fe6a0078-2198-4d86-9d6f-d299b6324819 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Lock "479bf6d9-ffec-4417-99c5-3af0dafc0881-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:33:45 user nova-compute[75066]: INFO nova.compute.manager [None req-fe6a0078-2198-4d86-9d6f-d299b6324819 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 479bf6d9-ffec-4417-99c5-3af0dafc0881] Terminating instance
Dec 01 19:33:45 user nova-compute[75066]: DEBUG nova.compute.manager [None req-fe6a0078-2198-4d86-9d6f-d299b6324819 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 479bf6d9-ffec-4417-99c5-3af0dafc0881] Start destroying the instance on the hypervisor. {{(pid=75066) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 19:33:45 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:33:45 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:33:45 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:33:45 user nova-compute[75066]: DEBUG nova.compute.manager [req-cca24fae-55f7-4500-b524-a53a68c8d374 req-9c0d0095-29cf-49eb-9161-f681331222d6 service nova] [instance: 479bf6d9-ffec-4417-99c5-3af0dafc0881] Received event network-vif-unplugged-73fd5302-db93-4304-97c6-735fd59227c0 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:33:45 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-cca24fae-55f7-4500-b524-a53a68c8d374 req-9c0d0095-29cf-49eb-9161-f681331222d6 service nova] Acquiring lock "479bf6d9-ffec-4417-99c5-3af0dafc0881-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:33:45 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-cca24fae-55f7-4500-b524-a53a68c8d374 req-9c0d0095-29cf-49eb-9161-f681331222d6 service nova] Lock "479bf6d9-ffec-4417-99c5-3af0dafc0881-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:33:45 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-cca24fae-55f7-4500-b524-a53a68c8d374 req-9c0d0095-29cf-49eb-9161-f681331222d6 service nova] Lock "479bf6d9-ffec-4417-99c5-3af0dafc0881-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:33:45 user nova-compute[75066]: DEBUG nova.compute.manager [req-cca24fae-55f7-4500-b524-a53a68c8d374 req-9c0d0095-29cf-49eb-9161-f681331222d6 service nova] [instance: 479bf6d9-ffec-4417-99c5-3af0dafc0881] No waiting events found dispatching network-vif-unplugged-73fd5302-db93-4304-97c6-735fd59227c0 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:33:45 user nova-compute[75066]: DEBUG nova.compute.manager [req-cca24fae-55f7-4500-b524-a53a68c8d374 req-9c0d0095-29cf-49eb-9161-f681331222d6 service nova] [instance: 479bf6d9-ffec-4417-99c5-3af0dafc0881] Received event network-vif-unplugged-73fd5302-db93-4304-97c6-735fd59227c0 for instance with task_state deleting. {{(pid=75066) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 19:33:45 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:33:45 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:33:46 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:33:46 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 479bf6d9-ffec-4417-99c5-3af0dafc0881] Instance destroyed successfully.
Dec 01 19:33:46 user nova-compute[75066]: DEBUG nova.objects.instance [None req-fe6a0078-2198-4d86-9d6f-d299b6324819 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Lazy-loading 'resources' on Instance uuid 479bf6d9-ffec-4417-99c5-3af0dafc0881 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:33:46 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-fe6a0078-2198-4d86-9d6f-d299b6324819 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:31:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-909713826',display_name='tempest-ServersNegativeTestJSON-server-909713826',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-909713826',id=36,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:32:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c9f677c9e8c24b7389273db9d82954fe',ramdisk_id='',reservation_id='r-ioskpdp0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1315108451',owner_user_name='tempest-ServersNegativeTestJSON-1315108451-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:32:03Z,user_data=None,user_id='14735fcf06cb45519d9fd71975871a62',uuid=479bf6d9-ffec-4417-99c5-3af0dafc0881,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "73fd5302-db93-4304-97c6-735fd59227c0", "address": "fa:16:3e:d0:5c:75", "network": {"id": "884b20a8-4ead-448d-994b-8e714dc32fae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-357575766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9f677c9e8c24b7389273db9d82954fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73fd5302-db", "ovs_interfaceid": "73fd5302-db93-4304-97c6-735fd59227c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:33:46 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-fe6a0078-2198-4d86-9d6f-d299b6324819 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Converting VIF {"id": "73fd5302-db93-4304-97c6-735fd59227c0", "address": "fa:16:3e:d0:5c:75", "network": {"id": "884b20a8-4ead-448d-994b-8e714dc32fae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-357575766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9f677c9e8c24b7389273db9d82954fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73fd5302-db", "ovs_interfaceid": "73fd5302-db93-4304-97c6-735fd59227c0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:33:46 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-fe6a0078-2198-4d86-9d6f-d299b6324819 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:5c:75,bridge_name='br-int',has_traffic_filtering=True,id=73fd5302-db93-4304-97c6-735fd59227c0,network=Network(884b20a8-4ead-448d-994b-8e714dc32fae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73fd5302-db') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:33:46 user nova-compute[75066]: DEBUG os_vif [None req-fe6a0078-2198-4d86-9d6f-d299b6324819 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:5c:75,bridge_name='br-int',has_traffic_filtering=True,id=73fd5302-db93-4304-97c6-735fd59227c0,network=Network(884b20a8-4ead-448d-994b-8e714dc32fae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73fd5302-db') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:33:46 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:33:46 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap73fd5302-db, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:33:46 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:33:46 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:33:46 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:33:46 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=25b175af-fce7-4605-99d7-8dbc2aa5848a) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:33:46 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:33:46 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:33:46 user nova-compute[75066]: INFO os_vif [None req-fe6a0078-2198-4d86-9d6f-d299b6324819 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:5c:75,bridge_name='br-int',has_traffic_filtering=True,id=73fd5302-db93-4304-97c6-735fd59227c0,network=Network(884b20a8-4ead-448d-994b-8e714dc32fae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73fd5302-db')
Dec 01 19:33:46 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-fe6a0078-2198-4d86-9d6f-d299b6324819 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 479bf6d9-ffec-4417-99c5-3af0dafc0881] Deleting instance files /opt/stack/data/nova/instances/479bf6d9-ffec-4417-99c5-3af0dafc0881_del
Dec 01 19:33:46 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-fe6a0078-2198-4d86-9d6f-d299b6324819 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 479bf6d9-ffec-4417-99c5-3af0dafc0881] Deletion of /opt/stack/data/nova/instances/479bf6d9-ffec-4417-99c5-3af0dafc0881_del complete
Dec 01 19:33:46 user nova-compute[75066]: INFO nova.compute.manager [None req-fe6a0078-2198-4d86-9d6f-d299b6324819 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 479bf6d9-ffec-4417-99c5-3af0dafc0881] Took 0.95 seconds to destroy the instance on the hypervisor.
Dec 01 19:33:46 user nova-compute[75066]: DEBUG oslo.service.loopingcall [None req-fe6a0078-2198-4d86-9d6f-d299b6324819 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75066) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 19:33:46 user nova-compute[75066]: DEBUG nova.compute.manager [-] [instance: 479bf6d9-ffec-4417-99c5-3af0dafc0881] Deallocating network for instance {{(pid=75066) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 19:33:46 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: 479bf6d9-ffec-4417-99c5-3af0dafc0881] deallocate_for_instance() {{(pid=75066) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 19:33:46 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: 479bf6d9-ffec-4417-99c5-3af0dafc0881] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:33:46 user nova-compute[75066]: INFO nova.compute.manager [-] [instance: 479bf6d9-ffec-4417-99c5-3af0dafc0881] Took 0.45 seconds to deallocate network for instance.
Dec 01 19:33:46 user nova-compute[75066]: DEBUG nova.compute.manager [req-fef227ad-8635-4b41-910e-2abb7651e55d req-646d16ff-22d9-4544-a837-11aa4e6e064f service nova] [instance: 479bf6d9-ffec-4417-99c5-3af0dafc0881] Received event network-vif-deleted-73fd5302-db93-4304-97c6-735fd59227c0 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:33:46 user nova-compute[75066]: INFO nova.compute.manager [req-fef227ad-8635-4b41-910e-2abb7651e55d req-646d16ff-22d9-4544-a837-11aa4e6e064f service nova] [instance: 479bf6d9-ffec-4417-99c5-3af0dafc0881] Neutron deleted interface 73fd5302-db93-4304-97c6-735fd59227c0; detaching it from the instance and deleting it from the info cache
Dec 01 19:33:46 user nova-compute[75066]: DEBUG nova.network.neutron [req-fef227ad-8635-4b41-910e-2abb7651e55d req-646d16ff-22d9-4544-a837-11aa4e6e064f service nova] [instance: 479bf6d9-ffec-4417-99c5-3af0dafc0881] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:33:46 user nova-compute[75066]: DEBUG nova.compute.manager [req-fef227ad-8635-4b41-910e-2abb7651e55d req-646d16ff-22d9-4544-a837-11aa4e6e064f service nova] [instance: 479bf6d9-ffec-4417-99c5-3af0dafc0881] Detach interface failed, port_id=73fd5302-db93-4304-97c6-735fd59227c0, reason: Instance 479bf6d9-ffec-4417-99c5-3af0dafc0881 could not be found. {{(pid=75066) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 01 19:33:46 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-fe6a0078-2198-4d86-9d6f-d299b6324819 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:33:46 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-fe6a0078-2198-4d86-9d6f-d299b6324819 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:33:47 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-fe6a0078-2198-4d86-9d6f-d299b6324819 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:33:47 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-fe6a0078-2198-4d86-9d6f-d299b6324819 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:33:47 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-fe6a0078-2198-4d86-9d6f-d299b6324819 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.439s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:33:47 user nova-compute[75066]: INFO nova.scheduler.client.report [None req-fe6a0078-2198-4d86-9d6f-d299b6324819 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Deleted allocations for instance 479bf6d9-ffec-4417-99c5-3af0dafc0881
Dec 01 19:33:47 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-fe6a0078-2198-4d86-9d6f-d299b6324819 tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Lock "479bf6d9-ffec-4417-99c5-3af0dafc0881" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.033s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:33:47 user nova-compute[75066]: DEBUG nova.compute.manager [req-1a6d2f12-6e88-4aaf-9f62-3be8d2606819 req-b41b6c4b-7931-4535-bed4-169bbc1fbc6c service nova] [instance: 479bf6d9-ffec-4417-99c5-3af0dafc0881] Received event network-vif-plugged-73fd5302-db93-4304-97c6-735fd59227c0 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:33:47 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-1a6d2f12-6e88-4aaf-9f62-3be8d2606819 req-b41b6c4b-7931-4535-bed4-169bbc1fbc6c service nova] Acquiring lock "479bf6d9-ffec-4417-99c5-3af0dafc0881-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:33:47 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-1a6d2f12-6e88-4aaf-9f62-3be8d2606819 req-b41b6c4b-7931-4535-bed4-169bbc1fbc6c service nova] Lock "479bf6d9-ffec-4417-99c5-3af0dafc0881-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:33:47 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-1a6d2f12-6e88-4aaf-9f62-3be8d2606819 req-b41b6c4b-7931-4535-bed4-169bbc1fbc6c service nova] Lock "479bf6d9-ffec-4417-99c5-3af0dafc0881-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:33:47 user nova-compute[75066]: DEBUG nova.compute.manager [req-1a6d2f12-6e88-4aaf-9f62-3be8d2606819 req-b41b6c4b-7931-4535-bed4-169bbc1fbc6c service nova] [instance: 479bf6d9-ffec-4417-99c5-3af0dafc0881] No waiting events found dispatching network-vif-plugged-73fd5302-db93-4304-97c6-735fd59227c0 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:33:47 user nova-compute[75066]: WARNING nova.compute.manager [req-1a6d2f12-6e88-4aaf-9f62-3be8d2606819 req-b41b6c4b-7931-4535-bed4-169bbc1fbc6c service nova] [instance: 479bf6d9-ffec-4417-99c5-3af0dafc0881] Received unexpected event network-vif-plugged-73fd5302-db93-4304-97c6-735fd59227c0 for instance with vm_state deleted and task_state None.
Dec 01 19:33:48 user nova-compute[75066]: INFO nova.compute.manager [None req-76550888-eca1-4800-83f8-7c5dd2c81be4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Unrescuing
Dec 01 19:33:48 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-76550888-eca1-4800-83f8-7c5dd2c81be4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Acquiring lock "refresh_cache-f04249c5-0196-455c-ac7a-f1ff8be320d4" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:33:48 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-76550888-eca1-4800-83f8-7c5dd2c81be4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Acquired lock "refresh_cache-f04249c5-0196-455c-ac7a-f1ff8be320d4" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:33:48 user nova-compute[75066]: DEBUG nova.network.neutron [None req-76550888-eca1-4800-83f8-7c5dd2c81be4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:33:48 user nova-compute[75066]: DEBUG nova.network.neutron [None req-76550888-eca1-4800-83f8-7c5dd2c81be4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Updating instance_info_cache with network_info: [{"id": "bbc4649f-c295-423e-a1c2-be3af706e4de", "address": "fa:16:3e:01:63:75", "network": {"id": "6b0f48b7-3db2-49b2-a238-8fd811b52d62", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1688127634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e000d89bca44cd8acba504256d8d1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbc4649f-c2", "ovs_interfaceid": "bbc4649f-c295-423e-a1c2-be3af706e4de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:33:48 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-76550888-eca1-4800-83f8-7c5dd2c81be4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Releasing lock "refresh_cache-f04249c5-0196-455c-ac7a-f1ff8be320d4" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:33:48 user nova-compute[75066]: DEBUG nova.objects.instance [None req-76550888-eca1-4800-83f8-7c5dd2c81be4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lazy-loading 'flavor' on Instance uuid f04249c5-0196-455c-ac7a-f1ff8be320d4 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:33:49 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:33:49 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:33:49 user nova-compute[75066]: DEBUG nova.compute.manager [req-ad815480-631d-4a27-8cb5-f5c4cedb89fe req-b229ec2d-730f-4c0e-b96e-e2555f4ee177 service nova] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Received event network-vif-unplugged-bbc4649f-c295-423e-a1c2-be3af706e4de {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:33:49 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-ad815480-631d-4a27-8cb5-f5c4cedb89fe req-b229ec2d-730f-4c0e-b96e-e2555f4ee177 service nova] Acquiring lock "f04249c5-0196-455c-ac7a-f1ff8be320d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:33:49 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-ad815480-631d-4a27-8cb5-f5c4cedb89fe req-b229ec2d-730f-4c0e-b96e-e2555f4ee177 service nova] Lock "f04249c5-0196-455c-ac7a-f1ff8be320d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:33:49 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-ad815480-631d-4a27-8cb5-f5c4cedb89fe req-b229ec2d-730f-4c0e-b96e-e2555f4ee177 service nova] Lock "f04249c5-0196-455c-ac7a-f1ff8be320d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:33:49 user nova-compute[75066]: DEBUG nova.compute.manager [req-ad815480-631d-4a27-8cb5-f5c4cedb89fe req-b229ec2d-730f-4c0e-b96e-e2555f4ee177 service nova] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] No waiting events found dispatching network-vif-unplugged-bbc4649f-c295-423e-a1c2-be3af706e4de {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:33:49 user nova-compute[75066]: WARNING nova.compute.manager [req-ad815480-631d-4a27-8cb5-f5c4cedb89fe req-b229ec2d-730f-4c0e-b96e-e2555f4ee177 service nova] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Received unexpected event network-vif-unplugged-bbc4649f-c295-423e-a1c2-be3af706e4de for instance with vm_state rescued and task_state unrescuing.
Dec 01 19:33:49 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:33:49 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:33:49 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Instance destroyed successfully.
Dec 01 19:33:50 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:33:50 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:33:50 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:33:50 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:33:50 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:33:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:33:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:33:51 user nova-compute[75066]: DEBUG nova.compute.manager [req-c85fde66-400a-4fc8-b3e7-62d1f269139d req-6128491c-5d71-496b-81a9-3215b4f5e1f5 service nova] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Received event network-vif-plugged-bbc4649f-c295-423e-a1c2-be3af706e4de {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:33:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-c85fde66-400a-4fc8-b3e7-62d1f269139d req-6128491c-5d71-496b-81a9-3215b4f5e1f5 service nova] Acquiring lock "f04249c5-0196-455c-ac7a-f1ff8be320d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:33:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-c85fde66-400a-4fc8-b3e7-62d1f269139d req-6128491c-5d71-496b-81a9-3215b4f5e1f5 service nova] Lock "f04249c5-0196-455c-ac7a-f1ff8be320d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:33:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-c85fde66-400a-4fc8-b3e7-62d1f269139d req-6128491c-5d71-496b-81a9-3215b4f5e1f5 service nova] Lock "f04249c5-0196-455c-ac7a-f1ff8be320d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:33:51 user nova-compute[75066]: DEBUG nova.compute.manager [req-c85fde66-400a-4fc8-b3e7-62d1f269139d req-6128491c-5d71-496b-81a9-3215b4f5e1f5 service nova] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] No waiting events found dispatching network-vif-plugged-bbc4649f-c295-423e-a1c2-be3af706e4de {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:33:51 user nova-compute[75066]: WARNING nova.compute.manager [req-c85fde66-400a-4fc8-b3e7-62d1f269139d req-6128491c-5d71-496b-81a9-3215b4f5e1f5 service nova] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Received unexpected event network-vif-plugged-bbc4649f-c295-423e-a1c2-be3af706e4de for instance with vm_state rescued and task_state unrescuing.
Dec 01 19:33:51 user nova-compute[75066]: DEBUG nova.compute.manager [req-c85fde66-400a-4fc8-b3e7-62d1f269139d req-6128491c-5d71-496b-81a9-3215b4f5e1f5 service nova] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Received event network-vif-plugged-bbc4649f-c295-423e-a1c2-be3af706e4de {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:33:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-c85fde66-400a-4fc8-b3e7-62d1f269139d req-6128491c-5d71-496b-81a9-3215b4f5e1f5 service nova] Acquiring lock "f04249c5-0196-455c-ac7a-f1ff8be320d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:33:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-c85fde66-400a-4fc8-b3e7-62d1f269139d req-6128491c-5d71-496b-81a9-3215b4f5e1f5 service nova] Lock "f04249c5-0196-455c-ac7a-f1ff8be320d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:33:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-c85fde66-400a-4fc8-b3e7-62d1f269139d req-6128491c-5d71-496b-81a9-3215b4f5e1f5 service nova] Lock "f04249c5-0196-455c-ac7a-f1ff8be320d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:33:51 user nova-compute[75066]: DEBUG nova.compute.manager [req-c85fde66-400a-4fc8-b3e7-62d1f269139d req-6128491c-5d71-496b-81a9-3215b4f5e1f5 service nova] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] No waiting events found dispatching network-vif-plugged-bbc4649f-c295-423e-a1c2-be3af706e4de {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:33:51 user nova-compute[75066]: WARNING nova.compute.manager [req-c85fde66-400a-4fc8-b3e7-62d1f269139d req-6128491c-5d71-496b-81a9-3215b4f5e1f5 service nova] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Received unexpected event network-vif-plugged-bbc4649f-c295-423e-a1c2-be3af706e4de for instance with vm_state rescued and task_state unrescuing.
Dec 01 19:33:51 user nova-compute[75066]: DEBUG nova.compute.manager [req-c85fde66-400a-4fc8-b3e7-62d1f269139d req-6128491c-5d71-496b-81a9-3215b4f5e1f5 service nova] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Received event network-vif-plugged-bbc4649f-c295-423e-a1c2-be3af706e4de {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:33:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-c85fde66-400a-4fc8-b3e7-62d1f269139d req-6128491c-5d71-496b-81a9-3215b4f5e1f5 service nova] Acquiring lock "f04249c5-0196-455c-ac7a-f1ff8be320d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:33:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-c85fde66-400a-4fc8-b3e7-62d1f269139d req-6128491c-5d71-496b-81a9-3215b4f5e1f5 service nova] Lock "f04249c5-0196-455c-ac7a-f1ff8be320d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:33:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-c85fde66-400a-4fc8-b3e7-62d1f269139d req-6128491c-5d71-496b-81a9-3215b4f5e1f5 service nova] Lock "f04249c5-0196-455c-ac7a-f1ff8be320d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:33:51 user nova-compute[75066]: DEBUG nova.compute.manager [req-c85fde66-400a-4fc8-b3e7-62d1f269139d req-6128491c-5d71-496b-81a9-3215b4f5e1f5 service nova] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] No waiting events found dispatching network-vif-plugged-bbc4649f-c295-423e-a1c2-be3af706e4de {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:33:51 user nova-compute[75066]: WARNING nova.compute.manager [req-c85fde66-400a-4fc8-b3e7-62d1f269139d req-6128491c-5d71-496b-81a9-3215b4f5e1f5 service nova] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Received unexpected event network-vif-plugged-bbc4649f-c295-423e-a1c2-be3af706e4de for instance with vm_state rescued and task_state unrescuing.
Dec 01 19:33:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:33:52 user nova-compute[75066]: DEBUG nova.compute.manager [None req-76550888-eca1-4800-83f8-7c5dd2c81be4 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:33:53 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:33:56 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:34:01 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:34:04 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-6dac30cb-a571-442a-809a-cc8efcc97b37 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Acquiring lock "e9a9bf17-1c03-426a-b33e-9d8c458df283" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:34:04 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-6dac30cb-a571-442a-809a-cc8efcc97b37 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Lock "e9a9bf17-1c03-426a-b33e-9d8c458df283" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:34:04 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-6dac30cb-a571-442a-809a-cc8efcc97b37 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Acquiring lock "e9a9bf17-1c03-426a-b33e-9d8c458df283-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:34:04 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-6dac30cb-a571-442a-809a-cc8efcc97b37 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Lock "e9a9bf17-1c03-426a-b33e-9d8c458df283-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:34:04 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-6dac30cb-a571-442a-809a-cc8efcc97b37 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Lock "e9a9bf17-1c03-426a-b33e-9d8c458df283-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:34:04 user nova-compute[75066]: INFO nova.compute.manager [None req-6dac30cb-a571-442a-809a-cc8efcc97b37 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Terminating instance
Dec 01 19:34:04 user nova-compute[75066]: DEBUG nova.compute.manager [None req-6dac30cb-a571-442a-809a-cc8efcc97b37 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Start destroying the instance on the hypervisor. {{(pid=75066) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 19:34:04 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:34:04 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:34:04 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:34:04 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:34:04 user nova-compute[75066]: DEBUG nova.compute.manager [req-cb0294df-5712-43ed-af5b-9510775c5445 req-a9355950-a652-41f2-94a6-bebc364e5cad service nova] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Received event network-vif-unplugged-a517b344-264d-4bf9-8c6a-48c950d4bca0 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:34:04 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-cb0294df-5712-43ed-af5b-9510775c5445 req-a9355950-a652-41f2-94a6-bebc364e5cad service nova] Acquiring lock "e9a9bf17-1c03-426a-b33e-9d8c458df283-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:34:04 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-cb0294df-5712-43ed-af5b-9510775c5445 req-a9355950-a652-41f2-94a6-bebc364e5cad service nova] Lock "e9a9bf17-1c03-426a-b33e-9d8c458df283-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:34:04 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-cb0294df-5712-43ed-af5b-9510775c5445 req-a9355950-a652-41f2-94a6-bebc364e5cad service nova] Lock "e9a9bf17-1c03-426a-b33e-9d8c458df283-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:34:04 user nova-compute[75066]: DEBUG nova.compute.manager [req-cb0294df-5712-43ed-af5b-9510775c5445 req-a9355950-a652-41f2-94a6-bebc364e5cad service nova] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] No waiting events found dispatching network-vif-unplugged-a517b344-264d-4bf9-8c6a-48c950d4bca0 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:34:04 user nova-compute[75066]: DEBUG nova.compute.manager [req-cb0294df-5712-43ed-af5b-9510775c5445 req-a9355950-a652-41f2-94a6-bebc364e5cad service nova] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Received event network-vif-unplugged-a517b344-264d-4bf9-8c6a-48c950d4bca0 for instance with task_state deleting. {{(pid=75066) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 19:34:05 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Instance destroyed successfully.
Dec 01 19:34:05 user nova-compute[75066]: DEBUG nova.objects.instance [None req-6dac30cb-a571-442a-809a-cc8efcc97b37 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Lazy-loading 'resources' on Instance uuid e9a9bf17-1c03-426a-b33e-9d8c458df283 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:34:05 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-6dac30cb-a571-442a-809a-cc8efcc97b37 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:29:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-774622526',display_name='tempest-TestServerVolumeAttachmentScenario-server-774622526',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-774622526',id=32,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7d6kDBnFyFcNVVXa33UmWf1yW6+6Z/Of2MyQnjw2TaaDlepM5519GYX6arcskIqtNfHVxPZQeGdEgGl5BLrqRzrgs1nV2upD/yucUQTclnWmDXrfJGIHuTQnhHtl93Qw==',key_name='tempest-keypair-823038',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:29:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='99b27d42c6c64cf08f74c75717439c13',ramdisk_id='',reservation_id='r-r4322m3a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1483328456',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1483328456-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:29:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c263caa90725445e8cf7eb481fc6af3c',uuid=e9a9bf17-1c03-426a-b33e-9d8c458df283,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a517b344-264d-4bf9-8c6a-48c950d4bca0", "address": "fa:16:3e:37:9e:f3", "network": {"id": "0432709c-c027-41b5-afa1-a9221c85cd4e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1490736568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99b27d42c6c64cf08f74c75717439c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa517b344-26", "ovs_interfaceid": "a517b344-264d-4bf9-8c6a-48c950d4bca0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:34:05 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-6dac30cb-a571-442a-809a-cc8efcc97b37 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Converting VIF {"id": "a517b344-264d-4bf9-8c6a-48c950d4bca0", "address": "fa:16:3e:37:9e:f3", "network": {"id": "0432709c-c027-41b5-afa1-a9221c85cd4e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1490736568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "99b27d42c6c64cf08f74c75717439c13", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa517b344-26", "ovs_interfaceid": "a517b344-264d-4bf9-8c6a-48c950d4bca0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:34:05 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-6dac30cb-a571-442a-809a-cc8efcc97b37 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:37:9e:f3,bridge_name='br-int',has_traffic_filtering=True,id=a517b344-264d-4bf9-8c6a-48c950d4bca0,network=Network(0432709c-c027-41b5-afa1-a9221c85cd4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa517b344-26') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:34:05 user nova-compute[75066]: DEBUG os_vif [None req-6dac30cb-a571-442a-809a-cc8efcc97b37 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:9e:f3,bridge_name='br-int',has_traffic_filtering=True,id=a517b344-264d-4bf9-8c6a-48c950d4bca0,network=Network(0432709c-c027-41b5-afa1-a9221c85cd4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa517b344-26') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:34:05 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:34:05 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa517b344-26, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:34:05 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:34:05 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:34:05 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:34:05 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0d4078ac-9931-4d97-b492-08a431f1958d) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:34:05 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:34:05 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:34:05 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:34:05 user nova-compute[75066]: INFO os_vif [None req-6dac30cb-a571-442a-809a-cc8efcc97b37 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:37:9e:f3,bridge_name='br-int',has_traffic_filtering=True,id=a517b344-264d-4bf9-8c6a-48c950d4bca0,network=Network(0432709c-c027-41b5-afa1-a9221c85cd4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa517b344-26')
Dec 01 19:34:05 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-6dac30cb-a571-442a-809a-cc8efcc97b37 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Deleting instance files /opt/stack/data/nova/instances/e9a9bf17-1c03-426a-b33e-9d8c458df283_del
Dec 01 19:34:05 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-6dac30cb-a571-442a-809a-cc8efcc97b37 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Deletion of /opt/stack/data/nova/instances/e9a9bf17-1c03-426a-b33e-9d8c458df283_del complete
Dec 01 19:34:05 user nova-compute[75066]: INFO nova.compute.manager [None req-6dac30cb-a571-442a-809a-cc8efcc97b37 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Took 0.95 seconds to destroy the instance on the hypervisor.
Dec 01 19:34:05 user nova-compute[75066]: DEBUG oslo.service.loopingcall [None req-6dac30cb-a571-442a-809a-cc8efcc97b37 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75066) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 19:34:05 user nova-compute[75066]: DEBUG nova.compute.manager [-] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Deallocating network for instance {{(pid=75066) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 19:34:05 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] deallocate_for_instance() {{(pid=75066) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 19:34:05 user nova-compute[75066]: DEBUG nova.compute.manager [req-520283ca-2c60-4c3b-bbc6-f16de3eac794 req-cef7d5e0-ca7e-48e5-a78b-56f8567e6519 service nova] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Received event network-changed-6d709e03-0f37-43f6-ab89-61e12ae93b48 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:34:05 user nova-compute[75066]: DEBUG nova.compute.manager [req-520283ca-2c60-4c3b-bbc6-f16de3eac794 req-cef7d5e0-ca7e-48e5-a78b-56f8567e6519 service nova] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Refreshing instance network info cache due to event network-changed-6d709e03-0f37-43f6-ab89-61e12ae93b48. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:34:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-520283ca-2c60-4c3b-bbc6-f16de3eac794 req-cef7d5e0-ca7e-48e5-a78b-56f8567e6519 service nova] Acquiring lock "refresh_cache-409478f4-7921-4a15-89b0-82c26fa39de7" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:34:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-520283ca-2c60-4c3b-bbc6-f16de3eac794 req-cef7d5e0-ca7e-48e5-a78b-56f8567e6519 service nova] Acquired lock "refresh_cache-409478f4-7921-4a15-89b0-82c26fa39de7" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:34:05 user nova-compute[75066]: DEBUG nova.network.neutron [req-520283ca-2c60-4c3b-bbc6-f16de3eac794 req-cef7d5e0-ca7e-48e5-a78b-56f8567e6519 service nova] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Refreshing network info cache for port 6d709e03-0f37-43f6-ab89-61e12ae93b48 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:34:05 user nova-compute[75066]: DEBUG nova.network.neutron [req-520283ca-2c60-4c3b-bbc6-f16de3eac794 req-cef7d5e0-ca7e-48e5-a78b-56f8567e6519 service nova] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Updated VIF entry in instance network info cache for port 6d709e03-0f37-43f6-ab89-61e12ae93b48. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:34:05 user nova-compute[75066]: DEBUG nova.network.neutron [req-520283ca-2c60-4c3b-bbc6-f16de3eac794 req-cef7d5e0-ca7e-48e5-a78b-56f8567e6519 service nova] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Updating instance_info_cache with network_info: [{"id": "6d709e03-0f37-43f6-ab89-61e12ae93b48", "address": "fa:16:3e:39:17:c8", "network": {"id": "49dd72ae-ec07-46a6-8463-e38bdfe1eba0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-738739404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879678dca7054c178839f56e66a6e0ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d709e03-0f", "ovs_interfaceid": "6d709e03-0f37-43f6-ab89-61e12ae93b48", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:34:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-520283ca-2c60-4c3b-bbc6-f16de3eac794 req-cef7d5e0-ca7e-48e5-a78b-56f8567e6519 service nova] Releasing lock "refresh_cache-409478f4-7921-4a15-89b0-82c26fa39de7" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:34:06 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:34:06 user nova-compute[75066]: INFO nova.compute.manager [-] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Took 0.83 seconds to deallocate network for instance.
Dec 01 19:34:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-6dac30cb-a571-442a-809a-cc8efcc97b37 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:34:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-6dac30cb-a571-442a-809a-cc8efcc97b37 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:34:06 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:34:06 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-6dac30cb-a571-442a-809a-cc8efcc97b37 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:34:06 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-6dac30cb-a571-442a-809a-cc8efcc97b37 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:34:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-6dac30cb-a571-442a-809a-cc8efcc97b37 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.401s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:34:06 user nova-compute[75066]: INFO nova.scheduler.client.report [None req-6dac30cb-a571-442a-809a-cc8efcc97b37 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Deleted allocations for instance e9a9bf17-1c03-426a-b33e-9d8c458df283
Dec 01 19:34:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-6dac30cb-a571-442a-809a-cc8efcc97b37 tempest-TestServerVolumeAttachmentScenario-1483328456 tempest-TestServerVolumeAttachmentScenario-1483328456-project-member] Lock "e9a9bf17-1c03-426a-b33e-9d8c458df283" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.365s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:34:06 user nova-compute[75066]: DEBUG nova.compute.manager [req-66345199-a980-4b7a-83f6-e14ba59ad24a req-eaadae70-133d-4115-8d64-27a832a38227 service nova] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Received event network-vif-plugged-a517b344-264d-4bf9-8c6a-48c950d4bca0 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:34:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-66345199-a980-4b7a-83f6-e14ba59ad24a req-eaadae70-133d-4115-8d64-27a832a38227 service nova] Acquiring lock "e9a9bf17-1c03-426a-b33e-9d8c458df283-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:34:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-66345199-a980-4b7a-83f6-e14ba59ad24a req-eaadae70-133d-4115-8d64-27a832a38227 service nova] Lock "e9a9bf17-1c03-426a-b33e-9d8c458df283-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:34:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-66345199-a980-4b7a-83f6-e14ba59ad24a req-eaadae70-133d-4115-8d64-27a832a38227 service nova] Lock "e9a9bf17-1c03-426a-b33e-9d8c458df283-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:34:06 user nova-compute[75066]: DEBUG nova.compute.manager [req-66345199-a980-4b7a-83f6-e14ba59ad24a req-eaadae70-133d-4115-8d64-27a832a38227 service nova] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] No waiting events found dispatching network-vif-plugged-a517b344-264d-4bf9-8c6a-48c950d4bca0 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:34:06 user nova-compute[75066]: WARNING nova.compute.manager [req-66345199-a980-4b7a-83f6-e14ba59ad24a req-eaadae70-133d-4115-8d64-27a832a38227 service nova] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Received unexpected event network-vif-plugged-a517b344-264d-4bf9-8c6a-48c950d4bca0 for instance with vm_state deleted and task_state None.
Dec 01 19:34:06 user nova-compute[75066]: DEBUG nova.compute.manager [req-66345199-a980-4b7a-83f6-e14ba59ad24a req-eaadae70-133d-4115-8d64-27a832a38227 service nova] [instance: e9a9bf17-1c03-426a-b33e-9d8c458df283] Received event network-vif-deleted-a517b344-264d-4bf9-8c6a-48c950d4bca0 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:34:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:34:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-640b0e5c-99b9-4d3c-99cf-00c261c52424 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Acquiring lock "409478f4-7921-4a15-89b0-82c26fa39de7" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:34:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-640b0e5c-99b9-4d3c-99cf-00c261c52424 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "409478f4-7921-4a15-89b0-82c26fa39de7" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:34:09 user nova-compute[75066]: INFO nova.compute.manager [None req-640b0e5c-99b9-4d3c-99cf-00c261c52424 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Shelving
Dec 01 19:34:09 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:34:09 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:34:09 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:34:09 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:34:09 user nova-compute[75066]: DEBUG nova.compute.manager [req-6ca3abe5-7e89-4f3f-b0af-83fa3c13e212 req-bf946688-8e85-49dd-8e7e-9912af73826b service nova] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Received event network-vif-unplugged-6d709e03-0f37-43f6-ab89-61e12ae93b48 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:34:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-6ca3abe5-7e89-4f3f-b0af-83fa3c13e212 req-bf946688-8e85-49dd-8e7e-9912af73826b service nova] Acquiring lock "409478f4-7921-4a15-89b0-82c26fa39de7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:34:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-6ca3abe5-7e89-4f3f-b0af-83fa3c13e212 req-bf946688-8e85-49dd-8e7e-9912af73826b service nova] Lock "409478f4-7921-4a15-89b0-82c26fa39de7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:34:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-6ca3abe5-7e89-4f3f-b0af-83fa3c13e212 req-bf946688-8e85-49dd-8e7e-9912af73826b service nova] Lock "409478f4-7921-4a15-89b0-82c26fa39de7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:34:09 user nova-compute[75066]: DEBUG nova.compute.manager [req-6ca3abe5-7e89-4f3f-b0af-83fa3c13e212 req-bf946688-8e85-49dd-8e7e-9912af73826b service nova] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] No waiting events found dispatching network-vif-unplugged-6d709e03-0f37-43f6-ab89-61e12ae93b48 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:34:09 user nova-compute[75066]: WARNING nova.compute.manager [req-6ca3abe5-7e89-4f3f-b0af-83fa3c13e212 req-bf946688-8e85-49dd-8e7e-9912af73826b service nova] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Received unexpected event network-vif-unplugged-6d709e03-0f37-43f6-ab89-61e12ae93b48 for instance with vm_state active and task_state shelving.
Dec 01 19:34:09 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Instance destroyed successfully.
Dec 01 19:34:09 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-640b0e5c-99b9-4d3c-99cf-00c261c52424 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Beginning cold snapshot process
Dec 01 19:34:10 user nova-compute[75066]: DEBUG nova.privsep.utils [None req-640b0e5c-99b9-4d3c-99cf-00c261c52424 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75066) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 01 19:34:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-640b0e5c-99b9-4d3c-99cf-00c261c52424 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/409478f4-7921-4a15-89b0-82c26fa39de7/disk /opt/stack/data/nova/instances/snapshots/tmpgclcbu9y/490db60cba8a40299a305bceb89812a5 {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:34:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:34:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-640b0e5c-99b9-4d3c-99cf-00c261c52424 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/409478f4-7921-4a15-89b0-82c26fa39de7/disk /opt/stack/data/nova/instances/snapshots/tmpgclcbu9y/490db60cba8a40299a305bceb89812a5" returned: 0 in 0.566s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:34:10 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-640b0e5c-99b9-4d3c-99cf-00c261c52424 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Snapshot extracted, beginning image upload
Dec 01 19:34:11 user nova-compute[75066]: DEBUG nova.compute.manager [req-865dad2c-a29c-4be0-9480-77e08e0a9a38 req-220fda68-9071-44f6-9301-45b7187a3323 service nova] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Received event network-vif-plugged-6d709e03-0f37-43f6-ab89-61e12ae93b48 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:34:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-865dad2c-a29c-4be0-9480-77e08e0a9a38 req-220fda68-9071-44f6-9301-45b7187a3323 service nova] Acquiring lock "409478f4-7921-4a15-89b0-82c26fa39de7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:34:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-865dad2c-a29c-4be0-9480-77e08e0a9a38 req-220fda68-9071-44f6-9301-45b7187a3323 service nova] Lock "409478f4-7921-4a15-89b0-82c26fa39de7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:34:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-865dad2c-a29c-4be0-9480-77e08e0a9a38 req-220fda68-9071-44f6-9301-45b7187a3323 service nova] Lock "409478f4-7921-4a15-89b0-82c26fa39de7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:34:11 user nova-compute[75066]: DEBUG nova.compute.manager [req-865dad2c-a29c-4be0-9480-77e08e0a9a38 req-220fda68-9071-44f6-9301-45b7187a3323 service nova] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] No waiting events found dispatching network-vif-plugged-6d709e03-0f37-43f6-ab89-61e12ae93b48 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:34:11 user nova-compute[75066]: WARNING nova.compute.manager [req-865dad2c-a29c-4be0-9480-77e08e0a9a38 req-220fda68-9071-44f6-9301-45b7187a3323 service nova] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Received unexpected event network-vif-plugged-6d709e03-0f37-43f6-ab89-61e12ae93b48 for instance with vm_state active and task_state shelving_image_uploading.
Dec 01 19:34:12 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:34:12 user nova-compute[75066]: DEBUG nova.compute.manager [req-ca1d8936-653f-4620-8820-72eb90f157b4 req-5703da37-9541-4872-a875-8ef7b10a1822 service nova] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Received event network-changed-5b64624f-4059-4689-83ef-856573e0eab0 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:34:12 user nova-compute[75066]: DEBUG nova.compute.manager [req-ca1d8936-653f-4620-8820-72eb90f157b4 req-5703da37-9541-4872-a875-8ef7b10a1822 service nova] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Refreshing instance network info cache due to event network-changed-5b64624f-4059-4689-83ef-856573e0eab0. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:34:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-ca1d8936-653f-4620-8820-72eb90f157b4 req-5703da37-9541-4872-a875-8ef7b10a1822 service nova] Acquiring lock "refresh_cache-b2c6c900-5d1b-44f8-8435-d9ad88b3a412" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:34:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-ca1d8936-653f-4620-8820-72eb90f157b4 req-5703da37-9541-4872-a875-8ef7b10a1822 service nova] Acquired lock "refresh_cache-b2c6c900-5d1b-44f8-8435-d9ad88b3a412" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:34:12 user nova-compute[75066]: DEBUG nova.network.neutron [req-ca1d8936-653f-4620-8820-72eb90f157b4 req-5703da37-9541-4872-a875-8ef7b10a1822 service nova] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Refreshing network info cache for port 5b64624f-4059-4689-83ef-856573e0eab0 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:34:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:34:13 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:34:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ee7f2692-94f8-4ed3-a42c-078f725d8de0 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Acquiring lock "b2c6c900-5d1b-44f8-8435-d9ad88b3a412" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:34:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ee7f2692-94f8-4ed3-a42c-078f725d8de0 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "b2c6c900-5d1b-44f8-8435-d9ad88b3a412" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:34:13 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-640b0e5c-99b9-4d3c-99cf-00c261c52424 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Snapshot image upload complete
Dec 01 19:34:13 user nova-compute[75066]: DEBUG nova.compute.manager [None req-640b0e5c-99b9-4d3c-99cf-00c261c52424 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:34:13 user nova-compute[75066]: INFO nova.compute.manager [None req-ee7f2692-94f8-4ed3-a42c-078f725d8de0 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Detaching volume 560d8e6e-8c2b-4d07-9db1-07e025a12db7
Dec 01 19:34:13 user nova-compute[75066]: INFO nova.virt.block_device [None req-ee7f2692-94f8-4ed3-a42c-078f725d8de0 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Attempting to driver detach volume 560d8e6e-8c2b-4d07-9db1-07e025a12db7 from mountpoint /dev/vdb
Dec 01 19:34:13 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ee7f2692-94f8-4ed3-a42c-078f725d8de0 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Attempting to detach device vdb from instance b2c6c900-5d1b-44f8-8435-d9ad88b3a412 from the persistent domain config. {{(pid=75066) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 19:34:13 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-ee7f2692-94f8-4ed3-a42c-078f725d8de0 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 19:34:13 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:34:13 user nova-compute[75066]:   <source dev="/dev/sdd"/>
Dec 01 19:34:13 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:34:13 user nova-compute[75066]:   <serial>560d8e6e-8c2b-4d07-9db1-07e025a12db7</serial>
Dec 01 19:34:13 user nova-compute[75066]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 19:34:13 user nova-compute[75066]: </disk>
Dec 01 19:34:13 user nova-compute[75066]:  {{(pid=75066) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 19:34:13 user nova-compute[75066]: INFO nova.compute.manager [None req-640b0e5c-99b9-4d3c-99cf-00c261c52424 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Shelve offloading
Dec 01 19:34:13 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-ee7f2692-94f8-4ed3-a42c-078f725d8de0 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Successfully detached device vdb from instance b2c6c900-5d1b-44f8-8435-d9ad88b3a412 from the persistent domain config.
Dec 01 19:34:13 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ee7f2692-94f8-4ed3-a42c-078f725d8de0 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b2c6c900-5d1b-44f8-8435-d9ad88b3a412 from the live domain config. {{(pid=75066) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 19:34:13 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-ee7f2692-94f8-4ed3-a42c-078f725d8de0 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 19:34:13 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:34:13 user nova-compute[75066]:   <source dev="/dev/sdd"/>
Dec 01 19:34:13 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:34:13 user nova-compute[75066]:   <serial>560d8e6e-8c2b-4d07-9db1-07e025a12db7</serial>
Dec 01 19:34:13 user nova-compute[75066]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 19:34:13 user nova-compute[75066]: </disk>
Dec 01 19:34:13 user nova-compute[75066]:  {{(pid=75066) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 19:34:13 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Instance destroyed successfully.
Dec 01 19:34:13 user nova-compute[75066]: DEBUG nova.compute.manager [None req-640b0e5c-99b9-4d3c-99cf-00c261c52424 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:34:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-640b0e5c-99b9-4d3c-99cf-00c261c52424 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Acquiring lock "refresh_cache-409478f4-7921-4a15-89b0-82c26fa39de7" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:34:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-640b0e5c-99b9-4d3c-99cf-00c261c52424 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Acquired lock "refresh_cache-409478f4-7921-4a15-89b0-82c26fa39de7" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:34:13 user nova-compute[75066]: DEBUG nova.network.neutron [None req-640b0e5c-99b9-4d3c-99cf-00c261c52424 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:34:13 user nova-compute[75066]: DEBUG nova.network.neutron [req-ca1d8936-653f-4620-8820-72eb90f157b4 req-5703da37-9541-4872-a875-8ef7b10a1822 service nova] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Updated VIF entry in instance network info cache for port 5b64624f-4059-4689-83ef-856573e0eab0. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:34:13 user nova-compute[75066]: DEBUG nova.network.neutron [req-ca1d8936-653f-4620-8820-72eb90f157b4 req-5703da37-9541-4872-a875-8ef7b10a1822 service nova] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Updating instance_info_cache with network_info: [{"id": "5b64624f-4059-4689-83ef-856573e0eab0", "address": "fa:16:3e:3f:cc:a8", "network": {"id": "47c850ae-6dcb-4977-a02a-e32cd3df4749", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-475363603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "943324a514a84cb4947dbab93abc4f6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b64624f-40", "ovs_interfaceid": "5b64624f-4059-4689-83ef-856573e0eab0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:34:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-ca1d8936-653f-4620-8820-72eb90f157b4 req-5703da37-9541-4872-a875-8ef7b10a1822 service nova] Releasing lock "refresh_cache-b2c6c900-5d1b-44f8-8435-d9ad88b3a412" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:34:13 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ee7f2692-94f8-4ed3-a42c-078f725d8de0 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b2c6c900-5d1b-44f8-8435-d9ad88b3a412 {{(pid=75066) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 19:34:13 user nova-compute[75066]: DEBUG nova.network.neutron [None req-640b0e5c-99b9-4d3c-99cf-00c261c52424 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Updating instance_info_cache with network_info: [{"id": "6d709e03-0f37-43f6-ab89-61e12ae93b48", "address": "fa:16:3e:39:17:c8", "network": {"id": "49dd72ae-ec07-46a6-8463-e38bdfe1eba0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-738739404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879678dca7054c178839f56e66a6e0ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d709e03-0f", "ovs_interfaceid": "6d709e03-0f37-43f6-ab89-61e12ae93b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:34:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-640b0e5c-99b9-4d3c-99cf-00c261c52424 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Releasing lock "refresh_cache-409478f4-7921-4a15-89b0-82c26fa39de7" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:34:14 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:34:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:34:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:34:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:34:14 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75066) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 19:34:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88850ea1-43cd-4066-8e6f-cfe5de621bc6/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:34:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88850ea1-43cd-4066-8e6f-cfe5de621bc6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:34:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88850ea1-43cd-4066-8e6f-cfe5de621bc6/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:34:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88850ea1-43cd-4066-8e6f-cfe5de621bc6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:34:14 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:34:14 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:34:14 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Instance destroyed successfully.
Dec 01 19:34:14 user nova-compute[75066]: DEBUG nova.objects.instance [None req-640b0e5c-99b9-4d3c-99cf-00c261c52424 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lazy-loading 'resources' on Instance uuid 409478f4-7921-4a15-89b0-82c26fa39de7 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:34:14 user nova-compute[75066]: DEBUG nova.compute.manager [req-df4b3e71-b550-4413-9eb2-23412e894b6e req-b52b36a7-3b7f-4820-b4c8-bc186132e2d5 service nova] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Received event network-changed-5b64624f-4059-4689-83ef-856573e0eab0 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:34:14 user nova-compute[75066]: DEBUG nova.compute.manager [req-df4b3e71-b550-4413-9eb2-23412e894b6e req-b52b36a7-3b7f-4820-b4c8-bc186132e2d5 service nova] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Refreshing instance network info cache due to event network-changed-5b64624f-4059-4689-83ef-856573e0eab0. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:34:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-df4b3e71-b550-4413-9eb2-23412e894b6e req-b52b36a7-3b7f-4820-b4c8-bc186132e2d5 service nova] Acquiring lock "refresh_cache-b2c6c900-5d1b-44f8-8435-d9ad88b3a412" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:34:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-df4b3e71-b550-4413-9eb2-23412e894b6e req-b52b36a7-3b7f-4820-b4c8-bc186132e2d5 service nova] Acquired lock "refresh_cache-b2c6c900-5d1b-44f8-8435-d9ad88b3a412" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:34:14 user nova-compute[75066]: DEBUG nova.network.neutron [req-df4b3e71-b550-4413-9eb2-23412e894b6e req-b52b36a7-3b7f-4820-b4c8-bc186132e2d5 service nova] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Refreshing network info cache for port 5b64624f-4059-4689-83ef-856573e0eab0 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:34:14 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-640b0e5c-99b9-4d3c-99cf-00c261c52424 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:32:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1093900305',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1093900305',id=37,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgqDSADCKIleBb+Rg1GEKVJGSrQo6Qd+GU89QRtb0lxLByFIoFjjq1Yx9XawcMp2fp+Dic5G4y8aiEZFbJzFY905Tc5W+gwtIgnquQavTd1u+xCi3/ZclYfjcIcKZPxRw==',key_name='tempest-keypair-1679278784',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:32:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='879678dca7054c178839f56e66a6e0ce',ramdisk_id='',reservation_id='r-1sjmbvuo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1680443764',owner_user_name='tempest-AttachVolumeShelveTestJSON-1680443764-project-member',shelved_at='2023-12-01T19:34:13.373655',shelved_host='user',shelved_image_id='c3c95edd-d843-455e-ac71-f6eb865a5100'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:34:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90e207044c0741e99c4a83b2c4746cd3',uuid=409478f4-7921-4a15-89b0-82c26fa39de7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "6d709e03-0f37-43f6-ab89-61e12ae93b48", "address": "fa:16:3e:39:17:c8", "network": {"id": "49dd72ae-ec07-46a6-8463-e38bdfe1eba0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-738739404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879678dca7054c178839f56e66a6e0ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d709e03-0f", "ovs_interfaceid": "6d709e03-0f37-43f6-ab89-61e12ae93b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:34:14 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-640b0e5c-99b9-4d3c-99cf-00c261c52424 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Converting VIF {"id": "6d709e03-0f37-43f6-ab89-61e12ae93b48", "address": "fa:16:3e:39:17:c8", "network": {"id": "49dd72ae-ec07-46a6-8463-e38bdfe1eba0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-738739404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879678dca7054c178839f56e66a6e0ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d709e03-0f", "ovs_interfaceid": "6d709e03-0f37-43f6-ab89-61e12ae93b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:34:14 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-640b0e5c-99b9-4d3c-99cf-00c261c52424 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:17:c8,bridge_name='br-int',has_traffic_filtering=True,id=6d709e03-0f37-43f6-ab89-61e12ae93b48,network=Network(49dd72ae-ec07-46a6-8463-e38bdfe1eba0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d709e03-0f') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:34:14 user nova-compute[75066]: DEBUG os_vif [None req-640b0e5c-99b9-4d3c-99cf-00c261c52424 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:17:c8,bridge_name='br-int',has_traffic_filtering=True,id=6d709e03-0f37-43f6-ab89-61e12ae93b48,network=Network(49dd72ae-ec07-46a6-8463-e38bdfe1eba0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d709e03-0f') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:34:14 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:34:14 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6d709e03-0f, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:34:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c67868e8-05f0-4501-a5fe-50c1870f31e4 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Acquiring lock "c223be70-8b9c-46d4-9b5a-3b83dfc05a17" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:34:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c67868e8-05f0-4501-a5fe-50c1870f31e4 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "c223be70-8b9c-46d4-9b5a-3b83dfc05a17" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:34:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c67868e8-05f0-4501-a5fe-50c1870f31e4 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Acquiring lock "c223be70-8b9c-46d4-9b5a-3b83dfc05a17-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:34:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c67868e8-05f0-4501-a5fe-50c1870f31e4 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "c223be70-8b9c-46d4-9b5a-3b83dfc05a17-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:34:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c67868e8-05f0-4501-a5fe-50c1870f31e4 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "c223be70-8b9c-46d4-9b5a-3b83dfc05a17-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:34:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:34:15 user nova-compute[75066]: INFO nova.compute.manager [None req-c67868e8-05f0-4501-a5fe-50c1870f31e4 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Terminating instance
Dec 01 19:34:15 user nova-compute[75066]: DEBUG nova.compute.manager [None req-c67868e8-05f0-4501-a5fe-50c1870f31e4 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Start destroying the instance on the hypervisor. {{(pid=75066) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 19:34:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:34:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:34:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=66d3ae89-4ecb-461c-9df0-3d659a4ef650) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:34:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:34:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:34:15 user nova-compute[75066]: INFO os_vif [None req-640b0e5c-99b9-4d3c-99cf-00c261c52424 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:17:c8,bridge_name='br-int',has_traffic_filtering=True,id=6d709e03-0f37-43f6-ab89-61e12ae93b48,network=Network(49dd72ae-ec07-46a6-8463-e38bdfe1eba0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d709e03-0f')
Dec 01 19:34:15 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-640b0e5c-99b9-4d3c-99cf-00c261c52424 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Deleting instance files /opt/stack/data/nova/instances/409478f4-7921-4a15-89b0-82c26fa39de7_del
Dec 01 19:34:15 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-640b0e5c-99b9-4d3c-99cf-00c261c52424 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Deletion of /opt/stack/data/nova/instances/409478f4-7921-4a15-89b0-82c26fa39de7_del complete
Dec 01 19:34:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:34:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:34:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:34:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:34:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:34:15 user nova-compute[75066]: INFO nova.scheduler.client.report [None req-640b0e5c-99b9-4d3c-99cf-00c261c52424 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Deleted allocations for instance 409478f4-7921-4a15-89b0-82c26fa39de7
Dec 01 19:34:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-640b0e5c-99b9-4d3c-99cf-00c261c52424 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:34:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-640b0e5c-99b9-4d3c-99cf-00c261c52424 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:34:15 user nova-compute[75066]: DEBUG nova.objects.instance [None req-640b0e5c-99b9-4d3c-99cf-00c261c52424 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lazy-loading 'numa_topology' on Instance uuid 409478f4-7921-4a15-89b0-82c26fa39de7 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:34:15 user nova-compute[75066]: DEBUG nova.objects.base [None req-640b0e5c-99b9-4d3c-99cf-00c261c52424 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Object Instance<409478f4-7921-4a15-89b0-82c26fa39de7> lazy-loaded attributes: resources,numa_topology {{(pid=75066) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 19:34:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:34:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7cc644b-006c-4453-aea2-abe35cfd5ba3/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:34:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7cc644b-006c-4453-aea2-abe35cfd5ba3/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:34:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7cc644b-006c-4453-aea2-abe35cfd5ba3/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:34:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7cc644b-006c-4453-aea2-abe35cfd5ba3/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:34:15 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:34:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:34:15 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-640b0e5c-99b9-4d3c-99cf-00c261c52424 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:34:15 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Instance destroyed successfully.
Dec 01 19:34:15 user nova-compute[75066]: DEBUG nova.objects.instance [None req-c67868e8-05f0-4501-a5fe-50c1870f31e4 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lazy-loading 'resources' on Instance uuid c223be70-8b9c-46d4-9b5a-3b83dfc05a17 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:34:15 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-640b0e5c-99b9-4d3c-99cf-00c261c52424 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:34:15 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-c67868e8-05f0-4501-a5fe-50c1870f31e4 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:15:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1950181567',display_name='tempest-ServerActionsTestOtherA-server-1950181567',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1950181567',id=3,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAjcDJi5RJTCazFFAj7dx2qLuKSEoyASrqNDKgiQGRQPewzJhIu6lQd3yuH2207H2lpqZiyuqBj2lXvz5vQM52pZXpO90p/UH43nVMO2RrMH5S7NUl16+at0nkGQGj24ng==',key_name='tempest-keypair-1092575275',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:15:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fb0f7516d1db4dd5bc7d77a0bd1d44d7',ramdisk_id='',reservation_id='r-en4ny5yt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1700253921',owner_user_name='tempest-ServerActionsTestOtherA-1700253921-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:15:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfb3e7b4b0444223af282b16da9bd919',uuid=c223be70-8b9c-46d4-9b5a-3b83dfc05a17,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2698607a-e8b6-4da8-bfc7-90dc528ade6b", "address": "fa:16:3e:52:d6:e9", "network": {"id": "9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-696310557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0f7516d1db4dd5bc7d77a0bd1d44d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2698607a-e8", "ovs_interfaceid": "2698607a-e8b6-4da8-bfc7-90dc528ade6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:34:15 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-c67868e8-05f0-4501-a5fe-50c1870f31e4 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Converting VIF {"id": "2698607a-e8b6-4da8-bfc7-90dc528ade6b", "address": "fa:16:3e:52:d6:e9", "network": {"id": "9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-696310557-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fb0f7516d1db4dd5bc7d77a0bd1d44d7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2698607a-e8", "ovs_interfaceid": "2698607a-e8b6-4da8-bfc7-90dc528ade6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:34:15 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-c67868e8-05f0-4501-a5fe-50c1870f31e4 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:52:d6:e9,bridge_name='br-int',has_traffic_filtering=True,id=2698607a-e8b6-4da8-bfc7-90dc528ade6b,network=Network(9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2698607a-e8') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:34:15 user nova-compute[75066]: DEBUG os_vif [None req-c67868e8-05f0-4501-a5fe-50c1870f31e4 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:d6:e9,bridge_name='br-int',has_traffic_filtering=True,id=2698607a-e8b6-4da8-bfc7-90dc528ade6b,network=Network(9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2698607a-e8') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:34:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:34:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2698607a-e8, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:34:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:34:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:34:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:34:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=db091d4f-0d42-4a01-9539-99b1728ca6c4) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:34:15 user nova-compute[75066]: DEBUG nova.network.neutron [req-df4b3e71-b550-4413-9eb2-23412e894b6e req-b52b36a7-3b7f-4820-b4c8-bc186132e2d5 service nova] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Updated VIF entry in instance network info cache for port 5b64624f-4059-4689-83ef-856573e0eab0. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:34:15 user nova-compute[75066]: DEBUG nova.network.neutron [req-df4b3e71-b550-4413-9eb2-23412e894b6e req-b52b36a7-3b7f-4820-b4c8-bc186132e2d5 service nova] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Updating instance_info_cache with network_info: [{"id": "5b64624f-4059-4689-83ef-856573e0eab0", "address": "fa:16:3e:3f:cc:a8", "network": {"id": "47c850ae-6dcb-4977-a02a-e32cd3df4749", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-475363603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "943324a514a84cb4947dbab93abc4f6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b64624f-40", "ovs_interfaceid": "5b64624f-4059-4689-83ef-856573e0eab0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:34:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:34:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-640b0e5c-99b9-4d3c-99cf-00c261c52424 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.599s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:34:15 user nova-compute[75066]: INFO os_vif [None req-c67868e8-05f0-4501-a5fe-50c1870f31e4 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:d6:e9,bridge_name='br-int',has_traffic_filtering=True,id=2698607a-e8b6-4da8-bfc7-90dc528ade6b,network=Network(9c4c0a4b-e4cf-4127-8bc1-8d3ef415583d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2698607a-e8')
Dec 01 19:34:15 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-c67868e8-05f0-4501-a5fe-50c1870f31e4 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Deleting instance files /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17_del
Dec 01 19:34:15 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-c67868e8-05f0-4501-a5fe-50c1870f31e4 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Deletion of /opt/stack/data/nova/instances/c223be70-8b9c-46d4-9b5a-3b83dfc05a17_del complete
Dec 01 19:34:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-df4b3e71-b550-4413-9eb2-23412e894b6e req-b52b36a7-3b7f-4820-b4c8-bc186132e2d5 service nova] Releasing lock "refresh_cache-b2c6c900-5d1b-44f8-8435-d9ad88b3a412" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:34:15 user nova-compute[75066]: DEBUG nova.compute.manager [req-df4b3e71-b550-4413-9eb2-23412e894b6e req-b52b36a7-3b7f-4820-b4c8-bc186132e2d5 service nova] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Received event network-changed-6d709e03-0f37-43f6-ab89-61e12ae93b48 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:34:15 user nova-compute[75066]: DEBUG nova.compute.manager [req-df4b3e71-b550-4413-9eb2-23412e894b6e req-b52b36a7-3b7f-4820-b4c8-bc186132e2d5 service nova] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Refreshing instance network info cache due to event network-changed-6d709e03-0f37-43f6-ab89-61e12ae93b48. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:34:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-df4b3e71-b550-4413-9eb2-23412e894b6e req-b52b36a7-3b7f-4820-b4c8-bc186132e2d5 service nova] Acquiring lock "refresh_cache-409478f4-7921-4a15-89b0-82c26fa39de7" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:34:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-df4b3e71-b550-4413-9eb2-23412e894b6e req-b52b36a7-3b7f-4820-b4c8-bc186132e2d5 service nova] Acquired lock "refresh_cache-409478f4-7921-4a15-89b0-82c26fa39de7" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:34:15 user nova-compute[75066]: DEBUG nova.network.neutron [req-df4b3e71-b550-4413-9eb2-23412e894b6e req-b52b36a7-3b7f-4820-b4c8-bc186132e2d5 service nova] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Refreshing network info cache for port 6d709e03-0f37-43f6-ab89-61e12ae93b48 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:34:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:34:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-640b0e5c-99b9-4d3c-99cf-00c261c52424 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "409478f4-7921-4a15-89b0-82c26fa39de7" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.866s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:34:15 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:34:16 user nova-compute[75066]: INFO nova.compute.manager [None req-c67868e8-05f0-4501-a5fe-50c1870f31e4 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Took 1.01 seconds to destroy the instance on the hypervisor.
Dec 01 19:34:16 user nova-compute[75066]: DEBUG oslo.service.loopingcall [None req-c67868e8-05f0-4501-a5fe-50c1870f31e4 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75066) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 19:34:16 user nova-compute[75066]: DEBUG nova.compute.manager [-] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Deallocating network for instance {{(pid=75066) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 19:34:16 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] deallocate_for_instance() {{(pid=75066) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 19:34:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:34:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:34:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:34:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:34:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:34:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk.rescue --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:34:16 user nova-compute[75066]: DEBUG nova.network.neutron [req-df4b3e71-b550-4413-9eb2-23412e894b6e req-b52b36a7-3b7f-4820-b4c8-bc186132e2d5 service nova] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Updated VIF entry in instance network info cache for port 6d709e03-0f37-43f6-ab89-61e12ae93b48. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:34:16 user nova-compute[75066]: DEBUG nova.network.neutron [req-df4b3e71-b550-4413-9eb2-23412e894b6e req-b52b36a7-3b7f-4820-b4c8-bc186132e2d5 service nova] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Updating instance_info_cache with network_info: [{"id": "6d709e03-0f37-43f6-ab89-61e12ae93b48", "address": "fa:16:3e:39:17:c8", "network": {"id": "49dd72ae-ec07-46a6-8463-e38bdfe1eba0", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-738739404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879678dca7054c178839f56e66a6e0ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap6d709e03-0f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:34:16 user nova-compute[75066]: DEBUG nova.compute.manager [req-88b20877-d1ce-47bf-97f9-de7496c88d07 req-4267fd02-3126-4c52-98a1-9226f2839263 service nova] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Received event network-vif-deleted-2698607a-e8b6-4da8-bfc7-90dc528ade6b {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:34:16 user nova-compute[75066]: INFO nova.compute.manager [req-88b20877-d1ce-47bf-97f9-de7496c88d07 req-4267fd02-3126-4c52-98a1-9226f2839263 service nova] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Neutron deleted interface 2698607a-e8b6-4da8-bfc7-90dc528ade6b; detaching it from the instance and deleting it from the info cache
Dec 01 19:34:16 user nova-compute[75066]: DEBUG nova.network.neutron [req-88b20877-d1ce-47bf-97f9-de7496c88d07 req-4267fd02-3126-4c52-98a1-9226f2839263 service nova] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:34:16 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:34:16 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-df4b3e71-b550-4413-9eb2-23412e894b6e req-b52b36a7-3b7f-4820-b4c8-bc186132e2d5 service nova] Releasing lock "refresh_cache-409478f4-7921-4a15-89b0-82c26fa39de7" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:34:16 user nova-compute[75066]: INFO nova.compute.manager [-] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Took 0.69 seconds to deallocate network for instance.
Dec 01 19:34:16 user nova-compute[75066]: DEBUG nova.compute.manager [req-88b20877-d1ce-47bf-97f9-de7496c88d07 req-4267fd02-3126-4c52-98a1-9226f2839263 service nova] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Detach interface failed, port_id=2698607a-e8b6-4da8-bfc7-90dc528ade6b, reason: Instance c223be70-8b9c-46d4-9b5a-3b83dfc05a17 could not be found. {{(pid=75066) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 01 19:34:16 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c67868e8-05f0-4501-a5fe-50c1870f31e4 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:34:16 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c67868e8-05f0-4501-a5fe-50c1870f31e4 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:34:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:34:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk.rescue --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:34:16 user nova-compute[75066]: DEBUG nova.compute.manager [req-4af664b2-51f9-4a39-80ec-217d9eb4fabb req-464f2e12-527c-486f-b413-9d04534cc1a3 service nova] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Received event network-vif-unplugged-2698607a-e8b6-4da8-bfc7-90dc528ade6b {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:34:16 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-4af664b2-51f9-4a39-80ec-217d9eb4fabb req-464f2e12-527c-486f-b413-9d04534cc1a3 service nova] Acquiring lock "c223be70-8b9c-46d4-9b5a-3b83dfc05a17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:34:16 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-4af664b2-51f9-4a39-80ec-217d9eb4fabb req-464f2e12-527c-486f-b413-9d04534cc1a3 service nova] Lock "c223be70-8b9c-46d4-9b5a-3b83dfc05a17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:34:16 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-4af664b2-51f9-4a39-80ec-217d9eb4fabb req-464f2e12-527c-486f-b413-9d04534cc1a3 service nova] Lock "c223be70-8b9c-46d4-9b5a-3b83dfc05a17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:34:16 user nova-compute[75066]: DEBUG nova.compute.manager [req-4af664b2-51f9-4a39-80ec-217d9eb4fabb req-464f2e12-527c-486f-b413-9d04534cc1a3 service nova] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] No waiting events found dispatching network-vif-unplugged-2698607a-e8b6-4da8-bfc7-90dc528ade6b {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:34:16 user nova-compute[75066]: WARNING nova.compute.manager [req-4af664b2-51f9-4a39-80ec-217d9eb4fabb req-464f2e12-527c-486f-b413-9d04534cc1a3 service nova] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Received unexpected event network-vif-unplugged-2698607a-e8b6-4da8-bfc7-90dc528ade6b for instance with vm_state deleted and task_state None.
Dec 01 19:34:16 user nova-compute[75066]: DEBUG nova.compute.manager [req-4af664b2-51f9-4a39-80ec-217d9eb4fabb req-464f2e12-527c-486f-b413-9d04534cc1a3 service nova] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Received event network-vif-plugged-2698607a-e8b6-4da8-bfc7-90dc528ade6b {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:34:16 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-4af664b2-51f9-4a39-80ec-217d9eb4fabb req-464f2e12-527c-486f-b413-9d04534cc1a3 service nova] Acquiring lock "c223be70-8b9c-46d4-9b5a-3b83dfc05a17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:34:16 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-4af664b2-51f9-4a39-80ec-217d9eb4fabb req-464f2e12-527c-486f-b413-9d04534cc1a3 service nova] Lock "c223be70-8b9c-46d4-9b5a-3b83dfc05a17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:34:16 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-4af664b2-51f9-4a39-80ec-217d9eb4fabb req-464f2e12-527c-486f-b413-9d04534cc1a3 service nova] Lock "c223be70-8b9c-46d4-9b5a-3b83dfc05a17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:34:16 user nova-compute[75066]: DEBUG nova.compute.manager [req-4af664b2-51f9-4a39-80ec-217d9eb4fabb req-464f2e12-527c-486f-b413-9d04534cc1a3 service nova] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] No waiting events found dispatching network-vif-plugged-2698607a-e8b6-4da8-bfc7-90dc528ade6b {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:34:16 user nova-compute[75066]: WARNING nova.compute.manager [req-4af664b2-51f9-4a39-80ec-217d9eb4fabb req-464f2e12-527c-486f-b413-9d04534cc1a3 service nova] [instance: c223be70-8b9c-46d4-9b5a-3b83dfc05a17] Received unexpected event network-vif-plugged-2698607a-e8b6-4da8-bfc7-90dc528ade6b for instance with vm_state deleted and task_state None.
Dec 01 19:34:17 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:34:17 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:34:17 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-c67868e8-05f0-4501-a5fe-50c1870f31e4 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:34:17 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-c67868e8-05f0-4501-a5fe-50c1870f31e4 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:34:17 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:34:17 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:34:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c67868e8-05f0-4501-a5fe-50c1870f31e4 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.464s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:34:17 user nova-compute[75066]: INFO nova.scheduler.client.report [None req-c67868e8-05f0-4501-a5fe-50c1870f31e4 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Deleted allocations for instance c223be70-8b9c-46d4-9b5a-3b83dfc05a17
Dec 01 19:34:17 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:34:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-c67868e8-05f0-4501-a5fe-50c1870f31e4 tempest-ServerActionsTestOtherA-1700253921 tempest-ServerActionsTestOtherA-1700253921-project-member] Lock "c223be70-8b9c-46d4-9b5a-3b83dfc05a17" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.384s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:34:17 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:34:17 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:34:17 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:34:17 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:34:17 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6c900-5d1b-44f8-8435-d9ad88b3a412/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:34:17 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6c900-5d1b-44f8-8435-d9ad88b3a412/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:34:17 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6c900-5d1b-44f8-8435-d9ad88b3a412/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:34:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b2c6c900-5d1b-44f8-8435-d9ad88b3a412/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:34:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:34:18 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Error from libvirt while getting description of instance-00000025: [Error Code 42] Domain not found: no domain with matching uuid '409478f4-7921-4a15-89b0-82c26fa39de7' (instance-00000025): libvirt.libvirtError: Domain not found: no domain with matching uuid '409478f4-7921-4a15-89b0-82c26fa39de7' (instance-00000025)
Dec 01 19:34:18 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:34:18 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:34:18 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:34:18 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Hypervisor/Node resource view: name=user free_ram=7720MB free_disk=24.52973175048828GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75066) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 19:34:18 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:34:18 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:34:18 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 90c49be6-97aa-45f1-bcbe-b9a3875226a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:34:18 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance d564b128-598b-4ad4-8618-afa4dc8a7347 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:34:18 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 14de9d20-9e66-4517-b904-2967e0a06a97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:34:18 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:34:18 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:34:18 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance b2c6c900-5d1b-44f8-8435-d9ad88b3a412 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:34:18 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 88850ea1-43cd-4066-8e6f-cfe5de621bc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:34:18 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance f04249c5-0196-455c-ac7a-f1ff8be320d4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:34:18 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance f7cc644b-006c-4453-aea2-abe35cfd5ba3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:34:18 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 19:34:18 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 19:34:18 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:34:18 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:34:18 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Compute_service record updated for user:user {{(pid=75066) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 19:34:18 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.419s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:34:19 user nova-compute[75066]: DEBUG nova.compute.manager [req-1c424314-1f7a-4687-9f0d-eed8d6d9681b req-9670f0c6-6d0c-4fb0-9351-95291d7bbd50 service nova] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Received event network-changed-3b45b67a-805d-4816-ad34-c5266535dd27 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:34:19 user nova-compute[75066]: DEBUG nova.compute.manager [req-1c424314-1f7a-4687-9f0d-eed8d6d9681b req-9670f0c6-6d0c-4fb0-9351-95291d7bbd50 service nova] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Refreshing instance network info cache due to event network-changed-3b45b67a-805d-4816-ad34-c5266535dd27. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:34:19 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-1c424314-1f7a-4687-9f0d-eed8d6d9681b req-9670f0c6-6d0c-4fb0-9351-95291d7bbd50 service nova] Acquiring lock "refresh_cache-f7cc644b-006c-4453-aea2-abe35cfd5ba3" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:34:19 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-1c424314-1f7a-4687-9f0d-eed8d6d9681b req-9670f0c6-6d0c-4fb0-9351-95291d7bbd50 service nova] Acquired lock "refresh_cache-f7cc644b-006c-4453-aea2-abe35cfd5ba3" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:34:19 user nova-compute[75066]: DEBUG nova.network.neutron [req-1c424314-1f7a-4687-9f0d-eed8d6d9681b req-9670f0c6-6d0c-4fb0-9351-95291d7bbd50 service nova] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Refreshing network info cache for port 3b45b67a-805d-4816-ad34-c5266535dd27 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:34:19 user nova-compute[75066]: DEBUG nova.network.neutron [req-1c424314-1f7a-4687-9f0d-eed8d6d9681b req-9670f0c6-6d0c-4fb0-9351-95291d7bbd50 service nova] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Updated VIF entry in instance network info cache for port 3b45b67a-805d-4816-ad34-c5266535dd27. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:34:19 user nova-compute[75066]: DEBUG nova.network.neutron [req-1c424314-1f7a-4687-9f0d-eed8d6d9681b req-9670f0c6-6d0c-4fb0-9351-95291d7bbd50 service nova] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Updating instance_info_cache with network_info: [{"id": "3b45b67a-805d-4816-ad34-c5266535dd27", "address": "fa:16:3e:43:97:2a", "network": {"id": "4fe4d56e-afe2-42a6-984a-9af8bc5377a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126385357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5326c00d464e008337e0dc8577fc2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b45b67a-80", "ovs_interfaceid": "3b45b67a-805d-4816-ad34-c5266535dd27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:34:19 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-1c424314-1f7a-4687-9f0d-eed8d6d9681b req-9670f0c6-6d0c-4fb0-9351-95291d7bbd50 service nova] Releasing lock "refresh_cache-f7cc644b-006c-4453-aea2-abe35cfd5ba3" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:34:19 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:34:19 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Starting heal instance info cache {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 19:34:20 user nova-compute[75066]: DEBUG nova.compute.manager [req-43078773-9fe8-4bed-825f-b6a38c42acbd req-2c5556e8-a5f5-43d1-93a5-a0b9752d9b53 service nova] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Received event network-changed-3b45b67a-805d-4816-ad34-c5266535dd27 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:34:20 user nova-compute[75066]: DEBUG nova.compute.manager [req-43078773-9fe8-4bed-825f-b6a38c42acbd req-2c5556e8-a5f5-43d1-93a5-a0b9752d9b53 service nova] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Refreshing instance network info cache due to event network-changed-3b45b67a-805d-4816-ad34-c5266535dd27. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:34:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-43078773-9fe8-4bed-825f-b6a38c42acbd req-2c5556e8-a5f5-43d1-93a5-a0b9752d9b53 service nova] Acquiring lock "refresh_cache-f7cc644b-006c-4453-aea2-abe35cfd5ba3" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:34:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-43078773-9fe8-4bed-825f-b6a38c42acbd req-2c5556e8-a5f5-43d1-93a5-a0b9752d9b53 service nova] Acquired lock "refresh_cache-f7cc644b-006c-4453-aea2-abe35cfd5ba3" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:34:20 user nova-compute[75066]: DEBUG nova.network.neutron [req-43078773-9fe8-4bed-825f-b6a38c42acbd req-2c5556e8-a5f5-43d1-93a5-a0b9752d9b53 service nova] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Refreshing network info cache for port 3b45b67a-805d-4816-ad34-c5266535dd27 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:34:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "refresh_cache-905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:34:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquired lock "refresh_cache-905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:34:20 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Forcefully refreshing network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 19:34:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-85721513-e878-472e-bf36-e3aa341884ef tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Acquiring lock "f7cc644b-006c-4453-aea2-abe35cfd5ba3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:34:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-85721513-e878-472e-bf36-e3aa341884ef tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "f7cc644b-006c-4453-aea2-abe35cfd5ba3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:34:20 user nova-compute[75066]: INFO nova.compute.manager [None req-85721513-e878-472e-bf36-e3aa341884ef tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Detaching volume 0898e25d-8549-401f-ab22-17b3d142f711
Dec 01 19:34:20 user nova-compute[75066]: INFO nova.virt.block_device [None req-85721513-e878-472e-bf36-e3aa341884ef tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Attempting to driver detach volume 0898e25d-8549-401f-ab22-17b3d142f711 from mountpoint /dev/vdb
Dec 01 19:34:20 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-85721513-e878-472e-bf36-e3aa341884ef tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Attempting to detach device vdb from instance f7cc644b-006c-4453-aea2-abe35cfd5ba3 from the persistent domain config. {{(pid=75066) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 19:34:20 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-85721513-e878-472e-bf36-e3aa341884ef tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 19:34:20 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:34:20 user nova-compute[75066]:   <source dev="/dev/sdg"/>
Dec 01 19:34:20 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:34:20 user nova-compute[75066]:   <serial>0898e25d-8549-401f-ab22-17b3d142f711</serial>
Dec 01 19:34:20 user nova-compute[75066]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 19:34:20 user nova-compute[75066]: </disk>
Dec 01 19:34:20 user nova-compute[75066]:  {{(pid=75066) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 19:34:20 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-85721513-e878-472e-bf36-e3aa341884ef tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Successfully detached device vdb from instance f7cc644b-006c-4453-aea2-abe35cfd5ba3 from the persistent domain config.
Dec 01 19:34:20 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-85721513-e878-472e-bf36-e3aa341884ef tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f7cc644b-006c-4453-aea2-abe35cfd5ba3 from the live domain config. {{(pid=75066) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 19:34:20 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-85721513-e878-472e-bf36-e3aa341884ef tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 19:34:20 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:34:20 user nova-compute[75066]:   <source dev="/dev/sdg"/>
Dec 01 19:34:20 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:34:20 user nova-compute[75066]:   <serial>0898e25d-8549-401f-ab22-17b3d142f711</serial>
Dec 01 19:34:20 user nova-compute[75066]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 19:34:20 user nova-compute[75066]: </disk>
Dec 01 19:34:20 user nova-compute[75066]:  {{(pid=75066) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 19:34:20 user nova-compute[75066]: DEBUG nova.network.neutron [req-43078773-9fe8-4bed-825f-b6a38c42acbd req-2c5556e8-a5f5-43d1-93a5-a0b9752d9b53 service nova] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Updated VIF entry in instance network info cache for port 3b45b67a-805d-4816-ad34-c5266535dd27. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:34:20 user nova-compute[75066]: DEBUG nova.network.neutron [req-43078773-9fe8-4bed-825f-b6a38c42acbd req-2c5556e8-a5f5-43d1-93a5-a0b9752d9b53 service nova] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Updating instance_info_cache with network_info: [{"id": "3b45b67a-805d-4816-ad34-c5266535dd27", "address": "fa:16:3e:43:97:2a", "network": {"id": "4fe4d56e-afe2-42a6-984a-9af8bc5377a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126385357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5326c00d464e008337e0dc8577fc2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b45b67a-80", "ovs_interfaceid": "3b45b67a-805d-4816-ad34-c5266535dd27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:34:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-43078773-9fe8-4bed-825f-b6a38c42acbd req-2c5556e8-a5f5-43d1-93a5-a0b9752d9b53 service nova] Releasing lock "refresh_cache-f7cc644b-006c-4453-aea2-abe35cfd5ba3" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:34:20 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Updating instance_info_cache with network_info: [{"id": "6c41fc1e-7ed5-490d-a375-0db34c7ae40b", "address": "fa:16:3e:ed:e9:7c", "network": {"id": "6b0f48b7-3db2-49b2-a238-8fd811b52d62", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1688127634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e000d89bca44cd8acba504256d8d1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c41fc1e-7e", "ovs_interfaceid": "6c41fc1e-7ed5-490d-a375-0db34c7ae40b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:34:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Releasing lock "refresh_cache-905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:34:20 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Updated the network info_cache for instance {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 19:34:20 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:34:20 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:34:20 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:34:20 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75066) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 19:34:20 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:34:20 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-85721513-e878-472e-bf36-e3aa341884ef tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f7cc644b-006c-4453-aea2-abe35cfd5ba3 {{(pid=75066) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 19:34:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:34:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:34:25 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:34:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:34:33 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ee7f2692-94f8-4ed3-a42c-078f725d8de0 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b2c6c900-5d1b-44f8-8435-d9ad88b3a412 is timed out.
Dec 01 19:34:33 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-ee7f2692-94f8-4ed3-a42c-078f725d8de0 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Successfully detached device vdb from instance b2c6c900-5d1b-44f8-8435-d9ad88b3a412 from the live domain config.
Dec 01 19:34:33 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee7f2692-94f8-4ed3-a42c-078f725d8de0 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] calling os-brick to detach iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 19:34:33 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7f2692-94f8-4ed3-a42c-078f725d8de0 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, {'target_iqn': 'iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'snEOyWIq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:34:33 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-ee7f2692-94f8-4ed3-a42c-078f725d8de0 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:34:33 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-ee7f2692-94f8-4ed3-a42c-078f725d8de0 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:34:33 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-ee7f2692-94f8-4ed3-a42c-078f725d8de0 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:34:33 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:34:33 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:34:33 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f439e7a-ef3e-4934-b37e-e9b7ca0207fb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:34:33 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7f2692-94f8-4ed3-a42c-078f725d8de0 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 19:34:33 user nova-compute[75066]: No targets found.
Dec 01 19:34:33 user nova-compute[75066]: iSNS:
Dec 01 19:34:33 user nova-compute[75066]: No targets found.
Dec 01 19:34:33 user nova-compute[75066]: STATIC:
Dec 01 19:34:33 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571
Dec 01 19:34:33 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:34:33 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:34:33 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7
Dec 01 19:34:33 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:34:33 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:34:33 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711
Dec 01 19:34:33 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:34:33 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:34:33 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb
Dec 01 19:34:33 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:34:33 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:34:33 user nova-compute[75066]: FIRMWARE:
Dec 01 19:34:33 user nova-compute[75066]: No targets found.
Dec 01 19:34:33 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:34:33 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7f2692-94f8-4ed3-a42c-078f725d8de0 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 19:34:33 user nova-compute[75066]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 19:34:33 user nova-compute[75066]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75066) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 19:34:33 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7f2692-94f8-4ed3-a42c-078f725d8de0 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7', 0)] {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 19:34:33 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:34:33 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:34:33 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7589f6-0567-4346-bf26-515871959edc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:34:33 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:34:34 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:34:34 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[21cf4038-7a80-4876-981b-117b893c1152]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:34:34 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7f2692-94f8-4ed3-a42c-078f725d8de0 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:34:34 user nova-compute[75066]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 (non-flash)
Dec 01 19:34:34 user nova-compute[75066]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 (non-flash)
Dec 01 19:34:34 user nova-compute[75066]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711 (non-flash)
Dec 01 19:34:34 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:34:34 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7f2692-94f8-4ed3-a42c-078f725d8de0 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:34:34 user nova-compute[75066]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 (non-flash)
Dec 01 19:34:34 user nova-compute[75066]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 (non-flash)
Dec 01 19:34:34 user nova-compute[75066]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711 (non-flash)
Dec 01 19:34:34 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:34:34 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7f2692-94f8-4ed3-a42c-078f725d8de0 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9190551990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7'): ({'sdd'}, set())}) {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 19:34:34 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-ee7f2692-94f8-4ed3-a42c-078f725d8de0 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Removing single pathed devices sdd {{(pid=75066) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 19:34:34 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:34:34 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:34:34 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8d881b-f1e7-4ec7-ab62-5626b4a007af]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:34:34 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:34:34 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:34:34 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[d170bb02-c539-4c8c-9a01-25a734934d07]: (4, ('ok\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:34:34 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-ee7f2692-94f8-4ed3-a42c-078f725d8de0 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Flushing IO for device /dev/sdd {{(pid=75066) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 19:34:34 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:34:34 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:34:34 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a2878f-c559-4e97-b87d-3088d6cf4d24]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:34:34 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-ee7f2692-94f8-4ed3-a42c-078f725d8de0 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75066) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 19:34:34 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:34:34 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.033s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:34:34 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7e8bcf-fe4a-4006-8083-65654569b099]: (4, ('1', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:34:34 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-ee7f2692-94f8-4ed3-a42c-078f725d8de0 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 19:34:34 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-ee7f2692-94f8-4ed3-a42c-078f725d8de0 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] SCSI volumes sdd have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 19:34:34 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7f2692-94f8-4ed3-a42c-078f725d8de0 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7')] {{(pid=75066) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 19:34:34 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:34:34 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:34:34 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19f332d-8c58-4311-89fb-7b66c6ad2421]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:34:34 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7f2692-94f8-4ed3-a42c-078f725d8de0 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:34:34 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 -p 172.16.0.220:3260 --logout {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:34:34 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:34:34 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f837d04-8ee5-48a7-b7d0-8fd73486149c]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:34:34 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7f2692-94f8-4ed3-a42c-078f725d8de0 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7, portal: 172.16.0.220,3260]
Dec 01 19:34:34 user nova-compute[75066]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7, portal: 172.16.0.220,3260] successful.
Dec 01 19:34:34 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:34:34 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 -p 172.16.0.220:3260 --op delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:34:34 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:560d8e6e-8c2b-4d07-9db1-07e025a12db7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:34:34 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[542a65f0-99e0-4262-99f3-067994e59e83]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:34:34 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7f2692-94f8-4ed3-a42c-078f725d8de0 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:34:34 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-ee7f2692-94f8-4ed3-a42c-078f725d8de0 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:34:34 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee7f2692-94f8-4ed3-a42c-078f725d8de0 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] <== disconnect_volume: return (281ms) None {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:34:34 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee7f2692-94f8-4ed3-a42c-078f725d8de0 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Disconnected iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 19:34:35 user nova-compute[75066]: DEBUG nova.objects.instance [None req-ee7f2692-94f8-4ed3-a42c-078f725d8de0 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lazy-loading 'flavor' on Instance uuid b2c6c900-5d1b-44f8-8435-d9ad88b3a412 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:34:35 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ee7f2692-94f8-4ed3-a42c-078f725d8de0 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "b2c6c900-5d1b-44f8-8435-d9ad88b3a412" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.833s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:34:35 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:34:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:34:40 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-85721513-e878-472e-bf36-e3aa341884ef tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f7cc644b-006c-4453-aea2-abe35cfd5ba3 is timed out.
Dec 01 19:34:40 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-85721513-e878-472e-bf36-e3aa341884ef tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Successfully detached device vdb from instance f7cc644b-006c-4453-aea2-abe35cfd5ba3 from the live domain config.
Dec 01 19:34:40 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85721513-e878-472e-bf36-e3aa341884ef tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] calling os-brick to detach iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 19:34:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-85721513-e878-472e-bf36-e3aa341884ef tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, {'target_iqn': 'iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HCUlAhzO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:34:40 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-85721513-e878-472e-bf36-e3aa341884ef tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:34:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-85721513-e878-472e-bf36-e3aa341884ef tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:34:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-85721513-e878-472e-bf36-e3aa341884ef tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:34:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:34:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:34:40 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[306bfcc1-2a3f-437f-b902-1f49a39773b5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:34:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-85721513-e878-472e-bf36-e3aa341884ef tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 19:34:40 user nova-compute[75066]: No targets found.
Dec 01 19:34:40 user nova-compute[75066]: iSNS:
Dec 01 19:34:40 user nova-compute[75066]: No targets found.
Dec 01 19:34:40 user nova-compute[75066]: STATIC:
Dec 01 19:34:40 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571
Dec 01 19:34:40 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:34:40 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:34:40 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711
Dec 01 19:34:40 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:34:40 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:34:40 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb
Dec 01 19:34:40 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:34:40 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:34:40 user nova-compute[75066]: FIRMWARE:
Dec 01 19:34:40 user nova-compute[75066]: No targets found.
Dec 01 19:34:40 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:34:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-85721513-e878-472e-bf36-e3aa341884ef tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 19:34:40 user nova-compute[75066]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 19:34:40 user nova-compute[75066]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75066) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 19:34:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-85721513-e878-472e-bf36-e3aa341884ef tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711', 0)] {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 19:34:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:34:40 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:34:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:34:40 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0442e64-1bce-4352-8149-9eb7d306d2e2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:34:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:34:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:34:40 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[af90a593-6acb-45cb-a2e2-32512551a432]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:34:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-85721513-e878-472e-bf36-e3aa341884ef tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:34:40 user nova-compute[75066]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 (non-flash)
Dec 01 19:34:40 user nova-compute[75066]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711 (non-flash)
Dec 01 19:34:40 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:34:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-85721513-e878-472e-bf36-e3aa341884ef tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:34:40 user nova-compute[75066]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 (non-flash)
Dec 01 19:34:40 user nova-compute[75066]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711 (non-flash)
Dec 01 19:34:40 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:34:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-85721513-e878-472e-bf36-e3aa341884ef tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9190169120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711'): ({'sdg'}, set())}) {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 19:34:40 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-85721513-e878-472e-bf36-e3aa341884ef tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Removing single pathed devices sdg {{(pid=75066) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 19:34:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:34:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:34:40 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d8349d-02ff-4d34-b995-957f0be7c95e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:34:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:34:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:34:40 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[294795ce-fd39-4d35-8021-d93c45fa3cdb]: (4, ('ok\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:34:40 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-85721513-e878-472e-bf36-e3aa341884ef tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Flushing IO for device /dev/sdg {{(pid=75066) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 19:34:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:34:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:34:40 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d783fcd-bdf0-494c-9ac8-f32841b6bd67]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:34:40 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-85721513-e878-472e-bf36-e3aa341884ef tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75066) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 19:34:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:34:41 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.042s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:34:41 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6fb1ac3-7829-4e37-bb5a-a873065b28a8]: (4, ('1', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:34:41 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-85721513-e878-472e-bf36-e3aa341884ef tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 19:34:41 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-85721513-e878-472e-bf36-e3aa341884ef tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] SCSI volumes sdg have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 19:34:41 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-85721513-e878-472e-bf36-e3aa341884ef tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711')] {{(pid=75066) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 19:34:41 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:34:41 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:34:41 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[207e4102-6ffc-4d83-8b98-9b8cd24dbc03]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:34:41 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-85721513-e878-472e-bf36-e3aa341884ef tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:34:41 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711 -p 172.16.0.220:3260 --logout {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:34:41 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:34:41 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4e1cf9-1c99-4467-8b12-538e2f93d8ca]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:34:41 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-85721513-e878-472e-bf36-e3aa341884ef tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711, portal: 172.16.0.220,3260]
Dec 01 19:34:41 user nova-compute[75066]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711, portal: 172.16.0.220,3260] successful.
Dec 01 19:34:41 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:34:41 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711 -p 172.16.0.220:3260 --op delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:34:41 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0898e25d-8549-401f-ab22-17b3d142f711 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:34:41 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee38c5a4-0797-4124-9b4d-9fc2be43a691]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:34:41 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-85721513-e878-472e-bf36-e3aa341884ef tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:34:41 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-85721513-e878-472e-bf36-e3aa341884ef tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:34:41 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-85721513-e878-472e-bf36-e3aa341884ef tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] <== disconnect_volume: return (285ms) None {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:34:41 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85721513-e878-472e-bf36-e3aa341884ef tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Disconnected iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 19:34:41 user nova-compute[75066]: DEBUG nova.objects.instance [None req-85721513-e878-472e-bf36-e3aa341884ef tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lazy-loading 'flavor' on Instance uuid f7cc644b-006c-4453-aea2-abe35cfd5ba3 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:34:41 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-85721513-e878-472e-bf36-e3aa341884ef tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "f7cc644b-006c-4453-aea2-abe35cfd5ba3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.717s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:34:45 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:34:50 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:34:50 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:34:50 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75066) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 19:34:50 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:34:50 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:34:50 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:34:55 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:34:55 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:35:00 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:35:03 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a1c9c838-8af6-49e1-a8d0-70f794860a45 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Acquiring lock "b2c6c900-5d1b-44f8-8435-d9ad88b3a412" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:35:03 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a1c9c838-8af6-49e1-a8d0-70f794860a45 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "b2c6c900-5d1b-44f8-8435-d9ad88b3a412" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:35:03 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a1c9c838-8af6-49e1-a8d0-70f794860a45 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Acquiring lock "b2c6c900-5d1b-44f8-8435-d9ad88b3a412-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:35:03 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a1c9c838-8af6-49e1-a8d0-70f794860a45 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "b2c6c900-5d1b-44f8-8435-d9ad88b3a412-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:35:03 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a1c9c838-8af6-49e1-a8d0-70f794860a45 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "b2c6c900-5d1b-44f8-8435-d9ad88b3a412-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:35:03 user nova-compute[75066]: INFO nova.compute.manager [None req-a1c9c838-8af6-49e1-a8d0-70f794860a45 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Terminating instance
Dec 01 19:35:03 user nova-compute[75066]: DEBUG nova.compute.manager [None req-a1c9c838-8af6-49e1-a8d0-70f794860a45 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Start destroying the instance on the hypervisor. {{(pid=75066) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 19:35:03 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:35:03 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:35:03 user nova-compute[75066]: DEBUG nova.compute.manager [req-0eb42a41-408d-4a50-a83c-9c71df728a80 req-e56f70c3-5a2e-49ee-92d0-9e482ad49b00 service nova] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Received event network-vif-unplugged-5b64624f-4059-4689-83ef-856573e0eab0 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:35:03 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-0eb42a41-408d-4a50-a83c-9c71df728a80 req-e56f70c3-5a2e-49ee-92d0-9e482ad49b00 service nova] Acquiring lock "b2c6c900-5d1b-44f8-8435-d9ad88b3a412-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:35:03 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-0eb42a41-408d-4a50-a83c-9c71df728a80 req-e56f70c3-5a2e-49ee-92d0-9e482ad49b00 service nova] Lock "b2c6c900-5d1b-44f8-8435-d9ad88b3a412-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:35:03 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-0eb42a41-408d-4a50-a83c-9c71df728a80 req-e56f70c3-5a2e-49ee-92d0-9e482ad49b00 service nova] Lock "b2c6c900-5d1b-44f8-8435-d9ad88b3a412-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:35:03 user nova-compute[75066]: DEBUG nova.compute.manager [req-0eb42a41-408d-4a50-a83c-9c71df728a80 req-e56f70c3-5a2e-49ee-92d0-9e482ad49b00 service nova] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] No waiting events found dispatching network-vif-unplugged-5b64624f-4059-4689-83ef-856573e0eab0 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:35:03 user nova-compute[75066]: DEBUG nova.compute.manager [req-0eb42a41-408d-4a50-a83c-9c71df728a80 req-e56f70c3-5a2e-49ee-92d0-9e482ad49b00 service nova] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Received event network-vif-unplugged-5b64624f-4059-4689-83ef-856573e0eab0 for instance with task_state deleting. {{(pid=75066) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 19:35:04 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:35:04 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:35:04 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Instance destroyed successfully.
Dec 01 19:35:04 user nova-compute[75066]: DEBUG nova.objects.instance [None req-a1c9c838-8af6-49e1-a8d0-70f794860a45 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lazy-loading 'resources' on Instance uuid b2c6c900-5d1b-44f8-8435-d9ad88b3a412 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:35:04 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-a1c9c838-8af6-49e1-a8d0-70f794860a45 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:28:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1435487615',display_name='tempest-ServerRescueNegativeTestJSON-server-1435487615',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1435487615',id=31,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDCNeprmgnfVxogNGgOlPPfFndhuZOSmJ9cRoqBokaw77D1VjF05n80FVq2sXbC1g2yqvZwE0g/0YU+PBmyhkD7PWUIyoZLPPecgdaLZA1vtC7lvG4JylIPIbZvcQHhUPw==',key_name='tempest-keypair-645274599',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:30:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='943324a514a84cb4947dbab93abc4f6c',ramdisk_id='',reservation_id='r-c4an3hxc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-146516797',owner_user_name='tempest-ServerRescueNegativeTestJSON-146516797-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:32:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e6ee9ed4a8d8418082a59be8db20cf2e',uuid=b2c6c900-5d1b-44f8-8435-d9ad88b3a412,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b64624f-4059-4689-83ef-856573e0eab0", "address": "fa:16:3e:3f:cc:a8", "network": {"id": "47c850ae-6dcb-4977-a02a-e32cd3df4749", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-475363603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "943324a514a84cb4947dbab93abc4f6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b64624f-40", "ovs_interfaceid": "5b64624f-4059-4689-83ef-856573e0eab0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:35:04 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-a1c9c838-8af6-49e1-a8d0-70f794860a45 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Converting VIF {"id": "5b64624f-4059-4689-83ef-856573e0eab0", "address": "fa:16:3e:3f:cc:a8", "network": {"id": "47c850ae-6dcb-4977-a02a-e32cd3df4749", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-475363603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.28", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "943324a514a84cb4947dbab93abc4f6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b64624f-40", "ovs_interfaceid": "5b64624f-4059-4689-83ef-856573e0eab0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:35:04 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-a1c9c838-8af6-49e1-a8d0-70f794860a45 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3f:cc:a8,bridge_name='br-int',has_traffic_filtering=True,id=5b64624f-4059-4689-83ef-856573e0eab0,network=Network(47c850ae-6dcb-4977-a02a-e32cd3df4749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b64624f-40') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:35:04 user nova-compute[75066]: DEBUG os_vif [None req-a1c9c838-8af6-49e1-a8d0-70f794860a45 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:cc:a8,bridge_name='br-int',has_traffic_filtering=True,id=5b64624f-4059-4689-83ef-856573e0eab0,network=Network(47c850ae-6dcb-4977-a02a-e32cd3df4749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b64624f-40') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:35:04 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:35:04 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b64624f-40, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:35:04 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:35:04 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:35:04 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:35:04 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c3cc5585-52b9-4874-b049-f7cf1e1d23ed) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:35:04 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:35:04 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:35:04 user nova-compute[75066]: INFO os_vif [None req-a1c9c838-8af6-49e1-a8d0-70f794860a45 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:cc:a8,bridge_name='br-int',has_traffic_filtering=True,id=5b64624f-4059-4689-83ef-856573e0eab0,network=Network(47c850ae-6dcb-4977-a02a-e32cd3df4749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b64624f-40')
Dec 01 19:35:04 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-a1c9c838-8af6-49e1-a8d0-70f794860a45 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Deleting instance files /opt/stack/data/nova/instances/b2c6c900-5d1b-44f8-8435-d9ad88b3a412_del
Dec 01 19:35:04 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-a1c9c838-8af6-49e1-a8d0-70f794860a45 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Deletion of /opt/stack/data/nova/instances/b2c6c900-5d1b-44f8-8435-d9ad88b3a412_del complete
Dec 01 19:35:04 user nova-compute[75066]: INFO nova.compute.manager [None req-a1c9c838-8af6-49e1-a8d0-70f794860a45 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Took 0.88 seconds to destroy the instance on the hypervisor.
Dec 01 19:35:04 user nova-compute[75066]: DEBUG oslo.service.loopingcall [None req-a1c9c838-8af6-49e1-a8d0-70f794860a45 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75066) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 19:35:04 user nova-compute[75066]: DEBUG nova.compute.manager [-] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Deallocating network for instance {{(pid=75066) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 19:35:04 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] deallocate_for_instance() {{(pid=75066) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 19:35:05 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:35:05 user nova-compute[75066]: INFO nova.compute.manager [-] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Took 0.77 seconds to deallocate network for instance.
Dec 01 19:35:05 user nova-compute[75066]: DEBUG nova.compute.manager [req-b743cfec-6400-4036-93cf-0f60d99befe5 req-f2d84d91-ddcd-48da-892c-f2eff44f4694 service nova] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Received event network-vif-deleted-5b64624f-4059-4689-83ef-856573e0eab0 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:35:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a1c9c838-8af6-49e1-a8d0-70f794860a45 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:35:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a1c9c838-8af6-49e1-a8d0-70f794860a45 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:35:05 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-a1c9c838-8af6-49e1-a8d0-70f794860a45 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:35:05 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-a1c9c838-8af6-49e1-a8d0-70f794860a45 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:35:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a1c9c838-8af6-49e1-a8d0-70f794860a45 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.306s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:35:05 user nova-compute[75066]: INFO nova.scheduler.client.report [None req-a1c9c838-8af6-49e1-a8d0-70f794860a45 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Deleted allocations for instance b2c6c900-5d1b-44f8-8435-d9ad88b3a412
Dec 01 19:35:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a1c9c838-8af6-49e1-a8d0-70f794860a45 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "b2c6c900-5d1b-44f8-8435-d9ad88b3a412" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.144s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:35:05 user nova-compute[75066]: DEBUG nova.compute.manager [req-03a121de-dc72-4b05-af84-c90924d5211b req-2fed1a5e-00bb-4090-a345-cfc323452fe4 service nova] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Received event network-vif-plugged-5b64624f-4059-4689-83ef-856573e0eab0 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:35:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-03a121de-dc72-4b05-af84-c90924d5211b req-2fed1a5e-00bb-4090-a345-cfc323452fe4 service nova] Acquiring lock "b2c6c900-5d1b-44f8-8435-d9ad88b3a412-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:35:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-03a121de-dc72-4b05-af84-c90924d5211b req-2fed1a5e-00bb-4090-a345-cfc323452fe4 service nova] Lock "b2c6c900-5d1b-44f8-8435-d9ad88b3a412-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:35:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-03a121de-dc72-4b05-af84-c90924d5211b req-2fed1a5e-00bb-4090-a345-cfc323452fe4 service nova] Lock "b2c6c900-5d1b-44f8-8435-d9ad88b3a412-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:35:05 user nova-compute[75066]: DEBUG nova.compute.manager [req-03a121de-dc72-4b05-af84-c90924d5211b req-2fed1a5e-00bb-4090-a345-cfc323452fe4 service nova] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] No waiting events found dispatching network-vif-plugged-5b64624f-4059-4689-83ef-856573e0eab0 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:35:05 user nova-compute[75066]: WARNING nova.compute.manager [req-03a121de-dc72-4b05-af84-c90924d5211b req-2fed1a5e-00bb-4090-a345-cfc323452fe4 service nova] [instance: b2c6c900-5d1b-44f8-8435-d9ad88b3a412] Received unexpected event network-vif-plugged-5b64624f-4059-4689-83ef-856573e0eab0 for instance with vm_state deleted and task_state None.
Dec 01 19:35:06 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:35:07 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:35:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:35:09 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:35:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:35:13 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:35:14 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:35:14 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:35:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-0648da6b-1fb8-468f-93f6-e3203c5e4780 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Acquiring lock "f7cc644b-006c-4453-aea2-abe35cfd5ba3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:35:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-0648da6b-1fb8-468f-93f6-e3203c5e4780 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "f7cc644b-006c-4453-aea2-abe35cfd5ba3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:35:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-0648da6b-1fb8-468f-93f6-e3203c5e4780 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Acquiring lock "f7cc644b-006c-4453-aea2-abe35cfd5ba3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:35:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-0648da6b-1fb8-468f-93f6-e3203c5e4780 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "f7cc644b-006c-4453-aea2-abe35cfd5ba3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:35:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-0648da6b-1fb8-468f-93f6-e3203c5e4780 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "f7cc644b-006c-4453-aea2-abe35cfd5ba3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:35:15 user nova-compute[75066]: INFO nova.compute.manager [None req-0648da6b-1fb8-468f-93f6-e3203c5e4780 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Terminating instance
Dec 01 19:35:15 user nova-compute[75066]: DEBUG nova.compute.manager [None req-0648da6b-1fb8-468f-93f6-e3203c5e4780 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Start destroying the instance on the hypervisor. {{(pid=75066) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 19:35:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:35:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:35:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:35:15 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:35:15 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75066) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 19:35:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:35:15 user nova-compute[75066]: DEBUG nova.compute.manager [req-43c6745b-cd03-4f2f-b4ba-4f5769c26f8e req-0ebad8bf-9b3b-4f85-802d-6c3b84682b50 service nova] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Received event network-vif-unplugged-3b45b67a-805d-4816-ad34-c5266535dd27 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:35:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-43c6745b-cd03-4f2f-b4ba-4f5769c26f8e req-0ebad8bf-9b3b-4f85-802d-6c3b84682b50 service nova] Acquiring lock "f7cc644b-006c-4453-aea2-abe35cfd5ba3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:35:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-43c6745b-cd03-4f2f-b4ba-4f5769c26f8e req-0ebad8bf-9b3b-4f85-802d-6c3b84682b50 service nova] Lock "f7cc644b-006c-4453-aea2-abe35cfd5ba3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:35:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-43c6745b-cd03-4f2f-b4ba-4f5769c26f8e req-0ebad8bf-9b3b-4f85-802d-6c3b84682b50 service nova] Lock "f7cc644b-006c-4453-aea2-abe35cfd5ba3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:35:15 user nova-compute[75066]: DEBUG nova.compute.manager [req-43c6745b-cd03-4f2f-b4ba-4f5769c26f8e req-0ebad8bf-9b3b-4f85-802d-6c3b84682b50 service nova] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] No waiting events found dispatching network-vif-unplugged-3b45b67a-805d-4816-ad34-c5266535dd27 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:35:15 user nova-compute[75066]: DEBUG nova.compute.manager [req-43c6745b-cd03-4f2f-b4ba-4f5769c26f8e req-0ebad8bf-9b3b-4f85-802d-6c3b84682b50 service nova] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Received event network-vif-unplugged-3b45b67a-805d-4816-ad34-c5266535dd27 for instance with task_state deleting. {{(pid=75066) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 19:35:15 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Instance destroyed successfully.
Dec 01 19:35:15 user nova-compute[75066]: DEBUG nova.objects.instance [None req-0648da6b-1fb8-468f-93f6-e3203c5e4780 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lazy-loading 'resources' on Instance uuid f7cc644b-006c-4453-aea2-abe35cfd5ba3 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:35:15 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-0648da6b-1fb8-468f-93f6-e3203c5e4780 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:30:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-263014517',display_name='tempest-TestMinimumBasicScenario-server-263014517',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-263014517',id=35,image_ref='f4263b44-262f-41ba-98ca-798c2b9528cd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdQJ2Yd21MdDeENp/SwylCgJAxC+OIAR+3elTs82WcN1jckBES8xf1wNF6MakHI6yBBDOMxYH8McmLKAZqgUpbHCUQRWesrbGs50mVoMEK4sAsvG/PV4ux6EkW7hI2H0w==',key_name='tempest-TestMinimumBasicScenario-1846437349',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:30:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1d5326c00d464e008337e0dc8577fc2d',ramdisk_id='',reservation_id='r-au36ziic',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='f4263b44-262f-41ba-98ca-798c2b9528cd',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-555382044',owner_user_name='tempest-TestMinimumBasicScenario-555382044-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:32:35Z,user_data=None,user_id='eeb6ade6e91541b5b737150a67b6bd39',uuid=f7cc644b-006c-4453-aea2-abe35cfd5ba3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b45b67a-805d-4816-ad34-c5266535dd27", "address": "fa:16:3e:43:97:2a", "network": {"id": "4fe4d56e-afe2-42a6-984a-9af8bc5377a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126385357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5326c00d464e008337e0dc8577fc2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b45b67a-80", "ovs_interfaceid": "3b45b67a-805d-4816-ad34-c5266535dd27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:35:15 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-0648da6b-1fb8-468f-93f6-e3203c5e4780 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Converting VIF {"id": "3b45b67a-805d-4816-ad34-c5266535dd27", "address": "fa:16:3e:43:97:2a", "network": {"id": "4fe4d56e-afe2-42a6-984a-9af8bc5377a9", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-2126385357-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d5326c00d464e008337e0dc8577fc2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b45b67a-80", "ovs_interfaceid": "3b45b67a-805d-4816-ad34-c5266535dd27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:35:15 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-0648da6b-1fb8-468f-93f6-e3203c5e4780 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:97:2a,bridge_name='br-int',has_traffic_filtering=True,id=3b45b67a-805d-4816-ad34-c5266535dd27,network=Network(4fe4d56e-afe2-42a6-984a-9af8bc5377a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b45b67a-80') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:35:15 user nova-compute[75066]: DEBUG os_vif [None req-0648da6b-1fb8-468f-93f6-e3203c5e4780 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:97:2a,bridge_name='br-int',has_traffic_filtering=True,id=3b45b67a-805d-4816-ad34-c5266535dd27,network=Network(4fe4d56e-afe2-42a6-984a-9af8bc5377a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b45b67a-80') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:35:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:35:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3b45b67a-80, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:35:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:35:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:35:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:35:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7e8d8934-ba4a-4247-8277-1ec288622288) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:35:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:35:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:35:15 user nova-compute[75066]: INFO os_vif [None req-0648da6b-1fb8-468f-93f6-e3203c5e4780 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:97:2a,bridge_name='br-int',has_traffic_filtering=True,id=3b45b67a-805d-4816-ad34-c5266535dd27,network=Network(4fe4d56e-afe2-42a6-984a-9af8bc5377a9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b45b67a-80')
Dec 01 19:35:15 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-0648da6b-1fb8-468f-93f6-e3203c5e4780 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Deleting instance files /opt/stack/data/nova/instances/f7cc644b-006c-4453-aea2-abe35cfd5ba3_del
Dec 01 19:35:15 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-0648da6b-1fb8-468f-93f6-e3203c5e4780 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Deletion of /opt/stack/data/nova/instances/f7cc644b-006c-4453-aea2-abe35cfd5ba3_del complete
Dec 01 19:35:16 user nova-compute[75066]: INFO nova.compute.manager [None req-0648da6b-1fb8-468f-93f6-e3203c5e4780 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Took 0.88 seconds to destroy the instance on the hypervisor.
Dec 01 19:35:16 user nova-compute[75066]: DEBUG oslo.service.loopingcall [None req-0648da6b-1fb8-468f-93f6-e3203c5e4780 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75066) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 19:35:16 user nova-compute[75066]: DEBUG nova.compute.manager [-] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Deallocating network for instance {{(pid=75066) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 19:35:16 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] deallocate_for_instance() {{(pid=75066) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 19:35:16 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:35:16 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:35:16 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:35:16 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:35:16 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75066) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 19:35:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:35:16 user nova-compute[75066]: DEBUG nova.compute.manager [req-a31c1ba6-7f87-428c-a9fa-8e0836d55714 req-62e230c6-4e45-4fa4-87ac-a539529dcc8e service nova] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Received event network-vif-deleted-3b45b67a-805d-4816-ad34-c5266535dd27 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:35:16 user nova-compute[75066]: INFO nova.compute.manager [req-a31c1ba6-7f87-428c-a9fa-8e0836d55714 req-62e230c6-4e45-4fa4-87ac-a539529dcc8e service nova] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Neutron deleted interface 3b45b67a-805d-4816-ad34-c5266535dd27; detaching it from the instance and deleting it from the info cache
Dec 01 19:35:16 user nova-compute[75066]: DEBUG nova.network.neutron [req-a31c1ba6-7f87-428c-a9fa-8e0836d55714 req-62e230c6-4e45-4fa4-87ac-a539529dcc8e service nova] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:35:16 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:35:16 user nova-compute[75066]: INFO nova.compute.manager [-] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Took 0.48 seconds to deallocate network for instance.
Dec 01 19:35:16 user nova-compute[75066]: DEBUG nova.compute.manager [req-a31c1ba6-7f87-428c-a9fa-8e0836d55714 req-62e230c6-4e45-4fa4-87ac-a539529dcc8e service nova] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Detach interface failed, port_id=3b45b67a-805d-4816-ad34-c5266535dd27, reason: Instance f7cc644b-006c-4453-aea2-abe35cfd5ba3 could not be found. {{(pid=75066) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 01 19:35:16 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-0648da6b-1fb8-468f-93f6-e3203c5e4780 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:35:16 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-0648da6b-1fb8-468f-93f6-e3203c5e4780 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:35:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:35:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:35:16 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-0648da6b-1fb8-468f-93f6-e3203c5e4780 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:35:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:35:16 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:35:16 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-0648da6b-1fb8-468f-93f6-e3203c5e4780 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:35:16 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-0648da6b-1fb8-468f-93f6-e3203c5e4780 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.366s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:35:17 user nova-compute[75066]: INFO nova.scheduler.client.report [None req-0648da6b-1fb8-468f-93f6-e3203c5e4780 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Deleted allocations for instance f7cc644b-006c-4453-aea2-abe35cfd5ba3
Dec 01 19:35:17 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:35:17 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:35:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-0648da6b-1fb8-468f-93f6-e3203c5e4780 tempest-TestMinimumBasicScenario-555382044 tempest-TestMinimumBasicScenario-555382044-project-member] Lock "f7cc644b-006c-4453-aea2-abe35cfd5ba3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.009s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:35:17 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:35:17 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk.rescue --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:35:17 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:35:17 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk.rescue --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:35:17 user nova-compute[75066]: DEBUG nova.compute.manager [req-4f91c4de-6249-4de0-8b7e-0ef4074f9e53 req-fb39e21e-d67a-4af5-8251-39104e9e89ca service nova] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Received event network-vif-plugged-3b45b67a-805d-4816-ad34-c5266535dd27 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:35:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-4f91c4de-6249-4de0-8b7e-0ef4074f9e53 req-fb39e21e-d67a-4af5-8251-39104e9e89ca service nova] Acquiring lock "f7cc644b-006c-4453-aea2-abe35cfd5ba3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:35:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-4f91c4de-6249-4de0-8b7e-0ef4074f9e53 req-fb39e21e-d67a-4af5-8251-39104e9e89ca service nova] Lock "f7cc644b-006c-4453-aea2-abe35cfd5ba3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:35:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-4f91c4de-6249-4de0-8b7e-0ef4074f9e53 req-fb39e21e-d67a-4af5-8251-39104e9e89ca service nova] Lock "f7cc644b-006c-4453-aea2-abe35cfd5ba3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:35:17 user nova-compute[75066]: DEBUG nova.compute.manager [req-4f91c4de-6249-4de0-8b7e-0ef4074f9e53 req-fb39e21e-d67a-4af5-8251-39104e9e89ca service nova] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] No waiting events found dispatching network-vif-plugged-3b45b67a-805d-4816-ad34-c5266535dd27 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:35:17 user nova-compute[75066]: WARNING nova.compute.manager [req-4f91c4de-6249-4de0-8b7e-0ef4074f9e53 req-fb39e21e-d67a-4af5-8251-39104e9e89ca service nova] [instance: f7cc644b-006c-4453-aea2-abe35cfd5ba3] Received unexpected event network-vif-plugged-3b45b67a-805d-4816-ad34-c5266535dd27 for instance with vm_state deleted and task_state None.
Dec 01 19:35:17 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:35:17 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:35:17 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:35:17 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:35:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:35:18 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:35:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88850ea1-43cd-4066-8e6f-cfe5de621bc6/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:35:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88850ea1-43cd-4066-8e6f-cfe5de621bc6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:35:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88850ea1-43cd-4066-8e6f-cfe5de621bc6/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:35:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88850ea1-43cd-4066-8e6f-cfe5de621bc6/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:35:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:35:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:35:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:35:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:35:18 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:35:19 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:35:19 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:35:19 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Hypervisor/Node resource view: name=user free_ram=8259MB free_disk=24.638893127441406GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75066) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 19:35:19 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:35:19 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:35:19 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 90c49be6-97aa-45f1-bcbe-b9a3875226a7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:35:19 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance d564b128-598b-4ad4-8618-afa4dc8a7347 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:35:19 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 14de9d20-9e66-4517-b904-2967e0a06a97 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:35:19 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:35:19 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:35:19 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 88850ea1-43cd-4066-8e6f-cfe5de621bc6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:35:19 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance f04249c5-0196-455c-ac7a-f1ff8be320d4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:35:19 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 19:35:19 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 19:35:19 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:35:19 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:35:19 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Compute_service record updated for user:user {{(pid=75066) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 19:35:19 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.370s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:35:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:35:22 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:35:22 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:35:22 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:35:22 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Starting heal instance info cache {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 19:35:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "refresh_cache-8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:35:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquired lock "refresh_cache-8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:35:22 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Forcefully refreshing network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 19:35:23 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Updating instance_info_cache with network_info: [{"id": "7654d80f-b374-4865-9ea5-17f0f93696fe", "address": "fa:16:3e:b6:38:39", "network": {"id": "6b0f48b7-3db2-49b2-a238-8fd811b52d62", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1688127634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e000d89bca44cd8acba504256d8d1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7654d80f-b3", "ovs_interfaceid": "7654d80f-b374-4865-9ea5-17f0f93696fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:35:23 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Releasing lock "refresh_cache-8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:35:23 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Updated the network info_cache for instance {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 19:35:23 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:35:23 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:35:25 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:35:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:35:35 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:35:39 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5c0bb888-e87c-49b1-86f7-af42cbef2a57 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Acquiring lock "f04249c5-0196-455c-ac7a-f1ff8be320d4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:35:39 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5c0bb888-e87c-49b1-86f7-af42cbef2a57 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "f04249c5-0196-455c-ac7a-f1ff8be320d4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:35:39 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5c0bb888-e87c-49b1-86f7-af42cbef2a57 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Acquiring lock "f04249c5-0196-455c-ac7a-f1ff8be320d4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:35:39 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5c0bb888-e87c-49b1-86f7-af42cbef2a57 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "f04249c5-0196-455c-ac7a-f1ff8be320d4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:35:39 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5c0bb888-e87c-49b1-86f7-af42cbef2a57 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "f04249c5-0196-455c-ac7a-f1ff8be320d4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:35:39 user nova-compute[75066]: INFO nova.compute.manager [None req-5c0bb888-e87c-49b1-86f7-af42cbef2a57 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Terminating instance
Dec 01 19:35:39 user nova-compute[75066]: DEBUG nova.compute.manager [None req-5c0bb888-e87c-49b1-86f7-af42cbef2a57 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Start destroying the instance on the hypervisor. {{(pid=75066) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 19:35:39 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:35:39 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:35:39 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:35:39 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:35:39 user nova-compute[75066]: DEBUG nova.compute.manager [req-1f20a149-e35a-4aff-bfc4-f04cb8493553 req-e1b65bbf-6d36-4cf2-b5b8-b7eff8b3904d service nova] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Received event network-vif-unplugged-bbc4649f-c295-423e-a1c2-be3af706e4de {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:35:39 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-1f20a149-e35a-4aff-bfc4-f04cb8493553 req-e1b65bbf-6d36-4cf2-b5b8-b7eff8b3904d service nova] Acquiring lock "f04249c5-0196-455c-ac7a-f1ff8be320d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:35:39 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-1f20a149-e35a-4aff-bfc4-f04cb8493553 req-e1b65bbf-6d36-4cf2-b5b8-b7eff8b3904d service nova] Lock "f04249c5-0196-455c-ac7a-f1ff8be320d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:35:39 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-1f20a149-e35a-4aff-bfc4-f04cb8493553 req-e1b65bbf-6d36-4cf2-b5b8-b7eff8b3904d service nova] Lock "f04249c5-0196-455c-ac7a-f1ff8be320d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:35:39 user nova-compute[75066]: DEBUG nova.compute.manager [req-1f20a149-e35a-4aff-bfc4-f04cb8493553 req-e1b65bbf-6d36-4cf2-b5b8-b7eff8b3904d service nova] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] No waiting events found dispatching network-vif-unplugged-bbc4649f-c295-423e-a1c2-be3af706e4de {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:35:39 user nova-compute[75066]: DEBUG nova.compute.manager [req-1f20a149-e35a-4aff-bfc4-f04cb8493553 req-e1b65bbf-6d36-4cf2-b5b8-b7eff8b3904d service nova] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Received event network-vif-unplugged-bbc4649f-c295-423e-a1c2-be3af706e4de for instance with task_state deleting. {{(pid=75066) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 19:35:40 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Instance destroyed successfully.
Dec 01 19:35:40 user nova-compute[75066]: DEBUG nova.objects.instance [None req-5c0bb888-e87c-49b1-86f7-af42cbef2a57 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lazy-loading 'resources' on Instance uuid f04249c5-0196-455c-ac7a-f1ff8be320d4 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-5c0bb888-e87c-49b1-86f7-af42cbef2a57 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:30:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2133252280',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2133252280',id=34,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:32:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e000d89bca44cd8acba504256d8d1f1',ramdisk_id='',reservation_id='r-1ouukm88',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-454493649',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:33:53Z,user_data=None,user_id='964c1681ca8745d0b3879266d24f507e',uuid=f04249c5-0196-455c-ac7a-f1ff8be320d4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bbc4649f-c295-423e-a1c2-be3af706e4de", "address": "fa:16:3e:01:63:75", "network": {"id": "6b0f48b7-3db2-49b2-a238-8fd811b52d62", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1688127634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e000d89bca44cd8acba504256d8d1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbc4649f-c2", "ovs_interfaceid": "bbc4649f-c295-423e-a1c2-be3af706e4de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-5c0bb888-e87c-49b1-86f7-af42cbef2a57 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Converting VIF {"id": "bbc4649f-c295-423e-a1c2-be3af706e4de", "address": "fa:16:3e:01:63:75", "network": {"id": "6b0f48b7-3db2-49b2-a238-8fd811b52d62", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1688127634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e000d89bca44cd8acba504256d8d1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbc4649f-c2", "ovs_interfaceid": "bbc4649f-c295-423e-a1c2-be3af706e4de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-5c0bb888-e87c-49b1-86f7-af42cbef2a57 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:01:63:75,bridge_name='br-int',has_traffic_filtering=True,id=bbc4649f-c295-423e-a1c2-be3af706e4de,network=Network(6b0f48b7-3db2-49b2-a238-8fd811b52d62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbc4649f-c2') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG os_vif [None req-5c0bb888-e87c-49b1-86f7-af42cbef2a57 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:63:75,bridge_name='br-int',has_traffic_filtering=True,id=bbc4649f-c295-423e-a1c2-be3af706e4de,network=Network(6b0f48b7-3db2-49b2-a238-8fd811b52d62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbc4649f-c2') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbbc4649f-c2, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=498d67b7-fa28-4385-b3b8-11990812c3c1) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:35:40 user nova-compute[75066]: INFO os_vif [None req-5c0bb888-e87c-49b1-86f7-af42cbef2a57 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:01:63:75,bridge_name='br-int',has_traffic_filtering=True,id=bbc4649f-c295-423e-a1c2-be3af706e4de,network=Network(6b0f48b7-3db2-49b2-a238-8fd811b52d62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbc4649f-c2')
Dec 01 19:35:40 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c0bb888-e87c-49b1-86f7-af42cbef2a57 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] calling os-brick to detach iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0bb888-e87c-49b1-86f7-af42cbef2a57 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, {'target_iqn': 'iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YDMXrRvi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:35:40 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-5c0bb888-e87c-49b1-86f7-af42cbef2a57 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:35:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-5c0bb888-e87c-49b1-86f7-af42cbef2a57 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-5c0bb888-e87c-49b1-86f7-af42cbef2a57 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19f7146-8322-49ab-9de8-efa7a56f173c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0bb888-e87c-49b1-86f7-af42cbef2a57 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 19:35:40 user nova-compute[75066]: No targets found.
Dec 01 19:35:40 user nova-compute[75066]: iSNS:
Dec 01 19:35:40 user nova-compute[75066]: No targets found.
Dec 01 19:35:40 user nova-compute[75066]: STATIC:
Dec 01 19:35:40 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571
Dec 01 19:35:40 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:35:40 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:35:40 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb
Dec 01 19:35:40 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:35:40 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:35:40 user nova-compute[75066]: FIRMWARE:
Dec 01 19:35:40 user nova-compute[75066]: No targets found.
Dec 01 19:35:40 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0bb888-e87c-49b1-86f7-af42cbef2a57 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 19:35:40 user nova-compute[75066]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 19:35:40 user nova-compute[75066]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75066) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0bb888-e87c-49b1-86f7-af42cbef2a57 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571', 0)] {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5e14d0-c035-408f-96d0-fd4aef87c7d5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dba313a-2392-450b-9c41-83bb9b30f4c9]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0bb888-e87c-49b1-86f7-af42cbef2a57 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:35:40 user nova-compute[75066]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 (non-flash)
Dec 01 19:35:40 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0bb888-e87c-49b1-86f7-af42cbef2a57 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:35:40 user nova-compute[75066]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 (non-flash)
Dec 01 19:35:40 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0bb888-e87c-49b1-86f7-af42cbef2a57 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9170534e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571'): ({'sde'}, set())}) {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-5c0bb888-e87c-49b1-86f7-af42cbef2a57 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Removing single pathed devices sde {{(pid=75066) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[eed8967a-37d4-4a54-bb97-5c1c9bb35492]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb55a61-c894-477c-907e-197a5de56ede]: (4, ('ok\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-5c0bb888-e87c-49b1-86f7-af42cbef2a57 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Flushing IO for device /dev/sde {{(pid=75066) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[0902ca67-edc2-44ec-b9f7-9cc8e1b69e75]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-5c0bb888-e87c-49b1-86f7-af42cbef2a57 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75066) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b5e263-f9d6-4d36-86fc-c7d19e43316a]: (4, ('1', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-5c0bb888-e87c-49b1-86f7-af42cbef2a57 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-5c0bb888-e87c-49b1-86f7-af42cbef2a57 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] SCSI volumes sde have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_350b8162', '/dev/disk/by-id/scsi-1SCST_BIO350b8162-bb231f50efa8f78f', '/dev/disk/by-id/scsi-26262323331663530') {{(pid=86136) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1bdcfe3-2549-44b1-bc40-fbcfa5880494]: (4, None) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0bb888-e87c-49b1-86f7-af42cbef2a57 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571')] {{(pid=75066) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ebb3661-9947-453e-a0b2-48cec89f3c4e]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0bb888-e87c-49b1-86f7-af42cbef2a57 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 -p 172.16.0.220:3260 --logout {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[de37bdac-b984-44ff-8876-7af94cca9433]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0bb888-e87c-49b1-86f7-af42cbef2a57 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571, portal: 172.16.0.220,3260]
Dec 01 19:35:40 user nova-compute[75066]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571, portal: 172.16.0.220,3260] successful.
Dec 01 19:35:40 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 -p 172.16.0.220:3260 --op delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:00a9a62a-bf5a-4a84-869d-3aea7a75f571 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b01cd8b-3c3a-4d9f-836b-fcc98ef7aac4]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0bb888-e87c-49b1-86f7-af42cbef2a57 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-5c0bb888-e87c-49b1-86f7-af42cbef2a57 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c0bb888-e87c-49b1-86f7-af42cbef2a57 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] <== disconnect_volume: return (308ms) None {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c0bb888-e87c-49b1-86f7-af42cbef2a57 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Disconnected iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 19:35:40 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-5c0bb888-e87c-49b1-86f7-af42cbef2a57 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Deleting instance files /opt/stack/data/nova/instances/f04249c5-0196-455c-ac7a-f1ff8be320d4_del
Dec 01 19:35:40 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-5c0bb888-e87c-49b1-86f7-af42cbef2a57 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Deletion of /opt/stack/data/nova/instances/f04249c5-0196-455c-ac7a-f1ff8be320d4_del complete
Dec 01 19:35:40 user nova-compute[75066]: INFO nova.compute.manager [None req-5c0bb888-e87c-49b1-86f7-af42cbef2a57 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Took 1.16 seconds to destroy the instance on the hypervisor.
Dec 01 19:35:40 user nova-compute[75066]: DEBUG oslo.service.loopingcall [None req-5c0bb888-e87c-49b1-86f7-af42cbef2a57 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75066) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG nova.compute.manager [-] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Deallocating network for instance {{(pid=75066) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] deallocate_for_instance() {{(pid=75066) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 19:35:40 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:35:40 user nova-compute[75066]: INFO nova.compute.manager [-] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Took 0.42 seconds to deallocate network for instance.
Dec 01 19:35:41 user nova-compute[75066]: INFO nova.compute.manager [None req-5c0bb888-e87c-49b1-86f7-af42cbef2a57 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Took 0.81 seconds to detach 1 volumes for instance.
Dec 01 19:35:41 user nova-compute[75066]: DEBUG nova.compute.manager [req-33b8961b-d626-49fb-abae-e5d5be11453b req-f6c9dfe2-dc7c-45d2-b28d-e0ea4262816b service nova] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Received event network-vif-plugged-bbc4649f-c295-423e-a1c2-be3af706e4de {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:35:41 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-33b8961b-d626-49fb-abae-e5d5be11453b req-f6c9dfe2-dc7c-45d2-b28d-e0ea4262816b service nova] Acquiring lock "f04249c5-0196-455c-ac7a-f1ff8be320d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:35:41 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-33b8961b-d626-49fb-abae-e5d5be11453b req-f6c9dfe2-dc7c-45d2-b28d-e0ea4262816b service nova] Lock "f04249c5-0196-455c-ac7a-f1ff8be320d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:35:41 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-33b8961b-d626-49fb-abae-e5d5be11453b req-f6c9dfe2-dc7c-45d2-b28d-e0ea4262816b service nova] Lock "f04249c5-0196-455c-ac7a-f1ff8be320d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:35:41 user nova-compute[75066]: DEBUG nova.compute.manager [req-33b8961b-d626-49fb-abae-e5d5be11453b req-f6c9dfe2-dc7c-45d2-b28d-e0ea4262816b service nova] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] No waiting events found dispatching network-vif-plugged-bbc4649f-c295-423e-a1c2-be3af706e4de {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:35:41 user nova-compute[75066]: WARNING nova.compute.manager [req-33b8961b-d626-49fb-abae-e5d5be11453b req-f6c9dfe2-dc7c-45d2-b28d-e0ea4262816b service nova] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Received unexpected event network-vif-plugged-bbc4649f-c295-423e-a1c2-be3af706e4de for instance with vm_state deleted and task_state None.
Dec 01 19:35:41 user nova-compute[75066]: DEBUG nova.compute.manager [req-33b8961b-d626-49fb-abae-e5d5be11453b req-f6c9dfe2-dc7c-45d2-b28d-e0ea4262816b service nova] [instance: f04249c5-0196-455c-ac7a-f1ff8be320d4] Received event network-vif-deleted-bbc4649f-c295-423e-a1c2-be3af706e4de {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:35:41 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5c0bb888-e87c-49b1-86f7-af42cbef2a57 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:35:41 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5c0bb888-e87c-49b1-86f7-af42cbef2a57 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:35:42 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-5c0bb888-e87c-49b1-86f7-af42cbef2a57 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:35:42 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-5c0bb888-e87c-49b1-86f7-af42cbef2a57 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:35:42 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5c0bb888-e87c-49b1-86f7-af42cbef2a57 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.256s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:35:42 user nova-compute[75066]: INFO nova.scheduler.client.report [None req-5c0bb888-e87c-49b1-86f7-af42cbef2a57 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Deleted allocations for instance f04249c5-0196-455c-ac7a-f1ff8be320d4
Dec 01 19:35:42 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5c0bb888-e87c-49b1-86f7-af42cbef2a57 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "f04249c5-0196-455c-ac7a-f1ff8be320d4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.877s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:35:45 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:35:50 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:35:55 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:36:00 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:36:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Acquiring lock "409478f4-7921-4a15-89b0-82c26fa39de7" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:36:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "409478f4-7921-4a15-89b0-82c26fa39de7" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:36:01 user nova-compute[75066]: INFO nova.compute.manager [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Unshelving
Dec 01 19:36:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:36:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:36:02 user nova-compute[75066]: DEBUG nova.objects.instance [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lazy-loading 'pci_requests' on Instance uuid 409478f4-7921-4a15-89b0-82c26fa39de7 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:36:02 user nova-compute[75066]: DEBUG nova.objects.instance [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lazy-loading 'numa_topology' on Instance uuid 409478f4-7921-4a15-89b0-82c26fa39de7 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:36:02 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75066) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 19:36:02 user nova-compute[75066]: INFO nova.compute.claims [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Claim successful on node user
Dec 01 19:36:02 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:36:02 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:36:02 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.385s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:36:02 user nova-compute[75066]: INFO nova.network.neutron [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Updating port 6d709e03-0f37-43f6-ab89-61e12ae93b48 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Dec 01 19:36:03 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Acquiring lock "refresh_cache-409478f4-7921-4a15-89b0-82c26fa39de7" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:36:03 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Acquired lock "refresh_cache-409478f4-7921-4a15-89b0-82c26fa39de7" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:36:03 user nova-compute[75066]: DEBUG nova.network.neutron [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:36:03 user nova-compute[75066]: DEBUG nova.compute.manager [req-2a98a706-195d-4810-8997-7a372a6e8ca0 req-55b22c36-5c10-4a2a-ac26-4117116baefe service nova] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Received event network-changed-6d709e03-0f37-43f6-ab89-61e12ae93b48 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:36:03 user nova-compute[75066]: DEBUG nova.compute.manager [req-2a98a706-195d-4810-8997-7a372a6e8ca0 req-55b22c36-5c10-4a2a-ac26-4117116baefe service nova] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Refreshing instance network info cache due to event network-changed-6d709e03-0f37-43f6-ab89-61e12ae93b48. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:36:03 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-2a98a706-195d-4810-8997-7a372a6e8ca0 req-55b22c36-5c10-4a2a-ac26-4117116baefe service nova] Acquiring lock "refresh_cache-409478f4-7921-4a15-89b0-82c26fa39de7" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:36:03 user nova-compute[75066]: DEBUG nova.network.neutron [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Updating instance_info_cache with network_info: [{"id": "6d709e03-0f37-43f6-ab89-61e12ae93b48", "address": "fa:16:3e:39:17:c8", "network": {"id": "49dd72ae-ec07-46a6-8463-e38bdfe1eba0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-738739404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879678dca7054c178839f56e66a6e0ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d709e03-0f", "ovs_interfaceid": "6d709e03-0f37-43f6-ab89-61e12ae93b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:36:03 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Releasing lock "refresh_cache-409478f4-7921-4a15-89b0-82c26fa39de7" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:36:03 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Creating instance directory {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 19:36:03 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Creating image(s)
Dec 01 19:36:03 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Acquiring lock "/opt/stack/data/nova/instances/409478f4-7921-4a15-89b0-82c26fa39de7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:36:03 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "/opt/stack/data/nova/instances/409478f4-7921-4a15-89b0-82c26fa39de7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:36:03 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "/opt/stack/data/nova/instances/409478f4-7921-4a15-89b0-82c26fa39de7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:36:03 user nova-compute[75066]: DEBUG nova.objects.instance [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lazy-loading 'trusted_certs' on Instance uuid 409478f4-7921-4a15-89b0-82c26fa39de7 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:36:03 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-2a98a706-195d-4810-8997-7a372a6e8ca0 req-55b22c36-5c10-4a2a-ac26-4117116baefe service nova] Acquired lock "refresh_cache-409478f4-7921-4a15-89b0-82c26fa39de7" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:36:03 user nova-compute[75066]: DEBUG nova.network.neutron [req-2a98a706-195d-4810-8997-7a372a6e8ca0 req-55b22c36-5c10-4a2a-ac26-4117116baefe service nova] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Refreshing network info cache for port 6d709e03-0f37-43f6-ab89-61e12ae93b48 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:36:03 user nova-compute[75066]: DEBUG nova.objects.base [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Object Instance<409478f4-7921-4a15-89b0-82c26fa39de7> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75066) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 19:36:03 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Acquiring lock "22af62ee917ffa70f532c9e7daa88fdd37263fe0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:36:03 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "22af62ee917ffa70f532c9e7daa88fdd37263fe0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:36:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22af62ee917ffa70f532c9e7daa88fdd37263fe0.part --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:36:04 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-2a410d38-565f-4e26-bfba-35cd040cbc0b tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Acquiring lock "14de9d20-9e66-4517-b904-2967e0a06a97" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:36:04 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-2a410d38-565f-4e26-bfba-35cd040cbc0b tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "14de9d20-9e66-4517-b904-2967e0a06a97" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:36:04 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-2a410d38-565f-4e26-bfba-35cd040cbc0b tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Acquiring lock "14de9d20-9e66-4517-b904-2967e0a06a97-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:36:04 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-2a410d38-565f-4e26-bfba-35cd040cbc0b tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "14de9d20-9e66-4517-b904-2967e0a06a97-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:36:04 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-2a410d38-565f-4e26-bfba-35cd040cbc0b tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "14de9d20-9e66-4517-b904-2967e0a06a97-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:36:04 user nova-compute[75066]: INFO nova.compute.manager [None req-2a410d38-565f-4e26-bfba-35cd040cbc0b tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Terminating instance
Dec 01 19:36:04 user nova-compute[75066]: DEBUG nova.compute.manager [None req-2a410d38-565f-4e26-bfba-35cd040cbc0b tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Start destroying the instance on the hypervisor. {{(pid=75066) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 19:36:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22af62ee917ffa70f532c9e7daa88fdd37263fe0.part --force-share --output=json" returned: 0 in 0.178s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:36:04 user nova-compute[75066]: DEBUG nova.virt.images [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] c3c95edd-d843-455e-ac71-f6eb865a5100 was qcow2, converting to raw {{(pid=75066) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Dec 01 19:36:04 user nova-compute[75066]: DEBUG nova.privsep.utils [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75066) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Dec 01 19:36:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/22af62ee917ffa70f532c9e7daa88fdd37263fe0.part /opt/stack/data/nova/instances/_base/22af62ee917ffa70f532c9e7daa88fdd37263fe0.converted {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:36:04 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:05 user nova-compute[75066]: DEBUG nova.network.neutron [req-2a98a706-195d-4810-8997-7a372a6e8ca0 req-55b22c36-5c10-4a2a-ac26-4117116baefe service nova] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Updated VIF entry in instance network info cache for port 6d709e03-0f37-43f6-ab89-61e12ae93b48. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:36:05 user nova-compute[75066]: DEBUG nova.network.neutron [req-2a98a706-195d-4810-8997-7a372a6e8ca0 req-55b22c36-5c10-4a2a-ac26-4117116baefe service nova] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Updating instance_info_cache with network_info: [{"id": "6d709e03-0f37-43f6-ab89-61e12ae93b48", "address": "fa:16:3e:39:17:c8", "network": {"id": "49dd72ae-ec07-46a6-8463-e38bdfe1eba0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-738739404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879678dca7054c178839f56e66a6e0ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d709e03-0f", "ovs_interfaceid": "6d709e03-0f37-43f6-ab89-61e12ae93b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:36:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-2a98a706-195d-4810-8997-7a372a6e8ca0 req-55b22c36-5c10-4a2a-ac26-4117116baefe service nova] Releasing lock "refresh_cache-409478f4-7921-4a15-89b0-82c26fa39de7" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:36:05 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:05 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:05 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:05 user nova-compute[75066]: DEBUG nova.compute.manager [req-84070d2c-5039-4e09-b6b4-488e3606e388 req-3cf9bf53-acef-4103-981c-ff5170436cd3 service nova] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Received event network-vif-unplugged-4ab99734-a7a9-43f9-b75e-f02d33a7a50d {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:36:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-84070d2c-5039-4e09-b6b4-488e3606e388 req-3cf9bf53-acef-4103-981c-ff5170436cd3 service nova] Acquiring lock "14de9d20-9e66-4517-b904-2967e0a06a97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:36:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-84070d2c-5039-4e09-b6b4-488e3606e388 req-3cf9bf53-acef-4103-981c-ff5170436cd3 service nova] Lock "14de9d20-9e66-4517-b904-2967e0a06a97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:36:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-84070d2c-5039-4e09-b6b4-488e3606e388 req-3cf9bf53-acef-4103-981c-ff5170436cd3 service nova] Lock "14de9d20-9e66-4517-b904-2967e0a06a97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:36:05 user nova-compute[75066]: DEBUG nova.compute.manager [req-84070d2c-5039-4e09-b6b4-488e3606e388 req-3cf9bf53-acef-4103-981c-ff5170436cd3 service nova] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] No waiting events found dispatching network-vif-unplugged-4ab99734-a7a9-43f9-b75e-f02d33a7a50d {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:36:05 user nova-compute[75066]: DEBUG nova.compute.manager [req-84070d2c-5039-4e09-b6b4-488e3606e388 req-3cf9bf53-acef-4103-981c-ff5170436cd3 service nova] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Received event network-vif-unplugged-4ab99734-a7a9-43f9-b75e-f02d33a7a50d for instance with task_state deleting. {{(pid=75066) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 19:36:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/22af62ee917ffa70f532c9e7daa88fdd37263fe0.part /opt/stack/data/nova/instances/_base/22af62ee917ffa70f532c9e7daa88fdd37263fe0.converted" returned: 0 in 0.685s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:36:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22af62ee917ffa70f532c9e7daa88fdd37263fe0.converted --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:36:05 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:05 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:05 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Instance destroyed successfully.
Dec 01 19:36:05 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:05 user nova-compute[75066]: DEBUG nova.objects.instance [None req-2a410d38-565f-4e26-bfba-35cd040cbc0b tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lazy-loading 'resources' on Instance uuid 14de9d20-9e66-4517-b904-2967e0a06a97 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:36:05 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-2a410d38-565f-4e26-bfba-35cd040cbc0b tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:19:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-186779241',display_name='tempest-ServerRescueNegativeTestJSON-server-186779241',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-186779241',id=16,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:21:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='943324a514a84cb4947dbab93abc4f6c',ramdisk_id='',reservation_id='r-z616xe6z',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-146516797',owner_user_name='tempest-ServerRescueNegativeTestJSON-146516797-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:21:49Z,user_data=None,user_id='e6ee9ed4a8d8418082a59be8db20cf2e',uuid=14de9d20-9e66-4517-b904-2967e0a06a97,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "4ab99734-a7a9-43f9-b75e-f02d33a7a50d", "address": "fa:16:3e:54:2d:24", "network": {"id": "47c850ae-6dcb-4977-a02a-e32cd3df4749", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-475363603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "943324a514a84cb4947dbab93abc4f6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ab99734-a7", "ovs_interfaceid": "4ab99734-a7a9-43f9-b75e-f02d33a7a50d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:36:05 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-2a410d38-565f-4e26-bfba-35cd040cbc0b tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Converting VIF {"id": "4ab99734-a7a9-43f9-b75e-f02d33a7a50d", "address": "fa:16:3e:54:2d:24", "network": {"id": "47c850ae-6dcb-4977-a02a-e32cd3df4749", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-475363603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "943324a514a84cb4947dbab93abc4f6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ab99734-a7", "ovs_interfaceid": "4ab99734-a7a9-43f9-b75e-f02d33a7a50d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:36:05 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-2a410d38-565f-4e26-bfba-35cd040cbc0b tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:54:2d:24,bridge_name='br-int',has_traffic_filtering=True,id=4ab99734-a7a9-43f9-b75e-f02d33a7a50d,network=Network(47c850ae-6dcb-4977-a02a-e32cd3df4749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ab99734-a7') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:36:05 user nova-compute[75066]: DEBUG os_vif [None req-2a410d38-565f-4e26-bfba-35cd040cbc0b tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:2d:24,bridge_name='br-int',has_traffic_filtering=True,id=4ab99734-a7a9-43f9-b75e-f02d33a7a50d,network=Network(47c850ae-6dcb-4977-a02a-e32cd3df4749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ab99734-a7') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:36:05 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:05 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ab99734-a7, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:36:05 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:36:05 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:05 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5ef40564-ec57-48f7-86e4-2d61a5f6ec8f) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:36:05 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:36:05 user nova-compute[75066]: INFO os_vif [None req-2a410d38-565f-4e26-bfba-35cd040cbc0b tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:54:2d:24,bridge_name='br-int',has_traffic_filtering=True,id=4ab99734-a7a9-43f9-b75e-f02d33a7a50d,network=Network(47c850ae-6dcb-4977-a02a-e32cd3df4749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ab99734-a7')
Dec 01 19:36:05 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-2a410d38-565f-4e26-bfba-35cd040cbc0b tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Deleting instance files /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97_del
Dec 01 19:36:05 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-2a410d38-565f-4e26-bfba-35cd040cbc0b tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Deletion of /opt/stack/data/nova/instances/14de9d20-9e66-4517-b904-2967e0a06a97_del complete
Dec 01 19:36:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22af62ee917ffa70f532c9e7daa88fdd37263fe0.converted --force-share --output=json" returned: 0 in 0.315s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:36:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "22af62ee917ffa70f532c9e7daa88fdd37263fe0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.417s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:36:05 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22af62ee917ffa70f532c9e7daa88fdd37263fe0 --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:36:05 user nova-compute[75066]: INFO nova.compute.manager [None req-2a410d38-565f-4e26-bfba-35cd040cbc0b tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Took 1.20 seconds to destroy the instance on the hypervisor.
Dec 01 19:36:05 user nova-compute[75066]: DEBUG oslo.service.loopingcall [None req-2a410d38-565f-4e26-bfba-35cd040cbc0b tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75066) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 19:36:05 user nova-compute[75066]: DEBUG nova.compute.manager [-] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Deallocating network for instance {{(pid=75066) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 19:36:05 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] deallocate_for_instance() {{(pid=75066) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 19:36:06 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22af62ee917ffa70f532c9e7daa88fdd37263fe0 --force-share --output=json" returned: 0 in 0.199s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:36:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Acquiring lock "22af62ee917ffa70f532c9e7daa88fdd37263fe0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:36:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "22af62ee917ffa70f532c9e7daa88fdd37263fe0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:36:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22af62ee917ffa70f532c9e7daa88fdd37263fe0 --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:36:06 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22af62ee917ffa70f532c9e7daa88fdd37263fe0 --force-share --output=json" returned: 0 in 0.176s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:36:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22af62ee917ffa70f532c9e7daa88fdd37263fe0,backing_fmt=raw /opt/stack/data/nova/instances/409478f4-7921-4a15-89b0-82c26fa39de7/disk 1073741824 {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:36:06 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:36:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22af62ee917ffa70f532c9e7daa88fdd37263fe0,backing_fmt=raw /opt/stack/data/nova/instances/409478f4-7921-4a15-89b0-82c26fa39de7/disk 1073741824" returned: 0 in 0.056s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:36:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "22af62ee917ffa70f532c9e7daa88fdd37263fe0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:36:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22af62ee917ffa70f532c9e7daa88fdd37263fe0 --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:36:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22af62ee917ffa70f532c9e7daa88fdd37263fe0 --force-share --output=json" returned: 0 in 0.187s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:36:06 user nova-compute[75066]: DEBUG nova.objects.instance [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lazy-loading 'migration_context' on Instance uuid 409478f4-7921-4a15-89b0-82c26fa39de7 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:36:06 user nova-compute[75066]: DEBUG nova.objects.base [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Object Instance<409478f4-7921-4a15-89b0-82c26fa39de7> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75066) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 19:36:06 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Rebasing disk image.
Dec 01 19:36:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:36:06 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:36:06 user nova-compute[75066]: INFO nova.compute.manager [-] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Took 0.69 seconds to deallocate network for instance.
Dec 01 19:36:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-2a410d38-565f-4e26-bfba-35cd040cbc0b tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:36:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-2a410d38-565f-4e26-bfba-35cd040cbc0b tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:36:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.189s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:36:06 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d -F raw /opt/stack/data/nova/instances/409478f4-7921-4a15-89b0-82c26fa39de7/disk {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:36:07 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-2a410d38-565f-4e26-bfba-35cd040cbc0b tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:36:07 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-2a410d38-565f-4e26-bfba-35cd040cbc0b tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:36:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-2a410d38-565f-4e26-bfba-35cd040cbc0b tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.339s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:36:07 user nova-compute[75066]: INFO nova.scheduler.client.report [None req-2a410d38-565f-4e26-bfba-35cd040cbc0b tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Deleted allocations for instance 14de9d20-9e66-4517-b904-2967e0a06a97
Dec 01 19:36:07 user nova-compute[75066]: DEBUG nova.compute.manager [req-2f904864-e676-4cf9-b738-bd99a9d271cb req-659c742e-f170-42bb-afce-da86062a0afc service nova] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Received event network-vif-plugged-4ab99734-a7a9-43f9-b75e-f02d33a7a50d {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:36:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-2f904864-e676-4cf9-b738-bd99a9d271cb req-659c742e-f170-42bb-afce-da86062a0afc service nova] Acquiring lock "14de9d20-9e66-4517-b904-2967e0a06a97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:36:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-2f904864-e676-4cf9-b738-bd99a9d271cb req-659c742e-f170-42bb-afce-da86062a0afc service nova] Lock "14de9d20-9e66-4517-b904-2967e0a06a97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:36:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-2f904864-e676-4cf9-b738-bd99a9d271cb req-659c742e-f170-42bb-afce-da86062a0afc service nova] Lock "14de9d20-9e66-4517-b904-2967e0a06a97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:36:07 user nova-compute[75066]: DEBUG nova.compute.manager [req-2f904864-e676-4cf9-b738-bd99a9d271cb req-659c742e-f170-42bb-afce-da86062a0afc service nova] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] No waiting events found dispatching network-vif-plugged-4ab99734-a7a9-43f9-b75e-f02d33a7a50d {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:36:07 user nova-compute[75066]: WARNING nova.compute.manager [req-2f904864-e676-4cf9-b738-bd99a9d271cb req-659c742e-f170-42bb-afce-da86062a0afc service nova] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Received unexpected event network-vif-plugged-4ab99734-a7a9-43f9-b75e-f02d33a7a50d for instance with vm_state deleted and task_state None.
Dec 01 19:36:07 user nova-compute[75066]: DEBUG nova.compute.manager [req-2f904864-e676-4cf9-b738-bd99a9d271cb req-659c742e-f170-42bb-afce-da86062a0afc service nova] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Received event network-vif-plugged-4ab99734-a7a9-43f9-b75e-f02d33a7a50d {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:36:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-2f904864-e676-4cf9-b738-bd99a9d271cb req-659c742e-f170-42bb-afce-da86062a0afc service nova] Acquiring lock "14de9d20-9e66-4517-b904-2967e0a06a97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:36:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-2f904864-e676-4cf9-b738-bd99a9d271cb req-659c742e-f170-42bb-afce-da86062a0afc service nova] Lock "14de9d20-9e66-4517-b904-2967e0a06a97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:36:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-2f904864-e676-4cf9-b738-bd99a9d271cb req-659c742e-f170-42bb-afce-da86062a0afc service nova] Lock "14de9d20-9e66-4517-b904-2967e0a06a97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:36:07 user nova-compute[75066]: DEBUG nova.compute.manager [req-2f904864-e676-4cf9-b738-bd99a9d271cb req-659c742e-f170-42bb-afce-da86062a0afc service nova] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] No waiting events found dispatching network-vif-plugged-4ab99734-a7a9-43f9-b75e-f02d33a7a50d {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:36:07 user nova-compute[75066]: WARNING nova.compute.manager [req-2f904864-e676-4cf9-b738-bd99a9d271cb req-659c742e-f170-42bb-afce-da86062a0afc service nova] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Received unexpected event network-vif-plugged-4ab99734-a7a9-43f9-b75e-f02d33a7a50d for instance with vm_state deleted and task_state None.
Dec 01 19:36:07 user nova-compute[75066]: DEBUG nova.compute.manager [req-2f904864-e676-4cf9-b738-bd99a9d271cb req-659c742e-f170-42bb-afce-da86062a0afc service nova] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Received event network-vif-plugged-4ab99734-a7a9-43f9-b75e-f02d33a7a50d {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:36:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-2f904864-e676-4cf9-b738-bd99a9d271cb req-659c742e-f170-42bb-afce-da86062a0afc service nova] Acquiring lock "14de9d20-9e66-4517-b904-2967e0a06a97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:36:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-2f904864-e676-4cf9-b738-bd99a9d271cb req-659c742e-f170-42bb-afce-da86062a0afc service nova] Lock "14de9d20-9e66-4517-b904-2967e0a06a97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:36:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-2f904864-e676-4cf9-b738-bd99a9d271cb req-659c742e-f170-42bb-afce-da86062a0afc service nova] Lock "14de9d20-9e66-4517-b904-2967e0a06a97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:36:07 user nova-compute[75066]: DEBUG nova.compute.manager [req-2f904864-e676-4cf9-b738-bd99a9d271cb req-659c742e-f170-42bb-afce-da86062a0afc service nova] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] No waiting events found dispatching network-vif-plugged-4ab99734-a7a9-43f9-b75e-f02d33a7a50d {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:36:07 user nova-compute[75066]: WARNING nova.compute.manager [req-2f904864-e676-4cf9-b738-bd99a9d271cb req-659c742e-f170-42bb-afce-da86062a0afc service nova] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Received unexpected event network-vif-plugged-4ab99734-a7a9-43f9-b75e-f02d33a7a50d for instance with vm_state deleted and task_state None.
Dec 01 19:36:07 user nova-compute[75066]: DEBUG nova.compute.manager [req-2f904864-e676-4cf9-b738-bd99a9d271cb req-659c742e-f170-42bb-afce-da86062a0afc service nova] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Received event network-vif-unplugged-4ab99734-a7a9-43f9-b75e-f02d33a7a50d {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:36:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-2f904864-e676-4cf9-b738-bd99a9d271cb req-659c742e-f170-42bb-afce-da86062a0afc service nova] Acquiring lock "14de9d20-9e66-4517-b904-2967e0a06a97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:36:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-2f904864-e676-4cf9-b738-bd99a9d271cb req-659c742e-f170-42bb-afce-da86062a0afc service nova] Lock "14de9d20-9e66-4517-b904-2967e0a06a97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:36:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-2f904864-e676-4cf9-b738-bd99a9d271cb req-659c742e-f170-42bb-afce-da86062a0afc service nova] Lock "14de9d20-9e66-4517-b904-2967e0a06a97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:36:07 user nova-compute[75066]: DEBUG nova.compute.manager [req-2f904864-e676-4cf9-b738-bd99a9d271cb req-659c742e-f170-42bb-afce-da86062a0afc service nova] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] No waiting events found dispatching network-vif-unplugged-4ab99734-a7a9-43f9-b75e-f02d33a7a50d {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:36:07 user nova-compute[75066]: WARNING nova.compute.manager [req-2f904864-e676-4cf9-b738-bd99a9d271cb req-659c742e-f170-42bb-afce-da86062a0afc service nova] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Received unexpected event network-vif-unplugged-4ab99734-a7a9-43f9-b75e-f02d33a7a50d for instance with vm_state deleted and task_state None.
Dec 01 19:36:07 user nova-compute[75066]: DEBUG nova.compute.manager [req-2f904864-e676-4cf9-b738-bd99a9d271cb req-659c742e-f170-42bb-afce-da86062a0afc service nova] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Received event network-vif-plugged-4ab99734-a7a9-43f9-b75e-f02d33a7a50d {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:36:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-2f904864-e676-4cf9-b738-bd99a9d271cb req-659c742e-f170-42bb-afce-da86062a0afc service nova] Acquiring lock "14de9d20-9e66-4517-b904-2967e0a06a97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:36:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-2f904864-e676-4cf9-b738-bd99a9d271cb req-659c742e-f170-42bb-afce-da86062a0afc service nova] Lock "14de9d20-9e66-4517-b904-2967e0a06a97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:36:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-2f904864-e676-4cf9-b738-bd99a9d271cb req-659c742e-f170-42bb-afce-da86062a0afc service nova] Lock "14de9d20-9e66-4517-b904-2967e0a06a97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:36:07 user nova-compute[75066]: DEBUG nova.compute.manager [req-2f904864-e676-4cf9-b738-bd99a9d271cb req-659c742e-f170-42bb-afce-da86062a0afc service nova] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] No waiting events found dispatching network-vif-plugged-4ab99734-a7a9-43f9-b75e-f02d33a7a50d {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:36:07 user nova-compute[75066]: WARNING nova.compute.manager [req-2f904864-e676-4cf9-b738-bd99a9d271cb req-659c742e-f170-42bb-afce-da86062a0afc service nova] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Received unexpected event network-vif-plugged-4ab99734-a7a9-43f9-b75e-f02d33a7a50d for instance with vm_state deleted and task_state None.
Dec 01 19:36:07 user nova-compute[75066]: DEBUG nova.compute.manager [req-2f904864-e676-4cf9-b738-bd99a9d271cb req-659c742e-f170-42bb-afce-da86062a0afc service nova] [instance: 14de9d20-9e66-4517-b904-2967e0a06a97] Received event network-vif-deleted-4ab99734-a7a9-43f9-b75e-f02d33a7a50d {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:36:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-2a410d38-565f-4e26-bfba-35cd040cbc0b tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "14de9d20-9e66-4517-b904-2967e0a06a97" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.602s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:36:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d -F raw /opt/stack/data/nova/instances/409478f4-7921-4a15-89b0-82c26fa39de7/disk" returned: 0 in 2.833s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:36:09 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Created local disks {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 19:36:09 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Ensure instance console log exists: /opt/stack/data/nova/instances/409478f4-7921-4a15-89b0-82c26fa39de7/console.log {{(pid=75066) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 19:36:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:36:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:36:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:36:09 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Start _get_guest_xml network_info=[{"id": "6d709e03-0f37-43f6-ab89-61e12ae93b48", "address": "fa:16:3e:39:17:c8", "network": {"id": "49dd72ae-ec07-46a6-8463-e38bdfe1eba0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-738739404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879678dca7054c178839f56e66a6e0ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d709e03-0f", "ovs_interfaceid": "6d709e03-0f37-43f6-ab89-61e12ae93b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='81be9fa9a182ed05b9dab6220f256caf',container_format='bare',created_at=2023-12-01T19:34:09Z,direct_url=<?>,disk_format='qcow2',id=c3c95edd-d843-455e-ac71-f6eb865a5100,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1093900305-shelved',owner='879678dca7054c178839f56e66a6e0ce',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-12-01T19:34:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'image_id': '900b237b-e99c-4fdd-a44f-dcb7a08baa86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:36:09 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:36:09 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:36:09 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:36:09 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:36:09 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:36:09 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:36:09 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:36:09 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='81be9fa9a182ed05b9dab6220f256caf',container_format='bare',created_at=2023-12-01T19:34:09Z,direct_url=<?>,disk_format='qcow2',id=c3c95edd-d843-455e-ac71-f6eb865a5100,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1093900305-shelved',owner='879678dca7054c178839f56e66a6e0ce',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-12-01T19:34:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:36:09 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:36:09 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:36:09 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:36:09 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:36:09 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:36:09 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:36:09 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:36:09 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:36:09 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:36:09 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:36:09 user nova-compute[75066]: DEBUG nova.objects.instance [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lazy-loading 'vcpu_model' on Instance uuid 409478f4-7921-4a15-89b0-82c26fa39de7 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:36:09 user nova-compute[75066]: DEBUG nova.objects.base [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Object Instance<409478f4-7921-4a15-89b0-82c26fa39de7> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75066) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 19:36:09 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-01T19:32:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1093900305',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1093900305',id=37,image_ref='c3c95edd-d843-455e-ac71-f6eb865a5100',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1679278784',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:32:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='879678dca7054c178839f56e66a6e0ce',ramdisk_id='',reservation_id='r-1sjmbvuo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1680443764',owner_user_name='tempest-AttachVolumeShelveTestJSON-1680443764-project-member',shelved_at='2023-12-01T19:34:13.373655',shelved_host='user',shelved_image_id='c3c95edd-d843-455e-ac71-f6eb865a5100'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:36:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90e207044c0741e99c4a83b2c4746cd3',uuid=409478f4-7921-4a15-89b0-82c26fa39de7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "6d709e03-0f37-43f6-ab89-61e12ae93b48", "address": "fa:16:3e:39:17:c8", "network": {"id": "49dd72ae-ec07-46a6-8463-e38bdfe1eba0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-738739404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879678dca7054c178839f56e66a6e0ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d709e03-0f", "ovs_interfaceid": "6d709e03-0f37-43f6-ab89-61e12ae93b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:36:09 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Converting VIF {"id": "6d709e03-0f37-43f6-ab89-61e12ae93b48", "address": "fa:16:3e:39:17:c8", "network": {"id": "49dd72ae-ec07-46a6-8463-e38bdfe1eba0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-738739404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879678dca7054c178839f56e66a6e0ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d709e03-0f", "ovs_interfaceid": "6d709e03-0f37-43f6-ab89-61e12ae93b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:36:09 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:17:c8,bridge_name='br-int',has_traffic_filtering=True,id=6d709e03-0f37-43f6-ab89-61e12ae93b48,network=Network(49dd72ae-ec07-46a6-8463-e38bdfe1eba0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d709e03-0f') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:36:09 user nova-compute[75066]: DEBUG nova.objects.instance [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lazy-loading 'pci_devices' on Instance uuid 409478f4-7921-4a15-89b0-82c26fa39de7 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:36:09 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:09 user nova-compute[75066]: DEBUG nova.objects.base [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Object Instance<409478f4-7921-4a15-89b0-82c26fa39de7> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75066) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Dec 01 19:36:09 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:36:09 user nova-compute[75066]:   <uuid>409478f4-7921-4a15-89b0-82c26fa39de7</uuid>
Dec 01 19:36:09 user nova-compute[75066]:   <name>instance-00000025</name>
Dec 01 19:36:09 user nova-compute[75066]:   <memory>524288</memory>
Dec 01 19:36:09 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:36:09 user nova-compute[75066]:   <metadata>
Dec 01 19:36:09 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:36:09 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:36:09 user nova-compute[75066]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1093900305</nova:name>
Dec 01 19:36:09 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:36:09</nova:creationTime>
Dec 01 19:36:09 user nova-compute[75066]:       <nova:flavor name="m1.tiny">
Dec 01 19:36:09 user nova-compute[75066]:         <nova:memory>512</nova:memory>
Dec 01 19:36:09 user nova-compute[75066]:         <nova:disk>1</nova:disk>
Dec 01 19:36:09 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:36:09 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:36:09 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:36:09 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:36:09 user nova-compute[75066]:       <nova:owner>
Dec 01 19:36:09 user nova-compute[75066]:         <nova:user uuid="90e207044c0741e99c4a83b2c4746cd3">tempest-AttachVolumeShelveTestJSON-1680443764-project-member</nova:user>
Dec 01 19:36:09 user nova-compute[75066]:         <nova:project uuid="879678dca7054c178839f56e66a6e0ce">tempest-AttachVolumeShelveTestJSON-1680443764</nova:project>
Dec 01 19:36:09 user nova-compute[75066]:       </nova:owner>
Dec 01 19:36:09 user nova-compute[75066]:       <nova:root type="image" uuid="c3c95edd-d843-455e-ac71-f6eb865a5100"/>
Dec 01 19:36:09 user nova-compute[75066]:       <nova:ports>
Dec 01 19:36:09 user nova-compute[75066]:         <nova:port uuid="6d709e03-0f37-43f6-ab89-61e12ae93b48">
Dec 01 19:36:09 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 01 19:36:09 user nova-compute[75066]:         </nova:port>
Dec 01 19:36:09 user nova-compute[75066]:       </nova:ports>
Dec 01 19:36:09 user nova-compute[75066]:     </nova:instance>
Dec 01 19:36:09 user nova-compute[75066]:   </metadata>
Dec 01 19:36:09 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:36:09 user nova-compute[75066]:     <system>
Dec 01 19:36:09 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:36:09 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:36:09 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:36:09 user nova-compute[75066]:       <entry name="serial">409478f4-7921-4a15-89b0-82c26fa39de7</entry>
Dec 01 19:36:09 user nova-compute[75066]:       <entry name="uuid">409478f4-7921-4a15-89b0-82c26fa39de7</entry>
Dec 01 19:36:09 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:36:09 user nova-compute[75066]:     </system>
Dec 01 19:36:09 user nova-compute[75066]:   </sysinfo>
Dec 01 19:36:09 user nova-compute[75066]:   <os>
Dec 01 19:36:09 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:36:09 user nova-compute[75066]:     <boot dev="hd"/>
Dec 01 19:36:09 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:36:09 user nova-compute[75066]:   </os>
Dec 01 19:36:09 user nova-compute[75066]:   <features>
Dec 01 19:36:09 user nova-compute[75066]:     <acpi/>
Dec 01 19:36:09 user nova-compute[75066]:     <apic/>
Dec 01 19:36:09 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:36:09 user nova-compute[75066]:   </features>
Dec 01 19:36:09 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:36:09 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:36:09 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:36:09 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:36:09 user nova-compute[75066]:   </clock>
Dec 01 19:36:09 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:36:09 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:36:09 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:36:09 user nova-compute[75066]:   </cpu>
Dec 01 19:36:09 user nova-compute[75066]:   <devices>
Dec 01 19:36:09 user nova-compute[75066]:     <disk type="file" device="disk">
Dec 01 19:36:09 user nova-compute[75066]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 19:36:09 user nova-compute[75066]:       <source file="/opt/stack/data/nova/instances/409478f4-7921-4a15-89b0-82c26fa39de7/disk"/>
Dec 01 19:36:09 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:36:09 user nova-compute[75066]:     </disk>
Dec 01 19:36:09 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:36:09 user nova-compute[75066]:       <mac address="fa:16:3e:39:17:c8"/>
Dec 01 19:36:09 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:36:09 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:36:09 user nova-compute[75066]:       <target dev="tap6d709e03-0f"/>
Dec 01 19:36:09 user nova-compute[75066]:     </interface>
Dec 01 19:36:09 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:36:09 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/409478f4-7921-4a15-89b0-82c26fa39de7/console.log" append="off"/>
Dec 01 19:36:09 user nova-compute[75066]:     </serial>
Dec 01 19:36:09 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:36:09 user nova-compute[75066]:     <video>
Dec 01 19:36:09 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:36:09 user nova-compute[75066]:     </video>
Dec 01 19:36:09 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:36:09 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:36:09 user nova-compute[75066]:     </rng>
Dec 01 19:36:09 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:36:09 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:36:09 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:36:09 user nova-compute[75066]:     </memballoon>
Dec 01 19:36:09 user nova-compute[75066]:   </devices>
Dec 01 19:36:09 user nova-compute[75066]: </domain>
Dec 01 19:36:09 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:36:09 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-01T19:32:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1093900305',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1093900305',id=37,image_ref='c3c95edd-d843-455e-ac71-f6eb865a5100',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1679278784',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:32:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='879678dca7054c178839f56e66a6e0ce',ramdisk_id='',reservation_id='r-1sjmbvuo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1680443764',owner_user_name='tempest-AttachVolumeShelveTestJSON-1680443764-project-member',shelved_at='2023-12-01T19:34:13.373655',shelved_host='user',shelved_image_id='c3c95edd-d843-455e-ac71-f6eb865a5100'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:36:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90e207044c0741e99c4a83b2c4746cd3',uuid=409478f4-7921-4a15-89b0-82c26fa39de7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "6d709e03-0f37-43f6-ab89-61e12ae93b48", "address": "fa:16:3e:39:17:c8", "network": {"id": "49dd72ae-ec07-46a6-8463-e38bdfe1eba0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-738739404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879678dca7054c178839f56e66a6e0ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d709e03-0f", "ovs_interfaceid": "6d709e03-0f37-43f6-ab89-61e12ae93b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:36:09 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Converting VIF {"id": "6d709e03-0f37-43f6-ab89-61e12ae93b48", "address": "fa:16:3e:39:17:c8", "network": {"id": "49dd72ae-ec07-46a6-8463-e38bdfe1eba0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-738739404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879678dca7054c178839f56e66a6e0ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d709e03-0f", "ovs_interfaceid": "6d709e03-0f37-43f6-ab89-61e12ae93b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:36:09 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:17:c8,bridge_name='br-int',has_traffic_filtering=True,id=6d709e03-0f37-43f6-ab89-61e12ae93b48,network=Network(49dd72ae-ec07-46a6-8463-e38bdfe1eba0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d709e03-0f') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:36:09 user nova-compute[75066]: DEBUG os_vif [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:17:c8,bridge_name='br-int',has_traffic_filtering=True,id=6d709e03-0f37-43f6-ab89-61e12ae93b48,network=Network(49dd72ae-ec07-46a6-8463-e38bdfe1eba0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d709e03-0f') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:36:09 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:09 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:36:09 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:36:09 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:09 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0457aee9-7d9f-571b-86e3-474b41a4d1df', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:36:09 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:09 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:09 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:09 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6d709e03-0f, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:36:09 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6d709e03-0f, col_values=(('qos', UUID('4da52292-7a3f-447d-883f-1d23a42214e8')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:36:09 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6d709e03-0f, col_values=(('external_ids', {'iface-id': '6d709e03-0f37-43f6-ab89-61e12ae93b48', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:17:c8', 'vm-uuid': '409478f4-7921-4a15-89b0-82c26fa39de7'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:36:09 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:09 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:36:09 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:09 user nova-compute[75066]: INFO os_vif [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:17:c8,bridge_name='br-int',has_traffic_filtering=True,id=6d709e03-0f37-43f6-ab89-61e12ae93b48,network=Network(49dd72ae-ec07-46a6-8463-e38bdfe1eba0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d709e03-0f')
Dec 01 19:36:09 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:36:09 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] No VIF found with MAC fa:16:3e:39:17:c8, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:36:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:11 user nova-compute[75066]: DEBUG nova.compute.manager [req-aa4153c6-4ecf-43ce-899a-4d24af15e77d req-34c3a17d-ae8c-47d8-a043-7157ac3cfef5 service nova] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Received event network-vif-plugged-6d709e03-0f37-43f6-ab89-61e12ae93b48 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:36:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-aa4153c6-4ecf-43ce-899a-4d24af15e77d req-34c3a17d-ae8c-47d8-a043-7157ac3cfef5 service nova] Acquiring lock "409478f4-7921-4a15-89b0-82c26fa39de7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:36:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-aa4153c6-4ecf-43ce-899a-4d24af15e77d req-34c3a17d-ae8c-47d8-a043-7157ac3cfef5 service nova] Lock "409478f4-7921-4a15-89b0-82c26fa39de7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:36:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-aa4153c6-4ecf-43ce-899a-4d24af15e77d req-34c3a17d-ae8c-47d8-a043-7157ac3cfef5 service nova] Lock "409478f4-7921-4a15-89b0-82c26fa39de7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:36:11 user nova-compute[75066]: DEBUG nova.compute.manager [req-aa4153c6-4ecf-43ce-899a-4d24af15e77d req-34c3a17d-ae8c-47d8-a043-7157ac3cfef5 service nova] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] No waiting events found dispatching network-vif-plugged-6d709e03-0f37-43f6-ab89-61e12ae93b48 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:36:11 user nova-compute[75066]: WARNING nova.compute.manager [req-aa4153c6-4ecf-43ce-899a-4d24af15e77d req-34c3a17d-ae8c-47d8-a043-7157ac3cfef5 service nova] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Received unexpected event network-vif-plugged-6d709e03-0f37-43f6-ab89-61e12ae93b48 for instance with vm_state shelved_offloaded and task_state spawning.
Dec 01 19:36:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:13 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:36:13 user nova-compute[75066]: DEBUG nova.compute.manager [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Instance event wait completed in 0 seconds for  {{(pid=75066) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 19:36:13 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Guest created on hypervisor {{(pid=75066) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 19:36:13 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Instance spawned successfully.
Dec 01 19:36:13 user nova-compute[75066]: DEBUG nova.compute.manager [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:36:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-da72c299-d73a-4901-8451-4643e27e50f4 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "409478f4-7921-4a15-89b0-82c26fa39de7" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.822s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:36:13 user nova-compute[75066]: DEBUG nova.compute.manager [req-4fea9cee-6a56-48ee-957d-83b54f6b1b28 req-3e68f460-0aaf-4dd8-8c2d-6542223714b1 service nova] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Received event network-vif-plugged-6d709e03-0f37-43f6-ab89-61e12ae93b48 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:36:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-4fea9cee-6a56-48ee-957d-83b54f6b1b28 req-3e68f460-0aaf-4dd8-8c2d-6542223714b1 service nova] Acquiring lock "409478f4-7921-4a15-89b0-82c26fa39de7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:36:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-4fea9cee-6a56-48ee-957d-83b54f6b1b28 req-3e68f460-0aaf-4dd8-8c2d-6542223714b1 service nova] Lock "409478f4-7921-4a15-89b0-82c26fa39de7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:36:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-4fea9cee-6a56-48ee-957d-83b54f6b1b28 req-3e68f460-0aaf-4dd8-8c2d-6542223714b1 service nova] Lock "409478f4-7921-4a15-89b0-82c26fa39de7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:36:13 user nova-compute[75066]: DEBUG nova.compute.manager [req-4fea9cee-6a56-48ee-957d-83b54f6b1b28 req-3e68f460-0aaf-4dd8-8c2d-6542223714b1 service nova] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] No waiting events found dispatching network-vif-plugged-6d709e03-0f37-43f6-ab89-61e12ae93b48 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:36:13 user nova-compute[75066]: WARNING nova.compute.manager [req-4fea9cee-6a56-48ee-957d-83b54f6b1b28 req-3e68f460-0aaf-4dd8-8c2d-6542223714b1 service nova] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Received unexpected event network-vif-plugged-6d709e03-0f37-43f6-ab89-61e12ae93b48 for instance with vm_state active and task_state None.
Dec 01 19:36:14 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:36:14 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:15 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:36:15 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75066) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 19:36:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:18 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:36:18 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:36:18 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:36:18 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:36:18 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75066) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 19:36:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:36:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:36:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:36:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:36:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:36:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:36:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:36:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:36:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/409478f4-7921-4a15-89b0-82c26fa39de7/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:36:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/409478f4-7921-4a15-89b0-82c26fa39de7/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:36:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/409478f4-7921-4a15-89b0-82c26fa39de7/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:36:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/409478f4-7921-4a15-89b0-82c26fa39de7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:36:19 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:36:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88850ea1-43cd-4066-8e6f-cfe5de621bc6/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:36:19 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88850ea1-43cd-4066-8e6f-cfe5de621bc6/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:36:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88850ea1-43cd-4066-8e6f-cfe5de621bc6/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:36:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88850ea1-43cd-4066-8e6f-cfe5de621bc6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:36:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:36:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:36:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:36:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:36:20 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:36:20 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:36:20 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Hypervisor/Node resource view: name=user free_ram=8554MB free_disk=24.670154571533203GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75066) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 19:36:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:36:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:36:21 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 90c49be6-97aa-45f1-bcbe-b9a3875226a7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:36:21 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance d564b128-598b-4ad4-8618-afa4dc8a7347 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:36:21 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:36:21 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:36:21 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 88850ea1-43cd-4066-8e6f-cfe5de621bc6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:36:21 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 409478f4-7921-4a15-89b0-82c26fa39de7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:36:21 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 19:36:21 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 19:36:21 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Refreshing inventories for resource provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 01 19:36:21 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Updating ProviderTree inventory for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 01 19:36:21 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Updating inventory in ProviderTree for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 01 19:36:21 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Refreshing aggregate associations for resource provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62, aggregates: None {{(pid=75066) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 01 19:36:21 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Refreshing trait associations for resource provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62, traits: COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SECURITY_UEFI_SECURE_BOOT {{(pid=75066) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 01 19:36:21 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:36:21 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:36:21 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Compute_service record updated for user:user {{(pid=75066) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 19:36:21 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.721s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:36:21 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:36:21 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75066) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 01 19:36:21 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:36:22 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:36:22 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:36:22 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Starting heal instance info cache {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 19:36:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "refresh_cache-88850ea1-43cd-4066-8e6f-cfe5de621bc6" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:36:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquired lock "refresh_cache-88850ea1-43cd-4066-8e6f-cfe5de621bc6" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:36:22 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] Forcefully refreshing network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 19:36:23 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] Updating instance_info_cache with network_info: [{"id": "b39d66c2-c9c7-4b66-af8e-5ec0c23a997e", "address": "fa:16:3e:19:e0:f5", "network": {"id": "884b20a8-4ead-448d-994b-8e714dc32fae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-357575766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9f677c9e8c24b7389273db9d82954fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb39d66c2-c9", "ovs_interfaceid": "b39d66c2-c9c7-4b66-af8e-5ec0c23a997e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:36:23 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Releasing lock "refresh_cache-88850ea1-43cd-4066-8e6f-cfe5de621bc6" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:36:23 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] Updated the network info_cache for instance {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 19:36:23 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:36:24 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:36:24 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:36:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:29 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:30 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-9051cd82-e84c-4b8b-bbb2-848b80169d7c tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Acquiring lock "8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:36:30 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-9051cd82-e84c-4b8b-bbb2-848b80169d7c tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:36:30 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-9051cd82-e84c-4b8b-bbb2-848b80169d7c tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Acquiring lock "8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:36:30 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-9051cd82-e84c-4b8b-bbb2-848b80169d7c tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:36:30 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-9051cd82-e84c-4b8b-bbb2-848b80169d7c tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:36:30 user nova-compute[75066]: INFO nova.compute.manager [None req-9051cd82-e84c-4b8b-bbb2-848b80169d7c tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Terminating instance
Dec 01 19:36:30 user nova-compute[75066]: DEBUG nova.compute.manager [None req-9051cd82-e84c-4b8b-bbb2-848b80169d7c tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Start destroying the instance on the hypervisor. {{(pid=75066) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 19:36:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:30 user nova-compute[75066]: DEBUG nova.compute.manager [req-e6f4d8c7-7510-4872-b42e-4a5d304215d5 req-769a4a1a-c5cd-414c-83b5-9633aa5be1f0 service nova] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Received event network-vif-unplugged-7654d80f-b374-4865-9ea5-17f0f93696fe {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:36:30 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-e6f4d8c7-7510-4872-b42e-4a5d304215d5 req-769a4a1a-c5cd-414c-83b5-9633aa5be1f0 service nova] Acquiring lock "8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:36:30 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-e6f4d8c7-7510-4872-b42e-4a5d304215d5 req-769a4a1a-c5cd-414c-83b5-9633aa5be1f0 service nova] Lock "8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:36:30 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-e6f4d8c7-7510-4872-b42e-4a5d304215d5 req-769a4a1a-c5cd-414c-83b5-9633aa5be1f0 service nova] Lock "8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:36:30 user nova-compute[75066]: DEBUG nova.compute.manager [req-e6f4d8c7-7510-4872-b42e-4a5d304215d5 req-769a4a1a-c5cd-414c-83b5-9633aa5be1f0 service nova] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] No waiting events found dispatching network-vif-unplugged-7654d80f-b374-4865-9ea5-17f0f93696fe {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:36:30 user nova-compute[75066]: DEBUG nova.compute.manager [req-e6f4d8c7-7510-4872-b42e-4a5d304215d5 req-769a4a1a-c5cd-414c-83b5-9633aa5be1f0 service nova] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Received event network-vif-unplugged-7654d80f-b374-4865-9ea5-17f0f93696fe for instance with task_state deleting. {{(pid=75066) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 19:36:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:30 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Instance destroyed successfully.
Dec 01 19:36:30 user nova-compute[75066]: DEBUG nova.objects.instance [None req-9051cd82-e84c-4b8b-bbb2-848b80169d7c tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lazy-loading 'resources' on Instance uuid 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:36:30 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-9051cd82-e84c-4b8b-bbb2-848b80169d7c tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:27:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-750615184',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-750615184',id=30,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:27:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e000d89bca44cd8acba504256d8d1f1',ramdisk_id='',reservation_id='r-0q8l0uxr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-454493649',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:29:04Z,user_data=None,user_id='964c1681ca8745d0b3879266d24f507e',uuid=8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7654d80f-b374-4865-9ea5-17f0f93696fe", "address": "fa:16:3e:b6:38:39", "network": {"id": "6b0f48b7-3db2-49b2-a238-8fd811b52d62", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1688127634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e000d89bca44cd8acba504256d8d1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7654d80f-b3", "ovs_interfaceid": "7654d80f-b374-4865-9ea5-17f0f93696fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:36:30 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-9051cd82-e84c-4b8b-bbb2-848b80169d7c tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Converting VIF {"id": "7654d80f-b374-4865-9ea5-17f0f93696fe", "address": "fa:16:3e:b6:38:39", "network": {"id": "6b0f48b7-3db2-49b2-a238-8fd811b52d62", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1688127634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e000d89bca44cd8acba504256d8d1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7654d80f-b3", "ovs_interfaceid": "7654d80f-b374-4865-9ea5-17f0f93696fe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:36:30 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-9051cd82-e84c-4b8b-bbb2-848b80169d7c tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:38:39,bridge_name='br-int',has_traffic_filtering=True,id=7654d80f-b374-4865-9ea5-17f0f93696fe,network=Network(6b0f48b7-3db2-49b2-a238-8fd811b52d62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7654d80f-b3') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:36:30 user nova-compute[75066]: DEBUG os_vif [None req-9051cd82-e84c-4b8b-bbb2-848b80169d7c tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:38:39,bridge_name='br-int',has_traffic_filtering=True,id=7654d80f-b374-4865-9ea5-17f0f93696fe,network=Network(6b0f48b7-3db2-49b2-a238-8fd811b52d62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7654d80f-b3') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:36:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7654d80f-b3, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:36:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:36:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6d9c7f5b-b574-425e-bafb-4a51322cf9ae) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:36:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:30 user nova-compute[75066]: INFO os_vif [None req-9051cd82-e84c-4b8b-bbb2-848b80169d7c tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:38:39,bridge_name='br-int',has_traffic_filtering=True,id=7654d80f-b374-4865-9ea5-17f0f93696fe,network=Network(6b0f48b7-3db2-49b2-a238-8fd811b52d62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7654d80f-b3')
Dec 01 19:36:30 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-9051cd82-e84c-4b8b-bbb2-848b80169d7c tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Deleting instance files /opt/stack/data/nova/instances/8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298_del
Dec 01 19:36:30 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-9051cd82-e84c-4b8b-bbb2-848b80169d7c tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Deletion of /opt/stack/data/nova/instances/8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298_del complete
Dec 01 19:36:31 user nova-compute[75066]: INFO nova.compute.manager [None req-9051cd82-e84c-4b8b-bbb2-848b80169d7c tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Took 0.71 seconds to destroy the instance on the hypervisor.
Dec 01 19:36:31 user nova-compute[75066]: DEBUG oslo.service.loopingcall [None req-9051cd82-e84c-4b8b-bbb2-848b80169d7c tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75066) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 19:36:31 user nova-compute[75066]: DEBUG nova.compute.manager [-] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Deallocating network for instance {{(pid=75066) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 19:36:31 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] deallocate_for_instance() {{(pid=75066) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 19:36:31 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:36:31 user nova-compute[75066]: DEBUG nova.compute.manager [req-2795c64f-77db-4d6c-899e-0dccc06a0aca req-2e646bde-78ad-439d-9f28-283b421e940d service nova] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Received event network-vif-deleted-7654d80f-b374-4865-9ea5-17f0f93696fe {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:36:31 user nova-compute[75066]: INFO nova.compute.manager [req-2795c64f-77db-4d6c-899e-0dccc06a0aca req-2e646bde-78ad-439d-9f28-283b421e940d service nova] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Neutron deleted interface 7654d80f-b374-4865-9ea5-17f0f93696fe; detaching it from the instance and deleting it from the info cache
Dec 01 19:36:31 user nova-compute[75066]: DEBUG nova.network.neutron [req-2795c64f-77db-4d6c-899e-0dccc06a0aca req-2e646bde-78ad-439d-9f28-283b421e940d service nova] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:36:31 user nova-compute[75066]: INFO nova.compute.manager [-] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Took 0.42 seconds to deallocate network for instance.
Dec 01 19:36:31 user nova-compute[75066]: DEBUG nova.compute.manager [req-2795c64f-77db-4d6c-899e-0dccc06a0aca req-2e646bde-78ad-439d-9f28-283b421e940d service nova] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Detach interface failed, port_id=7654d80f-b374-4865-9ea5-17f0f93696fe, reason: Instance 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298 could not be found. {{(pid=75066) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 01 19:36:31 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-9051cd82-e84c-4b8b-bbb2-848b80169d7c tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:36:31 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-9051cd82-e84c-4b8b-bbb2-848b80169d7c tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:36:31 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-9051cd82-e84c-4b8b-bbb2-848b80169d7c tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:36:31 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-9051cd82-e84c-4b8b-bbb2-848b80169d7c tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:36:31 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-9051cd82-e84c-4b8b-bbb2-848b80169d7c tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.219s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:36:31 user nova-compute[75066]: INFO nova.scheduler.client.report [None req-9051cd82-e84c-4b8b-bbb2-848b80169d7c tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Deleted allocations for instance 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298
Dec 01 19:36:31 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-9051cd82-e84c-4b8b-bbb2-848b80169d7c tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.526s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:36:32 user nova-compute[75066]: DEBUG nova.compute.manager [req-0cda05cb-1717-487b-a110-8ab63b70655d req-ba7fcad7-3a13-4e5e-a147-f3968886e8f8 service nova] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Received event network-vif-plugged-7654d80f-b374-4865-9ea5-17f0f93696fe {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:36:32 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-0cda05cb-1717-487b-a110-8ab63b70655d req-ba7fcad7-3a13-4e5e-a147-f3968886e8f8 service nova] Acquiring lock "8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:36:32 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-0cda05cb-1717-487b-a110-8ab63b70655d req-ba7fcad7-3a13-4e5e-a147-f3968886e8f8 service nova] Lock "8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:36:32 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-0cda05cb-1717-487b-a110-8ab63b70655d req-ba7fcad7-3a13-4e5e-a147-f3968886e8f8 service nova] Lock "8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:36:32 user nova-compute[75066]: DEBUG nova.compute.manager [req-0cda05cb-1717-487b-a110-8ab63b70655d req-ba7fcad7-3a13-4e5e-a147-f3968886e8f8 service nova] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] No waiting events found dispatching network-vif-plugged-7654d80f-b374-4865-9ea5-17f0f93696fe {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:36:32 user nova-compute[75066]: WARNING nova.compute.manager [req-0cda05cb-1717-487b-a110-8ab63b70655d req-ba7fcad7-3a13-4e5e-a147-f3968886e8f8 service nova] [instance: 8805ff34-b3f1-4dd7-b3b0-d87f1ef8d298] Received unexpected event network-vif-plugged-7654d80f-b374-4865-9ea5-17f0f93696fe for instance with vm_state deleted and task_state None.
Dec 01 19:36:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:34 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:35 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:36:35 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Cleaning up deleted instances {{(pid=75066) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 01 19:36:35 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] There are 0 instances to clean {{(pid=75066) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 01 19:36:35 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:36 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:40 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:40 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:42 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:45 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Acquiring lock "cac44489-2374-4478-842b-0722dd4fe2db" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:36:45 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Lock "cac44489-2374-4478-842b-0722dd4fe2db" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:36:45 user nova-compute[75066]: DEBUG nova.compute.manager [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Starting instance... {{(pid=75066) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 19:36:45 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:36:45 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:36:45 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75066) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 19:36:45 user nova-compute[75066]: INFO nova.compute.claims [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Claim successful on node user
Dec 01 19:36:45 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:36:45 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:36:45 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.315s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:36:45 user nova-compute[75066]: DEBUG nova.compute.manager [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Start building networks asynchronously for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 19:36:45 user nova-compute[75066]: DEBUG nova.compute.manager [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Allocating IP information in the background. {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 19:36:45 user nova-compute[75066]: DEBUG nova.network.neutron [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] [instance: cac44489-2374-4478-842b-0722dd4fe2db] allocate_for_instance() {{(pid=75066) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 19:36:45 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 19:36:45 user nova-compute[75066]: DEBUG nova.compute.manager [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Start building block device mappings for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 19:36:45 user nova-compute[75066]: DEBUG nova.policy [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '16c4932955fe48cfaefc0844ed6cbd73', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6afe015769943c28f090535f675eed5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75066) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 19:36:45 user nova-compute[75066]: DEBUG nova.compute.manager [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Start spawning the instance on the hypervisor. {{(pid=75066) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 19:36:45 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Creating instance directory {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 19:36:45 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Creating image(s)
Dec 01 19:36:45 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Acquiring lock "/opt/stack/data/nova/instances/cac44489-2374-4478-842b-0722dd4fe2db/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:36:45 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Lock "/opt/stack/data/nova/instances/cac44489-2374-4478-842b-0722dd4fe2db/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:36:45 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Lock "/opt/stack/data/nova/instances/cac44489-2374-4478-842b-0722dd4fe2db/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:36:45 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:36:45 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.219s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:36:45 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Acquiring lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:36:45 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:36:45 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:36:45 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:46 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.189s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:36:46 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/cac44489-2374-4478-842b-0722dd4fe2db/disk 1073741824 {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:36:46 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/cac44489-2374-4478-842b-0722dd4fe2db/disk 1073741824" returned: 0 in 0.065s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:36:46 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:36:46 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:36:46 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.192s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:36:46 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cac44489-2374-4478-842b-0722dd4fe2db/disk. size=1073741824 {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 19:36:46 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cac44489-2374-4478-842b-0722dd4fe2db/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:36:46 user nova-compute[75066]: DEBUG nova.network.neutron [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Successfully created port: 2f5ab3de-24e6-4c17-9628-879ce59eacd2 {{(pid=75066) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 19:36:46 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cac44489-2374-4478-842b-0722dd4fe2db/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:36:46 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Cannot resize image /opt/stack/data/nova/instances/cac44489-2374-4478-842b-0722dd4fe2db/disk to a smaller size. {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 19:36:46 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Created local disks {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 19:36:46 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Ensure instance console log exists: /opt/stack/data/nova/instances/cac44489-2374-4478-842b-0722dd4fe2db/console.log {{(pid=75066) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 19:36:46 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:36:46 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:36:46 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:36:47 user nova-compute[75066]: DEBUG nova.network.neutron [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Successfully updated port: 2f5ab3de-24e6-4c17-9628-879ce59eacd2 {{(pid=75066) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 19:36:47 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Acquiring lock "refresh_cache-cac44489-2374-4478-842b-0722dd4fe2db" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:36:47 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Acquired lock "refresh_cache-cac44489-2374-4478-842b-0722dd4fe2db" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:36:47 user nova-compute[75066]: DEBUG nova.network.neutron [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:36:47 user nova-compute[75066]: DEBUG nova.compute.manager [req-0b06a6b5-b8c0-4150-bc71-a58dd237acf3 req-bd66f89f-c976-42e7-98f4-76ad90087cd9 service nova] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Received event network-changed-2f5ab3de-24e6-4c17-9628-879ce59eacd2 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:36:47 user nova-compute[75066]: DEBUG nova.compute.manager [req-0b06a6b5-b8c0-4150-bc71-a58dd237acf3 req-bd66f89f-c976-42e7-98f4-76ad90087cd9 service nova] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Refreshing instance network info cache due to event network-changed-2f5ab3de-24e6-4c17-9628-879ce59eacd2. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:36:47 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-0b06a6b5-b8c0-4150-bc71-a58dd237acf3 req-bd66f89f-c976-42e7-98f4-76ad90087cd9 service nova] Acquiring lock "refresh_cache-cac44489-2374-4478-842b-0722dd4fe2db" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:36:47 user nova-compute[75066]: DEBUG nova.network.neutron [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:36:47 user nova-compute[75066]: DEBUG nova.network.neutron [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Updating instance_info_cache with network_info: [{"id": "2f5ab3de-24e6-4c17-9628-879ce59eacd2", "address": "fa:16:3e:18:64:a8", "network": {"id": "27d425c3-c498-4479-86d7-8d520a2e5bf9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1954318568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6afe015769943c28f090535f675eed5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f5ab3de-24", "ovs_interfaceid": "2f5ab3de-24e6-4c17-9628-879ce59eacd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:36:47 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Releasing lock "refresh_cache-cac44489-2374-4478-842b-0722dd4fe2db" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:36:47 user nova-compute[75066]: DEBUG nova.compute.manager [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Instance network_info: |[{"id": "2f5ab3de-24e6-4c17-9628-879ce59eacd2", "address": "fa:16:3e:18:64:a8", "network": {"id": "27d425c3-c498-4479-86d7-8d520a2e5bf9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1954318568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6afe015769943c28f090535f675eed5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f5ab3de-24", "ovs_interfaceid": "2f5ab3de-24e6-4c17-9628-879ce59eacd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 19:36:47 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-0b06a6b5-b8c0-4150-bc71-a58dd237acf3 req-bd66f89f-c976-42e7-98f4-76ad90087cd9 service nova] Acquired lock "refresh_cache-cac44489-2374-4478-842b-0722dd4fe2db" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:36:47 user nova-compute[75066]: DEBUG nova.network.neutron [req-0b06a6b5-b8c0-4150-bc71-a58dd237acf3 req-bd66f89f-c976-42e7-98f4-76ad90087cd9 service nova] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Refreshing network info cache for port 2f5ab3de-24e6-4c17-9628-879ce59eacd2 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:36:47 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Start _get_guest_xml network_info=[{"id": "2f5ab3de-24e6-4c17-9628-879ce59eacd2", "address": "fa:16:3e:18:64:a8", "network": {"id": "27d425c3-c498-4479-86d7-8d520a2e5bf9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1954318568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6afe015769943c28f090535f675eed5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f5ab3de-24", "ovs_interfaceid": "2f5ab3de-24e6-4c17-9628-879ce59eacd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'image_id': '900b237b-e99c-4fdd-a44f-dcb7a08baa86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:36:47 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:36:47 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:36:47 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:36:47 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:36:47 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:36:47 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:36:47 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:36:47 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:36:47 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:36:47 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:36:47 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:36:47 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:36:47 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:36:47 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:36:47 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:36:47 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:36:47 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:36:47 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:36:47 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:36:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-324682266',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-324682266',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-3246822',id=38,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBElHYKDuOZysZiJNDv4mkRT086UZjPDK5SqqmH+PnySoiwpNKzTZBq4EkN4TNnKBwX/PfecaqsELmwaS5GZiui/Lvji/JNcZBqTxP4f7vHAuvlcTXnQilYi8BM2nwW8dHA==',key_name='tempest-keypair-257222686',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6afe015769943c28f090535f675eed5',ramdisk_id='',reservation_id='r-rabfidwd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-950451626',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:36:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16c4932955fe48cfaefc0844ed6cbd73',uuid=cac44489-2374-4478-842b-0722dd4fe2db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f5ab3de-24e6-4c17-9628-879ce59eacd2", "address": "fa:16:3e:18:64:a8", "network": {"id": "27d425c3-c498-4479-86d7-8d520a2e5bf9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1954318568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6afe015769943c28f090535f675eed5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f5ab3de-24", "ovs_interfaceid": "2f5ab3de-24e6-4c17-9628-879ce59eacd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:36:47 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Converting VIF {"id": "2f5ab3de-24e6-4c17-9628-879ce59eacd2", "address": "fa:16:3e:18:64:a8", "network": {"id": "27d425c3-c498-4479-86d7-8d520a2e5bf9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1954318568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6afe015769943c28f090535f675eed5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f5ab3de-24", "ovs_interfaceid": "2f5ab3de-24e6-4c17-9628-879ce59eacd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:36:47 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:64:a8,bridge_name='br-int',has_traffic_filtering=True,id=2f5ab3de-24e6-4c17-9628-879ce59eacd2,network=Network(27d425c3-c498-4479-86d7-8d520a2e5bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f5ab3de-24') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:36:47 user nova-compute[75066]: DEBUG nova.objects.instance [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Lazy-loading 'pci_devices' on Instance uuid cac44489-2374-4478-842b-0722dd4fe2db {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:36:47 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] [instance: cac44489-2374-4478-842b-0722dd4fe2db] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:36:47 user nova-compute[75066]:   <uuid>cac44489-2374-4478-842b-0722dd4fe2db</uuid>
Dec 01 19:36:47 user nova-compute[75066]:   <name>instance-00000026</name>
Dec 01 19:36:47 user nova-compute[75066]:   <memory>524288</memory>
Dec 01 19:36:47 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:36:47 user nova-compute[75066]:   <metadata>
Dec 01 19:36:47 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:36:47 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:36:47 user nova-compute[75066]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-324682266</nova:name>
Dec 01 19:36:47 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:36:47</nova:creationTime>
Dec 01 19:36:47 user nova-compute[75066]:       <nova:flavor name="m1.tiny">
Dec 01 19:36:47 user nova-compute[75066]:         <nova:memory>512</nova:memory>
Dec 01 19:36:47 user nova-compute[75066]:         <nova:disk>1</nova:disk>
Dec 01 19:36:47 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:36:47 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:36:47 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:36:47 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:36:47 user nova-compute[75066]:       <nova:owner>
Dec 01 19:36:47 user nova-compute[75066]:         <nova:user uuid="16c4932955fe48cfaefc0844ed6cbd73">tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member</nova:user>
Dec 01 19:36:47 user nova-compute[75066]:         <nova:project uuid="e6afe015769943c28f090535f675eed5">tempest-TestServerVolumeAttachScenarioOldVersion-950451626</nova:project>
Dec 01 19:36:47 user nova-compute[75066]:       </nova:owner>
Dec 01 19:36:47 user nova-compute[75066]:       <nova:root type="image" uuid="900b237b-e99c-4fdd-a44f-dcb7a08baa86"/>
Dec 01 19:36:47 user nova-compute[75066]:       <nova:ports>
Dec 01 19:36:47 user nova-compute[75066]:         <nova:port uuid="2f5ab3de-24e6-4c17-9628-879ce59eacd2">
Dec 01 19:36:47 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Dec 01 19:36:47 user nova-compute[75066]:         </nova:port>
Dec 01 19:36:47 user nova-compute[75066]:       </nova:ports>
Dec 01 19:36:47 user nova-compute[75066]:     </nova:instance>
Dec 01 19:36:47 user nova-compute[75066]:   </metadata>
Dec 01 19:36:47 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:36:47 user nova-compute[75066]:     <system>
Dec 01 19:36:47 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:36:47 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:36:47 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:36:47 user nova-compute[75066]:       <entry name="serial">cac44489-2374-4478-842b-0722dd4fe2db</entry>
Dec 01 19:36:47 user nova-compute[75066]:       <entry name="uuid">cac44489-2374-4478-842b-0722dd4fe2db</entry>
Dec 01 19:36:47 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:36:47 user nova-compute[75066]:     </system>
Dec 01 19:36:47 user nova-compute[75066]:   </sysinfo>
Dec 01 19:36:47 user nova-compute[75066]:   <os>
Dec 01 19:36:47 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:36:47 user nova-compute[75066]:     <boot dev="hd"/>
Dec 01 19:36:47 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:36:47 user nova-compute[75066]:   </os>
Dec 01 19:36:47 user nova-compute[75066]:   <features>
Dec 01 19:36:47 user nova-compute[75066]:     <acpi/>
Dec 01 19:36:47 user nova-compute[75066]:     <apic/>
Dec 01 19:36:47 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:36:47 user nova-compute[75066]:   </features>
Dec 01 19:36:47 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:36:47 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:36:47 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:36:47 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:36:47 user nova-compute[75066]:   </clock>
Dec 01 19:36:47 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:36:47 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:36:47 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:36:47 user nova-compute[75066]:   </cpu>
Dec 01 19:36:47 user nova-compute[75066]:   <devices>
Dec 01 19:36:47 user nova-compute[75066]:     <disk type="file" device="disk">
Dec 01 19:36:47 user nova-compute[75066]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 19:36:47 user nova-compute[75066]:       <source file="/opt/stack/data/nova/instances/cac44489-2374-4478-842b-0722dd4fe2db/disk"/>
Dec 01 19:36:47 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:36:47 user nova-compute[75066]:     </disk>
Dec 01 19:36:47 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:36:47 user nova-compute[75066]:       <mac address="fa:16:3e:18:64:a8"/>
Dec 01 19:36:47 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:36:47 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:36:47 user nova-compute[75066]:       <target dev="tap2f5ab3de-24"/>
Dec 01 19:36:47 user nova-compute[75066]:     </interface>
Dec 01 19:36:47 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:36:47 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/cac44489-2374-4478-842b-0722dd4fe2db/console.log" append="off"/>
Dec 01 19:36:47 user nova-compute[75066]:     </serial>
Dec 01 19:36:47 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:36:47 user nova-compute[75066]:     <video>
Dec 01 19:36:47 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:36:47 user nova-compute[75066]:     </video>
Dec 01 19:36:47 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:36:47 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:36:47 user nova-compute[75066]:     </rng>
Dec 01 19:36:47 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:36:47 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:36:47 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:36:47 user nova-compute[75066]:     </memballoon>
Dec 01 19:36:47 user nova-compute[75066]:   </devices>
Dec 01 19:36:47 user nova-compute[75066]: </domain>
Dec 01 19:36:47 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:36:47 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:36:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-324682266',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-324682266',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-3246822',id=38,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBElHYKDuOZysZiJNDv4mkRT086UZjPDK5SqqmH+PnySoiwpNKzTZBq4EkN4TNnKBwX/PfecaqsELmwaS5GZiui/Lvji/JNcZBqTxP4f7vHAuvlcTXnQilYi8BM2nwW8dHA==',key_name='tempest-keypair-257222686',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e6afe015769943c28f090535f675eed5',ramdisk_id='',reservation_id='r-rabfidwd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-950451626',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:36:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16c4932955fe48cfaefc0844ed6cbd73',uuid=cac44489-2374-4478-842b-0722dd4fe2db,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f5ab3de-24e6-4c17-9628-879ce59eacd2", "address": "fa:16:3e:18:64:a8", "network": {"id": "27d425c3-c498-4479-86d7-8d520a2e5bf9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1954318568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6afe015769943c28f090535f675eed5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f5ab3de-24", "ovs_interfaceid": "2f5ab3de-24e6-4c17-9628-879ce59eacd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:36:47 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Converting VIF {"id": "2f5ab3de-24e6-4c17-9628-879ce59eacd2", "address": "fa:16:3e:18:64:a8", "network": {"id": "27d425c3-c498-4479-86d7-8d520a2e5bf9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1954318568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6afe015769943c28f090535f675eed5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f5ab3de-24", "ovs_interfaceid": "2f5ab3de-24e6-4c17-9628-879ce59eacd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:36:47 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:64:a8,bridge_name='br-int',has_traffic_filtering=True,id=2f5ab3de-24e6-4c17-9628-879ce59eacd2,network=Network(27d425c3-c498-4479-86d7-8d520a2e5bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f5ab3de-24') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:36:47 user nova-compute[75066]: DEBUG os_vif [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:64:a8,bridge_name='br-int',has_traffic_filtering=True,id=2f5ab3de-24e6-4c17-9628-879ce59eacd2,network=Network(27d425c3-c498-4479-86d7-8d520a2e5bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f5ab3de-24') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:36:47 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:47 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:36:47 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:36:47 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:47 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7b788890-af03-5d65-b892-7f4bd83258b0', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:36:47 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:47 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:47 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:47 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2f5ab3de-24, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:36:47 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2f5ab3de-24, col_values=(('qos', UUID('701214dd-45d7-43de-bdf3-b42d7af0e04f')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:36:47 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2f5ab3de-24, col_values=(('external_ids', {'iface-id': '2f5ab3de-24e6-4c17-9628-879ce59eacd2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:64:a8', 'vm-uuid': 'cac44489-2374-4478-842b-0722dd4fe2db'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:36:47 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:47 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:36:47 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:47 user nova-compute[75066]: INFO os_vif [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:64:a8,bridge_name='br-int',has_traffic_filtering=True,id=2f5ab3de-24e6-4c17-9628-879ce59eacd2,network=Network(27d425c3-c498-4479-86d7-8d520a2e5bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f5ab3de-24')
Dec 01 19:36:47 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:36:47 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] No VIF found with MAC fa:16:3e:18:64:a8, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:36:48 user nova-compute[75066]: DEBUG nova.network.neutron [req-0b06a6b5-b8c0-4150-bc71-a58dd237acf3 req-bd66f89f-c976-42e7-98f4-76ad90087cd9 service nova] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Updated VIF entry in instance network info cache for port 2f5ab3de-24e6-4c17-9628-879ce59eacd2. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:36:48 user nova-compute[75066]: DEBUG nova.network.neutron [req-0b06a6b5-b8c0-4150-bc71-a58dd237acf3 req-bd66f89f-c976-42e7-98f4-76ad90087cd9 service nova] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Updating instance_info_cache with network_info: [{"id": "2f5ab3de-24e6-4c17-9628-879ce59eacd2", "address": "fa:16:3e:18:64:a8", "network": {"id": "27d425c3-c498-4479-86d7-8d520a2e5bf9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1954318568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6afe015769943c28f090535f675eed5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f5ab3de-24", "ovs_interfaceid": "2f5ab3de-24e6-4c17-9628-879ce59eacd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:36:48 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-0b06a6b5-b8c0-4150-bc71-a58dd237acf3 req-bd66f89f-c976-42e7-98f4-76ad90087cd9 service nova] Releasing lock "refresh_cache-cac44489-2374-4478-842b-0722dd4fe2db" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:36:48 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:49 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:49 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:49 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:49 user nova-compute[75066]: DEBUG nova.compute.manager [req-ae260aa5-34f9-4d57-a77b-456c4c3b63c4 req-d5ffa71f-ee6a-4c05-a732-e767cd889839 service nova] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Received event network-vif-plugged-2f5ab3de-24e6-4c17-9628-879ce59eacd2 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:36:49 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-ae260aa5-34f9-4d57-a77b-456c4c3b63c4 req-d5ffa71f-ee6a-4c05-a732-e767cd889839 service nova] Acquiring lock "cac44489-2374-4478-842b-0722dd4fe2db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:36:49 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-ae260aa5-34f9-4d57-a77b-456c4c3b63c4 req-d5ffa71f-ee6a-4c05-a732-e767cd889839 service nova] Lock "cac44489-2374-4478-842b-0722dd4fe2db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:36:49 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-ae260aa5-34f9-4d57-a77b-456c4c3b63c4 req-d5ffa71f-ee6a-4c05-a732-e767cd889839 service nova] Lock "cac44489-2374-4478-842b-0722dd4fe2db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:36:49 user nova-compute[75066]: DEBUG nova.compute.manager [req-ae260aa5-34f9-4d57-a77b-456c4c3b63c4 req-d5ffa71f-ee6a-4c05-a732-e767cd889839 service nova] [instance: cac44489-2374-4478-842b-0722dd4fe2db] No waiting events found dispatching network-vif-plugged-2f5ab3de-24e6-4c17-9628-879ce59eacd2 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:36:49 user nova-compute[75066]: WARNING nova.compute.manager [req-ae260aa5-34f9-4d57-a77b-456c4c3b63c4 req-d5ffa71f-ee6a-4c05-a732-e767cd889839 service nova] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Received unexpected event network-vif-plugged-2f5ab3de-24e6-4c17-9628-879ce59eacd2 for instance with vm_state building and task_state spawning.
Dec 01 19:36:49 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:49 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:49 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:49 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:49 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:51 user nova-compute[75066]: DEBUG nova.compute.manager [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Instance event wait completed in 0 seconds for  {{(pid=75066) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 19:36:51 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Guest created on hypervisor {{(pid=75066) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 19:36:51 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Instance spawned successfully.
Dec 01 19:36:51 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 19:36:51 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Found default for hw_cdrom_bus of ide {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:36:51 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Found default for hw_disk_bus of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:36:51 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Found default for hw_input_bus of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:36:51 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Found default for hw_pointer_model of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:36:51 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Found default for hw_video_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:36:51 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Found default for hw_vif_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:36:51 user nova-compute[75066]: INFO nova.compute.manager [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Took 5.75 seconds to spawn the instance on the hypervisor.
Dec 01 19:36:51 user nova-compute[75066]: DEBUG nova.compute.manager [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:36:51 user nova-compute[75066]: INFO nova.compute.manager [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Took 6.38 seconds to build instance.
Dec 01 19:36:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-21c22ab1-8d6d-4947-8227-d58912e332a0 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Lock "cac44489-2374-4478-842b-0722dd4fe2db" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.495s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:36:51 user nova-compute[75066]: DEBUG nova.compute.manager [req-65fede3c-bbe5-4df8-87a2-e8ea3e4af88e req-40c27687-590d-4b98-bbe3-aa1235cec548 service nova] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Received event network-vif-plugged-2f5ab3de-24e6-4c17-9628-879ce59eacd2 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:36:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-65fede3c-bbe5-4df8-87a2-e8ea3e4af88e req-40c27687-590d-4b98-bbe3-aa1235cec548 service nova] Acquiring lock "cac44489-2374-4478-842b-0722dd4fe2db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:36:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-65fede3c-bbe5-4df8-87a2-e8ea3e4af88e req-40c27687-590d-4b98-bbe3-aa1235cec548 service nova] Lock "cac44489-2374-4478-842b-0722dd4fe2db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:36:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-65fede3c-bbe5-4df8-87a2-e8ea3e4af88e req-40c27687-590d-4b98-bbe3-aa1235cec548 service nova] Lock "cac44489-2374-4478-842b-0722dd4fe2db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:36:51 user nova-compute[75066]: DEBUG nova.compute.manager [req-65fede3c-bbe5-4df8-87a2-e8ea3e4af88e req-40c27687-590d-4b98-bbe3-aa1235cec548 service nova] [instance: cac44489-2374-4478-842b-0722dd4fe2db] No waiting events found dispatching network-vif-plugged-2f5ab3de-24e6-4c17-9628-879ce59eacd2 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:36:51 user nova-compute[75066]: WARNING nova.compute.manager [req-65fede3c-bbe5-4df8-87a2-e8ea3e4af88e req-40c27687-590d-4b98-bbe3-aa1235cec548 service nova] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Received unexpected event network-vif-plugged-2f5ab3de-24e6-4c17-9628-879ce59eacd2 for instance with vm_state active and task_state None.
Dec 01 19:36:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:53 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-4c25d7ce-e6c8-477e-9955-621b09867434 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Acquiring lock "d564b128-598b-4ad4-8618-afa4dc8a7347" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:36:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-4c25d7ce-e6c8-477e-9955-621b09867434 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "d564b128-598b-4ad4-8618-afa4dc8a7347" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:36:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-4c25d7ce-e6c8-477e-9955-621b09867434 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Acquiring lock "d564b128-598b-4ad4-8618-afa4dc8a7347-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:36:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-4c25d7ce-e6c8-477e-9955-621b09867434 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "d564b128-598b-4ad4-8618-afa4dc8a7347-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:36:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-4c25d7ce-e6c8-477e-9955-621b09867434 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "d564b128-598b-4ad4-8618-afa4dc8a7347-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:36:54 user nova-compute[75066]: INFO nova.compute.manager [None req-4c25d7ce-e6c8-477e-9955-621b09867434 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Terminating instance
Dec 01 19:36:54 user nova-compute[75066]: DEBUG nova.compute.manager [None req-4c25d7ce-e6c8-477e-9955-621b09867434 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Start destroying the instance on the hypervisor. {{(pid=75066) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 19:36:54 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:54 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:54 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:54 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:54 user nova-compute[75066]: DEBUG nova.compute.manager [req-b7fe202f-377c-4353-8d11-421c6b515b0a req-35859b33-82d2-41a9-b168-a8f3340f64d0 service nova] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Received event network-vif-unplugged-4850dc75-0d93-4536-abc1-a981dd385d96 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:36:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-b7fe202f-377c-4353-8d11-421c6b515b0a req-35859b33-82d2-41a9-b168-a8f3340f64d0 service nova] Acquiring lock "d564b128-598b-4ad4-8618-afa4dc8a7347-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:36:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-b7fe202f-377c-4353-8d11-421c6b515b0a req-35859b33-82d2-41a9-b168-a8f3340f64d0 service nova] Lock "d564b128-598b-4ad4-8618-afa4dc8a7347-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:36:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-b7fe202f-377c-4353-8d11-421c6b515b0a req-35859b33-82d2-41a9-b168-a8f3340f64d0 service nova] Lock "d564b128-598b-4ad4-8618-afa4dc8a7347-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:36:54 user nova-compute[75066]: DEBUG nova.compute.manager [req-b7fe202f-377c-4353-8d11-421c6b515b0a req-35859b33-82d2-41a9-b168-a8f3340f64d0 service nova] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] No waiting events found dispatching network-vif-unplugged-4850dc75-0d93-4536-abc1-a981dd385d96 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:36:54 user nova-compute[75066]: DEBUG nova.compute.manager [req-b7fe202f-377c-4353-8d11-421c6b515b0a req-35859b33-82d2-41a9-b168-a8f3340f64d0 service nova] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Received event network-vif-unplugged-4850dc75-0d93-4536-abc1-a981dd385d96 for instance with task_state deleting. {{(pid=75066) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 19:36:54 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:54 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:54 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:54 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Instance destroyed successfully.
Dec 01 19:36:54 user nova-compute[75066]: DEBUG nova.objects.instance [None req-4c25d7ce-e6c8-477e-9955-621b09867434 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lazy-loading 'resources' on Instance uuid d564b128-598b-4ad4-8618-afa4dc8a7347 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:36:54 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:54 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-4c25d7ce-e6c8-477e-9955-621b09867434 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:19:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1777670164',display_name='tempest-ServerRescueNegativeTestJSON-server-1777670164',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1777670164',id=15,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:24:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='943324a514a84cb4947dbab93abc4f6c',ramdisk_id='',reservation_id='r-nreed1q4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-146516797',owner_user_name='tempest-ServerRescueNegativeTestJSON-146516797-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:26:33Z,user_data=None,user_id='e6ee9ed4a8d8418082a59be8db20cf2e',uuid=d564b128-598b-4ad4-8618-afa4dc8a7347,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4850dc75-0d93-4536-abc1-a981dd385d96", "address": "fa:16:3e:fc:d1:96", "network": {"id": "47c850ae-6dcb-4977-a02a-e32cd3df4749", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-475363603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "943324a514a84cb4947dbab93abc4f6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4850dc75-0d", "ovs_interfaceid": "4850dc75-0d93-4536-abc1-a981dd385d96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:36:54 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-4c25d7ce-e6c8-477e-9955-621b09867434 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Converting VIF {"id": "4850dc75-0d93-4536-abc1-a981dd385d96", "address": "fa:16:3e:fc:d1:96", "network": {"id": "47c850ae-6dcb-4977-a02a-e32cd3df4749", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-475363603-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "943324a514a84cb4947dbab93abc4f6c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4850dc75-0d", "ovs_interfaceid": "4850dc75-0d93-4536-abc1-a981dd385d96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:36:54 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-4c25d7ce-e6c8-477e-9955-621b09867434 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fc:d1:96,bridge_name='br-int',has_traffic_filtering=True,id=4850dc75-0d93-4536-abc1-a981dd385d96,network=Network(47c850ae-6dcb-4977-a02a-e32cd3df4749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4850dc75-0d') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:36:54 user nova-compute[75066]: DEBUG os_vif [None req-4c25d7ce-e6c8-477e-9955-621b09867434 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:d1:96,bridge_name='br-int',has_traffic_filtering=True,id=4850dc75-0d93-4536-abc1-a981dd385d96,network=Network(47c850ae-6dcb-4977-a02a-e32cd3df4749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4850dc75-0d') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:36:54 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:54 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4850dc75-0d, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:36:54 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:54 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:36:54 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:54 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=79a4a53d-fbd2-4a80-a6a2-f1d31e0b59fb) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:36:54 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:54 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:36:54 user nova-compute[75066]: INFO os_vif [None req-4c25d7ce-e6c8-477e-9955-621b09867434 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fc:d1:96,bridge_name='br-int',has_traffic_filtering=True,id=4850dc75-0d93-4536-abc1-a981dd385d96,network=Network(47c850ae-6dcb-4977-a02a-e32cd3df4749),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4850dc75-0d')
Dec 01 19:36:54 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-4c25d7ce-e6c8-477e-9955-621b09867434 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Deleting instance files /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347_del
Dec 01 19:36:54 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-4c25d7ce-e6c8-477e-9955-621b09867434 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Deletion of /opt/stack/data/nova/instances/d564b128-598b-4ad4-8618-afa4dc8a7347_del complete
Dec 01 19:36:54 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:55 user nova-compute[75066]: INFO nova.compute.manager [None req-4c25d7ce-e6c8-477e-9955-621b09867434 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Took 0.97 seconds to destroy the instance on the hypervisor.
Dec 01 19:36:55 user nova-compute[75066]: DEBUG oslo.service.loopingcall [None req-4c25d7ce-e6c8-477e-9955-621b09867434 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75066) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 19:36:55 user nova-compute[75066]: DEBUG nova.compute.manager [-] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Deallocating network for instance {{(pid=75066) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 19:36:55 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] deallocate_for_instance() {{(pid=75066) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 19:36:55 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:55 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:55 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:55 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:55 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:55 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:36:55 user nova-compute[75066]: INFO nova.compute.manager [-] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Took 0.76 seconds to deallocate network for instance.
Dec 01 19:36:55 user nova-compute[75066]: DEBUG nova.compute.manager [req-29da8015-becf-4513-ae1d-786e5e1dbf41 req-9e71fb03-7366-4c79-a5ac-ed74d274e607 service nova] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Received event network-vif-deleted-4850dc75-0d93-4536-abc1-a981dd385d96 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:36:55 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-4c25d7ce-e6c8-477e-9955-621b09867434 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:36:55 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-4c25d7ce-e6c8-477e-9955-621b09867434 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:36:56 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-4c25d7ce-e6c8-477e-9955-621b09867434 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:36:56 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-4c25d7ce-e6c8-477e-9955-621b09867434 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:36:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-4c25d7ce-e6c8-477e-9955-621b09867434 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.270s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:36:56 user nova-compute[75066]: INFO nova.scheduler.client.report [None req-4c25d7ce-e6c8-477e-9955-621b09867434 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Deleted allocations for instance d564b128-598b-4ad4-8618-afa4dc8a7347
Dec 01 19:36:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-4c25d7ce-e6c8-477e-9955-621b09867434 tempest-ServerRescueNegativeTestJSON-146516797 tempest-ServerRescueNegativeTestJSON-146516797-project-member] Lock "d564b128-598b-4ad4-8618-afa4dc8a7347" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.267s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:36:56 user nova-compute[75066]: DEBUG nova.compute.manager [req-2c57b75c-a5ee-42a1-ab32-0e5dd8ff4367 req-45685b51-5b6c-476e-b71d-69281a149f9c service nova] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Received event network-vif-plugged-4850dc75-0d93-4536-abc1-a981dd385d96 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:36:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-2c57b75c-a5ee-42a1-ab32-0e5dd8ff4367 req-45685b51-5b6c-476e-b71d-69281a149f9c service nova] Acquiring lock "d564b128-598b-4ad4-8618-afa4dc8a7347-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:36:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-2c57b75c-a5ee-42a1-ab32-0e5dd8ff4367 req-45685b51-5b6c-476e-b71d-69281a149f9c service nova] Lock "d564b128-598b-4ad4-8618-afa4dc8a7347-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:36:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-2c57b75c-a5ee-42a1-ab32-0e5dd8ff4367 req-45685b51-5b6c-476e-b71d-69281a149f9c service nova] Lock "d564b128-598b-4ad4-8618-afa4dc8a7347-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:36:56 user nova-compute[75066]: DEBUG nova.compute.manager [req-2c57b75c-a5ee-42a1-ab32-0e5dd8ff4367 req-45685b51-5b6c-476e-b71d-69281a149f9c service nova] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] No waiting events found dispatching network-vif-plugged-4850dc75-0d93-4536-abc1-a981dd385d96 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:36:56 user nova-compute[75066]: WARNING nova.compute.manager [req-2c57b75c-a5ee-42a1-ab32-0e5dd8ff4367 req-45685b51-5b6c-476e-b71d-69281a149f9c service nova] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Received unexpected event network-vif-plugged-4850dc75-0d93-4536-abc1-a981dd385d96 for instance with vm_state deleted and task_state None.
Dec 01 19:36:56 user nova-compute[75066]: DEBUG nova.compute.manager [req-2c57b75c-a5ee-42a1-ab32-0e5dd8ff4367 req-45685b51-5b6c-476e-b71d-69281a149f9c service nova] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Received event network-vif-plugged-4850dc75-0d93-4536-abc1-a981dd385d96 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:36:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-2c57b75c-a5ee-42a1-ab32-0e5dd8ff4367 req-45685b51-5b6c-476e-b71d-69281a149f9c service nova] Acquiring lock "d564b128-598b-4ad4-8618-afa4dc8a7347-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:36:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-2c57b75c-a5ee-42a1-ab32-0e5dd8ff4367 req-45685b51-5b6c-476e-b71d-69281a149f9c service nova] Lock "d564b128-598b-4ad4-8618-afa4dc8a7347-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:36:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-2c57b75c-a5ee-42a1-ab32-0e5dd8ff4367 req-45685b51-5b6c-476e-b71d-69281a149f9c service nova] Lock "d564b128-598b-4ad4-8618-afa4dc8a7347-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:36:56 user nova-compute[75066]: DEBUG nova.compute.manager [req-2c57b75c-a5ee-42a1-ab32-0e5dd8ff4367 req-45685b51-5b6c-476e-b71d-69281a149f9c service nova] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] No waiting events found dispatching network-vif-plugged-4850dc75-0d93-4536-abc1-a981dd385d96 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:36:56 user nova-compute[75066]: WARNING nova.compute.manager [req-2c57b75c-a5ee-42a1-ab32-0e5dd8ff4367 req-45685b51-5b6c-476e-b71d-69281a149f9c service nova] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Received unexpected event network-vif-plugged-4850dc75-0d93-4536-abc1-a981dd385d96 for instance with vm_state deleted and task_state None.
Dec 01 19:36:56 user nova-compute[75066]: DEBUG nova.compute.manager [req-2c57b75c-a5ee-42a1-ab32-0e5dd8ff4367 req-45685b51-5b6c-476e-b71d-69281a149f9c service nova] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Received event network-vif-plugged-4850dc75-0d93-4536-abc1-a981dd385d96 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:36:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-2c57b75c-a5ee-42a1-ab32-0e5dd8ff4367 req-45685b51-5b6c-476e-b71d-69281a149f9c service nova] Acquiring lock "d564b128-598b-4ad4-8618-afa4dc8a7347-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:36:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-2c57b75c-a5ee-42a1-ab32-0e5dd8ff4367 req-45685b51-5b6c-476e-b71d-69281a149f9c service nova] Lock "d564b128-598b-4ad4-8618-afa4dc8a7347-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:36:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-2c57b75c-a5ee-42a1-ab32-0e5dd8ff4367 req-45685b51-5b6c-476e-b71d-69281a149f9c service nova] Lock "d564b128-598b-4ad4-8618-afa4dc8a7347-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:36:56 user nova-compute[75066]: DEBUG nova.compute.manager [req-2c57b75c-a5ee-42a1-ab32-0e5dd8ff4367 req-45685b51-5b6c-476e-b71d-69281a149f9c service nova] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] No waiting events found dispatching network-vif-plugged-4850dc75-0d93-4536-abc1-a981dd385d96 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:36:56 user nova-compute[75066]: WARNING nova.compute.manager [req-2c57b75c-a5ee-42a1-ab32-0e5dd8ff4367 req-45685b51-5b6c-476e-b71d-69281a149f9c service nova] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Received unexpected event network-vif-plugged-4850dc75-0d93-4536-abc1-a981dd385d96 for instance with vm_state deleted and task_state None.
Dec 01 19:36:56 user nova-compute[75066]: DEBUG nova.compute.manager [req-2c57b75c-a5ee-42a1-ab32-0e5dd8ff4367 req-45685b51-5b6c-476e-b71d-69281a149f9c service nova] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Received event network-vif-unplugged-4850dc75-0d93-4536-abc1-a981dd385d96 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:36:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-2c57b75c-a5ee-42a1-ab32-0e5dd8ff4367 req-45685b51-5b6c-476e-b71d-69281a149f9c service nova] Acquiring lock "d564b128-598b-4ad4-8618-afa4dc8a7347-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:36:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-2c57b75c-a5ee-42a1-ab32-0e5dd8ff4367 req-45685b51-5b6c-476e-b71d-69281a149f9c service nova] Lock "d564b128-598b-4ad4-8618-afa4dc8a7347-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:36:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-2c57b75c-a5ee-42a1-ab32-0e5dd8ff4367 req-45685b51-5b6c-476e-b71d-69281a149f9c service nova] Lock "d564b128-598b-4ad4-8618-afa4dc8a7347-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:36:56 user nova-compute[75066]: DEBUG nova.compute.manager [req-2c57b75c-a5ee-42a1-ab32-0e5dd8ff4367 req-45685b51-5b6c-476e-b71d-69281a149f9c service nova] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] No waiting events found dispatching network-vif-unplugged-4850dc75-0d93-4536-abc1-a981dd385d96 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:36:56 user nova-compute[75066]: WARNING nova.compute.manager [req-2c57b75c-a5ee-42a1-ab32-0e5dd8ff4367 req-45685b51-5b6c-476e-b71d-69281a149f9c service nova] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Received unexpected event network-vif-unplugged-4850dc75-0d93-4536-abc1-a981dd385d96 for instance with vm_state deleted and task_state None.
Dec 01 19:36:56 user nova-compute[75066]: DEBUG nova.compute.manager [req-2c57b75c-a5ee-42a1-ab32-0e5dd8ff4367 req-45685b51-5b6c-476e-b71d-69281a149f9c service nova] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Received event network-vif-plugged-4850dc75-0d93-4536-abc1-a981dd385d96 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:36:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-2c57b75c-a5ee-42a1-ab32-0e5dd8ff4367 req-45685b51-5b6c-476e-b71d-69281a149f9c service nova] Acquiring lock "d564b128-598b-4ad4-8618-afa4dc8a7347-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:36:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-2c57b75c-a5ee-42a1-ab32-0e5dd8ff4367 req-45685b51-5b6c-476e-b71d-69281a149f9c service nova] Lock "d564b128-598b-4ad4-8618-afa4dc8a7347-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:36:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-2c57b75c-a5ee-42a1-ab32-0e5dd8ff4367 req-45685b51-5b6c-476e-b71d-69281a149f9c service nova] Lock "d564b128-598b-4ad4-8618-afa4dc8a7347-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:36:56 user nova-compute[75066]: DEBUG nova.compute.manager [req-2c57b75c-a5ee-42a1-ab32-0e5dd8ff4367 req-45685b51-5b6c-476e-b71d-69281a149f9c service nova] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] No waiting events found dispatching network-vif-plugged-4850dc75-0d93-4536-abc1-a981dd385d96 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:36:56 user nova-compute[75066]: WARNING nova.compute.manager [req-2c57b75c-a5ee-42a1-ab32-0e5dd8ff4367 req-45685b51-5b6c-476e-b71d-69281a149f9c service nova] [instance: d564b128-598b-4ad4-8618-afa4dc8a7347] Received unexpected event network-vif-plugged-4850dc75-0d93-4536-abc1-a981dd385d96 for instance with vm_state deleted and task_state None.
Dec 01 19:36:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:36:59 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:37:04 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:37:04 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:37:04 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75066) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 19:37:04 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:37:04 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:37:04 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:37:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:37:08 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:37:09 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:37:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:37:13 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:37:14 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:37:14 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:37:15 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:37:15 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75066) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 19:37:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:37:18 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:37:18 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:37:18 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:37:18 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:37:18 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75066) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 19:37:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/409478f4-7921-4a15-89b0-82c26fa39de7/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:37:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/409478f4-7921-4a15-89b0-82c26fa39de7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:37:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/409478f4-7921-4a15-89b0-82c26fa39de7/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:37:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/409478f4-7921-4a15-89b0-82c26fa39de7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:37:18 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:37:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88850ea1-43cd-4066-8e6f-cfe5de621bc6/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:37:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88850ea1-43cd-4066-8e6f-cfe5de621bc6/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:37:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88850ea1-43cd-4066-8e6f-cfe5de621bc6/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:37:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88850ea1-43cd-4066-8e6f-cfe5de621bc6/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:37:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:37:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:37:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:37:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:37:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cac44489-2374-4478-842b-0722dd4fe2db/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:37:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cac44489-2374-4478-842b-0722dd4fe2db/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:37:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cac44489-2374-4478-842b-0722dd4fe2db/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:37:19 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:37:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cac44489-2374-4478-842b-0722dd4fe2db/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:37:20 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:37:20 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:37:20 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Hypervisor/Node resource view: name=user free_ram=8490MB free_disk=24.791664123535156GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75066) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 19:37:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:37:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:37:20 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 90c49be6-97aa-45f1-bcbe-b9a3875226a7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:37:20 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:37:20 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 88850ea1-43cd-4066-8e6f-cfe5de621bc6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:37:20 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 409478f4-7921-4a15-89b0-82c26fa39de7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:37:20 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance cac44489-2374-4478-842b-0722dd4fe2db actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:37:20 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 19:37:20 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 19:37:20 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:37:20 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:37:20 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Compute_service record updated for user:user {{(pid=75066) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 19:37:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.353s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-81b9bb60-34b8-447c-a800-93c4a996ebdb tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Acquiring lock "905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-81b9bb60-34b8-447c-a800-93c4a996ebdb tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-81b9bb60-34b8-447c-a800-93c4a996ebdb tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Acquiring lock "905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-81b9bb60-34b8-447c-a800-93c4a996ebdb tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-81b9bb60-34b8-447c-a800-93c4a996ebdb tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:37:21 user nova-compute[75066]: INFO nova.compute.manager [None req-81b9bb60-34b8-447c-a800-93c4a996ebdb tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Terminating instance
Dec 01 19:37:21 user nova-compute[75066]: DEBUG nova.compute.manager [None req-81b9bb60-34b8-447c-a800-93c4a996ebdb tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Start destroying the instance on the hypervisor. {{(pid=75066) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG nova.compute.manager [req-128b523c-dca5-4ffa-9dea-e2d6ef390bb7 req-6ad1ce89-01d2-4831-aa95-b66905d8835c service nova] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Received event network-vif-unplugged-6c41fc1e-7ed5-490d-a375-0db34c7ae40b {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-128b523c-dca5-4ffa-9dea-e2d6ef390bb7 req-6ad1ce89-01d2-4831-aa95-b66905d8835c service nova] Acquiring lock "905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-128b523c-dca5-4ffa-9dea-e2d6ef390bb7 req-6ad1ce89-01d2-4831-aa95-b66905d8835c service nova] Lock "905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-128b523c-dca5-4ffa-9dea-e2d6ef390bb7 req-6ad1ce89-01d2-4831-aa95-b66905d8835c service nova] Lock "905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG nova.compute.manager [req-128b523c-dca5-4ffa-9dea-e2d6ef390bb7 req-6ad1ce89-01d2-4831-aa95-b66905d8835c service nova] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] No waiting events found dispatching network-vif-unplugged-6c41fc1e-7ed5-490d-a375-0db34c7ae40b {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG nova.compute.manager [req-128b523c-dca5-4ffa-9dea-e2d6ef390bb7 req-6ad1ce89-01d2-4831-aa95-b66905d8835c service nova] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Received event network-vif-unplugged-6c41fc1e-7ed5-490d-a375-0db34c7ae40b for instance with task_state deleting. {{(pid=75066) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:37:21 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Instance destroyed successfully.
Dec 01 19:37:21 user nova-compute[75066]: DEBUG nova.objects.instance [None req-81b9bb60-34b8-447c-a800-93c4a996ebdb tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lazy-loading 'resources' on Instance uuid 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-81b9bb60-34b8-447c-a800-93c4a996ebdb tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:21:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1711948720',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1711948720',id=20,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:23:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e000d89bca44cd8acba504256d8d1f1',ramdisk_id='',reservation_id='r-dxnjcyj0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-454493649',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:25:18Z,user_data=None,user_id='964c1681ca8745d0b3879266d24f507e',uuid=905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6c41fc1e-7ed5-490d-a375-0db34c7ae40b", "address": "fa:16:3e:ed:e9:7c", "network": {"id": "6b0f48b7-3db2-49b2-a238-8fd811b52d62", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1688127634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e000d89bca44cd8acba504256d8d1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c41fc1e-7e", "ovs_interfaceid": "6c41fc1e-7ed5-490d-a375-0db34c7ae40b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-81b9bb60-34b8-447c-a800-93c4a996ebdb tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Converting VIF {"id": "6c41fc1e-7ed5-490d-a375-0db34c7ae40b", "address": "fa:16:3e:ed:e9:7c", "network": {"id": "6b0f48b7-3db2-49b2-a238-8fd811b52d62", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1688127634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e000d89bca44cd8acba504256d8d1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c41fc1e-7e", "ovs_interfaceid": "6c41fc1e-7ed5-490d-a375-0db34c7ae40b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-81b9bb60-34b8-447c-a800-93c4a996ebdb tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:e9:7c,bridge_name='br-int',has_traffic_filtering=True,id=6c41fc1e-7ed5-490d-a375-0db34c7ae40b,network=Network(6b0f48b7-3db2-49b2-a238-8fd811b52d62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c41fc1e-7e') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG os_vif [None req-81b9bb60-34b8-447c-a800-93c4a996ebdb tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:e9:7c,bridge_name='br-int',has_traffic_filtering=True,id=6c41fc1e-7ed5-490d-a375-0db34c7ae40b,network=Network(6b0f48b7-3db2-49b2-a238-8fd811b52d62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c41fc1e-7e') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6c41fc1e-7e, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=dfdb1775-0f49-40d9-8633-b00dcc91116d) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:37:21 user nova-compute[75066]: INFO os_vif [None req-81b9bb60-34b8-447c-a800-93c4a996ebdb tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:e9:7c,bridge_name='br-int',has_traffic_filtering=True,id=6c41fc1e-7ed5-490d-a375-0db34c7ae40b,network=Network(6b0f48b7-3db2-49b2-a238-8fd811b52d62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c41fc1e-7e')
Dec 01 19:37:21 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81b9bb60-34b8-447c-a800-93c4a996ebdb tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] calling os-brick to detach iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b9bb60-34b8-447c-a800-93c4a996ebdb tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, {'target_iqn': 'iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fQZgCqOJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:37:21 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-81b9bb60-34b8-447c-a800-93c4a996ebdb tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:37:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-81b9bb60-34b8-447c-a800-93c4a996ebdb tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-81b9bb60-34b8-447c-a800-93c4a996ebdb tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[083cb9a2-5e04-4cb0-90c7-b4d2378421db]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b9bb60-34b8-447c-a800-93c4a996ebdb tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 19:37:21 user nova-compute[75066]: No targets found.
Dec 01 19:37:21 user nova-compute[75066]: iSNS:
Dec 01 19:37:21 user nova-compute[75066]: No targets found.
Dec 01 19:37:21 user nova-compute[75066]: STATIC:
Dec 01 19:37:21 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb
Dec 01 19:37:21 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:37:21 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:37:21 user nova-compute[75066]: FIRMWARE:
Dec 01 19:37:21 user nova-compute[75066]: No targets found.
Dec 01 19:37:21 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b9bb60-34b8-447c-a800-93c4a996ebdb tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 19:37:21 user nova-compute[75066]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 19:37:21 user nova-compute[75066]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75066) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b9bb60-34b8-447c-a800-93c4a996ebdb tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb', 0)] {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49bbc49-d5c1-47c5-ac46-47037bc04167]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a26e6dc-36cb-438d-9ff9-b19f098f5142]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b9bb60-34b8-447c-a800-93c4a996ebdb tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:37:21 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b9bb60-34b8-447c-a800-93c4a996ebdb tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb (non-flash)
Dec 01 19:37:21 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b9bb60-34b8-447c-a800-93c4a996ebdb tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91905331c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb'): ({'sdf'}, set())}) {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-81b9bb60-34b8-447c-a800-93c4a996ebdb tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Removing single pathed devices sdf {{(pid=75066) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e595ba0-be36-4ded-95f6-4ed2453a863b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1f042c-8d35-42fe-ab52-006472b3c914]: (4, ('ok\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-81b9bb60-34b8-447c-a800-93c4a996ebdb tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Flushing IO for device /dev/sdf {{(pid=75066) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[907e9519-bba6-4480-884b-f3eca413af69]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-81b9bb60-34b8-447c-a800-93c4a996ebdb tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75066) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.042s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[471511a9-33dd-427e-8928-9e3b2f38443c]: (4, ('1', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-81b9bb60-34b8-447c-a800-93c4a996ebdb tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-81b9bb60-34b8-447c-a800-93c4a996ebdb tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] SCSI volumes sdf have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b9bb60-34b8-447c-a800-93c4a996ebdb tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb')] {{(pid=75066) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea27cd1-686d-4345-9ca3-e9e433240abc]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b9bb60-34b8-447c-a800-93c4a996ebdb tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:37:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb -p 172.16.0.220:3260 --logout {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:37:22 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:37:22 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce25e37-9f4a-4ae4-9849-c32610e1984b]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:37:22 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b9bb60-34b8-447c-a800-93c4a996ebdb tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb, portal: 172.16.0.220,3260]
Dec 01 19:37:22 user nova-compute[75066]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb, portal: 172.16.0.220,3260] successful.
Dec 01 19:37:22 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:37:22 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb -p 172.16.0.220:3260 --op delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:37:22 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1aa1b3ad-5a2c-4b77-871a-9ce4dee5f5bb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:37:22 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8bcddf-1c4b-4af2-a3c0-740b0fac9beb]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:37:22 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b9bb60-34b8-447c-a800-93c4a996ebdb tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:37:22 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-81b9bb60-34b8-447c-a800-93c4a996ebdb tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:37:22 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-81b9bb60-34b8-447c-a800-93c4a996ebdb tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] <== disconnect_volume: return (289ms) None {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:37:22 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81b9bb60-34b8-447c-a800-93c4a996ebdb tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Disconnected iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 19:37:22 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-81b9bb60-34b8-447c-a800-93c4a996ebdb tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Deleting instance files /opt/stack/data/nova/instances/905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436_del
Dec 01 19:37:22 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-81b9bb60-34b8-447c-a800-93c4a996ebdb tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Deletion of /opt/stack/data/nova/instances/905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436_del complete
Dec 01 19:37:22 user nova-compute[75066]: INFO nova.compute.manager [None req-81b9bb60-34b8-447c-a800-93c4a996ebdb tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Took 0.95 seconds to destroy the instance on the hypervisor.
Dec 01 19:37:22 user nova-compute[75066]: DEBUG oslo.service.loopingcall [None req-81b9bb60-34b8-447c-a800-93c4a996ebdb tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75066) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 19:37:22 user nova-compute[75066]: DEBUG nova.compute.manager [-] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Deallocating network for instance {{(pid=75066) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 19:37:22 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] deallocate_for_instance() {{(pid=75066) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 19:37:22 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:37:22 user nova-compute[75066]: INFO nova.compute.manager [-] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Took 0.44 seconds to deallocate network for instance.
Dec 01 19:37:22 user nova-compute[75066]: DEBUG nova.compute.manager [req-f6c34fa0-dd7d-4520-a6b6-e7e62a7e4103 req-ea01956b-5d43-49d4-81da-2b1d9b3e0633 service nova] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Received event network-vif-deleted-6c41fc1e-7ed5-490d-a375-0db34c7ae40b {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:37:22 user nova-compute[75066]: INFO nova.compute.manager [req-f6c34fa0-dd7d-4520-a6b6-e7e62a7e4103 req-ea01956b-5d43-49d4-81da-2b1d9b3e0633 service nova] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Neutron deleted interface 6c41fc1e-7ed5-490d-a375-0db34c7ae40b; detaching it from the instance and deleting it from the info cache
Dec 01 19:37:22 user nova-compute[75066]: DEBUG nova.network.neutron [req-f6c34fa0-dd7d-4520-a6b6-e7e62a7e4103 req-ea01956b-5d43-49d4-81da-2b1d9b3e0633 service nova] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:37:22 user nova-compute[75066]: DEBUG nova.compute.manager [req-f6c34fa0-dd7d-4520-a6b6-e7e62a7e4103 req-ea01956b-5d43-49d4-81da-2b1d9b3e0633 service nova] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Detach interface failed, port_id=6c41fc1e-7ed5-490d-a375-0db34c7ae40b, reason: Instance 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436 could not be found. {{(pid=75066) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Dec 01 19:37:22 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:37:22 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:37:22 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Starting heal instance info cache {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 19:37:22 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Didn't find any instances for network info cache update. {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 01 19:37:22 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:37:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:37:23 user nova-compute[75066]: INFO nova.compute.manager [None req-81b9bb60-34b8-447c-a800-93c4a996ebdb tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Took 0.78 seconds to detach 1 volumes for instance.
Dec 01 19:37:23 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-81b9bb60-34b8-447c-a800-93c4a996ebdb tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:37:23 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-81b9bb60-34b8-447c-a800-93c4a996ebdb tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:37:23 user nova-compute[75066]: DEBUG nova.compute.manager [req-afd8f86f-0061-4026-a94c-20b36c6a5043 req-3f4e6b56-0fc0-4728-9d3b-fb677c1abbdb service nova] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Received event network-vif-plugged-6c41fc1e-7ed5-490d-a375-0db34c7ae40b {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:37:23 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-afd8f86f-0061-4026-a94c-20b36c6a5043 req-3f4e6b56-0fc0-4728-9d3b-fb677c1abbdb service nova] Acquiring lock "905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:37:23 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-afd8f86f-0061-4026-a94c-20b36c6a5043 req-3f4e6b56-0fc0-4728-9d3b-fb677c1abbdb service nova] Lock "905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:37:23 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-afd8f86f-0061-4026-a94c-20b36c6a5043 req-3f4e6b56-0fc0-4728-9d3b-fb677c1abbdb service nova] Lock "905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:37:23 user nova-compute[75066]: DEBUG nova.compute.manager [req-afd8f86f-0061-4026-a94c-20b36c6a5043 req-3f4e6b56-0fc0-4728-9d3b-fb677c1abbdb service nova] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] No waiting events found dispatching network-vif-plugged-6c41fc1e-7ed5-490d-a375-0db34c7ae40b {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:37:23 user nova-compute[75066]: WARNING nova.compute.manager [req-afd8f86f-0061-4026-a94c-20b36c6a5043 req-3f4e6b56-0fc0-4728-9d3b-fb677c1abbdb service nova] [instance: 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436] Received unexpected event network-vif-plugged-6c41fc1e-7ed5-490d-a375-0db34c7ae40b for instance with vm_state deleted and task_state None.
Dec 01 19:37:23 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-81b9bb60-34b8-447c-a800-93c4a996ebdb tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:37:23 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-81b9bb60-34b8-447c-a800-93c4a996ebdb tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:37:23 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-81b9bb60-34b8-447c-a800-93c4a996ebdb tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.211s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:37:23 user nova-compute[75066]: INFO nova.scheduler.client.report [None req-81b9bb60-34b8-447c-a800-93c4a996ebdb tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Deleted allocations for instance 905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436
Dec 01 19:37:23 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-81b9bb60-34b8-447c-a800-93c4a996ebdb tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "905f3a2f-d736-4f0a-bc9e-b9b9e7d2b436" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.555s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:37:24 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:37:24 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:37:26 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:37:31 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:37:36 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:37:41 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:37:46 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:37:46 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:37:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:37:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-0a1b456f-4c60-4eaa-a036-b4ec8cd25173 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Acquiring lock "409478f4-7921-4a15-89b0-82c26fa39de7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:37:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-0a1b456f-4c60-4eaa-a036-b4ec8cd25173 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "409478f4-7921-4a15-89b0-82c26fa39de7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:37:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-0a1b456f-4c60-4eaa-a036-b4ec8cd25173 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Acquiring lock "409478f4-7921-4a15-89b0-82c26fa39de7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:37:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-0a1b456f-4c60-4eaa-a036-b4ec8cd25173 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "409478f4-7921-4a15-89b0-82c26fa39de7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:37:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-0a1b456f-4c60-4eaa-a036-b4ec8cd25173 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "409478f4-7921-4a15-89b0-82c26fa39de7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:37:51 user nova-compute[75066]: INFO nova.compute.manager [None req-0a1b456f-4c60-4eaa-a036-b4ec8cd25173 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Terminating instance
Dec 01 19:37:51 user nova-compute[75066]: DEBUG nova.compute.manager [None req-0a1b456f-4c60-4eaa-a036-b4ec8cd25173 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Start destroying the instance on the hypervisor. {{(pid=75066) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 19:37:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:37:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:37:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:37:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:37:52 user nova-compute[75066]: DEBUG nova.compute.manager [req-9cdb9af5-0a89-4941-8f0c-9d79f8a43700 req-920016da-81e1-4d70-a998-50db5c07591e service nova] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Received event network-vif-unplugged-6d709e03-0f37-43f6-ab89-61e12ae93b48 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:37:52 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-9cdb9af5-0a89-4941-8f0c-9d79f8a43700 req-920016da-81e1-4d70-a998-50db5c07591e service nova] Acquiring lock "409478f4-7921-4a15-89b0-82c26fa39de7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:37:52 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-9cdb9af5-0a89-4941-8f0c-9d79f8a43700 req-920016da-81e1-4d70-a998-50db5c07591e service nova] Lock "409478f4-7921-4a15-89b0-82c26fa39de7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:37:52 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-9cdb9af5-0a89-4941-8f0c-9d79f8a43700 req-920016da-81e1-4d70-a998-50db5c07591e service nova] Lock "409478f4-7921-4a15-89b0-82c26fa39de7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:37:52 user nova-compute[75066]: DEBUG nova.compute.manager [req-9cdb9af5-0a89-4941-8f0c-9d79f8a43700 req-920016da-81e1-4d70-a998-50db5c07591e service nova] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] No waiting events found dispatching network-vif-unplugged-6d709e03-0f37-43f6-ab89-61e12ae93b48 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:37:52 user nova-compute[75066]: DEBUG nova.compute.manager [req-9cdb9af5-0a89-4941-8f0c-9d79f8a43700 req-920016da-81e1-4d70-a998-50db5c07591e service nova] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Received event network-vif-unplugged-6d709e03-0f37-43f6-ab89-61e12ae93b48 for instance with task_state deleting. {{(pid=75066) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 19:37:52 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Instance destroyed successfully.
Dec 01 19:37:52 user nova-compute[75066]: DEBUG nova.objects.instance [None req-0a1b456f-4c60-4eaa-a036-b4ec8cd25173 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lazy-loading 'resources' on Instance uuid 409478f4-7921-4a15-89b0-82c26fa39de7 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:37:52 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-0a1b456f-4c60-4eaa-a036-b4ec8cd25173 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-12-01T19:32:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1093900305',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1093900305',id=37,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgqDSADCKIleBb+Rg1GEKVJGSrQo6Qd+GU89QRtb0lxLByFIoFjjq1Yx9XawcMp2fp+Dic5G4y8aiEZFbJzFY905Tc5W+gwtIgnquQavTd1u+xCi3/ZclYfjcIcKZPxRw==',key_name='tempest-keypair-1679278784',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:36:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='879678dca7054c178839f56e66a6e0ce',ramdisk_id='',reservation_id='r-1sjmbvuo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1680443764',owner_user_name='tempest-AttachVolumeShelveTestJSON-1680443764-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:36:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='90e207044c0741e99c4a83b2c4746cd3',uuid=409478f4-7921-4a15-89b0-82c26fa39de7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6d709e03-0f37-43f6-ab89-61e12ae93b48", "address": "fa:16:3e:39:17:c8", "network": {"id": "49dd72ae-ec07-46a6-8463-e38bdfe1eba0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-738739404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879678dca7054c178839f56e66a6e0ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d709e03-0f", "ovs_interfaceid": "6d709e03-0f37-43f6-ab89-61e12ae93b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:37:52 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-0a1b456f-4c60-4eaa-a036-b4ec8cd25173 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Converting VIF {"id": "6d709e03-0f37-43f6-ab89-61e12ae93b48", "address": "fa:16:3e:39:17:c8", "network": {"id": "49dd72ae-ec07-46a6-8463-e38bdfe1eba0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-738739404-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "879678dca7054c178839f56e66a6e0ce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d709e03-0f", "ovs_interfaceid": "6d709e03-0f37-43f6-ab89-61e12ae93b48", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:37:52 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-0a1b456f-4c60-4eaa-a036-b4ec8cd25173 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:17:c8,bridge_name='br-int',has_traffic_filtering=True,id=6d709e03-0f37-43f6-ab89-61e12ae93b48,network=Network(49dd72ae-ec07-46a6-8463-e38bdfe1eba0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d709e03-0f') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:37:52 user nova-compute[75066]: DEBUG os_vif [None req-0a1b456f-4c60-4eaa-a036-b4ec8cd25173 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:17:c8,bridge_name='br-int',has_traffic_filtering=True,id=6d709e03-0f37-43f6-ab89-61e12ae93b48,network=Network(49dd72ae-ec07-46a6-8463-e38bdfe1eba0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d709e03-0f') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:37:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:37:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6d709e03-0f, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:37:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:37:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:37:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:37:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4da52292-7a3f-447d-883f-1d23a42214e8) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:37:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:37:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:37:52 user nova-compute[75066]: INFO os_vif [None req-0a1b456f-4c60-4eaa-a036-b4ec8cd25173 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:17:c8,bridge_name='br-int',has_traffic_filtering=True,id=6d709e03-0f37-43f6-ab89-61e12ae93b48,network=Network(49dd72ae-ec07-46a6-8463-e38bdfe1eba0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d709e03-0f')
Dec 01 19:37:52 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-0a1b456f-4c60-4eaa-a036-b4ec8cd25173 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Deleting instance files /opt/stack/data/nova/instances/409478f4-7921-4a15-89b0-82c26fa39de7_del
Dec 01 19:37:52 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-0a1b456f-4c60-4eaa-a036-b4ec8cd25173 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Deletion of /opt/stack/data/nova/instances/409478f4-7921-4a15-89b0-82c26fa39de7_del complete
Dec 01 19:37:52 user nova-compute[75066]: INFO nova.compute.manager [None req-0a1b456f-4c60-4eaa-a036-b4ec8cd25173 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Took 0.92 seconds to destroy the instance on the hypervisor.
Dec 01 19:37:52 user nova-compute[75066]: DEBUG oslo.service.loopingcall [None req-0a1b456f-4c60-4eaa-a036-b4ec8cd25173 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75066) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 19:37:52 user nova-compute[75066]: DEBUG nova.compute.manager [-] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Deallocating network for instance {{(pid=75066) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 19:37:52 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] deallocate_for_instance() {{(pid=75066) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 19:37:53 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:37:53 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:37:53 user nova-compute[75066]: INFO nova.compute.manager [-] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Took 0.73 seconds to deallocate network for instance.
Dec 01 19:37:53 user nova-compute[75066]: DEBUG nova.compute.manager [req-7e6e264a-0b31-4420-a37c-edb74a4f4351 req-e36c2573-82b7-41c6-b1d3-d98015546b55 service nova] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Received event network-vif-deleted-6d709e03-0f37-43f6-ab89-61e12ae93b48 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:37:53 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-0a1b456f-4c60-4eaa-a036-b4ec8cd25173 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:37:53 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-0a1b456f-4c60-4eaa-a036-b4ec8cd25173 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:37:53 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-0a1b456f-4c60-4eaa-a036-b4ec8cd25173 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:37:53 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-0a1b456f-4c60-4eaa-a036-b4ec8cd25173 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:37:53 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-0a1b456f-4c60-4eaa-a036-b4ec8cd25173 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.194s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:37:53 user nova-compute[75066]: INFO nova.scheduler.client.report [None req-0a1b456f-4c60-4eaa-a036-b4ec8cd25173 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Deleted allocations for instance 409478f4-7921-4a15-89b0-82c26fa39de7
Dec 01 19:37:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-0a1b456f-4c60-4eaa-a036-b4ec8cd25173 tempest-AttachVolumeShelveTestJSON-1680443764 tempest-AttachVolumeShelveTestJSON-1680443764-project-member] Lock "409478f4-7921-4a15-89b0-82c26fa39de7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.030s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:37:54 user nova-compute[75066]: DEBUG nova.compute.manager [req-beec0142-d91d-448e-a22f-534b0d5b6716 req-66a65fbc-879f-4be3-bb0e-0103484dc6d9 service nova] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Received event network-vif-plugged-6d709e03-0f37-43f6-ab89-61e12ae93b48 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:37:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-beec0142-d91d-448e-a22f-534b0d5b6716 req-66a65fbc-879f-4be3-bb0e-0103484dc6d9 service nova] Acquiring lock "409478f4-7921-4a15-89b0-82c26fa39de7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:37:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-beec0142-d91d-448e-a22f-534b0d5b6716 req-66a65fbc-879f-4be3-bb0e-0103484dc6d9 service nova] Lock "409478f4-7921-4a15-89b0-82c26fa39de7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:37:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-beec0142-d91d-448e-a22f-534b0d5b6716 req-66a65fbc-879f-4be3-bb0e-0103484dc6d9 service nova] Lock "409478f4-7921-4a15-89b0-82c26fa39de7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:37:54 user nova-compute[75066]: DEBUG nova.compute.manager [req-beec0142-d91d-448e-a22f-534b0d5b6716 req-66a65fbc-879f-4be3-bb0e-0103484dc6d9 service nova] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] No waiting events found dispatching network-vif-plugged-6d709e03-0f37-43f6-ab89-61e12ae93b48 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:37:54 user nova-compute[75066]: WARNING nova.compute.manager [req-beec0142-d91d-448e-a22f-534b0d5b6716 req-66a65fbc-879f-4be3-bb0e-0103484dc6d9 service nova] [instance: 409478f4-7921-4a15-89b0-82c26fa39de7] Received unexpected event network-vif-plugged-6d709e03-0f37-43f6-ab89-61e12ae93b48 for instance with vm_state deleted and task_state None.
Dec 01 19:37:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:38:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:38:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:38:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75066) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 19:38:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:38:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:38:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:38:07 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:38:10 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:38:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-7d03a15b-d2e2-4e55-a454-90762347f926 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Acquiring lock "90c49be6-97aa-45f1-bcbe-b9a3875226a7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:38:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-7d03a15b-d2e2-4e55-a454-90762347f926 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "90c49be6-97aa-45f1-bcbe-b9a3875226a7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:38:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-7d03a15b-d2e2-4e55-a454-90762347f926 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Acquiring lock "90c49be6-97aa-45f1-bcbe-b9a3875226a7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:38:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-7d03a15b-d2e2-4e55-a454-90762347f926 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "90c49be6-97aa-45f1-bcbe-b9a3875226a7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:38:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-7d03a15b-d2e2-4e55-a454-90762347f926 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "90c49be6-97aa-45f1-bcbe-b9a3875226a7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:38:11 user nova-compute[75066]: INFO nova.compute.manager [None req-7d03a15b-d2e2-4e55-a454-90762347f926 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Terminating instance
Dec 01 19:38:11 user nova-compute[75066]: DEBUG nova.compute.manager [None req-7d03a15b-d2e2-4e55-a454-90762347f926 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Start destroying the instance on the hypervisor. {{(pid=75066) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 19:38:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:38:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:38:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:38:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:38:12 user nova-compute[75066]: DEBUG nova.compute.manager [req-37e12ccd-c75d-4d69-a981-35c0749dcba8 req-76174239-f0d2-4ab0-9441-d3f0564dff16 service nova] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Received event network-vif-unplugged-5ccc5509-ab48-4e15-96b2-5757927fa168 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:38:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-37e12ccd-c75d-4d69-a981-35c0749dcba8 req-76174239-f0d2-4ab0-9441-d3f0564dff16 service nova] Acquiring lock "90c49be6-97aa-45f1-bcbe-b9a3875226a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:38:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-37e12ccd-c75d-4d69-a981-35c0749dcba8 req-76174239-f0d2-4ab0-9441-d3f0564dff16 service nova] Lock "90c49be6-97aa-45f1-bcbe-b9a3875226a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:38:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-37e12ccd-c75d-4d69-a981-35c0749dcba8 req-76174239-f0d2-4ab0-9441-d3f0564dff16 service nova] Lock "90c49be6-97aa-45f1-bcbe-b9a3875226a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:38:12 user nova-compute[75066]: DEBUG nova.compute.manager [req-37e12ccd-c75d-4d69-a981-35c0749dcba8 req-76174239-f0d2-4ab0-9441-d3f0564dff16 service nova] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] No waiting events found dispatching network-vif-unplugged-5ccc5509-ab48-4e15-96b2-5757927fa168 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:38:12 user nova-compute[75066]: DEBUG nova.compute.manager [req-37e12ccd-c75d-4d69-a981-35c0749dcba8 req-76174239-f0d2-4ab0-9441-d3f0564dff16 service nova] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Received event network-vif-unplugged-5ccc5509-ab48-4e15-96b2-5757927fa168 for instance with task_state deleting. {{(pid=75066) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 19:38:12 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Instance destroyed successfully.
Dec 01 19:38:12 user nova-compute[75066]: DEBUG nova.objects.instance [None req-7d03a15b-d2e2-4e55-a454-90762347f926 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lazy-loading 'resources' on Instance uuid 90c49be6-97aa-45f1-bcbe-b9a3875226a7 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:38:12 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-7d03a15b-d2e2-4e55-a454-90762347f926 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:18:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1301412549',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1301412549',id=12,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:18:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2e000d89bca44cd8acba504256d8d1f1',ramdisk_id='',reservation_id='r-xam9baff',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-454493649',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:20:28Z,user_data=None,user_id='964c1681ca8745d0b3879266d24f507e',uuid=90c49be6-97aa-45f1-bcbe-b9a3875226a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ccc5509-ab48-4e15-96b2-5757927fa168", "address": "fa:16:3e:eb:66:d7", "network": {"id": "6b0f48b7-3db2-49b2-a238-8fd811b52d62", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1688127634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e000d89bca44cd8acba504256d8d1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccc5509-ab", "ovs_interfaceid": "5ccc5509-ab48-4e15-96b2-5757927fa168", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:38:12 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-7d03a15b-d2e2-4e55-a454-90762347f926 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Converting VIF {"id": "5ccc5509-ab48-4e15-96b2-5757927fa168", "address": "fa:16:3e:eb:66:d7", "network": {"id": "6b0f48b7-3db2-49b2-a238-8fd811b52d62", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1688127634-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2e000d89bca44cd8acba504256d8d1f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ccc5509-ab", "ovs_interfaceid": "5ccc5509-ab48-4e15-96b2-5757927fa168", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:38:12 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-7d03a15b-d2e2-4e55-a454-90762347f926 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:66:d7,bridge_name='br-int',has_traffic_filtering=True,id=5ccc5509-ab48-4e15-96b2-5757927fa168,network=Network(6b0f48b7-3db2-49b2-a238-8fd811b52d62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ccc5509-ab') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:38:12 user nova-compute[75066]: DEBUG os_vif [None req-7d03a15b-d2e2-4e55-a454-90762347f926 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:66:d7,bridge_name='br-int',has_traffic_filtering=True,id=5ccc5509-ab48-4e15-96b2-5757927fa168,network=Network(6b0f48b7-3db2-49b2-a238-8fd811b52d62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ccc5509-ab') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:38:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:38:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ccc5509-ab, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:38:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:38:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:38:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:38:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=759d17ae-36f0-4d6c-8983-62a258798bc1) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:38:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:38:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:38:12 user nova-compute[75066]: INFO os_vif [None req-7d03a15b-d2e2-4e55-a454-90762347f926 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:66:d7,bridge_name='br-int',has_traffic_filtering=True,id=5ccc5509-ab48-4e15-96b2-5757927fa168,network=Network(6b0f48b7-3db2-49b2-a238-8fd811b52d62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ccc5509-ab')
Dec 01 19:38:12 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-7d03a15b-d2e2-4e55-a454-90762347f926 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Deleting instance files /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7_del
Dec 01 19:38:12 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-7d03a15b-d2e2-4e55-a454-90762347f926 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Deletion of /opt/stack/data/nova/instances/90c49be6-97aa-45f1-bcbe-b9a3875226a7_del complete
Dec 01 19:38:12 user nova-compute[75066]: INFO nova.compute.manager [None req-7d03a15b-d2e2-4e55-a454-90762347f926 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Took 0.88 seconds to destroy the instance on the hypervisor.
Dec 01 19:38:12 user nova-compute[75066]: DEBUG oslo.service.loopingcall [None req-7d03a15b-d2e2-4e55-a454-90762347f926 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75066) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 19:38:12 user nova-compute[75066]: DEBUG nova.compute.manager [-] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Deallocating network for instance {{(pid=75066) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 19:38:12 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] deallocate_for_instance() {{(pid=75066) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 19:38:13 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:38:13 user nova-compute[75066]: INFO nova.compute.manager [-] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Took 0.63 seconds to deallocate network for instance.
Dec 01 19:38:13 user nova-compute[75066]: DEBUG nova.compute.manager [req-3b989bed-0b39-403e-88ac-74b853569bf0 req-ae2d2b61-0341-4bf2-b0e9-bd5082962f18 service nova] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Received event network-vif-deleted-5ccc5509-ab48-4e15-96b2-5757927fa168 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:38:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-7d03a15b-d2e2-4e55-a454-90762347f926 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:38:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-7d03a15b-d2e2-4e55-a454-90762347f926 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:38:13 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-7d03a15b-d2e2-4e55-a454-90762347f926 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:38:13 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-7d03a15b-d2e2-4e55-a454-90762347f926 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:38:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-7d03a15b-d2e2-4e55-a454-90762347f926 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.153s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:38:13 user nova-compute[75066]: INFO nova.scheduler.client.report [None req-7d03a15b-d2e2-4e55-a454-90762347f926 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Deleted allocations for instance 90c49be6-97aa-45f1-bcbe-b9a3875226a7
Dec 01 19:38:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-7d03a15b-d2e2-4e55-a454-90762347f926 tempest-ServerBootFromVolumeStableRescueTest-454493649 tempest-ServerBootFromVolumeStableRescueTest-454493649-project-member] Lock "90c49be6-97aa-45f1-bcbe-b9a3875226a7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.839s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:38:14 user nova-compute[75066]: DEBUG nova.compute.manager [req-cac1d237-555b-41b5-9517-554dd00ee076 req-5a666e90-0785-43a4-879a-c0455507212e service nova] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Received event network-vif-plugged-5ccc5509-ab48-4e15-96b2-5757927fa168 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:38:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-cac1d237-555b-41b5-9517-554dd00ee076 req-5a666e90-0785-43a4-879a-c0455507212e service nova] Acquiring lock "90c49be6-97aa-45f1-bcbe-b9a3875226a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:38:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-cac1d237-555b-41b5-9517-554dd00ee076 req-5a666e90-0785-43a4-879a-c0455507212e service nova] Lock "90c49be6-97aa-45f1-bcbe-b9a3875226a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:38:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-cac1d237-555b-41b5-9517-554dd00ee076 req-5a666e90-0785-43a4-879a-c0455507212e service nova] Lock "90c49be6-97aa-45f1-bcbe-b9a3875226a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:38:14 user nova-compute[75066]: DEBUG nova.compute.manager [req-cac1d237-555b-41b5-9517-554dd00ee076 req-5a666e90-0785-43a4-879a-c0455507212e service nova] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] No waiting events found dispatching network-vif-plugged-5ccc5509-ab48-4e15-96b2-5757927fa168 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:38:14 user nova-compute[75066]: WARNING nova.compute.manager [req-cac1d237-555b-41b5-9517-554dd00ee076 req-5a666e90-0785-43a4-879a-c0455507212e service nova] [instance: 90c49be6-97aa-45f1-bcbe-b9a3875226a7] Received unexpected event network-vif-plugged-5ccc5509-ab48-4e15-96b2-5757927fa168 for instance with vm_state deleted and task_state None.
Dec 01 19:38:15 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:38:15 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:38:15 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75066) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 19:38:16 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:38:17 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:38:18 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:38:18 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:38:18 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:38:18 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:38:18 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75066) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 19:38:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cac44489-2374-4478-842b-0722dd4fe2db/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:38:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cac44489-2374-4478-842b-0722dd4fe2db/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:38:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cac44489-2374-4478-842b-0722dd4fe2db/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:38:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cac44489-2374-4478-842b-0722dd4fe2db/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:38:18 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88850ea1-43cd-4066-8e6f-cfe5de621bc6/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:38:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88850ea1-43cd-4066-8e6f-cfe5de621bc6/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:38:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88850ea1-43cd-4066-8e6f-cfe5de621bc6/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:38:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88850ea1-43cd-4066-8e6f-cfe5de621bc6/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:38:19 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:38:19 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:38:19 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Hypervisor/Node resource view: name=user free_ram=8756MB free_disk=24.94249725341797GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75066) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 19:38:19 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:38:19 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:38:19 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 88850ea1-43cd-4066-8e6f-cfe5de621bc6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:38:19 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance cac44489-2374-4478-842b-0722dd4fe2db actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:38:19 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 19:38:19 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 19:38:19 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:38:19 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:38:19 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Compute_service record updated for user:user {{(pid=75066) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 19:38:19 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.240s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:38:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:38:22 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:38:22 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:38:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:38:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:38:23 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:38:23 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Starting heal instance info cache {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 19:38:23 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Rebuilding the list of instances to heal {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 19:38:23 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "refresh_cache-88850ea1-43cd-4066-8e6f-cfe5de621bc6" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:38:23 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquired lock "refresh_cache-88850ea1-43cd-4066-8e6f-cfe5de621bc6" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:38:23 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] Forcefully refreshing network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 19:38:23 user nova-compute[75066]: DEBUG nova.objects.instance [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lazy-loading 'info_cache' on Instance uuid 88850ea1-43cd-4066-8e6f-cfe5de621bc6 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:38:24 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] Updating instance_info_cache with network_info: [{"id": "b39d66c2-c9c7-4b66-af8e-5ec0c23a997e", "address": "fa:16:3e:19:e0:f5", "network": {"id": "884b20a8-4ead-448d-994b-8e714dc32fae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-357575766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9f677c9e8c24b7389273db9d82954fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb39d66c2-c9", "ovs_interfaceid": "b39d66c2-c9c7-4b66-af8e-5ec0c23a997e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:38:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Releasing lock "refresh_cache-88850ea1-43cd-4066-8e6f-cfe5de621bc6" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:38:24 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] Updated the network info_cache for instance {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 19:38:24 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:38:24 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:38:24 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:38:26 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Acquiring lock "d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:38:26 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Lock "d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:38:26 user nova-compute[75066]: DEBUG nova.compute.manager [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0] Starting instance... {{(pid=75066) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 19:38:26 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:38:26 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:38:26 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75066) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 19:38:26 user nova-compute[75066]: INFO nova.compute.claims [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0] Claim successful on node user
Dec 01 19:38:26 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:38:26 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:38:26 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.238s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:38:26 user nova-compute[75066]: DEBUG nova.compute.manager [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0] Start building networks asynchronously for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 19:38:26 user nova-compute[75066]: DEBUG nova.compute.manager [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0] Allocating IP information in the background. {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 19:38:26 user nova-compute[75066]: DEBUG nova.network.neutron [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0] allocate_for_instance() {{(pid=75066) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 19:38:26 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 19:38:26 user nova-compute[75066]: DEBUG nova.compute.manager [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0] Start building block device mappings for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 19:38:26 user nova-compute[75066]: DEBUG nova.policy [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '259ab964702944ba980aa28a8f38d3fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0783de30bbc465fa27a20ae871178b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75066) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 19:38:26 user nova-compute[75066]: DEBUG nova.compute.manager [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0] Start spawning the instance on the hypervisor. {{(pid=75066) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 19:38:26 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0] Creating instance directory {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 19:38:26 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0] Creating image(s)
Dec 01 19:38:26 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Acquiring lock "/opt/stack/data/nova/instances/d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:38:26 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Lock "/opt/stack/data/nova/instances/d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:38:26 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Lock "/opt/stack/data/nova/instances/d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:38:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:38:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.172s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:38:26 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Acquiring lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:38:26 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:38:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:38:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.196s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:38:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0/disk 1073741824 {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:38:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0/disk 1073741824" returned: 0 in 0.058s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:38:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.268s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:38:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:38:27 user nova-compute[75066]: DEBUG nova.network.neutron [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0] Successfully created port: f5e9e254-d309-4053-91aa-c05bc80f5fe5 {{(pid=75066) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 19:38:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.232s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:38:27 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0/disk. size=1073741824 {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 19:38:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:38:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:38:27 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Cannot resize image /opt/stack/data/nova/instances/d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0/disk to a smaller size. {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 19:38:27 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0] Created local disks {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 19:38:27 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0] Ensure instance console log exists: /opt/stack/data/nova/instances/d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0/console.log {{(pid=75066) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 19:38:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:38:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:38:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:38:27 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:38:27 user nova-compute[75066]: DEBUG nova.network.neutron [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0] Successfully updated port: f5e9e254-d309-4053-91aa-c05bc80f5fe5 {{(pid=75066) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 19:38:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Acquiring lock "refresh_cache-d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:38:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Acquired lock "refresh_cache-d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:38:27 user nova-compute[75066]: DEBUG nova.network.neutron [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:38:27 user nova-compute[75066]: DEBUG nova.compute.manager [req-b106f2c7-52e8-4b36-8ca9-fcd6231a7046 req-16bac6bb-c56b-4827-86a3-4cf2dd89fff7 service nova] [instance: d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0] Received event network-changed-f5e9e254-d309-4053-91aa-c05bc80f5fe5 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:38:27 user nova-compute[75066]: DEBUG nova.compute.manager [req-b106f2c7-52e8-4b36-8ca9-fcd6231a7046 req-16bac6bb-c56b-4827-86a3-4cf2dd89fff7 service nova] [instance: d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0] Refreshing instance network info cache due to event network-changed-f5e9e254-d309-4053-91aa-c05bc80f5fe5. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:38:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-b106f2c7-52e8-4b36-8ca9-fcd6231a7046 req-16bac6bb-c56b-4827-86a3-4cf2dd89fff7 service nova] Acquiring lock "refresh_cache-d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:38:27 user nova-compute[75066]: DEBUG nova.network.neutron [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:38:28 user nova-compute[75066]: DEBUG nova.network.neutron [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0] Updating instance_info_cache with network_info: [{"id": "f5e9e254-d309-4053-91aa-c05bc80f5fe5", "address": "fa:16:3e:fc:00:4d", "network": {"id": "89966bbc-72a7-4613-a11f-cacdc22d2be7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-217253460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0783de30bbc465fa27a20ae871178b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e9e254-d3", "ovs_interfaceid": "f5e9e254-d309-4053-91aa-c05bc80f5fe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:38:28 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Releasing lock "refresh_cache-d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:38:28 user nova-compute[75066]: DEBUG nova.compute.manager [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0] Instance network_info: |[{"id": "f5e9e254-d309-4053-91aa-c05bc80f5fe5", "address": "fa:16:3e:fc:00:4d", "network": {"id": "89966bbc-72a7-4613-a11f-cacdc22d2be7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-217253460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0783de30bbc465fa27a20ae871178b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e9e254-d3", "ovs_interfaceid": "f5e9e254-d309-4053-91aa-c05bc80f5fe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 19:38:28 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-b106f2c7-52e8-4b36-8ca9-fcd6231a7046 req-16bac6bb-c56b-4827-86a3-4cf2dd89fff7 service nova] Acquired lock "refresh_cache-d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:38:28 user nova-compute[75066]: DEBUG nova.network.neutron [req-b106f2c7-52e8-4b36-8ca9-fcd6231a7046 req-16bac6bb-c56b-4827-86a3-4cf2dd89fff7 service nova] [instance: d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0] Refreshing network info cache for port f5e9e254-d309-4053-91aa-c05bc80f5fe5 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:38:28 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0] Start _get_guest_xml network_info=[{"id": "f5e9e254-d309-4053-91aa-c05bc80f5fe5", "address": "fa:16:3e:fc:00:4d", "network": {"id": "89966bbc-72a7-4613-a11f-cacdc22d2be7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-217253460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0783de30bbc465fa27a20ae871178b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e9e254-d3", "ovs_interfaceid": "f5e9e254-d309-4053-91aa-c05bc80f5fe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'image_id': '900b237b-e99c-4fdd-a44f-dcb7a08baa86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:38:28 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:38:28 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:38:28 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:38:28 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:38:28 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:38:28 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:38:28 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:38:28 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:38:28 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:38:28 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:38:28 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:38:28 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:38:28 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:38:28 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:38:28 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:38:28 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:38:28 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:38:28 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:38:28 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1674059249',display_name='tempest-VolumesActionsTest-instance-1674059249',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1674059249',id=39,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0783de30bbc465fa27a20ae871178b8',ramdisk_id='',reservation_id='r-yr688iby',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1936494950',owner_user_name='tempest-VolumesActionsTest-1936494950-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:38:27Z,user_data=None,user_id='259ab964702944ba980aa28a8f38d3fb',uuid=d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5e9e254-d309-4053-91aa-c05bc80f5fe5", "address": "fa:16:3e:fc:00:4d", "network": {"id": "89966bbc-72a7-4613-a11f-cacdc22d2be7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-217253460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0783de30bbc465fa27a20ae871178b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e9e254-d3", "ovs_interfaceid": "f5e9e254-d309-4053-91aa-c05bc80f5fe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:38:28 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Converting VIF {"id": "f5e9e254-d309-4053-91aa-c05bc80f5fe5", "address": "fa:16:3e:fc:00:4d", "network": {"id": "89966bbc-72a7-4613-a11f-cacdc22d2be7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-217253460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0783de30bbc465fa27a20ae871178b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e9e254-d3", "ovs_interfaceid": "f5e9e254-d309-4053-91aa-c05bc80f5fe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:38:28 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:00:4d,bridge_name='br-int',has_traffic_filtering=True,id=f5e9e254-d309-4053-91aa-c05bc80f5fe5,network=Network(89966bbc-72a7-4613-a11f-cacdc22d2be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e9e254-d3') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:38:28 user nova-compute[75066]: DEBUG nova.objects.instance [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Lazy-loading 'pci_devices' on Instance uuid d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:38:28 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:38:28 user nova-compute[75066]:   <uuid>d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0</uuid>
Dec 01 19:38:28 user nova-compute[75066]:   <name>instance-00000027</name>
Dec 01 19:38:28 user nova-compute[75066]:   <memory>524288</memory>
Dec 01 19:38:28 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:38:28 user nova-compute[75066]:   <metadata>
Dec 01 19:38:28 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:38:28 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:38:28 user nova-compute[75066]:       <nova:name>tempest-VolumesActionsTest-instance-1674059249</nova:name>
Dec 01 19:38:28 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:38:28</nova:creationTime>
Dec 01 19:38:28 user nova-compute[75066]:       <nova:flavor name="m1.tiny">
Dec 01 19:38:28 user nova-compute[75066]:         <nova:memory>512</nova:memory>
Dec 01 19:38:28 user nova-compute[75066]:         <nova:disk>1</nova:disk>
Dec 01 19:38:28 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:38:28 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:38:28 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:38:28 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:38:28 user nova-compute[75066]:       <nova:owner>
Dec 01 19:38:28 user nova-compute[75066]:         <nova:user uuid="259ab964702944ba980aa28a8f38d3fb">tempest-VolumesActionsTest-1936494950-project-member</nova:user>
Dec 01 19:38:28 user nova-compute[75066]:         <nova:project uuid="c0783de30bbc465fa27a20ae871178b8">tempest-VolumesActionsTest-1936494950</nova:project>
Dec 01 19:38:28 user nova-compute[75066]:       </nova:owner>
Dec 01 19:38:28 user nova-compute[75066]:       <nova:root type="image" uuid="900b237b-e99c-4fdd-a44f-dcb7a08baa86"/>
Dec 01 19:38:28 user nova-compute[75066]:       <nova:ports>
Dec 01 19:38:28 user nova-compute[75066]:         <nova:port uuid="f5e9e254-d309-4053-91aa-c05bc80f5fe5">
Dec 01 19:38:28 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Dec 01 19:38:28 user nova-compute[75066]:         </nova:port>
Dec 01 19:38:28 user nova-compute[75066]:       </nova:ports>
Dec 01 19:38:28 user nova-compute[75066]:     </nova:instance>
Dec 01 19:38:28 user nova-compute[75066]:   </metadata>
Dec 01 19:38:28 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:38:28 user nova-compute[75066]:     <system>
Dec 01 19:38:28 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:38:28 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:38:28 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:38:28 user nova-compute[75066]:       <entry name="serial">d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0</entry>
Dec 01 19:38:28 user nova-compute[75066]:       <entry name="uuid">d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0</entry>
Dec 01 19:38:28 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:38:28 user nova-compute[75066]:     </system>
Dec 01 19:38:28 user nova-compute[75066]:   </sysinfo>
Dec 01 19:38:28 user nova-compute[75066]:   <os>
Dec 01 19:38:28 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:38:28 user nova-compute[75066]:     <boot dev="hd"/>
Dec 01 19:38:28 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:38:28 user nova-compute[75066]:   </os>
Dec 01 19:38:28 user nova-compute[75066]:   <features>
Dec 01 19:38:28 user nova-compute[75066]:     <acpi/>
Dec 01 19:38:28 user nova-compute[75066]:     <apic/>
Dec 01 19:38:28 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:38:28 user nova-compute[75066]:   </features>
Dec 01 19:38:28 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:38:28 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:38:28 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:38:28 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:38:28 user nova-compute[75066]:   </clock>
Dec 01 19:38:28 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:38:28 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:38:28 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:38:28 user nova-compute[75066]:   </cpu>
Dec 01 19:38:28 user nova-compute[75066]:   <devices>
Dec 01 19:38:28 user nova-compute[75066]:     <disk type="file" device="disk">
Dec 01 19:38:28 user nova-compute[75066]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 19:38:28 user nova-compute[75066]:       <source file="/opt/stack/data/nova/instances/d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0/disk"/>
Dec 01 19:38:28 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:38:28 user nova-compute[75066]:     </disk>
Dec 01 19:38:28 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:38:28 user nova-compute[75066]:       <mac address="fa:16:3e:fc:00:4d"/>
Dec 01 19:38:28 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:38:28 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:38:28 user nova-compute[75066]:       <target dev="tapf5e9e254-d3"/>
Dec 01 19:38:28 user nova-compute[75066]:     </interface>
Dec 01 19:38:28 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:38:28 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0/console.log" append="off"/>
Dec 01 19:38:28 user nova-compute[75066]:     </serial>
Dec 01 19:38:28 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:38:28 user nova-compute[75066]:     <video>
Dec 01 19:38:28 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:38:28 user nova-compute[75066]:     </video>
Dec 01 19:38:28 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:38:28 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:38:28 user nova-compute[75066]:     </rng>
Dec 01 19:38:28 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:38:28 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:38:28 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:38:28 user nova-compute[75066]:     </memballoon>
Dec 01 19:38:28 user nova-compute[75066]:   </devices>
Dec 01 19:38:28 user nova-compute[75066]: </domain>
Dec 01 19:38:28 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:38:28 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1674059249',display_name='tempest-VolumesActionsTest-instance-1674059249',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1674059249',id=39,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0783de30bbc465fa27a20ae871178b8',ramdisk_id='',reservation_id='r-yr688iby',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1936494950',owner_user_name='tempest-VolumesActionsTest-1936494950-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:38:27Z,user_data=None,user_id='259ab964702944ba980aa28a8f38d3fb',uuid=d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5e9e254-d309-4053-91aa-c05bc80f5fe5", "address": "fa:16:3e:fc:00:4d", "network": {"id": "89966bbc-72a7-4613-a11f-cacdc22d2be7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-217253460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0783de30bbc465fa27a20ae871178b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e9e254-d3", "ovs_interfaceid": "f5e9e254-d309-4053-91aa-c05bc80f5fe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:38:28 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Converting VIF {"id": "f5e9e254-d309-4053-91aa-c05bc80f5fe5", "address": "fa:16:3e:fc:00:4d", "network": {"id": "89966bbc-72a7-4613-a11f-cacdc22d2be7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-217253460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0783de30bbc465fa27a20ae871178b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e9e254-d3", "ovs_interfaceid": "f5e9e254-d309-4053-91aa-c05bc80f5fe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:38:28 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:00:4d,bridge_name='br-int',has_traffic_filtering=True,id=f5e9e254-d309-4053-91aa-c05bc80f5fe5,network=Network(89966bbc-72a7-4613-a11f-cacdc22d2be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e9e254-d3') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:38:28 user nova-compute[75066]: DEBUG os_vif [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:00:4d,bridge_name='br-int',has_traffic_filtering=True,id=f5e9e254-d309-4053-91aa-c05bc80f5fe5,network=Network(89966bbc-72a7-4613-a11f-cacdc22d2be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e9e254-d3') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:38:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:38:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:38:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:38:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:38:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd86a13fa-16f9-587e-8f0b-f64586c8ca47', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:38:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:38:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:38:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:38:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf5e9e254-d3, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:38:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf5e9e254-d3, col_values=(('qos', UUID('943398e4-7c23-4f31-8a19-4d6186c4f4e2')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:38:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf5e9e254-d3, col_values=(('external_ids', {'iface-id': 'f5e9e254-d309-4053-91aa-c05bc80f5fe5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:00:4d', 'vm-uuid': 'd01c6c53-4e57-4c84-aa23-d5f48f2f1dd0'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:38:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:38:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:38:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:38:28 user nova-compute[75066]: INFO os_vif [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:00:4d,bridge_name='br-int',has_traffic_filtering=True,id=f5e9e254-d309-4053-91aa-c05bc80f5fe5,network=Network(89966bbc-72a7-4613-a11f-cacdc22d2be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e9e254-d3')
Dec 01 19:38:28 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:38:28 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] No VIF found with MAC fa:16:3e:fc:00:4d, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:38:28 user nova-compute[75066]: DEBUG nova.network.neutron [req-b106f2c7-52e8-4b36-8ca9-fcd6231a7046 req-16bac6bb-c56b-4827-86a3-4cf2dd89fff7 service nova] [instance: d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0] Updated VIF entry in instance network info cache for port f5e9e254-d309-4053-91aa-c05bc80f5fe5. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:38:28 user nova-compute[75066]: DEBUG nova.network.neutron [req-b106f2c7-52e8-4b36-8ca9-fcd6231a7046 req-16bac6bb-c56b-4827-86a3-4cf2dd89fff7 service nova] [instance: d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0] Updating instance_info_cache with network_info: [{"id": "f5e9e254-d309-4053-91aa-c05bc80f5fe5", "address": "fa:16:3e:fc:00:4d", "network": {"id": "89966bbc-72a7-4613-a11f-cacdc22d2be7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-217253460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0783de30bbc465fa27a20ae871178b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e9e254-d3", "ovs_interfaceid": "f5e9e254-d309-4053-91aa-c05bc80f5fe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:38:28 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-b106f2c7-52e8-4b36-8ca9-fcd6231a7046 req-16bac6bb-c56b-4827-86a3-4cf2dd89fff7 service nova] Releasing lock "refresh_cache-d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:38:29 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:38:29 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:38:29 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:38:29 user nova-compute[75066]: DEBUG nova.compute.manager [req-7e4cb9ba-2db2-4a66-8d6c-67725beed801 req-df14d1d0-be2a-42ef-95c9-e31ed8ef3731 service nova] [instance: d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0] Received event network-vif-plugged-f5e9e254-d309-4053-91aa-c05bc80f5fe5 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:38:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-7e4cb9ba-2db2-4a66-8d6c-67725beed801 req-df14d1d0-be2a-42ef-95c9-e31ed8ef3731 service nova] Acquiring lock "d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:38:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-7e4cb9ba-2db2-4a66-8d6c-67725beed801 req-df14d1d0-be2a-42ef-95c9-e31ed8ef3731 service nova] Lock "d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:38:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-7e4cb9ba-2db2-4a66-8d6c-67725beed801 req-df14d1d0-be2a-42ef-95c9-e31ed8ef3731 service nova] Lock "d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:38:29 user nova-compute[75066]: DEBUG nova.compute.manager [req-7e4cb9ba-2db2-4a66-8d6c-67725beed801 req-df14d1d0-be2a-42ef-95c9-e31ed8ef3731 service nova] [instance: d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0] No waiting events found dispatching network-vif-plugged-f5e9e254-d309-4053-91aa-c05bc80f5fe5 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:38:29 user nova-compute[75066]: WARNING nova.compute.manager [req-7e4cb9ba-2db2-4a66-8d6c-67725beed801 req-df14d1d0-be2a-42ef-95c9-e31ed8ef3731 service nova] [instance: d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0] Received unexpected event network-vif-plugged-f5e9e254-d309-4053-91aa-c05bc80f5fe5 for instance with vm_state building and task_state spawning.
Dec 01 19:38:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:38:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:38:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:38:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:38:31 user nova-compute[75066]: DEBUG nova.compute.manager [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0] Instance event wait completed in 0 seconds for  {{(pid=75066) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 19:38:31 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0] Guest created on hypervisor {{(pid=75066) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 19:38:31 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0] Instance spawned successfully.
Dec 01 19:38:31 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 19:38:31 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0] Found default for hw_cdrom_bus of ide {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:38:31 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0] Found default for hw_disk_bus of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:38:31 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0] Found default for hw_input_bus of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:38:31 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0] Found default for hw_pointer_model of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:38:31 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0] Found default for hw_video_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:38:31 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0] Found default for hw_vif_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:38:31 user nova-compute[75066]: INFO nova.compute.manager [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0] Took 5.08 seconds to spawn the instance on the hypervisor.
Dec 01 19:38:31 user nova-compute[75066]: DEBUG nova.compute.manager [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:38:31 user nova-compute[75066]: DEBUG nova.compute.manager [req-d5543141-f069-4901-af12-bc202a5a53aa req-26191a9b-0a34-4a75-971b-225bb02068e5 service nova] [instance: d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0] Received event network-vif-plugged-f5e9e254-d309-4053-91aa-c05bc80f5fe5 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:38:31 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d5543141-f069-4901-af12-bc202a5a53aa req-26191a9b-0a34-4a75-971b-225bb02068e5 service nova] Acquiring lock "d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:38:31 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d5543141-f069-4901-af12-bc202a5a53aa req-26191a9b-0a34-4a75-971b-225bb02068e5 service nova] Lock "d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:38:31 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d5543141-f069-4901-af12-bc202a5a53aa req-26191a9b-0a34-4a75-971b-225bb02068e5 service nova] Lock "d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:38:31 user nova-compute[75066]: DEBUG nova.compute.manager [req-d5543141-f069-4901-af12-bc202a5a53aa req-26191a9b-0a34-4a75-971b-225bb02068e5 service nova] [instance: d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0] No waiting events found dispatching network-vif-plugged-f5e9e254-d309-4053-91aa-c05bc80f5fe5 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:38:31 user nova-compute[75066]: WARNING nova.compute.manager [req-d5543141-f069-4901-af12-bc202a5a53aa req-26191a9b-0a34-4a75-971b-225bb02068e5 service nova] [instance: d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0] Received unexpected event network-vif-plugged-f5e9e254-d309-4053-91aa-c05bc80f5fe5 for instance with vm_state building and task_state spawning.
Dec 01 19:38:31 user nova-compute[75066]: INFO nova.compute.manager [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0] Took 5.64 seconds to build instance.
Dec 01 19:38:31 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a8b97319-912e-4df3-867b-ad111e92a5bd tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Lock "d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.768s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:38:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:38:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:38:36 user nova-compute[75066]: DEBUG nova.compute.manager [req-728ee4b1-8b21-4724-afb4-4911064abc1f req-911da807-a17f-4893-9938-bddf866c3d67 service nova] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Received event network-changed-2f5ab3de-24e6-4c17-9628-879ce59eacd2 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:38:36 user nova-compute[75066]: DEBUG nova.compute.manager [req-728ee4b1-8b21-4724-afb4-4911064abc1f req-911da807-a17f-4893-9938-bddf866c3d67 service nova] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Refreshing instance network info cache due to event network-changed-2f5ab3de-24e6-4c17-9628-879ce59eacd2. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:38:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-728ee4b1-8b21-4724-afb4-4911064abc1f req-911da807-a17f-4893-9938-bddf866c3d67 service nova] Acquiring lock "refresh_cache-cac44489-2374-4478-842b-0722dd4fe2db" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:38:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-728ee4b1-8b21-4724-afb4-4911064abc1f req-911da807-a17f-4893-9938-bddf866c3d67 service nova] Acquired lock "refresh_cache-cac44489-2374-4478-842b-0722dd4fe2db" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:38:36 user nova-compute[75066]: DEBUG nova.network.neutron [req-728ee4b1-8b21-4724-afb4-4911064abc1f req-911da807-a17f-4893-9938-bddf866c3d67 service nova] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Refreshing network info cache for port 2f5ab3de-24e6-4c17-9628-879ce59eacd2 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:38:36 user nova-compute[75066]: DEBUG nova.network.neutron [req-728ee4b1-8b21-4724-afb4-4911064abc1f req-911da807-a17f-4893-9938-bddf866c3d67 service nova] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Updated VIF entry in instance network info cache for port 2f5ab3de-24e6-4c17-9628-879ce59eacd2. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:38:36 user nova-compute[75066]: DEBUG nova.network.neutron [req-728ee4b1-8b21-4724-afb4-4911064abc1f req-911da807-a17f-4893-9938-bddf866c3d67 service nova] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Updating instance_info_cache with network_info: [{"id": "2f5ab3de-24e6-4c17-9628-879ce59eacd2", "address": "fa:16:3e:18:64:a8", "network": {"id": "27d425c3-c498-4479-86d7-8d520a2e5bf9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1954318568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6afe015769943c28f090535f675eed5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f5ab3de-24", "ovs_interfaceid": "2f5ab3de-24e6-4c17-9628-879ce59eacd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:38:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-728ee4b1-8b21-4724-afb4-4911064abc1f req-911da807-a17f-4893-9938-bddf866c3d67 service nova] Releasing lock "refresh_cache-cac44489-2374-4478-842b-0722dd4fe2db" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:38:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:38:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:38:39 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5c4198fb-cc63-4d42-8468-fa924a321a76 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Acquiring lock "cac44489-2374-4478-842b-0722dd4fe2db" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:38:39 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5c4198fb-cc63-4d42-8468-fa924a321a76 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Lock "cac44489-2374-4478-842b-0722dd4fe2db" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:38:39 user nova-compute[75066]: DEBUG nova.objects.instance [None req-5c4198fb-cc63-4d42-8468-fa924a321a76 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Lazy-loading 'flavor' on Instance uuid cac44489-2374-4478-842b-0722dd4fe2db {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:38:39 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5c4198fb-cc63-4d42-8468-fa924a321a76 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Lock "cac44489-2374-4478-842b-0722dd4fe2db" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:38:39 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5c4198fb-cc63-4d42-8468-fa924a321a76 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Acquiring lock "cac44489-2374-4478-842b-0722dd4fe2db" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:38:39 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5c4198fb-cc63-4d42-8468-fa924a321a76 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Lock "cac44489-2374-4478-842b-0722dd4fe2db" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:38:39 user nova-compute[75066]: INFO nova.compute.manager [None req-5c4198fb-cc63-4d42-8468-fa924a321a76 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Attaching volume 1389ab63-0286-4fff-917a-5f3989fa127d to /dev/vdb
Dec 01 19:38:39 user nova-compute[75066]: DEBUG os_brick.utils [None req-5c4198fb-cc63-4d42-8468-fa924a321a76 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:38:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:38:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:38:39 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7ec974-3d7a-483d-910d-92d98fca338f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1959854982f\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:38:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:38:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:38:39 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[519cc732-623a-4d68-8e37-8a156fc2156c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:38:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:38:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:38:39 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[779f9fba-e7b5-4294-abd7-27648bfe18fd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:38:39 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dbef16c-4fab-451c-8b38-66735f3d0678]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:38:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-5c4198fb-cc63-4d42-8468-fa924a321a76 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Running cmd (subprocess): nvme version {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:38:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-5c4198fb-cc63-4d42-8468-fa924a321a76 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] 'nvme version' failed. Not Retrying. {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:38:39 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5c4198fb-cc63-4d42-8468-fa924a321a76 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] nvme not present on system {{(pid=75066) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 19:38:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:38:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:38:39 user nova-compute[75066]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 19:38:39 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[2283edf2-37d8-490c-8c9a-10aa7c6808c6]: (4, '') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:38:39 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-5c4198fb-cc63-4d42-8468-fa924a321a76 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75066) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 19:38:39 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-5c4198fb-cc63-4d42-8468-fa924a321a76 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 19:38:39 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-5c4198fb-cc63-4d42-8468-fa924a321a76 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] LIGHTOS: no hostnqn found. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 19:38:39 user nova-compute[75066]: DEBUG os_brick.utils [None req-5c4198fb-cc63-4d42-8468-fa924a321a76 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] <== get_connector_properties: return (113ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1959854982f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:38:39 user nova-compute[75066]: DEBUG nova.virt.block_device [None req-5c4198fb-cc63-4d42-8468-fa924a321a76 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Updating existing volume attachment record: 295f4e95-6b53-4500-a1a2-5a4ca2c0b57c {{(pid=75066) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 19:38:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:38:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:38:48 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:38:48 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:38:49 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c4198fb-cc63-4d42-8468-fa924a321a76 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Calling os-brick to attach iSCSI Volume {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 19:38:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c4198fb-cc63-4d42-8468-fa924a321a76 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1389ab63-0286-4fff-917a-5f3989fa127d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QyadDcrC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:38:49 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-5c4198fb-cc63-4d42-8468-fa924a321a76 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:38:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-5c4198fb-cc63-4d42-8468-fa924a321a76 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:38:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-5c4198fb-cc63-4d42-8468-fa924a321a76 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:38:49 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-5c4198fb-cc63-4d42-8468-fa924a321a76 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:38:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-5c4198fb-cc63-4d42-8468-fa924a321a76 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1389ab63-0286-4fff-917a-5f3989fa127d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:38:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-5c4198fb-cc63-4d42-8468-fa924a321a76 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1389ab63-0286-4fff-917a-5f3989fa127d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:38:49 user nova-compute[75066]: INFO os_brick.initiator.connectors.iscsi [None req-5c4198fb-cc63-4d42-8468-fa924a321a76 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 19:38:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1389ab63-0286-4fff-917a-5f3989fa127d -p 172.16.0.220:3260 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:38:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1389ab63-0286-4fff-917a-5f3989fa127d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:38:49 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a294df-5d71-4f23-b9d9-3355f846487d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:38:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c4198fb-cc63-4d42-8468-fa924a321a76 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 19:38:49 user nova-compute[75066]:  {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:38:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1389ab63-0286-4fff-917a-5f3989fa127d -p 172.16.0.220:3260 --interface default --op new {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:38:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1389ab63-0286-4fff-917a-5f3989fa127d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:38:49 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad15689c-709a-4534-a848-2630a3fc3b10]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1389ab63-0286-4fff-917a-5f3989fa127d] added\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:38:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c4198fb-cc63-4d42-8468-fa924a321a76 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1389ab63-0286-4fff-917a-5f3989fa127d] added
Dec 01 19:38:49 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:38:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1389ab63-0286-4fff-917a-5f3989fa127d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:38:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1389ab63-0286-4fff-917a-5f3989fa127d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:38:49 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc73f9b0-2b58-4adc-b8f8-db9e1cd34b5f]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:38:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c4198fb-cc63-4d42-8468-fa924a321a76 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:38:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1389ab63-0286-4fff-917a-5f3989fa127d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:38:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1389ab63-0286-4fff-917a-5f3989fa127d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:38:49 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[4afdd54a-0448-4f98-9a14-78ab6d5d5c29]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:38:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c4198fb-cc63-4d42-8468-fa924a321a76 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:38:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1389ab63-0286-4fff-917a-5f3989fa127d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QyadDcrC {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:38:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1389ab63-0286-4fff-917a-5f3989fa127d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QyadDcrC" returned: 0 in 0.021s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:38:49 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[469ef97c-8dd4-46ff-87d9-71d6460ff681]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:38:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c4198fb-cc63-4d42-8468-fa924a321a76 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QyadDcrC'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:38:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1389ab63-0286-4fff-917a-5f3989fa127d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:38:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1389ab63-0286-4fff-917a-5f3989fa127d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:38:49 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e259c8b-e1cc-4ee2-9ded-3866a5042377]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:38:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c4198fb-cc63-4d42-8468-fa924a321a76 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:38:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:38:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:38:49 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef804b84-6c22-438f-8662-0f942cb14824]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:38:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c4198fb-cc63-4d42-8468-fa924a321a76 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 01 19:38:49 user nova-compute[75066]:  {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:38:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c4198fb-cc63-4d42-8468-fa924a321a76 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 01 19:38:49 user nova-compute[75066]:  {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:38:49 user nova-compute[75066]: WARNING os_brick.initiator.connectors.iscsi [None req-5c4198fb-cc63-4d42-8468-fa924a321a76 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 01 19:38:49 user nova-compute[75066]: 
Dec 01 19:38:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1389ab63-0286-4fff-917a-5f3989fa127d -p 172.16.0.220:3260 --login {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:38:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1389ab63-0286-4fff-917a-5f3989fa127d -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:38:49 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[1500c8ec-a7c6-4866-8942-73de2b81f79e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1389ab63-0286-4fff-917a-5f3989fa127d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1389ab63-0286-4fff-917a-5f3989fa127d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:38:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c4198fb-cc63-4d42-8468-fa924a321a76 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1389ab63-0286-4fff-917a-5f3989fa127d, portal: 172.16.0.220,3260]
Dec 01 19:38:49 user nova-compute[75066]: Login to [iface: default, target: iqn.2010-10.org.openstack:1389ab63-0286-4fff-917a-5f3989fa127d, portal: 172.16.0.220,3260] successful.
Dec 01 19:38:49 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:38:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1389ab63-0286-4fff-917a-5f3989fa127d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:38:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1389ab63-0286-4fff-917a-5f3989fa127d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:38:49 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e0e905-96bb-4644-baf4-92b0309ed05b]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:38:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c4198fb-cc63-4d42-8468-fa924a321a76 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:38:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:38:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:38:49 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[42703e97-90e0-4679-98dd-b04b8910d068]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1389ab63-0286-4fff-917a-5f3989fa127d (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:38:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c4198fb-cc63-4d42-8468-fa924a321a76 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1389ab63-0286-4fff-917a-5f3989fa127d (non-flash)
Dec 01 19:38:49 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:38:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c4198fb-cc63-4d42-8468-fa924a321a76 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1389ab63-0286-4fff-917a-5f3989fa127d (non-flash)
Dec 01 19:38:49 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:38:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-5c4198fb-cc63-4d42-8468-fa924a321a76 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1389ab63-0286-4fff-917a-5f3989fa127d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:38:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c4198fb-cc63-4d42-8468-fa924a321a76 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Connected to 172.16.0.220:3260 {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 19:38:49 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-5c4198fb-cc63-4d42-8468-fa924a321a76 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=75066) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 19:38:49 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-5c4198fb-cc63-4d42-8468-fa924a321a76 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75066) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 19:38:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:38:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:38:49 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[19288333-16bb-443d-9938-cf375a7d52b6]: (4, ('- - 0', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:38:49 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-5c4198fb-cc63-4d42-8468-fa924a321a76 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: None {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:38:50 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-5c4198fb-cc63-4d42-8468-fa924a321a76 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:38:50 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c4198fb-cc63-4d42-8468-fa924a321a76 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:1389ab63-0286-4fff-917a-5f3989fa127d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QyadDcrC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 19:38:50 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-5c4198fb-cc63-4d42-8468-fa924a321a76 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.282s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:38:50 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c4198fb-cc63-4d42-8468-fa924a321a76 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '26561363131313732', 'path': '/dev/sdb'} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:38:50 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c4198fb-cc63-4d42-8468-fa924a321a76 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26561363131313732', 'path': '/dev/sdb'} {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 19:38:50 user nova-compute[75066]: DEBUG nova.objects.instance [None req-5c4198fb-cc63-4d42-8468-fa924a321a76 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Lazy-loading 'flavor' on Instance uuid cac44489-2374-4478-842b-0722dd4fe2db {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:38:50 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-5c4198fb-cc63-4d42-8468-fa924a321a76 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 19:38:50 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:38:50 user nova-compute[75066]:   <source dev="/dev/sdb"/>
Dec 01 19:38:50 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:38:50 user nova-compute[75066]:   <serial>1389ab63-0286-4fff-917a-5f3989fa127d</serial>
Dec 01 19:38:50 user nova-compute[75066]: </disk>
Dec 01 19:38:50 user nova-compute[75066]:  {{(pid=75066) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 19:38:50 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-5c4198fb-cc63-4d42-8468-fa924a321a76 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:38:50 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-5c4198fb-cc63-4d42-8468-fa924a321a76 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:38:50 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-5c4198fb-cc63-4d42-8468-fa924a321a76 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] No VIF found with MAC fa:16:3e:18:64:a8, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:38:50 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-5c4198fb-cc63-4d42-8468-fa924a321a76 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Lock "cac44489-2374-4478-842b-0722dd4fe2db" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.518s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:38:52 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-79f56fa5-5c84-4b0f-9a9e-036813a55afb tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Acquiring lock "cac44489-2374-4478-842b-0722dd4fe2db" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:38:52 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-79f56fa5-5c84-4b0f-9a9e-036813a55afb tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Lock "cac44489-2374-4478-842b-0722dd4fe2db" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:38:52 user nova-compute[75066]: INFO nova.compute.manager [None req-79f56fa5-5c84-4b0f-9a9e-036813a55afb tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Detaching volume 1389ab63-0286-4fff-917a-5f3989fa127d
Dec 01 19:38:52 user nova-compute[75066]: INFO nova.virt.block_device [None req-79f56fa5-5c84-4b0f-9a9e-036813a55afb tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Attempting to driver detach volume 1389ab63-0286-4fff-917a-5f3989fa127d from mountpoint /dev/vdb
Dec 01 19:38:52 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-79f56fa5-5c84-4b0f-9a9e-036813a55afb tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Attempting to detach device vdb from instance cac44489-2374-4478-842b-0722dd4fe2db from the persistent domain config. {{(pid=75066) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 19:38:52 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-79f56fa5-5c84-4b0f-9a9e-036813a55afb tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 19:38:52 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:38:52 user nova-compute[75066]:   <source dev="/dev/sdb"/>
Dec 01 19:38:52 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:38:52 user nova-compute[75066]:   <serial>1389ab63-0286-4fff-917a-5f3989fa127d</serial>
Dec 01 19:38:52 user nova-compute[75066]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 19:38:52 user nova-compute[75066]: </disk>
Dec 01 19:38:52 user nova-compute[75066]:  {{(pid=75066) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 19:38:52 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-79f56fa5-5c84-4b0f-9a9e-036813a55afb tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Successfully detached device vdb from instance cac44489-2374-4478-842b-0722dd4fe2db from the persistent domain config.
Dec 01 19:38:52 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-79f56fa5-5c84-4b0f-9a9e-036813a55afb tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cac44489-2374-4478-842b-0722dd4fe2db from the live domain config. {{(pid=75066) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 19:38:52 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-79f56fa5-5c84-4b0f-9a9e-036813a55afb tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 19:38:52 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:38:52 user nova-compute[75066]:   <source dev="/dev/sdb"/>
Dec 01 19:38:52 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:38:52 user nova-compute[75066]:   <serial>1389ab63-0286-4fff-917a-5f3989fa127d</serial>
Dec 01 19:38:52 user nova-compute[75066]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 19:38:52 user nova-compute[75066]: </disk>
Dec 01 19:38:52 user nova-compute[75066]:  {{(pid=75066) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 19:38:52 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-79f56fa5-5c84-4b0f-9a9e-036813a55afb tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cac44489-2374-4478-842b-0722dd4fe2db {{(pid=75066) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 19:38:53 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:38:53 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:38:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-46ebbabb-07ec-4a35-91a4-44c3eb96fdaa tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Acquiring lock "88850ea1-43cd-4066-8e6f-cfe5de621bc6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:38:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-46ebbabb-07ec-4a35-91a4-44c3eb96fdaa tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Lock "88850ea1-43cd-4066-8e6f-cfe5de621bc6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:38:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-46ebbabb-07ec-4a35-91a4-44c3eb96fdaa tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Acquiring lock "88850ea1-43cd-4066-8e6f-cfe5de621bc6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:38:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-46ebbabb-07ec-4a35-91a4-44c3eb96fdaa tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Lock "88850ea1-43cd-4066-8e6f-cfe5de621bc6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:38:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-46ebbabb-07ec-4a35-91a4-44c3eb96fdaa tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Lock "88850ea1-43cd-4066-8e6f-cfe5de621bc6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:38:54 user nova-compute[75066]: INFO nova.compute.manager [None req-46ebbabb-07ec-4a35-91a4-44c3eb96fdaa tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] Terminating instance
Dec 01 19:38:54 user nova-compute[75066]: DEBUG nova.compute.manager [None req-46ebbabb-07ec-4a35-91a4-44c3eb96fdaa tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] Start destroying the instance on the hypervisor. {{(pid=75066) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 19:38:54 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:38:54 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:38:54 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:38:54 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:38:54 user nova-compute[75066]: DEBUG nova.compute.manager [req-9f952b47-7e6e-4479-9f0a-dc3e213bee21 req-59dff6a7-f3b9-44ac-8259-fd2139945e87 service nova] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] Received event network-vif-unplugged-b39d66c2-c9c7-4b66-af8e-5ec0c23a997e {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:38:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-9f952b47-7e6e-4479-9f0a-dc3e213bee21 req-59dff6a7-f3b9-44ac-8259-fd2139945e87 service nova] Acquiring lock "88850ea1-43cd-4066-8e6f-cfe5de621bc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:38:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-9f952b47-7e6e-4479-9f0a-dc3e213bee21 req-59dff6a7-f3b9-44ac-8259-fd2139945e87 service nova] Lock "88850ea1-43cd-4066-8e6f-cfe5de621bc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:38:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-9f952b47-7e6e-4479-9f0a-dc3e213bee21 req-59dff6a7-f3b9-44ac-8259-fd2139945e87 service nova] Lock "88850ea1-43cd-4066-8e6f-cfe5de621bc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:38:54 user nova-compute[75066]: DEBUG nova.compute.manager [req-9f952b47-7e6e-4479-9f0a-dc3e213bee21 req-59dff6a7-f3b9-44ac-8259-fd2139945e87 service nova] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] No waiting events found dispatching network-vif-unplugged-b39d66c2-c9c7-4b66-af8e-5ec0c23a997e {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:38:54 user nova-compute[75066]: DEBUG nova.compute.manager [req-9f952b47-7e6e-4479-9f0a-dc3e213bee21 req-59dff6a7-f3b9-44ac-8259-fd2139945e87 service nova] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] Received event network-vif-unplugged-b39d66c2-c9c7-4b66-af8e-5ec0c23a997e for instance with task_state deleting. {{(pid=75066) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 19:38:55 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] Instance destroyed successfully.
Dec 01 19:38:55 user nova-compute[75066]: DEBUG nova.objects.instance [None req-46ebbabb-07ec-4a35-91a4-44c3eb96fdaa tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Lazy-loading 'resources' on Instance uuid 88850ea1-43cd-4066-8e6f-cfe5de621bc6 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:38:55 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-46ebbabb-07ec-4a35-91a4-44c3eb96fdaa tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:30:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-317889789',display_name='tempest-ServersNegativeTestJSON-server-317889789',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-317889789',id=33,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:30:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c9f677c9e8c24b7389273db9d82954fe',ramdisk_id='',reservation_id='r-0t7eb5c6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1315108451',owner_user_name='tempest-ServersNegativeTestJSON-1315108451-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:30:12Z,user_data=None,user_id='14735fcf06cb45519d9fd71975871a62',uuid=88850ea1-43cd-4066-8e6f-cfe5de621bc6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b39d66c2-c9c7-4b66-af8e-5ec0c23a997e", "address": "fa:16:3e:19:e0:f5", "network": {"id": "884b20a8-4ead-448d-994b-8e714dc32fae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-357575766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9f677c9e8c24b7389273db9d82954fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb39d66c2-c9", "ovs_interfaceid": "b39d66c2-c9c7-4b66-af8e-5ec0c23a997e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:38:55 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-46ebbabb-07ec-4a35-91a4-44c3eb96fdaa tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Converting VIF {"id": "b39d66c2-c9c7-4b66-af8e-5ec0c23a997e", "address": "fa:16:3e:19:e0:f5", "network": {"id": "884b20a8-4ead-448d-994b-8e714dc32fae", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-357575766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c9f677c9e8c24b7389273db9d82954fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb39d66c2-c9", "ovs_interfaceid": "b39d66c2-c9c7-4b66-af8e-5ec0c23a997e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:38:55 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-46ebbabb-07ec-4a35-91a4-44c3eb96fdaa tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:19:e0:f5,bridge_name='br-int',has_traffic_filtering=True,id=b39d66c2-c9c7-4b66-af8e-5ec0c23a997e,network=Network(884b20a8-4ead-448d-994b-8e714dc32fae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb39d66c2-c9') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:38:55 user nova-compute[75066]: DEBUG os_vif [None req-46ebbabb-07ec-4a35-91a4-44c3eb96fdaa tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:e0:f5,bridge_name='br-int',has_traffic_filtering=True,id=b39d66c2-c9c7-4b66-af8e-5ec0c23a997e,network=Network(884b20a8-4ead-448d-994b-8e714dc32fae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb39d66c2-c9') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:38:55 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:38:55 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb39d66c2-c9, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:38:55 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:38:55 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:38:55 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:38:55 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=467d8355-04f4-4ccb-984b-4ed47a9c1d05) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:38:55 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:38:55 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:38:55 user nova-compute[75066]: INFO os_vif [None req-46ebbabb-07ec-4a35-91a4-44c3eb96fdaa tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:e0:f5,bridge_name='br-int',has_traffic_filtering=True,id=b39d66c2-c9c7-4b66-af8e-5ec0c23a997e,network=Network(884b20a8-4ead-448d-994b-8e714dc32fae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb39d66c2-c9')
Dec 01 19:38:55 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-46ebbabb-07ec-4a35-91a4-44c3eb96fdaa tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] Deleting instance files /opt/stack/data/nova/instances/88850ea1-43cd-4066-8e6f-cfe5de621bc6_del
Dec 01 19:38:55 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-46ebbabb-07ec-4a35-91a4-44c3eb96fdaa tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] Deletion of /opt/stack/data/nova/instances/88850ea1-43cd-4066-8e6f-cfe5de621bc6_del complete
Dec 01 19:38:55 user nova-compute[75066]: INFO nova.compute.manager [None req-46ebbabb-07ec-4a35-91a4-44c3eb96fdaa tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] Took 0.98 seconds to destroy the instance on the hypervisor.
Dec 01 19:38:55 user nova-compute[75066]: DEBUG oslo.service.loopingcall [None req-46ebbabb-07ec-4a35-91a4-44c3eb96fdaa tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75066) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 19:38:55 user nova-compute[75066]: DEBUG nova.compute.manager [-] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] Deallocating network for instance {{(pid=75066) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 19:38:55 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] deallocate_for_instance() {{(pid=75066) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 19:38:56 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:38:56 user nova-compute[75066]: INFO nova.compute.manager [-] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] Took 0.50 seconds to deallocate network for instance.
Dec 01 19:38:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-46ebbabb-07ec-4a35-91a4-44c3eb96fdaa tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:38:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-46ebbabb-07ec-4a35-91a4-44c3eb96fdaa tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:38:56 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-46ebbabb-07ec-4a35-91a4-44c3eb96fdaa tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:38:56 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-46ebbabb-07ec-4a35-91a4-44c3eb96fdaa tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:38:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-46ebbabb-07ec-4a35-91a4-44c3eb96fdaa tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.195s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:38:56 user nova-compute[75066]: INFO nova.scheduler.client.report [None req-46ebbabb-07ec-4a35-91a4-44c3eb96fdaa tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Deleted allocations for instance 88850ea1-43cd-4066-8e6f-cfe5de621bc6
Dec 01 19:38:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-46ebbabb-07ec-4a35-91a4-44c3eb96fdaa tempest-ServersNegativeTestJSON-1315108451 tempest-ServersNegativeTestJSON-1315108451-project-member] Lock "88850ea1-43cd-4066-8e6f-cfe5de621bc6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.865s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:38:56 user nova-compute[75066]: DEBUG nova.compute.manager [req-d1208f2e-6ff6-4956-957f-491d9407787f req-add6bbfa-addc-426d-93ae-6d725ecf5158 service nova] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] Received event network-vif-plugged-b39d66c2-c9c7-4b66-af8e-5ec0c23a997e {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:38:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d1208f2e-6ff6-4956-957f-491d9407787f req-add6bbfa-addc-426d-93ae-6d725ecf5158 service nova] Acquiring lock "88850ea1-43cd-4066-8e6f-cfe5de621bc6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:38:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d1208f2e-6ff6-4956-957f-491d9407787f req-add6bbfa-addc-426d-93ae-6d725ecf5158 service nova] Lock "88850ea1-43cd-4066-8e6f-cfe5de621bc6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:38:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d1208f2e-6ff6-4956-957f-491d9407787f req-add6bbfa-addc-426d-93ae-6d725ecf5158 service nova] Lock "88850ea1-43cd-4066-8e6f-cfe5de621bc6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:38:56 user nova-compute[75066]: DEBUG nova.compute.manager [req-d1208f2e-6ff6-4956-957f-491d9407787f req-add6bbfa-addc-426d-93ae-6d725ecf5158 service nova] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] No waiting events found dispatching network-vif-plugged-b39d66c2-c9c7-4b66-af8e-5ec0c23a997e {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:38:56 user nova-compute[75066]: WARNING nova.compute.manager [req-d1208f2e-6ff6-4956-957f-491d9407787f req-add6bbfa-addc-426d-93ae-6d725ecf5158 service nova] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] Received unexpected event network-vif-plugged-b39d66c2-c9c7-4b66-af8e-5ec0c23a997e for instance with vm_state deleted and task_state None.
Dec 01 19:38:56 user nova-compute[75066]: DEBUG nova.compute.manager [req-d1208f2e-6ff6-4956-957f-491d9407787f req-add6bbfa-addc-426d-93ae-6d725ecf5158 service nova] [instance: 88850ea1-43cd-4066-8e6f-cfe5de621bc6] Received event network-vif-deleted-b39d66c2-c9c7-4b66-af8e-5ec0c23a997e {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:38:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:39:00 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:39:00 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:39:03 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:39:04 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:39:05 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:39:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:39:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:39:11 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:39:12 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-79f56fa5-5c84-4b0f-9a9e-036813a55afb tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cac44489-2374-4478-842b-0722dd4fe2db is timed out.
Dec 01 19:39:12 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-79f56fa5-5c84-4b0f-9a9e-036813a55afb tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Successfully detached device vdb from instance cac44489-2374-4478-842b-0722dd4fe2db from the live domain config.
Dec 01 19:39:12 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79f56fa5-5c84-4b0f-9a9e-036813a55afb tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] [instance: cac44489-2374-4478-842b-0722dd4fe2db] calling os-brick to detach iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 19:39:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-79f56fa5-5c84-4b0f-9a9e-036813a55afb tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, {'target_iqn': 'iqn.2010-10.org.openstack:1389ab63-0286-4fff-917a-5f3989fa127d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QyadDcrC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:39:12 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-79f56fa5-5c84-4b0f-9a9e-036813a55afb tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:39:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-79f56fa5-5c84-4b0f-9a9e-036813a55afb tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:39:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-79f56fa5-5c84-4b0f-9a9e-036813a55afb tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:39:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:39:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:39:12 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d54de3-5530-448c-8b51-1e90d2f3e0b6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:1389ab63-0286-4fff-917a-5f3989fa127d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:39:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-79f56fa5-5c84-4b0f-9a9e-036813a55afb tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 19:39:12 user nova-compute[75066]: No targets found.
Dec 01 19:39:12 user nova-compute[75066]: iSNS:
Dec 01 19:39:12 user nova-compute[75066]: No targets found.
Dec 01 19:39:12 user nova-compute[75066]: STATIC:
Dec 01 19:39:12 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:1389ab63-0286-4fff-917a-5f3989fa127d
Dec 01 19:39:12 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:39:12 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:39:12 user nova-compute[75066]: FIRMWARE:
Dec 01 19:39:12 user nova-compute[75066]: No targets found.
Dec 01 19:39:12 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:39:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-79f56fa5-5c84-4b0f-9a9e-036813a55afb tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 19:39:12 user nova-compute[75066]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 19:39:12 user nova-compute[75066]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75066) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 19:39:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-79f56fa5-5c84-4b0f-9a9e-036813a55afb tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1389ab63-0286-4fff-917a-5f3989fa127d', 0)] {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 19:39:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:39:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:39:12 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[d604264a-085e-46c1-b8aa-85c3aa4ea72d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1389ab63-0286-4fff-917a-5f3989fa127d\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:39:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:39:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:39:12 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[82448e7e-5114-404a-b190-e98e4dcf6282]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1389ab63-0286-4fff-917a-5f3989fa127d (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:39:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-79f56fa5-5c84-4b0f-9a9e-036813a55afb tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1389ab63-0286-4fff-917a-5f3989fa127d (non-flash)
Dec 01 19:39:12 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:39:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-79f56fa5-5c84-4b0f-9a9e-036813a55afb tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1389ab63-0286-4fff-917a-5f3989fa127d (non-flash)
Dec 01 19:39:12 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:39:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-79f56fa5-5c84-4b0f-9a9e-036813a55afb tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9170504160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1389ab63-0286-4fff-917a-5f3989fa127d'): ({'sdb'}, set())}) {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 19:39:12 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-79f56fa5-5c84-4b0f-9a9e-036813a55afb tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Removing single pathed devices sdb {{(pid=75066) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 19:39:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:39:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:39:12 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29699a8-271b-4431-91b0-8e9e1e031e70]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:39:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:39:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:39:12 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5cc3c3-865d-494b-ab6c-be65323ed934]: (4, ('ok\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:39:12 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-79f56fa5-5c84-4b0f-9a9e-036813a55afb tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Flushing IO for device /dev/sdb {{(pid=75066) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 19:39:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:39:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:39:12 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[090c060d-942a-44bd-8ef3-8cfddbacf4f9]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:39:12 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-79f56fa5-5c84-4b0f-9a9e-036813a55afb tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75066) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 19:39:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:39:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:39:12 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[7029a51b-4b2e-4094-96cf-b33db3fbf447]: (4, ('1', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:39:12 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-79f56fa5-5c84-4b0f-9a9e-036813a55afb tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 19:39:12 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-79f56fa5-5c84-4b0f-9a9e-036813a55afb tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] SCSI volumes sdb have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 19:39:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-79f56fa5-5c84-4b0f-9a9e-036813a55afb tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1389ab63-0286-4fff-917a-5f3989fa127d')] {{(pid=75066) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 19:39:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1389ab63-0286-4fff-917a-5f3989fa127d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:39:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1389ab63-0286-4fff-917a-5f3989fa127d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:39:12 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a7b08a-69a6-4698-8d88-614ff5114a05]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:39:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-79f56fa5-5c84-4b0f-9a9e-036813a55afb tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:39:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1389ab63-0286-4fff-917a-5f3989fa127d -p 172.16.0.220:3260 --logout {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:39:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1389ab63-0286-4fff-917a-5f3989fa127d -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:39:12 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4f075b-790c-4d35-bc66-ecedb09d76da]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:1389ab63-0286-4fff-917a-5f3989fa127d, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:1389ab63-0286-4fff-917a-5f3989fa127d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:39:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-79f56fa5-5c84-4b0f-9a9e-036813a55afb tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:1389ab63-0286-4fff-917a-5f3989fa127d, portal: 172.16.0.220,3260]
Dec 01 19:39:12 user nova-compute[75066]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:1389ab63-0286-4fff-917a-5f3989fa127d, portal: 172.16.0.220,3260] successful.
Dec 01 19:39:12 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:39:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1389ab63-0286-4fff-917a-5f3989fa127d -p 172.16.0.220:3260 --op delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:39:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1389ab63-0286-4fff-917a-5f3989fa127d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:39:12 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[16cf164d-70fc-43f1-8f5a-86dd97dfa4fe]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:39:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-79f56fa5-5c84-4b0f-9a9e-036813a55afb tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:39:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-79f56fa5-5c84-4b0f-9a9e-036813a55afb tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:39:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-79f56fa5-5c84-4b0f-9a9e-036813a55afb tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] <== disconnect_volume: return (309ms) None {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:39:12 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79f56fa5-5c84-4b0f-9a9e-036813a55afb tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Disconnected iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 19:39:15 user nova-compute[75066]: DEBUG nova.objects.instance [None req-79f56fa5-5c84-4b0f-9a9e-036813a55afb tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Lazy-loading 'flavor' on Instance uuid cac44489-2374-4478-842b-0722dd4fe2db {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:39:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-79f56fa5-5c84-4b0f-9a9e-036813a55afb tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Lock "cac44489-2374-4478-842b-0722dd4fe2db" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.027s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:39:15 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:39:15 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75066) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 19:39:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:39:17 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:39:17 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:39:20 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:39:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:39:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:39:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:39:20 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75066) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 19:39:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:39:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:39:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:39:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:39:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:39:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cac44489-2374-4478-842b-0722dd4fe2db/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:39:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cac44489-2374-4478-842b-0722dd4fe2db/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:39:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cac44489-2374-4478-842b-0722dd4fe2db/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:39:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cac44489-2374-4478-842b-0722dd4fe2db/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:39:21 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:39:21 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:39:21 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Hypervisor/Node resource view: name=user free_ram=8728MB free_disk=24.930240631103516GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75066) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 19:39:21 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:39:21 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:39:21 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance cac44489-2374-4478-842b-0722dd4fe2db actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:39:21 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:39:21 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 19:39:21 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 19:39:21 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:39:21 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:39:21 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Compute_service record updated for user:user {{(pid=75066) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 19:39:21 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.221s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:39:22 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:39:23 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:39:23 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Starting heal instance info cache {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 19:39:23 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "refresh_cache-cac44489-2374-4478-842b-0722dd4fe2db" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:39:23 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquired lock "refresh_cache-cac44489-2374-4478-842b-0722dd4fe2db" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:39:23 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Forcefully refreshing network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 19:39:23 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Updating instance_info_cache with network_info: [{"id": "2f5ab3de-24e6-4c17-9628-879ce59eacd2", "address": "fa:16:3e:18:64:a8", "network": {"id": "27d425c3-c498-4479-86d7-8d520a2e5bf9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1954318568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6afe015769943c28f090535f675eed5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f5ab3de-24", "ovs_interfaceid": "2f5ab3de-24e6-4c17-9628-879ce59eacd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:39:23 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Releasing lock "refresh_cache-cac44489-2374-4478-842b-0722dd4fe2db" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:39:23 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Updated the network info_cache for instance {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 19:39:23 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:39:24 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:39:25 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:39:26 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:39:29 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:39:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:39:35 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:39:40 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:39:40 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:39:42 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:39:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:39:45 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:39:45 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:39:47 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:39:48 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:39:48 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-13bcdae5-3ce5-4567-8588-c736cc12aba4 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Acquiring lock "cac44489-2374-4478-842b-0722dd4fe2db" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:39:48 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-13bcdae5-3ce5-4567-8588-c736cc12aba4 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Lock "cac44489-2374-4478-842b-0722dd4fe2db" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:39:48 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-13bcdae5-3ce5-4567-8588-c736cc12aba4 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Acquiring lock "cac44489-2374-4478-842b-0722dd4fe2db-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:39:48 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-13bcdae5-3ce5-4567-8588-c736cc12aba4 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Lock "cac44489-2374-4478-842b-0722dd4fe2db-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:39:48 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-13bcdae5-3ce5-4567-8588-c736cc12aba4 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Lock "cac44489-2374-4478-842b-0722dd4fe2db-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:39:48 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:39:48 user nova-compute[75066]: INFO nova.compute.manager [None req-13bcdae5-3ce5-4567-8588-c736cc12aba4 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Terminating instance
Dec 01 19:39:48 user nova-compute[75066]: DEBUG nova.compute.manager [None req-13bcdae5-3ce5-4567-8588-c736cc12aba4 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Start destroying the instance on the hypervisor. {{(pid=75066) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 19:39:49 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:39:49 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:39:49 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:39:49 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:39:49 user nova-compute[75066]: DEBUG nova.compute.manager [req-68526e89-8c2e-49d0-9c8b-c27ce23200b4 req-205626c6-cfd2-4a43-bdc5-18671154450e service nova] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Received event network-vif-unplugged-2f5ab3de-24e6-4c17-9628-879ce59eacd2 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:39:49 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-68526e89-8c2e-49d0-9c8b-c27ce23200b4 req-205626c6-cfd2-4a43-bdc5-18671154450e service nova] Acquiring lock "cac44489-2374-4478-842b-0722dd4fe2db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:39:49 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-68526e89-8c2e-49d0-9c8b-c27ce23200b4 req-205626c6-cfd2-4a43-bdc5-18671154450e service nova] Lock "cac44489-2374-4478-842b-0722dd4fe2db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:39:49 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-68526e89-8c2e-49d0-9c8b-c27ce23200b4 req-205626c6-cfd2-4a43-bdc5-18671154450e service nova] Lock "cac44489-2374-4478-842b-0722dd4fe2db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:39:49 user nova-compute[75066]: DEBUG nova.compute.manager [req-68526e89-8c2e-49d0-9c8b-c27ce23200b4 req-205626c6-cfd2-4a43-bdc5-18671154450e service nova] [instance: cac44489-2374-4478-842b-0722dd4fe2db] No waiting events found dispatching network-vif-unplugged-2f5ab3de-24e6-4c17-9628-879ce59eacd2 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:39:49 user nova-compute[75066]: DEBUG nova.compute.manager [req-68526e89-8c2e-49d0-9c8b-c27ce23200b4 req-205626c6-cfd2-4a43-bdc5-18671154450e service nova] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Received event network-vif-unplugged-2f5ab3de-24e6-4c17-9628-879ce59eacd2 for instance with task_state deleting. {{(pid=75066) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 19:39:49 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Instance destroyed successfully.
Dec 01 19:39:49 user nova-compute[75066]: DEBUG nova.objects.instance [None req-13bcdae5-3ce5-4567-8588-c736cc12aba4 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Lazy-loading 'resources' on Instance uuid cac44489-2374-4478-842b-0722dd4fe2db {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:39:49 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-13bcdae5-3ce5-4567-8588-c736cc12aba4 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:36:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-324682266',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-324682266',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-3246822',id=38,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBElHYKDuOZysZiJNDv4mkRT086UZjPDK5SqqmH+PnySoiwpNKzTZBq4EkN4TNnKBwX/PfecaqsELmwaS5GZiui/Lvji/JNcZBqTxP4f7vHAuvlcTXnQilYi8BM2nwW8dHA==',key_name='tempest-keypair-257222686',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:36:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e6afe015769943c28f090535f675eed5',ramdisk_id='',reservation_id='r-rabfidwd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-950451626',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:36:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='16c4932955fe48cfaefc0844ed6cbd73',uuid=cac44489-2374-4478-842b-0722dd4fe2db,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f5ab3de-24e6-4c17-9628-879ce59eacd2", "address": "fa:16:3e:18:64:a8", "network": {"id": "27d425c3-c498-4479-86d7-8d520a2e5bf9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1954318568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6afe015769943c28f090535f675eed5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f5ab3de-24", "ovs_interfaceid": "2f5ab3de-24e6-4c17-9628-879ce59eacd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:39:49 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-13bcdae5-3ce5-4567-8588-c736cc12aba4 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Converting VIF {"id": "2f5ab3de-24e6-4c17-9628-879ce59eacd2", "address": "fa:16:3e:18:64:a8", "network": {"id": "27d425c3-c498-4479-86d7-8d520a2e5bf9", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1954318568-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e6afe015769943c28f090535f675eed5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f5ab3de-24", "ovs_interfaceid": "2f5ab3de-24e6-4c17-9628-879ce59eacd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:39:49 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-13bcdae5-3ce5-4567-8588-c736cc12aba4 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:18:64:a8,bridge_name='br-int',has_traffic_filtering=True,id=2f5ab3de-24e6-4c17-9628-879ce59eacd2,network=Network(27d425c3-c498-4479-86d7-8d520a2e5bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f5ab3de-24') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:39:49 user nova-compute[75066]: DEBUG os_vif [None req-13bcdae5-3ce5-4567-8588-c736cc12aba4 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:64:a8,bridge_name='br-int',has_traffic_filtering=True,id=2f5ab3de-24e6-4c17-9628-879ce59eacd2,network=Network(27d425c3-c498-4479-86d7-8d520a2e5bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f5ab3de-24') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:39:49 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:39:49 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2f5ab3de-24, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:39:49 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:39:49 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:39:49 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:39:49 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=701214dd-45d7-43de-bdf3-b42d7af0e04f) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:39:49 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:39:49 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:39:49 user nova-compute[75066]: INFO os_vif [None req-13bcdae5-3ce5-4567-8588-c736cc12aba4 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:64:a8,bridge_name='br-int',has_traffic_filtering=True,id=2f5ab3de-24e6-4c17-9628-879ce59eacd2,network=Network(27d425c3-c498-4479-86d7-8d520a2e5bf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f5ab3de-24')
Dec 01 19:39:49 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-13bcdae5-3ce5-4567-8588-c736cc12aba4 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Deleting instance files /opt/stack/data/nova/instances/cac44489-2374-4478-842b-0722dd4fe2db_del
Dec 01 19:39:49 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-13bcdae5-3ce5-4567-8588-c736cc12aba4 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Deletion of /opt/stack/data/nova/instances/cac44489-2374-4478-842b-0722dd4fe2db_del complete
Dec 01 19:39:49 user nova-compute[75066]: INFO nova.compute.manager [None req-13bcdae5-3ce5-4567-8588-c736cc12aba4 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Took 0.88 seconds to destroy the instance on the hypervisor.
Dec 01 19:39:49 user nova-compute[75066]: DEBUG oslo.service.loopingcall [None req-13bcdae5-3ce5-4567-8588-c736cc12aba4 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75066) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 19:39:49 user nova-compute[75066]: DEBUG nova.compute.manager [-] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Deallocating network for instance {{(pid=75066) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 19:39:49 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: cac44489-2374-4478-842b-0722dd4fe2db] deallocate_for_instance() {{(pid=75066) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 19:39:50 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:39:50 user nova-compute[75066]: INFO nova.compute.manager [-] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Took 0.83 seconds to deallocate network for instance.
Dec 01 19:39:50 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-13bcdae5-3ce5-4567-8588-c736cc12aba4 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:39:50 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-13bcdae5-3ce5-4567-8588-c736cc12aba4 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:39:50 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-13bcdae5-3ce5-4567-8588-c736cc12aba4 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:39:50 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-13bcdae5-3ce5-4567-8588-c736cc12aba4 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:39:50 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-13bcdae5-3ce5-4567-8588-c736cc12aba4 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.161s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:39:50 user nova-compute[75066]: INFO nova.scheduler.client.report [None req-13bcdae5-3ce5-4567-8588-c736cc12aba4 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Deleted allocations for instance cac44489-2374-4478-842b-0722dd4fe2db
Dec 01 19:39:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-13bcdae5-3ce5-4567-8588-c736cc12aba4 tempest-TestServerVolumeAttachScenarioOldVersion-950451626 tempest-TestServerVolumeAttachScenarioOldVersion-950451626-project-member] Lock "cac44489-2374-4478-842b-0722dd4fe2db" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.100s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:39:51 user nova-compute[75066]: DEBUG nova.compute.manager [req-a6eb0530-d9c5-4b25-b17e-3ad666b56a42 req-d56060c2-5fc9-4b52-9bf4-005ed4b03473 service nova] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Received event network-vif-plugged-2f5ab3de-24e6-4c17-9628-879ce59eacd2 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:39:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a6eb0530-d9c5-4b25-b17e-3ad666b56a42 req-d56060c2-5fc9-4b52-9bf4-005ed4b03473 service nova] Acquiring lock "cac44489-2374-4478-842b-0722dd4fe2db-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:39:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a6eb0530-d9c5-4b25-b17e-3ad666b56a42 req-d56060c2-5fc9-4b52-9bf4-005ed4b03473 service nova] Lock "cac44489-2374-4478-842b-0722dd4fe2db-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:39:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a6eb0530-d9c5-4b25-b17e-3ad666b56a42 req-d56060c2-5fc9-4b52-9bf4-005ed4b03473 service nova] Lock "cac44489-2374-4478-842b-0722dd4fe2db-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:39:51 user nova-compute[75066]: DEBUG nova.compute.manager [req-a6eb0530-d9c5-4b25-b17e-3ad666b56a42 req-d56060c2-5fc9-4b52-9bf4-005ed4b03473 service nova] [instance: cac44489-2374-4478-842b-0722dd4fe2db] No waiting events found dispatching network-vif-plugged-2f5ab3de-24e6-4c17-9628-879ce59eacd2 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:39:51 user nova-compute[75066]: WARNING nova.compute.manager [req-a6eb0530-d9c5-4b25-b17e-3ad666b56a42 req-d56060c2-5fc9-4b52-9bf4-005ed4b03473 service nova] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Received unexpected event network-vif-plugged-2f5ab3de-24e6-4c17-9628-879ce59eacd2 for instance with vm_state deleted and task_state None.
Dec 01 19:39:51 user nova-compute[75066]: DEBUG nova.compute.manager [req-a6eb0530-d9c5-4b25-b17e-3ad666b56a42 req-d56060c2-5fc9-4b52-9bf4-005ed4b03473 service nova] [instance: cac44489-2374-4478-842b-0722dd4fe2db] Received event network-vif-deleted-2f5ab3de-24e6-4c17-9628-879ce59eacd2 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:39:53 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:39:54 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:39:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Acquiring lock "544d6830-e6cf-4c06-95b3-151da602bc6d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:39:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lock "544d6830-e6cf-4c06-95b3-151da602bc6d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:39:54 user nova-compute[75066]: DEBUG nova.compute.manager [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Starting instance... {{(pid=75066) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 19:39:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:39:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:39:54 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75066) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 19:39:54 user nova-compute[75066]: INFO nova.compute.claims [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Claim successful on node user
Dec 01 19:39:54 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:39:54 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:39:54 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:39:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.238s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:39:54 user nova-compute[75066]: DEBUG nova.compute.manager [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Start building networks asynchronously for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 19:39:54 user nova-compute[75066]: DEBUG nova.compute.manager [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Allocating IP information in the background. {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 19:39:54 user nova-compute[75066]: DEBUG nova.network.neutron [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] allocate_for_instance() {{(pid=75066) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 19:39:54 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 19:39:54 user nova-compute[75066]: DEBUG nova.compute.manager [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Start building block device mappings for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 19:39:55 user nova-compute[75066]: DEBUG nova.policy [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '928459d1f7dd4705bc3e6f3de827fe30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b227dfb7ede2407ba03f2840bc5de4f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75066) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 19:39:55 user nova-compute[75066]: DEBUG nova.compute.manager [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Start spawning the instance on the hypervisor. {{(pid=75066) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 19:39:55 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Creating instance directory {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 19:39:55 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Creating image(s)
Dec 01 19:39:55 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Acquiring lock "/opt/stack/data/nova/instances/544d6830-e6cf-4c06-95b3-151da602bc6d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:39:55 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lock "/opt/stack/data/nova/instances/544d6830-e6cf-4c06-95b3-151da602bc6d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:39:55 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lock "/opt/stack/data/nova/instances/544d6830-e6cf-4c06-95b3-151da602bc6d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:39:55 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:39:55 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.182s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:39:55 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Acquiring lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:39:55 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:39:55 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:39:55 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.186s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:39:55 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/544d6830-e6cf-4c06-95b3-151da602bc6d/disk 1073741824 {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:39:55 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/544d6830-e6cf-4c06-95b3-151da602bc6d/disk 1073741824" returned: 0 in 0.051s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:39:55 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:39:55 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:39:55 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.166s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:39:55 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Checking if we can resize image /opt/stack/data/nova/instances/544d6830-e6cf-4c06-95b3-151da602bc6d/disk. size=1073741824 {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 19:39:55 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/544d6830-e6cf-4c06-95b3-151da602bc6d/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:39:55 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/544d6830-e6cf-4c06-95b3-151da602bc6d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:39:55 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Cannot resize image /opt/stack/data/nova/instances/544d6830-e6cf-4c06-95b3-151da602bc6d/disk to a smaller size. {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 19:39:55 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Created local disks {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 19:39:55 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Ensure instance console log exists: /opt/stack/data/nova/instances/544d6830-e6cf-4c06-95b3-151da602bc6d/console.log {{(pid=75066) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 19:39:55 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:39:55 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:39:55 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:39:56 user nova-compute[75066]: DEBUG nova.network.neutron [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Successfully created port: 6a67de06-74d9-4b6a-ae10-8fbe730f6558 {{(pid=75066) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 19:39:56 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:39:57 user nova-compute[75066]: DEBUG nova.network.neutron [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Successfully updated port: 6a67de06-74d9-4b6a-ae10-8fbe730f6558 {{(pid=75066) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 19:39:57 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Acquiring lock "refresh_cache-544d6830-e6cf-4c06-95b3-151da602bc6d" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:39:57 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Acquired lock "refresh_cache-544d6830-e6cf-4c06-95b3-151da602bc6d" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:39:57 user nova-compute[75066]: DEBUG nova.network.neutron [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:39:57 user nova-compute[75066]: DEBUG nova.compute.manager [req-0ccb3753-295e-4041-860e-b64346227a87 req-14e2f231-631a-499d-add3-165b7dbfb067 service nova] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Received event network-changed-6a67de06-74d9-4b6a-ae10-8fbe730f6558 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:39:57 user nova-compute[75066]: DEBUG nova.compute.manager [req-0ccb3753-295e-4041-860e-b64346227a87 req-14e2f231-631a-499d-add3-165b7dbfb067 service nova] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Refreshing instance network info cache due to event network-changed-6a67de06-74d9-4b6a-ae10-8fbe730f6558. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:39:57 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-0ccb3753-295e-4041-860e-b64346227a87 req-14e2f231-631a-499d-add3-165b7dbfb067 service nova] Acquiring lock "refresh_cache-544d6830-e6cf-4c06-95b3-151da602bc6d" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:39:57 user nova-compute[75066]: DEBUG nova.network.neutron [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:39:57 user nova-compute[75066]: DEBUG nova.network.neutron [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Updating instance_info_cache with network_info: [{"id": "6a67de06-74d9-4b6a-ae10-8fbe730f6558", "address": "fa:16:3e:b1:1b:aa", "network": {"id": "10a180e0-96f5-4b54-8f70-8955d6c0e288", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1853322930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b227dfb7ede2407ba03f2840bc5de4f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a67de06-74", "ovs_interfaceid": "6a67de06-74d9-4b6a-ae10-8fbe730f6558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:39:57 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Releasing lock "refresh_cache-544d6830-e6cf-4c06-95b3-151da602bc6d" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:39:57 user nova-compute[75066]: DEBUG nova.compute.manager [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Instance network_info: |[{"id": "6a67de06-74d9-4b6a-ae10-8fbe730f6558", "address": "fa:16:3e:b1:1b:aa", "network": {"id": "10a180e0-96f5-4b54-8f70-8955d6c0e288", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1853322930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b227dfb7ede2407ba03f2840bc5de4f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a67de06-74", "ovs_interfaceid": "6a67de06-74d9-4b6a-ae10-8fbe730f6558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 19:39:57 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-0ccb3753-295e-4041-860e-b64346227a87 req-14e2f231-631a-499d-add3-165b7dbfb067 service nova] Acquired lock "refresh_cache-544d6830-e6cf-4c06-95b3-151da602bc6d" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:39:57 user nova-compute[75066]: DEBUG nova.network.neutron [req-0ccb3753-295e-4041-860e-b64346227a87 req-14e2f231-631a-499d-add3-165b7dbfb067 service nova] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Refreshing network info cache for port 6a67de06-74d9-4b6a-ae10-8fbe730f6558 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:39:57 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Start _get_guest_xml network_info=[{"id": "6a67de06-74d9-4b6a-ae10-8fbe730f6558", "address": "fa:16:3e:b1:1b:aa", "network": {"id": "10a180e0-96f5-4b54-8f70-8955d6c0e288", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1853322930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b227dfb7ede2407ba03f2840bc5de4f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a67de06-74", "ovs_interfaceid": "6a67de06-74d9-4b6a-ae10-8fbe730f6558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'image_id': '900b237b-e99c-4fdd-a44f-dcb7a08baa86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:39:57 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:39:57 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:39:57 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:39:57 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:39:57 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:39:57 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:39:57 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:39:57 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:39:57 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:39:57 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:39:57 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:39:57 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:39:57 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:39:57 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:39:57 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:39:57 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:39:57 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:39:57 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:39:57 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:39:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1667858717',display_name='tempest-SnapshotDataIntegrityTests-server-1667858717',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1667858717',id=40,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPRo4MSB12Jo9y3Z7pVX2ycodhGdOIN/mE8U1Obwf8PwSIzzUEOgE54UiJJ65mQ8TeDYyxE8HBx4oXboklyCz4ndaGPGKvfmltRoFVkR7LlhwWmzJWoRmhesLIsX0j6m1w==',key_name='tempest-keypair-921551098',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b227dfb7ede2407ba03f2840bc5de4f5',ramdisk_id='',reservation_id='r-nhz4sxrf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-626539035',owner_user_name='tempest-SnapshotDataIntegrityTests-626539035-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:39:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='928459d1f7dd4705bc3e6f3de827fe30',uuid=544d6830-e6cf-4c06-95b3-151da602bc6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a67de06-74d9-4b6a-ae10-8fbe730f6558", "address": "fa:16:3e:b1:1b:aa", "network": {"id": "10a180e0-96f5-4b54-8f70-8955d6c0e288", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1853322930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b227dfb7ede2407ba03f2840bc5de4f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a67de06-74", "ovs_interfaceid": "6a67de06-74d9-4b6a-ae10-8fbe730f6558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:39:57 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Converting VIF {"id": "6a67de06-74d9-4b6a-ae10-8fbe730f6558", "address": "fa:16:3e:b1:1b:aa", "network": {"id": "10a180e0-96f5-4b54-8f70-8955d6c0e288", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1853322930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b227dfb7ede2407ba03f2840bc5de4f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a67de06-74", "ovs_interfaceid": "6a67de06-74d9-4b6a-ae10-8fbe730f6558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:39:57 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:1b:aa,bridge_name='br-int',has_traffic_filtering=True,id=6a67de06-74d9-4b6a-ae10-8fbe730f6558,network=Network(10a180e0-96f5-4b54-8f70-8955d6c0e288),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a67de06-74') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:39:57 user nova-compute[75066]: DEBUG nova.objects.instance [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lazy-loading 'pci_devices' on Instance uuid 544d6830-e6cf-4c06-95b3-151da602bc6d {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:39:57 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:39:57 user nova-compute[75066]:   <uuid>544d6830-e6cf-4c06-95b3-151da602bc6d</uuid>
Dec 01 19:39:57 user nova-compute[75066]:   <name>instance-00000028</name>
Dec 01 19:39:57 user nova-compute[75066]:   <memory>524288</memory>
Dec 01 19:39:57 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:39:57 user nova-compute[75066]:   <metadata>
Dec 01 19:39:57 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:39:57 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:39:57 user nova-compute[75066]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1667858717</nova:name>
Dec 01 19:39:57 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:39:57</nova:creationTime>
Dec 01 19:39:57 user nova-compute[75066]:       <nova:flavor name="m1.tiny">
Dec 01 19:39:57 user nova-compute[75066]:         <nova:memory>512</nova:memory>
Dec 01 19:39:57 user nova-compute[75066]:         <nova:disk>1</nova:disk>
Dec 01 19:39:57 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:39:57 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:39:57 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:39:57 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:39:57 user nova-compute[75066]:       <nova:owner>
Dec 01 19:39:57 user nova-compute[75066]:         <nova:user uuid="928459d1f7dd4705bc3e6f3de827fe30">tempest-SnapshotDataIntegrityTests-626539035-project-member</nova:user>
Dec 01 19:39:57 user nova-compute[75066]:         <nova:project uuid="b227dfb7ede2407ba03f2840bc5de4f5">tempest-SnapshotDataIntegrityTests-626539035</nova:project>
Dec 01 19:39:57 user nova-compute[75066]:       </nova:owner>
Dec 01 19:39:57 user nova-compute[75066]:       <nova:root type="image" uuid="900b237b-e99c-4fdd-a44f-dcb7a08baa86"/>
Dec 01 19:39:57 user nova-compute[75066]:       <nova:ports>
Dec 01 19:39:57 user nova-compute[75066]:         <nova:port uuid="6a67de06-74d9-4b6a-ae10-8fbe730f6558">
Dec 01 19:39:57 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Dec 01 19:39:57 user nova-compute[75066]:         </nova:port>
Dec 01 19:39:57 user nova-compute[75066]:       </nova:ports>
Dec 01 19:39:57 user nova-compute[75066]:     </nova:instance>
Dec 01 19:39:57 user nova-compute[75066]:   </metadata>
Dec 01 19:39:57 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:39:57 user nova-compute[75066]:     <system>
Dec 01 19:39:57 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:39:57 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:39:57 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:39:57 user nova-compute[75066]:       <entry name="serial">544d6830-e6cf-4c06-95b3-151da602bc6d</entry>
Dec 01 19:39:57 user nova-compute[75066]:       <entry name="uuid">544d6830-e6cf-4c06-95b3-151da602bc6d</entry>
Dec 01 19:39:57 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:39:57 user nova-compute[75066]:     </system>
Dec 01 19:39:57 user nova-compute[75066]:   </sysinfo>
Dec 01 19:39:57 user nova-compute[75066]:   <os>
Dec 01 19:39:57 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:39:57 user nova-compute[75066]:     <boot dev="hd"/>
Dec 01 19:39:57 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:39:57 user nova-compute[75066]:   </os>
Dec 01 19:39:57 user nova-compute[75066]:   <features>
Dec 01 19:39:57 user nova-compute[75066]:     <acpi/>
Dec 01 19:39:57 user nova-compute[75066]:     <apic/>
Dec 01 19:39:57 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:39:57 user nova-compute[75066]:   </features>
Dec 01 19:39:57 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:39:57 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:39:57 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:39:57 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:39:57 user nova-compute[75066]:   </clock>
Dec 01 19:39:57 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:39:57 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:39:57 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:39:57 user nova-compute[75066]:   </cpu>
Dec 01 19:39:57 user nova-compute[75066]:   <devices>
Dec 01 19:39:57 user nova-compute[75066]:     <disk type="file" device="disk">
Dec 01 19:39:57 user nova-compute[75066]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 19:39:57 user nova-compute[75066]:       <source file="/opt/stack/data/nova/instances/544d6830-e6cf-4c06-95b3-151da602bc6d/disk"/>
Dec 01 19:39:57 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:39:57 user nova-compute[75066]:     </disk>
Dec 01 19:39:57 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:39:57 user nova-compute[75066]:       <mac address="fa:16:3e:b1:1b:aa"/>
Dec 01 19:39:57 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:39:57 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:39:57 user nova-compute[75066]:       <target dev="tap6a67de06-74"/>
Dec 01 19:39:57 user nova-compute[75066]:     </interface>
Dec 01 19:39:57 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:39:57 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/544d6830-e6cf-4c06-95b3-151da602bc6d/console.log" append="off"/>
Dec 01 19:39:57 user nova-compute[75066]:     </serial>
Dec 01 19:39:57 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:39:57 user nova-compute[75066]:     <video>
Dec 01 19:39:57 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:39:57 user nova-compute[75066]:     </video>
Dec 01 19:39:57 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:39:57 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:39:57 user nova-compute[75066]:     </rng>
Dec 01 19:39:57 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:39:57 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:39:57 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:39:57 user nova-compute[75066]:     </memballoon>
Dec 01 19:39:57 user nova-compute[75066]:   </devices>
Dec 01 19:39:57 user nova-compute[75066]: </domain>
Dec 01 19:39:57 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:39:57 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:39:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1667858717',display_name='tempest-SnapshotDataIntegrityTests-server-1667858717',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1667858717',id=40,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPRo4MSB12Jo9y3Z7pVX2ycodhGdOIN/mE8U1Obwf8PwSIzzUEOgE54UiJJ65mQ8TeDYyxE8HBx4oXboklyCz4ndaGPGKvfmltRoFVkR7LlhwWmzJWoRmhesLIsX0j6m1w==',key_name='tempest-keypair-921551098',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b227dfb7ede2407ba03f2840bc5de4f5',ramdisk_id='',reservation_id='r-nhz4sxrf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-626539035',owner_user_name='tempest-SnapshotDataIntegrityTests-626539035-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:39:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='928459d1f7dd4705bc3e6f3de827fe30',uuid=544d6830-e6cf-4c06-95b3-151da602bc6d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a67de06-74d9-4b6a-ae10-8fbe730f6558", "address": "fa:16:3e:b1:1b:aa", "network": {"id": "10a180e0-96f5-4b54-8f70-8955d6c0e288", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1853322930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b227dfb7ede2407ba03f2840bc5de4f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a67de06-74", "ovs_interfaceid": "6a67de06-74d9-4b6a-ae10-8fbe730f6558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:39:57 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Converting VIF {"id": "6a67de06-74d9-4b6a-ae10-8fbe730f6558", "address": "fa:16:3e:b1:1b:aa", "network": {"id": "10a180e0-96f5-4b54-8f70-8955d6c0e288", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1853322930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b227dfb7ede2407ba03f2840bc5de4f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a67de06-74", "ovs_interfaceid": "6a67de06-74d9-4b6a-ae10-8fbe730f6558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:39:57 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:1b:aa,bridge_name='br-int',has_traffic_filtering=True,id=6a67de06-74d9-4b6a-ae10-8fbe730f6558,network=Network(10a180e0-96f5-4b54-8f70-8955d6c0e288),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a67de06-74') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:39:57 user nova-compute[75066]: DEBUG os_vif [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:1b:aa,bridge_name='br-int',has_traffic_filtering=True,id=6a67de06-74d9-4b6a-ae10-8fbe730f6558,network=Network(10a180e0-96f5-4b54-8f70-8955d6c0e288),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a67de06-74') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:39:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:39:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:39:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:39:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:39:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '69e44b7a-b9e4-5ef5-9a37-3dc381897a64', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:39:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:39:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:39:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6a67de06-74, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:39:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6a67de06-74, col_values=(('qos', UUID('c3ce6289-cda5-4780-bbb6-b944fc6cd443')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:39:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6a67de06-74, col_values=(('external_ids', {'iface-id': '6a67de06-74d9-4b6a-ae10-8fbe730f6558', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:1b:aa', 'vm-uuid': '544d6830-e6cf-4c06-95b3-151da602bc6d'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:39:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:39:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:39:57 user nova-compute[75066]: INFO os_vif [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:1b:aa,bridge_name='br-int',has_traffic_filtering=True,id=6a67de06-74d9-4b6a-ae10-8fbe730f6558,network=Network(10a180e0-96f5-4b54-8f70-8955d6c0e288),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a67de06-74')
Dec 01 19:39:57 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:39:57 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] No VIF found with MAC fa:16:3e:b1:1b:aa, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:39:58 user nova-compute[75066]: DEBUG nova.network.neutron [req-0ccb3753-295e-4041-860e-b64346227a87 req-14e2f231-631a-499d-add3-165b7dbfb067 service nova] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Updated VIF entry in instance network info cache for port 6a67de06-74d9-4b6a-ae10-8fbe730f6558. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:39:58 user nova-compute[75066]: DEBUG nova.network.neutron [req-0ccb3753-295e-4041-860e-b64346227a87 req-14e2f231-631a-499d-add3-165b7dbfb067 service nova] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Updating instance_info_cache with network_info: [{"id": "6a67de06-74d9-4b6a-ae10-8fbe730f6558", "address": "fa:16:3e:b1:1b:aa", "network": {"id": "10a180e0-96f5-4b54-8f70-8955d6c0e288", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1853322930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b227dfb7ede2407ba03f2840bc5de4f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a67de06-74", "ovs_interfaceid": "6a67de06-74d9-4b6a-ae10-8fbe730f6558", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:39:58 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-0ccb3753-295e-4041-860e-b64346227a87 req-14e2f231-631a-499d-add3-165b7dbfb067 service nova] Releasing lock "refresh_cache-544d6830-e6cf-4c06-95b3-151da602bc6d" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:39:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:39:59 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:39:59 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:39:59 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:39:59 user nova-compute[75066]: DEBUG nova.compute.manager [req-5a0c7af0-ba64-4018-8de3-3ba9a99b2251 req-d025289a-8d88-4ca5-ab78-a01152171950 service nova] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Received event network-vif-plugged-6a67de06-74d9-4b6a-ae10-8fbe730f6558 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:39:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-5a0c7af0-ba64-4018-8de3-3ba9a99b2251 req-d025289a-8d88-4ca5-ab78-a01152171950 service nova] Acquiring lock "544d6830-e6cf-4c06-95b3-151da602bc6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:39:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-5a0c7af0-ba64-4018-8de3-3ba9a99b2251 req-d025289a-8d88-4ca5-ab78-a01152171950 service nova] Lock "544d6830-e6cf-4c06-95b3-151da602bc6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:39:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-5a0c7af0-ba64-4018-8de3-3ba9a99b2251 req-d025289a-8d88-4ca5-ab78-a01152171950 service nova] Lock "544d6830-e6cf-4c06-95b3-151da602bc6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:39:59 user nova-compute[75066]: DEBUG nova.compute.manager [req-5a0c7af0-ba64-4018-8de3-3ba9a99b2251 req-d025289a-8d88-4ca5-ab78-a01152171950 service nova] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] No waiting events found dispatching network-vif-plugged-6a67de06-74d9-4b6a-ae10-8fbe730f6558 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:39:59 user nova-compute[75066]: WARNING nova.compute.manager [req-5a0c7af0-ba64-4018-8de3-3ba9a99b2251 req-d025289a-8d88-4ca5-ab78-a01152171950 service nova] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Received unexpected event network-vif-plugged-6a67de06-74d9-4b6a-ae10-8fbe730f6558 for instance with vm_state building and task_state spawning.
Dec 01 19:39:59 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:39:59 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:39:59 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:39:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Acquiring lock "1f7bbc49-b34e-4a0c-b577-7ceadf0cf288" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:39:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "1f7bbc49-b34e-4a0c-b577-7ceadf0cf288" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:39:59 user nova-compute[75066]: DEBUG nova.compute.manager [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Starting instance... {{(pid=75066) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 19:39:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:39:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:39:59 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75066) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 19:39:59 user nova-compute[75066]: INFO nova.compute.claims [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Claim successful on node user
Dec 01 19:40:00 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:40:00 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:40:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.258s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:40:00 user nova-compute[75066]: DEBUG nova.compute.manager [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Start building networks asynchronously for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 19:40:00 user nova-compute[75066]: DEBUG nova.compute.manager [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Allocating IP information in the background. {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 19:40:00 user nova-compute[75066]: DEBUG nova.network.neutron [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] allocate_for_instance() {{(pid=75066) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 19:40:00 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 19:40:00 user nova-compute[75066]: DEBUG nova.compute.manager [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Start building block device mappings for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 19:40:00 user nova-compute[75066]: DEBUG nova.policy [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b92b1beca2ee480181e771eafe1a9f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109097a30a40419092c74f4c7a695ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75066) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 19:40:00 user nova-compute[75066]: DEBUG nova.compute.manager [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Start spawning the instance on the hypervisor. {{(pid=75066) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 19:40:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Creating instance directory {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 19:40:00 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Creating image(s)
Dec 01 19:40:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Acquiring lock "/opt/stack/data/nova/instances/1f7bbc49-b34e-4a0c-b577-7ceadf0cf288/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:40:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "/opt/stack/data/nova/instances/1f7bbc49-b34e-4a0c-b577-7ceadf0cf288/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:40:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "/opt/stack/data/nova/instances/1f7bbc49-b34e-4a0c-b577-7ceadf0cf288/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:40:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:40:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.181s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:40:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Acquiring lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:40:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:40:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:40:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.173s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:40:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/1f7bbc49-b34e-4a0c-b577-7ceadf0cf288/disk 1073741824 {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:40:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/1f7bbc49-b34e-4a0c-b577-7ceadf0cf288/disk 1073741824" returned: 0 in 0.052s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:40:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:40:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:40:00 user nova-compute[75066]: DEBUG nova.network.neutron [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Successfully created port: 5b2ebcf7-2624-49c2-bfa0-c5b694a37ec8 {{(pid=75066) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 19:40:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.197s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:40:01 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1f7bbc49-b34e-4a0c-b577-7ceadf0cf288/disk. size=1073741824 {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 19:40:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f7bbc49-b34e-4a0c-b577-7ceadf0cf288/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:40:01 user nova-compute[75066]: DEBUG nova.compute.manager [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Instance event wait completed in 0 seconds for  {{(pid=75066) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 19:40:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Guest created on hypervisor {{(pid=75066) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 19:40:01 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f7bbc49-b34e-4a0c-b577-7ceadf0cf288/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:40:01 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Cannot resize image /opt/stack/data/nova/instances/1f7bbc49-b34e-4a0c-b577-7ceadf0cf288/disk to a smaller size. {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 19:40:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Created local disks {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 19:40:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Ensure instance console log exists: /opt/stack/data/nova/instances/1f7bbc49-b34e-4a0c-b577-7ceadf0cf288/console.log {{(pid=75066) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 19:40:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:40:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:40:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:40:01 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Instance spawned successfully.
Dec 01 19:40:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 19:40:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Found default for hw_cdrom_bus of ide {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:40:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Found default for hw_disk_bus of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:40:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Found default for hw_input_bus of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:40:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Found default for hw_pointer_model of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:40:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Found default for hw_video_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:40:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Found default for hw_vif_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:40:01 user nova-compute[75066]: DEBUG nova.compute.manager [req-626f9561-1725-4d96-824e-93b328d017ae req-87b81bce-6818-4dc5-9575-24bfb9536f56 service nova] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Received event network-vif-plugged-6a67de06-74d9-4b6a-ae10-8fbe730f6558 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:40:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-626f9561-1725-4d96-824e-93b328d017ae req-87b81bce-6818-4dc5-9575-24bfb9536f56 service nova] Acquiring lock "544d6830-e6cf-4c06-95b3-151da602bc6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:40:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-626f9561-1725-4d96-824e-93b328d017ae req-87b81bce-6818-4dc5-9575-24bfb9536f56 service nova] Lock "544d6830-e6cf-4c06-95b3-151da602bc6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:40:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-626f9561-1725-4d96-824e-93b328d017ae req-87b81bce-6818-4dc5-9575-24bfb9536f56 service nova] Lock "544d6830-e6cf-4c06-95b3-151da602bc6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:40:01 user nova-compute[75066]: DEBUG nova.compute.manager [req-626f9561-1725-4d96-824e-93b328d017ae req-87b81bce-6818-4dc5-9575-24bfb9536f56 service nova] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] No waiting events found dispatching network-vif-plugged-6a67de06-74d9-4b6a-ae10-8fbe730f6558 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:40:01 user nova-compute[75066]: WARNING nova.compute.manager [req-626f9561-1725-4d96-824e-93b328d017ae req-87b81bce-6818-4dc5-9575-24bfb9536f56 service nova] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Received unexpected event network-vif-plugged-6a67de06-74d9-4b6a-ae10-8fbe730f6558 for instance with vm_state building and task_state spawning.
Dec 01 19:40:01 user nova-compute[75066]: INFO nova.compute.manager [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Took 6.28 seconds to spawn the instance on the hypervisor.
Dec 01 19:40:01 user nova-compute[75066]: DEBUG nova.compute.manager [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:40:01 user nova-compute[75066]: INFO nova.compute.manager [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Took 6.90 seconds to build instance.
Dec 01 19:40:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-8086a05f-e957-48a2-bdd9-050de765c2a5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lock "544d6830-e6cf-4c06-95b3-151da602bc6d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.031s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:40:01 user nova-compute[75066]: DEBUG nova.network.neutron [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Successfully updated port: 5b2ebcf7-2624-49c2-bfa0-c5b694a37ec8 {{(pid=75066) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 19:40:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Acquiring lock "refresh_cache-1f7bbc49-b34e-4a0c-b577-7ceadf0cf288" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:40:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Acquired lock "refresh_cache-1f7bbc49-b34e-4a0c-b577-7ceadf0cf288" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:40:01 user nova-compute[75066]: DEBUG nova.network.neutron [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:40:01 user nova-compute[75066]: DEBUG nova.network.neutron [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:40:01 user nova-compute[75066]: DEBUG nova.network.neutron [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Updating instance_info_cache with network_info: [{"id": "5b2ebcf7-2624-49c2-bfa0-c5b694a37ec8", "address": "fa:16:3e:6e:e4:53", "network": {"id": "955d6293-ede6-4cb4-8cee-0157dbad93ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-603640322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109097a30a40419092c74f4c7a695ce4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2ebcf7-26", "ovs_interfaceid": "5b2ebcf7-2624-49c2-bfa0-c5b694a37ec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:40:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Releasing lock "refresh_cache-1f7bbc49-b34e-4a0c-b577-7ceadf0cf288" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:40:01 user nova-compute[75066]: DEBUG nova.compute.manager [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Instance network_info: |[{"id": "5b2ebcf7-2624-49c2-bfa0-c5b694a37ec8", "address": "fa:16:3e:6e:e4:53", "network": {"id": "955d6293-ede6-4cb4-8cee-0157dbad93ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-603640322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109097a30a40419092c74f4c7a695ce4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2ebcf7-26", "ovs_interfaceid": "5b2ebcf7-2624-49c2-bfa0-c5b694a37ec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 19:40:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Start _get_guest_xml network_info=[{"id": "5b2ebcf7-2624-49c2-bfa0-c5b694a37ec8", "address": "fa:16:3e:6e:e4:53", "network": {"id": "955d6293-ede6-4cb4-8cee-0157dbad93ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-603640322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109097a30a40419092c74f4c7a695ce4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2ebcf7-26", "ovs_interfaceid": "5b2ebcf7-2624-49c2-bfa0-c5b694a37ec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'image_id': '900b237b-e99c-4fdd-a44f-dcb7a08baa86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:40:01 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:40:01 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:40:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:40:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:40:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:40:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:40:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:40:01 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:40:01 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:40:01 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:40:01 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:40:01 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:40:01 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:40:01 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:40:01 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:40:01 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:40:01 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:40:01 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:40:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:39:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-844266273',display_name='tempest-AttachVolumeNegativeTest-server-844266273',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-844266273',id=41,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGL0PpwGNr/1F3KncgISYnszcLmd61o4+ZSxOZl7yzqOoWwyNCgsBx+FXVG7x5f8VjJS/MeNjxGAvDE9dLignxwQOiVYMezgIX/mnxD2ZtkLAwoXocFq/lYVl24wkCZtXQ==',key_name='tempest-keypair-797088992',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='109097a30a40419092c74f4c7a695ce4',ramdisk_id='',reservation_id='r-7bzyh3gp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-711021602',owner_user_name='tempest-AttachVolumeNegativeTest-711021602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:40:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b92b1beca2ee480181e771eafe1a9f97',uuid=1f7bbc49-b34e-4a0c-b577-7ceadf0cf288,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b2ebcf7-2624-49c2-bfa0-c5b694a37ec8", "address": "fa:16:3e:6e:e4:53", "network": {"id": "955d6293-ede6-4cb4-8cee-0157dbad93ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-603640322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109097a30a40419092c74f4c7a695ce4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2ebcf7-26", "ovs_interfaceid": "5b2ebcf7-2624-49c2-bfa0-c5b694a37ec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:40:01 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Converting VIF {"id": "5b2ebcf7-2624-49c2-bfa0-c5b694a37ec8", "address": "fa:16:3e:6e:e4:53", "network": {"id": "955d6293-ede6-4cb4-8cee-0157dbad93ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-603640322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109097a30a40419092c74f4c7a695ce4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2ebcf7-26", "ovs_interfaceid": "5b2ebcf7-2624-49c2-bfa0-c5b694a37ec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:40:01 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:e4:53,bridge_name='br-int',has_traffic_filtering=True,id=5b2ebcf7-2624-49c2-bfa0-c5b694a37ec8,network=Network(955d6293-ede6-4cb4-8cee-0157dbad93ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b2ebcf7-26') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:40:01 user nova-compute[75066]: DEBUG nova.objects.instance [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lazy-loading 'pci_devices' on Instance uuid 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:40:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:40:01 user nova-compute[75066]:   <uuid>1f7bbc49-b34e-4a0c-b577-7ceadf0cf288</uuid>
Dec 01 19:40:01 user nova-compute[75066]:   <name>instance-00000029</name>
Dec 01 19:40:01 user nova-compute[75066]:   <memory>524288</memory>
Dec 01 19:40:01 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:40:01 user nova-compute[75066]:   <metadata>
Dec 01 19:40:01 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:40:01 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:40:01 user nova-compute[75066]:       <nova:name>tempest-AttachVolumeNegativeTest-server-844266273</nova:name>
Dec 01 19:40:01 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:40:01</nova:creationTime>
Dec 01 19:40:01 user nova-compute[75066]:       <nova:flavor name="m1.tiny">
Dec 01 19:40:01 user nova-compute[75066]:         <nova:memory>512</nova:memory>
Dec 01 19:40:01 user nova-compute[75066]:         <nova:disk>1</nova:disk>
Dec 01 19:40:01 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:40:01 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:40:01 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:40:01 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:40:01 user nova-compute[75066]:       <nova:owner>
Dec 01 19:40:01 user nova-compute[75066]:         <nova:user uuid="b92b1beca2ee480181e771eafe1a9f97">tempest-AttachVolumeNegativeTest-711021602-project-member</nova:user>
Dec 01 19:40:01 user nova-compute[75066]:         <nova:project uuid="109097a30a40419092c74f4c7a695ce4">tempest-AttachVolumeNegativeTest-711021602</nova:project>
Dec 01 19:40:01 user nova-compute[75066]:       </nova:owner>
Dec 01 19:40:01 user nova-compute[75066]:       <nova:root type="image" uuid="900b237b-e99c-4fdd-a44f-dcb7a08baa86"/>
Dec 01 19:40:01 user nova-compute[75066]:       <nova:ports>
Dec 01 19:40:01 user nova-compute[75066]:         <nova:port uuid="5b2ebcf7-2624-49c2-bfa0-c5b694a37ec8">
Dec 01 19:40:01 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Dec 01 19:40:01 user nova-compute[75066]:         </nova:port>
Dec 01 19:40:01 user nova-compute[75066]:       </nova:ports>
Dec 01 19:40:01 user nova-compute[75066]:     </nova:instance>
Dec 01 19:40:01 user nova-compute[75066]:   </metadata>
Dec 01 19:40:01 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:40:01 user nova-compute[75066]:     <system>
Dec 01 19:40:01 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:40:01 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:40:01 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:40:01 user nova-compute[75066]:       <entry name="serial">1f7bbc49-b34e-4a0c-b577-7ceadf0cf288</entry>
Dec 01 19:40:01 user nova-compute[75066]:       <entry name="uuid">1f7bbc49-b34e-4a0c-b577-7ceadf0cf288</entry>
Dec 01 19:40:01 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:40:01 user nova-compute[75066]:     </system>
Dec 01 19:40:01 user nova-compute[75066]:   </sysinfo>
Dec 01 19:40:01 user nova-compute[75066]:   <os>
Dec 01 19:40:01 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:40:01 user nova-compute[75066]:     <boot dev="hd"/>
Dec 01 19:40:01 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:40:01 user nova-compute[75066]:   </os>
Dec 01 19:40:01 user nova-compute[75066]:   <features>
Dec 01 19:40:01 user nova-compute[75066]:     <acpi/>
Dec 01 19:40:01 user nova-compute[75066]:     <apic/>
Dec 01 19:40:01 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:40:01 user nova-compute[75066]:   </features>
Dec 01 19:40:01 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:40:01 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:40:01 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:40:01 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:40:01 user nova-compute[75066]:   </clock>
Dec 01 19:40:01 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:40:01 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:40:01 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:40:01 user nova-compute[75066]:   </cpu>
Dec 01 19:40:01 user nova-compute[75066]:   <devices>
Dec 01 19:40:01 user nova-compute[75066]:     <disk type="file" device="disk">
Dec 01 19:40:01 user nova-compute[75066]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 19:40:01 user nova-compute[75066]:       <source file="/opt/stack/data/nova/instances/1f7bbc49-b34e-4a0c-b577-7ceadf0cf288/disk"/>
Dec 01 19:40:01 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:40:01 user nova-compute[75066]:     </disk>
Dec 01 19:40:01 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:40:01 user nova-compute[75066]:       <mac address="fa:16:3e:6e:e4:53"/>
Dec 01 19:40:01 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:40:01 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:40:01 user nova-compute[75066]:       <target dev="tap5b2ebcf7-26"/>
Dec 01 19:40:01 user nova-compute[75066]:     </interface>
Dec 01 19:40:01 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:40:01 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/1f7bbc49-b34e-4a0c-b577-7ceadf0cf288/console.log" append="off"/>
Dec 01 19:40:01 user nova-compute[75066]:     </serial>
Dec 01 19:40:01 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:40:01 user nova-compute[75066]:     <video>
Dec 01 19:40:01 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:40:01 user nova-compute[75066]:     </video>
Dec 01 19:40:01 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:40:01 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:40:01 user nova-compute[75066]:     </rng>
Dec 01 19:40:01 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:40:01 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:40:01 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:40:01 user nova-compute[75066]:     </memballoon>
Dec 01 19:40:01 user nova-compute[75066]:   </devices>
Dec 01 19:40:01 user nova-compute[75066]: </domain>
Dec 01 19:40:01 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:40:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:39:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-844266273',display_name='tempest-AttachVolumeNegativeTest-server-844266273',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-844266273',id=41,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGL0PpwGNr/1F3KncgISYnszcLmd61o4+ZSxOZl7yzqOoWwyNCgsBx+FXVG7x5f8VjJS/MeNjxGAvDE9dLignxwQOiVYMezgIX/mnxD2ZtkLAwoXocFq/lYVl24wkCZtXQ==',key_name='tempest-keypair-797088992',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='109097a30a40419092c74f4c7a695ce4',ramdisk_id='',reservation_id='r-7bzyh3gp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-711021602',owner_user_name='tempest-AttachVolumeNegativeTest-711021602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:40:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b92b1beca2ee480181e771eafe1a9f97',uuid=1f7bbc49-b34e-4a0c-b577-7ceadf0cf288,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b2ebcf7-2624-49c2-bfa0-c5b694a37ec8", "address": "fa:16:3e:6e:e4:53", "network": {"id": "955d6293-ede6-4cb4-8cee-0157dbad93ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-603640322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109097a30a40419092c74f4c7a695ce4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2ebcf7-26", "ovs_interfaceid": "5b2ebcf7-2624-49c2-bfa0-c5b694a37ec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:40:01 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Converting VIF {"id": "5b2ebcf7-2624-49c2-bfa0-c5b694a37ec8", "address": "fa:16:3e:6e:e4:53", "network": {"id": "955d6293-ede6-4cb4-8cee-0157dbad93ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-603640322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109097a30a40419092c74f4c7a695ce4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2ebcf7-26", "ovs_interfaceid": "5b2ebcf7-2624-49c2-bfa0-c5b694a37ec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:40:01 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:e4:53,bridge_name='br-int',has_traffic_filtering=True,id=5b2ebcf7-2624-49c2-bfa0-c5b694a37ec8,network=Network(955d6293-ede6-4cb4-8cee-0157dbad93ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b2ebcf7-26') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:40:01 user nova-compute[75066]: DEBUG os_vif [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:e4:53,bridge_name='br-int',has_traffic_filtering=True,id=5b2ebcf7-2624-49c2-bfa0-c5b694a37ec8,network=Network(955d6293-ede6-4cb4-8cee-0157dbad93ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b2ebcf7-26') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:40:01 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:40:01 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:40:01 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:40:01 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:40:01 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '532168c0-697c-5f13-bff5-b56744f8e77a', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:40:01 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:40:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:40:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:40:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b2ebcf7-26, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:40:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5b2ebcf7-26, col_values=(('qos', UUID('bea6cbf3-f54c-4611-87ec-ef0e0a68e967')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:40:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5b2ebcf7-26, col_values=(('external_ids', {'iface-id': '5b2ebcf7-2624-49c2-bfa0-c5b694a37ec8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:e4:53', 'vm-uuid': '1f7bbc49-b34e-4a0c-b577-7ceadf0cf288'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:40:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:40:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:40:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:40:02 user nova-compute[75066]: INFO os_vif [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:e4:53,bridge_name='br-int',has_traffic_filtering=True,id=5b2ebcf7-2624-49c2-bfa0-c5b694a37ec8,network=Network(955d6293-ede6-4cb4-8cee-0157dbad93ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b2ebcf7-26')
Dec 01 19:40:02 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:40:02 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] No VIF found with MAC fa:16:3e:6e:e4:53, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:40:03 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:40:03 user nova-compute[75066]: DEBUG nova.compute.manager [req-8bf18524-aab2-4846-ab99-dd0eab748aa2 req-9dbe667b-c450-4bfc-8380-7e5e5420786e service nova] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Received event network-changed-5b2ebcf7-2624-49c2-bfa0-c5b694a37ec8 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:40:03 user nova-compute[75066]: DEBUG nova.compute.manager [req-8bf18524-aab2-4846-ab99-dd0eab748aa2 req-9dbe667b-c450-4bfc-8380-7e5e5420786e service nova] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Refreshing instance network info cache due to event network-changed-5b2ebcf7-2624-49c2-bfa0-c5b694a37ec8. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:40:03 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-8bf18524-aab2-4846-ab99-dd0eab748aa2 req-9dbe667b-c450-4bfc-8380-7e5e5420786e service nova] Acquiring lock "refresh_cache-1f7bbc49-b34e-4a0c-b577-7ceadf0cf288" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:40:03 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-8bf18524-aab2-4846-ab99-dd0eab748aa2 req-9dbe667b-c450-4bfc-8380-7e5e5420786e service nova] Acquired lock "refresh_cache-1f7bbc49-b34e-4a0c-b577-7ceadf0cf288" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:40:03 user nova-compute[75066]: DEBUG nova.network.neutron [req-8bf18524-aab2-4846-ab99-dd0eab748aa2 req-9dbe667b-c450-4bfc-8380-7e5e5420786e service nova] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Refreshing network info cache for port 5b2ebcf7-2624-49c2-bfa0-c5b694a37ec8 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:40:03 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:40:03 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:40:03 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:40:03 user nova-compute[75066]: DEBUG nova.network.neutron [req-8bf18524-aab2-4846-ab99-dd0eab748aa2 req-9dbe667b-c450-4bfc-8380-7e5e5420786e service nova] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Updated VIF entry in instance network info cache for port 5b2ebcf7-2624-49c2-bfa0-c5b694a37ec8. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:40:03 user nova-compute[75066]: DEBUG nova.network.neutron [req-8bf18524-aab2-4846-ab99-dd0eab748aa2 req-9dbe667b-c450-4bfc-8380-7e5e5420786e service nova] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Updating instance_info_cache with network_info: [{"id": "5b2ebcf7-2624-49c2-bfa0-c5b694a37ec8", "address": "fa:16:3e:6e:e4:53", "network": {"id": "955d6293-ede6-4cb4-8cee-0157dbad93ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-603640322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109097a30a40419092c74f4c7a695ce4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2ebcf7-26", "ovs_interfaceid": "5b2ebcf7-2624-49c2-bfa0-c5b694a37ec8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:40:03 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-8bf18524-aab2-4846-ab99-dd0eab748aa2 req-9dbe667b-c450-4bfc-8380-7e5e5420786e service nova] Releasing lock "refresh_cache-1f7bbc49-b34e-4a0c-b577-7ceadf0cf288" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:40:04 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:40:04 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:40:04 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:40:04 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:40:04 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:40:05 user nova-compute[75066]: DEBUG nova.compute.manager [req-ccc357af-98a1-44af-81b5-5b19d4634f74 req-6658a705-6bc4-40c5-baf9-97fa08c06f36 service nova] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Received event network-vif-plugged-5b2ebcf7-2624-49c2-bfa0-c5b694a37ec8 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:40:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-ccc357af-98a1-44af-81b5-5b19d4634f74 req-6658a705-6bc4-40c5-baf9-97fa08c06f36 service nova] Acquiring lock "1f7bbc49-b34e-4a0c-b577-7ceadf0cf288-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:40:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-ccc357af-98a1-44af-81b5-5b19d4634f74 req-6658a705-6bc4-40c5-baf9-97fa08c06f36 service nova] Lock "1f7bbc49-b34e-4a0c-b577-7ceadf0cf288-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:40:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-ccc357af-98a1-44af-81b5-5b19d4634f74 req-6658a705-6bc4-40c5-baf9-97fa08c06f36 service nova] Lock "1f7bbc49-b34e-4a0c-b577-7ceadf0cf288-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:40:05 user nova-compute[75066]: DEBUG nova.compute.manager [req-ccc357af-98a1-44af-81b5-5b19d4634f74 req-6658a705-6bc4-40c5-baf9-97fa08c06f36 service nova] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] No waiting events found dispatching network-vif-plugged-5b2ebcf7-2624-49c2-bfa0-c5b694a37ec8 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:40:05 user nova-compute[75066]: WARNING nova.compute.manager [req-ccc357af-98a1-44af-81b5-5b19d4634f74 req-6658a705-6bc4-40c5-baf9-97fa08c06f36 service nova] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Received unexpected event network-vif-plugged-5b2ebcf7-2624-49c2-bfa0-c5b694a37ec8 for instance with vm_state building and task_state spawning.
Dec 01 19:40:05 user nova-compute[75066]: DEBUG nova.compute.manager [req-ccc357af-98a1-44af-81b5-5b19d4634f74 req-6658a705-6bc4-40c5-baf9-97fa08c06f36 service nova] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Received event network-vif-plugged-5b2ebcf7-2624-49c2-bfa0-c5b694a37ec8 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:40:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-ccc357af-98a1-44af-81b5-5b19d4634f74 req-6658a705-6bc4-40c5-baf9-97fa08c06f36 service nova] Acquiring lock "1f7bbc49-b34e-4a0c-b577-7ceadf0cf288-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:40:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-ccc357af-98a1-44af-81b5-5b19d4634f74 req-6658a705-6bc4-40c5-baf9-97fa08c06f36 service nova] Lock "1f7bbc49-b34e-4a0c-b577-7ceadf0cf288-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:40:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-ccc357af-98a1-44af-81b5-5b19d4634f74 req-6658a705-6bc4-40c5-baf9-97fa08c06f36 service nova] Lock "1f7bbc49-b34e-4a0c-b577-7ceadf0cf288-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:40:05 user nova-compute[75066]: DEBUG nova.compute.manager [req-ccc357af-98a1-44af-81b5-5b19d4634f74 req-6658a705-6bc4-40c5-baf9-97fa08c06f36 service nova] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] No waiting events found dispatching network-vif-plugged-5b2ebcf7-2624-49c2-bfa0-c5b694a37ec8 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:40:05 user nova-compute[75066]: WARNING nova.compute.manager [req-ccc357af-98a1-44af-81b5-5b19d4634f74 req-6658a705-6bc4-40c5-baf9-97fa08c06f36 service nova] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Received unexpected event network-vif-plugged-5b2ebcf7-2624-49c2-bfa0-c5b694a37ec8 for instance with vm_state building and task_state spawning.
Dec 01 19:40:05 user nova-compute[75066]: DEBUG nova.compute.manager [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Instance event wait completed in 0 seconds for  {{(pid=75066) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 19:40:05 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Guest created on hypervisor {{(pid=75066) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 19:40:05 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Instance spawned successfully.
Dec 01 19:40:05 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 19:40:05 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Found default for hw_cdrom_bus of ide {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:40:05 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Found default for hw_disk_bus of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:40:05 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Found default for hw_input_bus of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:40:05 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Found default for hw_pointer_model of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:40:05 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Found default for hw_video_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:40:05 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Found default for hw_vif_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:40:05 user nova-compute[75066]: INFO nova.compute.manager [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Took 5.50 seconds to spawn the instance on the hypervisor.
Dec 01 19:40:05 user nova-compute[75066]: DEBUG nova.compute.manager [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:40:06 user nova-compute[75066]: INFO nova.compute.manager [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Took 6.07 seconds to build instance.
Dec 01 19:40:06 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-68d031e5-6ede-4684-a594-3a558a913ffa tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "1f7bbc49-b34e-4a0c-b577-7ceadf0cf288" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.164s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:40:07 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:40:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:40:11 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:40:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:40:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:40:15 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:40:15 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75066) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 19:40:16 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-037b3acf-b6a8-491a-9d18-6b8567a5f8aa tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Acquiring lock "d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:40:16 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-037b3acf-b6a8-491a-9d18-6b8567a5f8aa tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Lock "d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:40:16 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-037b3acf-b6a8-491a-9d18-6b8567a5f8aa tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Acquiring lock "d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:40:16 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-037b3acf-b6a8-491a-9d18-6b8567a5f8aa tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Lock "d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:40:16 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-037b3acf-b6a8-491a-9d18-6b8567a5f8aa tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Lock "d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:40:16 user nova-compute[75066]: INFO nova.compute.manager [None req-037b3acf-b6a8-491a-9d18-6b8567a5f8aa tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0] Terminating instance
Dec 01 19:40:16 user nova-compute[75066]: DEBUG nova.compute.manager [None req-037b3acf-b6a8-491a-9d18-6b8567a5f8aa tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0] Start destroying the instance on the hypervisor. {{(pid=75066) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 19:40:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:40:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:40:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:40:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:40:16 user nova-compute[75066]: DEBUG nova.compute.manager [req-03a2336a-ebde-478c-8d80-78a89b114940 req-6270e00b-f20c-4344-8012-6c916bd9e2d2 service nova] [instance: d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0] Received event network-vif-unplugged-f5e9e254-d309-4053-91aa-c05bc80f5fe5 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:40:16 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-03a2336a-ebde-478c-8d80-78a89b114940 req-6270e00b-f20c-4344-8012-6c916bd9e2d2 service nova] Acquiring lock "d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:40:16 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-03a2336a-ebde-478c-8d80-78a89b114940 req-6270e00b-f20c-4344-8012-6c916bd9e2d2 service nova] Lock "d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:40:16 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-03a2336a-ebde-478c-8d80-78a89b114940 req-6270e00b-f20c-4344-8012-6c916bd9e2d2 service nova] Lock "d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:40:16 user nova-compute[75066]: DEBUG nova.compute.manager [req-03a2336a-ebde-478c-8d80-78a89b114940 req-6270e00b-f20c-4344-8012-6c916bd9e2d2 service nova] [instance: d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0] No waiting events found dispatching network-vif-unplugged-f5e9e254-d309-4053-91aa-c05bc80f5fe5 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:40:16 user nova-compute[75066]: DEBUG nova.compute.manager [req-03a2336a-ebde-478c-8d80-78a89b114940 req-6270e00b-f20c-4344-8012-6c916bd9e2d2 service nova] [instance: d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0] Received event network-vif-unplugged-f5e9e254-d309-4053-91aa-c05bc80f5fe5 for instance with task_state deleting. {{(pid=75066) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 19:40:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:40:17 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0] Instance destroyed successfully.
Dec 01 19:40:17 user nova-compute[75066]: DEBUG nova.objects.instance [None req-037b3acf-b6a8-491a-9d18-6b8567a5f8aa tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Lazy-loading 'resources' on Instance uuid d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:40:17 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-037b3acf-b6a8-491a-9d18-6b8567a5f8aa tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:38:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1674059249',display_name='tempest-VolumesActionsTest-instance-1674059249',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1674059249',id=39,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:38:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c0783de30bbc465fa27a20ae871178b8',ramdisk_id='',reservation_id='r-yr688iby',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1936494950',owner_user_name='tempest-VolumesActionsTest-1936494950-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:38:32Z,user_data=None,user_id='259ab964702944ba980aa28a8f38d3fb',uuid=d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5e9e254-d309-4053-91aa-c05bc80f5fe5", "address": "fa:16:3e:fc:00:4d", "network": {"id": "89966bbc-72a7-4613-a11f-cacdc22d2be7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-217253460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0783de30bbc465fa27a20ae871178b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e9e254-d3", "ovs_interfaceid": "f5e9e254-d309-4053-91aa-c05bc80f5fe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:40:17 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-037b3acf-b6a8-491a-9d18-6b8567a5f8aa tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Converting VIF {"id": "f5e9e254-d309-4053-91aa-c05bc80f5fe5", "address": "fa:16:3e:fc:00:4d", "network": {"id": "89966bbc-72a7-4613-a11f-cacdc22d2be7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-217253460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0783de30bbc465fa27a20ae871178b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e9e254-d3", "ovs_interfaceid": "f5e9e254-d309-4053-91aa-c05bc80f5fe5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:40:17 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-037b3acf-b6a8-491a-9d18-6b8567a5f8aa tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:00:4d,bridge_name='br-int',has_traffic_filtering=True,id=f5e9e254-d309-4053-91aa-c05bc80f5fe5,network=Network(89966bbc-72a7-4613-a11f-cacdc22d2be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e9e254-d3') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:40:17 user nova-compute[75066]: DEBUG os_vif [None req-037b3acf-b6a8-491a-9d18-6b8567a5f8aa tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:00:4d,bridge_name='br-int',has_traffic_filtering=True,id=f5e9e254-d309-4053-91aa-c05bc80f5fe5,network=Network(89966bbc-72a7-4613-a11f-cacdc22d2be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e9e254-d3') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:40:17 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:40:17 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf5e9e254-d3, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:40:17 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:40:17 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:40:17 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:40:17 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:40:17 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=943398e4-7c23-4f31-8a19-4d6186c4f4e2) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:40:17 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:40:17 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:40:17 user nova-compute[75066]: INFO os_vif [None req-037b3acf-b6a8-491a-9d18-6b8567a5f8aa tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:00:4d,bridge_name='br-int',has_traffic_filtering=True,id=f5e9e254-d309-4053-91aa-c05bc80f5fe5,network=Network(89966bbc-72a7-4613-a11f-cacdc22d2be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e9e254-d3')
Dec 01 19:40:17 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-037b3acf-b6a8-491a-9d18-6b8567a5f8aa tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0] Deleting instance files /opt/stack/data/nova/instances/d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0_del
Dec 01 19:40:17 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-037b3acf-b6a8-491a-9d18-6b8567a5f8aa tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0] Deletion of /opt/stack/data/nova/instances/d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0_del complete
Dec 01 19:40:17 user nova-compute[75066]: INFO nova.compute.manager [None req-037b3acf-b6a8-491a-9d18-6b8567a5f8aa tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0] Took 0.84 seconds to destroy the instance on the hypervisor.
Dec 01 19:40:17 user nova-compute[75066]: DEBUG oslo.service.loopingcall [None req-037b3acf-b6a8-491a-9d18-6b8567a5f8aa tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75066) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 19:40:17 user nova-compute[75066]: DEBUG nova.compute.manager [-] [instance: d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0] Deallocating network for instance {{(pid=75066) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 19:40:17 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0] deallocate_for_instance() {{(pid=75066) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 19:40:17 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:40:17 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:40:17 user nova-compute[75066]: INFO nova.compute.manager [-] [instance: d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0] Took 0.47 seconds to deallocate network for instance.
Dec 01 19:40:17 user nova-compute[75066]: DEBUG nova.compute.manager [req-fb7e22d8-ae94-4033-b2a3-188c9a183f3d req-b8514a77-0992-4fd7-9cd9-ba0c5f0eec8e service nova] [instance: d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0] Received event network-vif-deleted-f5e9e254-d309-4053-91aa-c05bc80f5fe5 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:40:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-037b3acf-b6a8-491a-9d18-6b8567a5f8aa tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:40:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-037b3acf-b6a8-491a-9d18-6b8567a5f8aa tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:40:17 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-037b3acf-b6a8-491a-9d18-6b8567a5f8aa tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:40:17 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-037b3acf-b6a8-491a-9d18-6b8567a5f8aa tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:40:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-037b3acf-b6a8-491a-9d18-6b8567a5f8aa tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.179s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:40:17 user nova-compute[75066]: INFO nova.scheduler.client.report [None req-037b3acf-b6a8-491a-9d18-6b8567a5f8aa tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Deleted allocations for instance d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0
Dec 01 19:40:18 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-037b3acf-b6a8-491a-9d18-6b8567a5f8aa tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Lock "d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.667s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:40:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:40:18 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:40:18 user nova-compute[75066]: DEBUG nova.compute.manager [req-f5ffd135-44f1-4942-9de7-033970641087 req-9262259c-a573-4992-a8b1-6cea78322206 service nova] [instance: d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0] Received event network-vif-plugged-f5e9e254-d309-4053-91aa-c05bc80f5fe5 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:40:18 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-f5ffd135-44f1-4942-9de7-033970641087 req-9262259c-a573-4992-a8b1-6cea78322206 service nova] Acquiring lock "d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:40:18 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-f5ffd135-44f1-4942-9de7-033970641087 req-9262259c-a573-4992-a8b1-6cea78322206 service nova] Lock "d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:40:18 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-f5ffd135-44f1-4942-9de7-033970641087 req-9262259c-a573-4992-a8b1-6cea78322206 service nova] Lock "d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:40:18 user nova-compute[75066]: DEBUG nova.compute.manager [req-f5ffd135-44f1-4942-9de7-033970641087 req-9262259c-a573-4992-a8b1-6cea78322206 service nova] [instance: d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0] No waiting events found dispatching network-vif-plugged-f5e9e254-d309-4053-91aa-c05bc80f5fe5 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:40:18 user nova-compute[75066]: WARNING nova.compute.manager [req-f5ffd135-44f1-4942-9de7-033970641087 req-9262259c-a573-4992-a8b1-6cea78322206 service nova] [instance: d01c6c53-4e57-4c84-aa23-d5f48f2f1dd0] Received unexpected event network-vif-plugged-f5e9e254-d309-4053-91aa-c05bc80f5fe5 for instance with vm_state deleted and task_state None.
Dec 01 19:40:22 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:40:22 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:40:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:40:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:40:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:40:22 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75066) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 19:40:22 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f7bbc49-b34e-4a0c-b577-7ceadf0cf288/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:40:22 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f7bbc49-b34e-4a0c-b577-7ceadf0cf288/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:40:22 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f7bbc49-b34e-4a0c-b577-7ceadf0cf288/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:40:22 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f7bbc49-b34e-4a0c-b577-7ceadf0cf288/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:40:22 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/544d6830-e6cf-4c06-95b3-151da602bc6d/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:40:22 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/544d6830-e6cf-4c06-95b3-151da602bc6d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:40:22 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/544d6830-e6cf-4c06-95b3-151da602bc6d/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:40:23 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/544d6830-e6cf-4c06-95b3-151da602bc6d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:40:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:40:23 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:40:23 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:40:23 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Hypervisor/Node resource view: name=user free_ram=8610MB free_disk=24.91122055053711GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75066) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 19:40:23 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:40:23 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:40:23 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 544d6830-e6cf-4c06-95b3-151da602bc6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:40:23 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:40:23 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 19:40:23 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 19:40:23 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:40:23 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:40:23 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Compute_service record updated for user:user {{(pid=75066) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 19:40:23 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.220s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:40:24 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:40:24 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:40:25 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:40:25 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Starting heal instance info cache {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 19:40:25 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Rebuilding the list of instances to heal {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 19:40:25 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "refresh_cache-544d6830-e6cf-4c06-95b3-151da602bc6d" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:40:25 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquired lock "refresh_cache-544d6830-e6cf-4c06-95b3-151da602bc6d" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:40:25 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Forcefully refreshing network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 19:40:25 user nova-compute[75066]: DEBUG nova.objects.instance [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lazy-loading 'info_cache' on Instance uuid 544d6830-e6cf-4c06-95b3-151da602bc6d {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:40:26 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Updating instance_info_cache with network_info: [{"id": "6a67de06-74d9-4b6a-ae10-8fbe730f6558", "address": "fa:16:3e:b1:1b:aa", "network": {"id": "10a180e0-96f5-4b54-8f70-8955d6c0e288", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1853322930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b227dfb7ede2407ba03f2840bc5de4f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a67de06-74", "ovs_interfaceid": "6a67de06-74d9-4b6a-ae10-8fbe730f6558", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:40:26 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Releasing lock "refresh_cache-544d6830-e6cf-4c06-95b3-151da602bc6d" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:40:26 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Updated the network info_cache for instance {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 19:40:27 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:40:27 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:40:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:40:32 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:40:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:40:37 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:40:42 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:40:42 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:40:44 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:40:47 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:40:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:40:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:41:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:41:07 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:41:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Acquiring lock "17401a50-7650-4fb7-9b01-abcce8e7f457" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:41:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Lock "17401a50-7650-4fb7-9b01-abcce8e7f457" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:41:07 user nova-compute[75066]: DEBUG nova.compute.manager [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: 17401a50-7650-4fb7-9b01-abcce8e7f457] Starting instance... {{(pid=75066) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 19:41:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:41:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:41:07 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75066) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 19:41:07 user nova-compute[75066]: INFO nova.compute.claims [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: 17401a50-7650-4fb7-9b01-abcce8e7f457] Claim successful on node user
Dec 01 19:41:07 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:41:07 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:41:08 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.252s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:41:08 user nova-compute[75066]: DEBUG nova.compute.manager [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: 17401a50-7650-4fb7-9b01-abcce8e7f457] Start building networks asynchronously for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 19:41:08 user nova-compute[75066]: DEBUG nova.compute.manager [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: 17401a50-7650-4fb7-9b01-abcce8e7f457] Allocating IP information in the background. {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 19:41:08 user nova-compute[75066]: DEBUG nova.network.neutron [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: 17401a50-7650-4fb7-9b01-abcce8e7f457] allocate_for_instance() {{(pid=75066) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 19:41:08 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: 17401a50-7650-4fb7-9b01-abcce8e7f457] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 19:41:08 user nova-compute[75066]: DEBUG nova.compute.manager [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: 17401a50-7650-4fb7-9b01-abcce8e7f457] Start building block device mappings for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 19:41:08 user nova-compute[75066]: DEBUG nova.policy [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '259ab964702944ba980aa28a8f38d3fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0783de30bbc465fa27a20ae871178b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75066) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 19:41:08 user nova-compute[75066]: DEBUG nova.compute.manager [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: 17401a50-7650-4fb7-9b01-abcce8e7f457] Start spawning the instance on the hypervisor. {{(pid=75066) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 19:41:08 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: 17401a50-7650-4fb7-9b01-abcce8e7f457] Creating instance directory {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 19:41:08 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: 17401a50-7650-4fb7-9b01-abcce8e7f457] Creating image(s)
Dec 01 19:41:08 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Acquiring lock "/opt/stack/data/nova/instances/17401a50-7650-4fb7-9b01-abcce8e7f457/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:41:08 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Lock "/opt/stack/data/nova/instances/17401a50-7650-4fb7-9b01-abcce8e7f457/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:41:08 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Lock "/opt/stack/data/nova/instances/17401a50-7650-4fb7-9b01-abcce8e7f457/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:41:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:41:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.184s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:41:08 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Acquiring lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:41:08 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:41:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:41:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.171s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:41:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/17401a50-7650-4fb7-9b01-abcce8e7f457/disk 1073741824 {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:41:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/17401a50-7650-4fb7-9b01-abcce8e7f457/disk 1073741824" returned: 0 in 0.053s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:41:08 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:41:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:41:08 user nova-compute[75066]: DEBUG nova.network.neutron [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: 17401a50-7650-4fb7-9b01-abcce8e7f457] Successfully created port: 67af355d-32f0-4ea5-ae6d-b341aec1e169 {{(pid=75066) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 19:41:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.174s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:41:08 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Checking if we can resize image /opt/stack/data/nova/instances/17401a50-7650-4fb7-9b01-abcce8e7f457/disk. size=1073741824 {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 19:41:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17401a50-7650-4fb7-9b01-abcce8e7f457/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:41:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17401a50-7650-4fb7-9b01-abcce8e7f457/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:41:09 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Cannot resize image /opt/stack/data/nova/instances/17401a50-7650-4fb7-9b01-abcce8e7f457/disk to a smaller size. {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 19:41:09 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: 17401a50-7650-4fb7-9b01-abcce8e7f457] Created local disks {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 19:41:09 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: 17401a50-7650-4fb7-9b01-abcce8e7f457] Ensure instance console log exists: /opt/stack/data/nova/instances/17401a50-7650-4fb7-9b01-abcce8e7f457/console.log {{(pid=75066) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 19:41:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:41:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:41:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:41:09 user nova-compute[75066]: DEBUG nova.network.neutron [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: 17401a50-7650-4fb7-9b01-abcce8e7f457] Successfully updated port: 67af355d-32f0-4ea5-ae6d-b341aec1e169 {{(pid=75066) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 19:41:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Acquiring lock "refresh_cache-17401a50-7650-4fb7-9b01-abcce8e7f457" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:41:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Acquired lock "refresh_cache-17401a50-7650-4fb7-9b01-abcce8e7f457" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:41:09 user nova-compute[75066]: DEBUG nova.network.neutron [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: 17401a50-7650-4fb7-9b01-abcce8e7f457] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:41:09 user nova-compute[75066]: DEBUG nova.network.neutron [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: 17401a50-7650-4fb7-9b01-abcce8e7f457] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:41:09 user nova-compute[75066]: DEBUG nova.compute.manager [req-a212d596-cfe7-4ddf-8a97-90c59186c03b req-f1e77e32-00c6-42fc-be10-dd2ca1141741 service nova] [instance: 17401a50-7650-4fb7-9b01-abcce8e7f457] Received event network-changed-67af355d-32f0-4ea5-ae6d-b341aec1e169 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:41:09 user nova-compute[75066]: DEBUG nova.compute.manager [req-a212d596-cfe7-4ddf-8a97-90c59186c03b req-f1e77e32-00c6-42fc-be10-dd2ca1141741 service nova] [instance: 17401a50-7650-4fb7-9b01-abcce8e7f457] Refreshing instance network info cache due to event network-changed-67af355d-32f0-4ea5-ae6d-b341aec1e169. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:41:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a212d596-cfe7-4ddf-8a97-90c59186c03b req-f1e77e32-00c6-42fc-be10-dd2ca1141741 service nova] Acquiring lock "refresh_cache-17401a50-7650-4fb7-9b01-abcce8e7f457" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:41:10 user nova-compute[75066]: DEBUG nova.network.neutron [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: 17401a50-7650-4fb7-9b01-abcce8e7f457] Updating instance_info_cache with network_info: [{"id": "67af355d-32f0-4ea5-ae6d-b341aec1e169", "address": "fa:16:3e:3f:d2:5f", "network": {"id": "89966bbc-72a7-4613-a11f-cacdc22d2be7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-217253460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0783de30bbc465fa27a20ae871178b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67af355d-32", "ovs_interfaceid": "67af355d-32f0-4ea5-ae6d-b341aec1e169", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:41:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Releasing lock "refresh_cache-17401a50-7650-4fb7-9b01-abcce8e7f457" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:41:10 user nova-compute[75066]: DEBUG nova.compute.manager [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: 17401a50-7650-4fb7-9b01-abcce8e7f457] Instance network_info: |[{"id": "67af355d-32f0-4ea5-ae6d-b341aec1e169", "address": "fa:16:3e:3f:d2:5f", "network": {"id": "89966bbc-72a7-4613-a11f-cacdc22d2be7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-217253460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0783de30bbc465fa27a20ae871178b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67af355d-32", "ovs_interfaceid": "67af355d-32f0-4ea5-ae6d-b341aec1e169", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 19:41:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a212d596-cfe7-4ddf-8a97-90c59186c03b req-f1e77e32-00c6-42fc-be10-dd2ca1141741 service nova] Acquired lock "refresh_cache-17401a50-7650-4fb7-9b01-abcce8e7f457" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:41:10 user nova-compute[75066]: DEBUG nova.network.neutron [req-a212d596-cfe7-4ddf-8a97-90c59186c03b req-f1e77e32-00c6-42fc-be10-dd2ca1141741 service nova] [instance: 17401a50-7650-4fb7-9b01-abcce8e7f457] Refreshing network info cache for port 67af355d-32f0-4ea5-ae6d-b341aec1e169 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:41:10 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: 17401a50-7650-4fb7-9b01-abcce8e7f457] Start _get_guest_xml network_info=[{"id": "67af355d-32f0-4ea5-ae6d-b341aec1e169", "address": "fa:16:3e:3f:d2:5f", "network": {"id": "89966bbc-72a7-4613-a11f-cacdc22d2be7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-217253460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0783de30bbc465fa27a20ae871178b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67af355d-32", "ovs_interfaceid": "67af355d-32f0-4ea5-ae6d-b341aec1e169", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'image_id': '900b237b-e99c-4fdd-a44f-dcb7a08baa86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:41:10 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:41:10 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:41:10 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:41:10 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:41:10 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:41:10 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:41:10 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:41:10 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:41:10 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:41:10 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:41:10 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:41:10 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:41:10 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:41:10 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:41:10 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:41:10 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:41:10 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:41:10 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:41:10 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:41:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1374449381',display_name='tempest-VolumesActionsTest-instance-1374449381',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1374449381',id=42,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0783de30bbc465fa27a20ae871178b8',ramdisk_id='',reservation_id='r-mw8p73r8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1936494950',owner_user_name='tempest-VolumesActionsTest-1936494950-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:41:08Z,user_data=None,user_id='259ab964702944ba980aa28a8f38d3fb',uuid=17401a50-7650-4fb7-9b01-abcce8e7f457,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67af355d-32f0-4ea5-ae6d-b341aec1e169", "address": "fa:16:3e:3f:d2:5f", "network": {"id": "89966bbc-72a7-4613-a11f-cacdc22d2be7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-217253460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0783de30bbc465fa27a20ae871178b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67af355d-32", "ovs_interfaceid": "67af355d-32f0-4ea5-ae6d-b341aec1e169", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:41:10 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Converting VIF {"id": "67af355d-32f0-4ea5-ae6d-b341aec1e169", "address": "fa:16:3e:3f:d2:5f", "network": {"id": "89966bbc-72a7-4613-a11f-cacdc22d2be7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-217253460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0783de30bbc465fa27a20ae871178b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67af355d-32", "ovs_interfaceid": "67af355d-32f0-4ea5-ae6d-b341aec1e169", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:41:10 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:d2:5f,bridge_name='br-int',has_traffic_filtering=True,id=67af355d-32f0-4ea5-ae6d-b341aec1e169,network=Network(89966bbc-72a7-4613-a11f-cacdc22d2be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67af355d-32') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:41:10 user nova-compute[75066]: DEBUG nova.objects.instance [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Lazy-loading 'pci_devices' on Instance uuid 17401a50-7650-4fb7-9b01-abcce8e7f457 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:41:10 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: 17401a50-7650-4fb7-9b01-abcce8e7f457] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:41:10 user nova-compute[75066]:   <uuid>17401a50-7650-4fb7-9b01-abcce8e7f457</uuid>
Dec 01 19:41:10 user nova-compute[75066]:   <name>instance-0000002a</name>
Dec 01 19:41:10 user nova-compute[75066]:   <memory>524288</memory>
Dec 01 19:41:10 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:41:10 user nova-compute[75066]:   <metadata>
Dec 01 19:41:10 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:41:10 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:41:10 user nova-compute[75066]:       <nova:name>tempest-VolumesActionsTest-instance-1374449381</nova:name>
Dec 01 19:41:10 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:41:10</nova:creationTime>
Dec 01 19:41:10 user nova-compute[75066]:       <nova:flavor name="m1.tiny">
Dec 01 19:41:10 user nova-compute[75066]:         <nova:memory>512</nova:memory>
Dec 01 19:41:10 user nova-compute[75066]:         <nova:disk>1</nova:disk>
Dec 01 19:41:10 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:41:10 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:41:10 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:41:10 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:41:10 user nova-compute[75066]:       <nova:owner>
Dec 01 19:41:10 user nova-compute[75066]:         <nova:user uuid="259ab964702944ba980aa28a8f38d3fb">tempest-VolumesActionsTest-1936494950-project-member</nova:user>
Dec 01 19:41:10 user nova-compute[75066]:         <nova:project uuid="c0783de30bbc465fa27a20ae871178b8">tempest-VolumesActionsTest-1936494950</nova:project>
Dec 01 19:41:10 user nova-compute[75066]:       </nova:owner>
Dec 01 19:41:10 user nova-compute[75066]:       <nova:root type="image" uuid="900b237b-e99c-4fdd-a44f-dcb7a08baa86"/>
Dec 01 19:41:10 user nova-compute[75066]:       <nova:ports>
Dec 01 19:41:10 user nova-compute[75066]:         <nova:port uuid="67af355d-32f0-4ea5-ae6d-b341aec1e169">
Dec 01 19:41:10 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 01 19:41:10 user nova-compute[75066]:         </nova:port>
Dec 01 19:41:10 user nova-compute[75066]:       </nova:ports>
Dec 01 19:41:10 user nova-compute[75066]:     </nova:instance>
Dec 01 19:41:10 user nova-compute[75066]:   </metadata>
Dec 01 19:41:10 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:41:10 user nova-compute[75066]:     <system>
Dec 01 19:41:10 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:41:10 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:41:10 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:41:10 user nova-compute[75066]:       <entry name="serial">17401a50-7650-4fb7-9b01-abcce8e7f457</entry>
Dec 01 19:41:10 user nova-compute[75066]:       <entry name="uuid">17401a50-7650-4fb7-9b01-abcce8e7f457</entry>
Dec 01 19:41:10 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:41:10 user nova-compute[75066]:     </system>
Dec 01 19:41:10 user nova-compute[75066]:   </sysinfo>
Dec 01 19:41:10 user nova-compute[75066]:   <os>
Dec 01 19:41:10 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:41:10 user nova-compute[75066]:     <boot dev="hd"/>
Dec 01 19:41:10 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:41:10 user nova-compute[75066]:   </os>
Dec 01 19:41:10 user nova-compute[75066]:   <features>
Dec 01 19:41:10 user nova-compute[75066]:     <acpi/>
Dec 01 19:41:10 user nova-compute[75066]:     <apic/>
Dec 01 19:41:10 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:41:10 user nova-compute[75066]:   </features>
Dec 01 19:41:10 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:41:10 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:41:10 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:41:10 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:41:10 user nova-compute[75066]:   </clock>
Dec 01 19:41:10 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:41:10 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:41:10 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:41:10 user nova-compute[75066]:   </cpu>
Dec 01 19:41:10 user nova-compute[75066]:   <devices>
Dec 01 19:41:10 user nova-compute[75066]:     <disk type="file" device="disk">
Dec 01 19:41:10 user nova-compute[75066]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 19:41:10 user nova-compute[75066]:       <source file="/opt/stack/data/nova/instances/17401a50-7650-4fb7-9b01-abcce8e7f457/disk"/>
Dec 01 19:41:10 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:41:10 user nova-compute[75066]:     </disk>
Dec 01 19:41:10 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:41:10 user nova-compute[75066]:       <mac address="fa:16:3e:3f:d2:5f"/>
Dec 01 19:41:10 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:41:10 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:41:10 user nova-compute[75066]:       <target dev="tap67af355d-32"/>
Dec 01 19:41:10 user nova-compute[75066]:     </interface>
Dec 01 19:41:10 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:41:10 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/17401a50-7650-4fb7-9b01-abcce8e7f457/console.log" append="off"/>
Dec 01 19:41:10 user nova-compute[75066]:     </serial>
Dec 01 19:41:10 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:41:10 user nova-compute[75066]:     <video>
Dec 01 19:41:10 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:41:10 user nova-compute[75066]:     </video>
Dec 01 19:41:10 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:41:10 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:41:10 user nova-compute[75066]:     </rng>
Dec 01 19:41:10 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:41:10 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:41:10 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:41:10 user nova-compute[75066]:     </memballoon>
Dec 01 19:41:10 user nova-compute[75066]:   </devices>
Dec 01 19:41:10 user nova-compute[75066]: </domain>
Dec 01 19:41:10 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:41:10 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:41:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1374449381',display_name='tempest-VolumesActionsTest-instance-1374449381',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1374449381',id=42,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0783de30bbc465fa27a20ae871178b8',ramdisk_id='',reservation_id='r-mw8p73r8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1936494950',owner_user_name='tempest-VolumesActionsTest-1936494950-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:41:08Z,user_data=None,user_id='259ab964702944ba980aa28a8f38d3fb',uuid=17401a50-7650-4fb7-9b01-abcce8e7f457,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67af355d-32f0-4ea5-ae6d-b341aec1e169", "address": "fa:16:3e:3f:d2:5f", "network": {"id": "89966bbc-72a7-4613-a11f-cacdc22d2be7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-217253460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0783de30bbc465fa27a20ae871178b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67af355d-32", "ovs_interfaceid": "67af355d-32f0-4ea5-ae6d-b341aec1e169", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:41:10 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Converting VIF {"id": "67af355d-32f0-4ea5-ae6d-b341aec1e169", "address": "fa:16:3e:3f:d2:5f", "network": {"id": "89966bbc-72a7-4613-a11f-cacdc22d2be7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-217253460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0783de30bbc465fa27a20ae871178b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67af355d-32", "ovs_interfaceid": "67af355d-32f0-4ea5-ae6d-b341aec1e169", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:41:10 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:d2:5f,bridge_name='br-int',has_traffic_filtering=True,id=67af355d-32f0-4ea5-ae6d-b341aec1e169,network=Network(89966bbc-72a7-4613-a11f-cacdc22d2be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67af355d-32') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:41:10 user nova-compute[75066]: DEBUG os_vif [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:d2:5f,bridge_name='br-int',has_traffic_filtering=True,id=67af355d-32f0-4ea5-ae6d-b341aec1e169,network=Network(89966bbc-72a7-4613-a11f-cacdc22d2be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67af355d-32') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:41:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:41:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:41:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:41:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:41:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c3562d15-8a05-5bd7-a4d6-944fa12884f8', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:41:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:41:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:41:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap67af355d-32, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:41:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap67af355d-32, col_values=(('qos', UUID('602c79a0-951c-4665-af37-90d1ba83905a')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:41:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap67af355d-32, col_values=(('external_ids', {'iface-id': '67af355d-32f0-4ea5-ae6d-b341aec1e169', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:d2:5f', 'vm-uuid': '17401a50-7650-4fb7-9b01-abcce8e7f457'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:41:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:41:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:41:10 user nova-compute[75066]: INFO os_vif [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:d2:5f,bridge_name='br-int',has_traffic_filtering=True,id=67af355d-32f0-4ea5-ae6d-b341aec1e169,network=Network(89966bbc-72a7-4613-a11f-cacdc22d2be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67af355d-32')
Dec 01 19:41:10 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:41:10 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] No VIF found with MAC fa:16:3e:3f:d2:5f, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:41:10 user nova-compute[75066]: DEBUG nova.network.neutron [req-a212d596-cfe7-4ddf-8a97-90c59186c03b req-f1e77e32-00c6-42fc-be10-dd2ca1141741 service nova] [instance: 17401a50-7650-4fb7-9b01-abcce8e7f457] Updated VIF entry in instance network info cache for port 67af355d-32f0-4ea5-ae6d-b341aec1e169. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:41:10 user nova-compute[75066]: DEBUG nova.network.neutron [req-a212d596-cfe7-4ddf-8a97-90c59186c03b req-f1e77e32-00c6-42fc-be10-dd2ca1141741 service nova] [instance: 17401a50-7650-4fb7-9b01-abcce8e7f457] Updating instance_info_cache with network_info: [{"id": "67af355d-32f0-4ea5-ae6d-b341aec1e169", "address": "fa:16:3e:3f:d2:5f", "network": {"id": "89966bbc-72a7-4613-a11f-cacdc22d2be7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-217253460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0783de30bbc465fa27a20ae871178b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67af355d-32", "ovs_interfaceid": "67af355d-32f0-4ea5-ae6d-b341aec1e169", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:41:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a212d596-cfe7-4ddf-8a97-90c59186c03b req-f1e77e32-00c6-42fc-be10-dd2ca1141741 service nova] Releasing lock "refresh_cache-17401a50-7650-4fb7-9b01-abcce8e7f457" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:41:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:41:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:41:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:41:11 user nova-compute[75066]: DEBUG nova.compute.manager [req-a64cf5bf-0c22-4323-a716-89d9a2593927 req-42f7af64-56ac-41f9-9209-d12a89c99c3f service nova] [instance: 17401a50-7650-4fb7-9b01-abcce8e7f457] Received event network-vif-plugged-67af355d-32f0-4ea5-ae6d-b341aec1e169 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:41:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a64cf5bf-0c22-4323-a716-89d9a2593927 req-42f7af64-56ac-41f9-9209-d12a89c99c3f service nova] Acquiring lock "17401a50-7650-4fb7-9b01-abcce8e7f457-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:41:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a64cf5bf-0c22-4323-a716-89d9a2593927 req-42f7af64-56ac-41f9-9209-d12a89c99c3f service nova] Lock "17401a50-7650-4fb7-9b01-abcce8e7f457-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:41:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a64cf5bf-0c22-4323-a716-89d9a2593927 req-42f7af64-56ac-41f9-9209-d12a89c99c3f service nova] Lock "17401a50-7650-4fb7-9b01-abcce8e7f457-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:41:11 user nova-compute[75066]: DEBUG nova.compute.manager [req-a64cf5bf-0c22-4323-a716-89d9a2593927 req-42f7af64-56ac-41f9-9209-d12a89c99c3f service nova] [instance: 17401a50-7650-4fb7-9b01-abcce8e7f457] No waiting events found dispatching network-vif-plugged-67af355d-32f0-4ea5-ae6d-b341aec1e169 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:41:11 user nova-compute[75066]: WARNING nova.compute.manager [req-a64cf5bf-0c22-4323-a716-89d9a2593927 req-42f7af64-56ac-41f9-9209-d12a89c99c3f service nova] [instance: 17401a50-7650-4fb7-9b01-abcce8e7f457] Received unexpected event network-vif-plugged-67af355d-32f0-4ea5-ae6d-b341aec1e169 for instance with vm_state building and task_state spawning.
Dec 01 19:41:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:41:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:41:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:41:13 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:41:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:41:13 user nova-compute[75066]: DEBUG nova.compute.manager [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: 17401a50-7650-4fb7-9b01-abcce8e7f457] Instance event wait completed in 0 seconds for  {{(pid=75066) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 19:41:13 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: 17401a50-7650-4fb7-9b01-abcce8e7f457] Guest created on hypervisor {{(pid=75066) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 19:41:13 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 17401a50-7650-4fb7-9b01-abcce8e7f457] Instance spawned successfully.
Dec 01 19:41:13 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: 17401a50-7650-4fb7-9b01-abcce8e7f457] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 19:41:13 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: 17401a50-7650-4fb7-9b01-abcce8e7f457] Found default for hw_cdrom_bus of ide {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:41:13 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: 17401a50-7650-4fb7-9b01-abcce8e7f457] Found default for hw_disk_bus of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:41:13 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: 17401a50-7650-4fb7-9b01-abcce8e7f457] Found default for hw_input_bus of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:41:13 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: 17401a50-7650-4fb7-9b01-abcce8e7f457] Found default for hw_pointer_model of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:41:13 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: 17401a50-7650-4fb7-9b01-abcce8e7f457] Found default for hw_video_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:41:13 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: 17401a50-7650-4fb7-9b01-abcce8e7f457] Found default for hw_vif_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:41:13 user nova-compute[75066]: INFO nova.compute.manager [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: 17401a50-7650-4fb7-9b01-abcce8e7f457] Took 5.52 seconds to spawn the instance on the hypervisor.
Dec 01 19:41:13 user nova-compute[75066]: DEBUG nova.compute.manager [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: 17401a50-7650-4fb7-9b01-abcce8e7f457] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:41:13 user nova-compute[75066]: DEBUG nova.compute.manager [req-db7e566f-6fd2-4577-a661-05ffce355a09 req-fe370b66-99ce-41bf-8628-e63119278c6c service nova] [instance: 17401a50-7650-4fb7-9b01-abcce8e7f457] Received event network-vif-plugged-67af355d-32f0-4ea5-ae6d-b341aec1e169 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:41:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-db7e566f-6fd2-4577-a661-05ffce355a09 req-fe370b66-99ce-41bf-8628-e63119278c6c service nova] Acquiring lock "17401a50-7650-4fb7-9b01-abcce8e7f457-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:41:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-db7e566f-6fd2-4577-a661-05ffce355a09 req-fe370b66-99ce-41bf-8628-e63119278c6c service nova] Lock "17401a50-7650-4fb7-9b01-abcce8e7f457-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:41:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-db7e566f-6fd2-4577-a661-05ffce355a09 req-fe370b66-99ce-41bf-8628-e63119278c6c service nova] Lock "17401a50-7650-4fb7-9b01-abcce8e7f457-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:41:13 user nova-compute[75066]: DEBUG nova.compute.manager [req-db7e566f-6fd2-4577-a661-05ffce355a09 req-fe370b66-99ce-41bf-8628-e63119278c6c service nova] [instance: 17401a50-7650-4fb7-9b01-abcce8e7f457] No waiting events found dispatching network-vif-plugged-67af355d-32f0-4ea5-ae6d-b341aec1e169 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:41:13 user nova-compute[75066]: WARNING nova.compute.manager [req-db7e566f-6fd2-4577-a661-05ffce355a09 req-fe370b66-99ce-41bf-8628-e63119278c6c service nova] [instance: 17401a50-7650-4fb7-9b01-abcce8e7f457] Received unexpected event network-vif-plugged-67af355d-32f0-4ea5-ae6d-b341aec1e169 for instance with vm_state building and task_state spawning.
Dec 01 19:41:13 user nova-compute[75066]: INFO nova.compute.manager [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: 17401a50-7650-4fb7-9b01-abcce8e7f457] Took 6.16 seconds to build instance.
Dec 01 19:41:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-715c3c90-9ee2-465b-9a21-0da894be6a4b tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Lock "17401a50-7650-4fb7-9b01-abcce8e7f457" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.253s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:41:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:41:15 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:41:15 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75066) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 19:41:18 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:41:18 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:41:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:41:19 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:41:19 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75066) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 01 19:41:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:41:24 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:41:24 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:41:24 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:41:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:41:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:41:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:41:24 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75066) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 19:41:24 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f7bbc49-b34e-4a0c-b577-7ceadf0cf288/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:41:24 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f7bbc49-b34e-4a0c-b577-7ceadf0cf288/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:41:24 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f7bbc49-b34e-4a0c-b577-7ceadf0cf288/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:41:24 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f7bbc49-b34e-4a0c-b577-7ceadf0cf288/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:41:24 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17401a50-7650-4fb7-9b01-abcce8e7f457/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:41:24 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17401a50-7650-4fb7-9b01-abcce8e7f457/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:41:24 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17401a50-7650-4fb7-9b01-abcce8e7f457/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:41:25 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17401a50-7650-4fb7-9b01-abcce8e7f457/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:41:25 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:41:25 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/544d6830-e6cf-4c06-95b3-151da602bc6d/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:41:25 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/544d6830-e6cf-4c06-95b3-151da602bc6d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:41:25 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/544d6830-e6cf-4c06-95b3-151da602bc6d/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:41:25 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/544d6830-e6cf-4c06-95b3-151da602bc6d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:41:25 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:41:25 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:41:25 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Hypervisor/Node resource view: name=user free_ram=8648MB free_disk=24.897136688232422GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75066) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 19:41:25 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:41:25 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:41:26 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 544d6830-e6cf-4c06-95b3-151da602bc6d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:41:26 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:41:26 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 17401a50-7650-4fb7-9b01-abcce8e7f457 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:41:26 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 19:41:26 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 19:41:26 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Refreshing inventories for resource provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 01 19:41:26 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Updating ProviderTree inventory for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 01 19:41:26 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Updating inventory in ProviderTree for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 01 19:41:26 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Refreshing aggregate associations for resource provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62, aggregates: None {{(pid=75066) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 01 19:41:26 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Refreshing trait associations for resource provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62, traits: COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SECURITY_UEFI_SECURE_BOOT {{(pid=75066) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 01 19:41:26 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:41:26 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:41:26 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Compute_service record updated for user:user {{(pid=75066) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 19:41:26 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.601s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:41:27 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:41:27 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:41:27 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Starting heal instance info cache {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 19:41:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "refresh_cache-1f7bbc49-b34e-4a0c-b577-7ceadf0cf288" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:41:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquired lock "refresh_cache-1f7bbc49-b34e-4a0c-b577-7ceadf0cf288" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:41:27 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Forcefully refreshing network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 19:41:27 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Updating instance_info_cache with network_info: [{"id": "5b2ebcf7-2624-49c2-bfa0-c5b694a37ec8", "address": "fa:16:3e:6e:e4:53", "network": {"id": "955d6293-ede6-4cb4-8cee-0157dbad93ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-603640322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109097a30a40419092c74f4c7a695ce4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2ebcf7-26", "ovs_interfaceid": "5b2ebcf7-2624-49c2-bfa0-c5b694a37ec8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:41:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Releasing lock "refresh_cache-1f7bbc49-b34e-4a0c-b577-7ceadf0cf288" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:41:27 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Updated the network info_cache for instance {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 19:41:27 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:41:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:41:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:41:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:41:35 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:41:35 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:41:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:41:40 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:41:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:41:45 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:41:45 user nova-compute[75066]: DEBUG nova.compute.manager [req-8c50085a-a5d7-46ee-8b39-a663ddc50e25 req-8a27c7e7-9eff-4afb-a9c8-33029722357c service nova] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Received event network-changed-6a67de06-74d9-4b6a-ae10-8fbe730f6558 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:41:45 user nova-compute[75066]: DEBUG nova.compute.manager [req-8c50085a-a5d7-46ee-8b39-a663ddc50e25 req-8a27c7e7-9eff-4afb-a9c8-33029722357c service nova] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Refreshing instance network info cache due to event network-changed-6a67de06-74d9-4b6a-ae10-8fbe730f6558. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:41:45 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-8c50085a-a5d7-46ee-8b39-a663ddc50e25 req-8a27c7e7-9eff-4afb-a9c8-33029722357c service nova] Acquiring lock "refresh_cache-544d6830-e6cf-4c06-95b3-151da602bc6d" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:41:45 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-8c50085a-a5d7-46ee-8b39-a663ddc50e25 req-8a27c7e7-9eff-4afb-a9c8-33029722357c service nova] Acquired lock "refresh_cache-544d6830-e6cf-4c06-95b3-151da602bc6d" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:41:45 user nova-compute[75066]: DEBUG nova.network.neutron [req-8c50085a-a5d7-46ee-8b39-a663ddc50e25 req-8a27c7e7-9eff-4afb-a9c8-33029722357c service nova] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Refreshing network info cache for port 6a67de06-74d9-4b6a-ae10-8fbe730f6558 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:41:45 user nova-compute[75066]: DEBUG nova.network.neutron [req-8c50085a-a5d7-46ee-8b39-a663ddc50e25 req-8a27c7e7-9eff-4afb-a9c8-33029722357c service nova] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Updated VIF entry in instance network info cache for port 6a67de06-74d9-4b6a-ae10-8fbe730f6558. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:41:45 user nova-compute[75066]: DEBUG nova.network.neutron [req-8c50085a-a5d7-46ee-8b39-a663ddc50e25 req-8a27c7e7-9eff-4afb-a9c8-33029722357c service nova] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Updating instance_info_cache with network_info: [{"id": "6a67de06-74d9-4b6a-ae10-8fbe730f6558", "address": "fa:16:3e:b1:1b:aa", "network": {"id": "10a180e0-96f5-4b54-8f70-8955d6c0e288", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1853322930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b227dfb7ede2407ba03f2840bc5de4f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a67de06-74", "ovs_interfaceid": "6a67de06-74d9-4b6a-ae10-8fbe730f6558", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:41:45 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-8c50085a-a5d7-46ee-8b39-a663ddc50e25 req-8a27c7e7-9eff-4afb-a9c8-33029722357c service nova] Releasing lock "refresh_cache-544d6830-e6cf-4c06-95b3-151da602bc6d" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:41:48 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:41:48 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Cleaning up deleted instances {{(pid=75066) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 01 19:41:48 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:41:48 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] There are 0 instances to clean {{(pid=75066) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 01 19:41:49 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ca841c81-e534-4f43-ba2c-88d9579b0073 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Acquiring lock "544d6830-e6cf-4c06-95b3-151da602bc6d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:41:49 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ca841c81-e534-4f43-ba2c-88d9579b0073 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lock "544d6830-e6cf-4c06-95b3-151da602bc6d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:41:49 user nova-compute[75066]: DEBUG nova.objects.instance [None req-ca841c81-e534-4f43-ba2c-88d9579b0073 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lazy-loading 'flavor' on Instance uuid 544d6830-e6cf-4c06-95b3-151da602bc6d {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:41:49 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ca841c81-e534-4f43-ba2c-88d9579b0073 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lock "544d6830-e6cf-4c06-95b3-151da602bc6d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:41:49 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ca841c81-e534-4f43-ba2c-88d9579b0073 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Acquiring lock "544d6830-e6cf-4c06-95b3-151da602bc6d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:41:49 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ca841c81-e534-4f43-ba2c-88d9579b0073 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lock "544d6830-e6cf-4c06-95b3-151da602bc6d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:41:49 user nova-compute[75066]: INFO nova.compute.manager [None req-ca841c81-e534-4f43-ba2c-88d9579b0073 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Attaching volume 6b572e6d-086d-45ff-9351-17c8a8f1325d to /dev/vdb
Dec 01 19:41:49 user nova-compute[75066]: DEBUG os_brick.utils [None req-ca841c81-e534-4f43-ba2c-88d9579b0073 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:41:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:41:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:41:49 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c63c62c-ede7-475b-9c6d-93768a15b876]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1959854982f\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:41:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:41:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:41:49 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1e14ab-dc95-46b1-9207-dc21840e4135]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:41:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:41:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:41:49 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[3159f1dc-7789-42b8-b50f-c7a29d6a6e2d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:41:49 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02fc1c3-aa4b-43ca-bc26-5dd347a5bd2a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:41:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ca841c81-e534-4f43-ba2c-88d9579b0073 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Running cmd (subprocess): nvme version {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:41:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ca841c81-e534-4f43-ba2c-88d9579b0073 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] 'nvme version' failed. Not Retrying. {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:41:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ca841c81-e534-4f43-ba2c-88d9579b0073 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] nvme not present on system {{(pid=75066) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 19:41:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:41:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:41:49 user nova-compute[75066]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 19:41:49 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4492520-9bde-4078-87f4-d2d1b37e6a55]: (4, '') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:41:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-ca841c81-e534-4f43-ba2c-88d9579b0073 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75066) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 19:41:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-ca841c81-e534-4f43-ba2c-88d9579b0073 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 19:41:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-ca841c81-e534-4f43-ba2c-88d9579b0073 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] LIGHTOS: no hostnqn found. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 19:41:49 user nova-compute[75066]: DEBUG os_brick.utils [None req-ca841c81-e534-4f43-ba2c-88d9579b0073 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1959854982f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:41:49 user nova-compute[75066]: DEBUG nova.virt.block_device [None req-ca841c81-e534-4f43-ba2c-88d9579b0073 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Updating existing volume attachment record: 3eae05cd-7b23-4721-84de-a24f3d277fa0 {{(pid=75066) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 19:41:50 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:41:50 user nova-compute[75066]: DEBUG nova.compute.manager [req-bcfecc77-d921-4b30-a3da-04741b75aad1 req-9a222e20-eb91-4fd2-91e3-e013cdc3124b service nova] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Received event network-changed-5b2ebcf7-2624-49c2-bfa0-c5b694a37ec8 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:41:50 user nova-compute[75066]: DEBUG nova.compute.manager [req-bcfecc77-d921-4b30-a3da-04741b75aad1 req-9a222e20-eb91-4fd2-91e3-e013cdc3124b service nova] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Refreshing instance network info cache due to event network-changed-5b2ebcf7-2624-49c2-bfa0-c5b694a37ec8. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:41:50 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-bcfecc77-d921-4b30-a3da-04741b75aad1 req-9a222e20-eb91-4fd2-91e3-e013cdc3124b service nova] Acquiring lock "refresh_cache-1f7bbc49-b34e-4a0c-b577-7ceadf0cf288" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:41:50 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-bcfecc77-d921-4b30-a3da-04741b75aad1 req-9a222e20-eb91-4fd2-91e3-e013cdc3124b service nova] Acquired lock "refresh_cache-1f7bbc49-b34e-4a0c-b577-7ceadf0cf288" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:41:50 user nova-compute[75066]: DEBUG nova.network.neutron [req-bcfecc77-d921-4b30-a3da-04741b75aad1 req-9a222e20-eb91-4fd2-91e3-e013cdc3124b service nova] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Refreshing network info cache for port 5b2ebcf7-2624-49c2-bfa0-c5b694a37ec8 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:41:51 user nova-compute[75066]: DEBUG nova.network.neutron [req-bcfecc77-d921-4b30-a3da-04741b75aad1 req-9a222e20-eb91-4fd2-91e3-e013cdc3124b service nova] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Updated VIF entry in instance network info cache for port 5b2ebcf7-2624-49c2-bfa0-c5b694a37ec8. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:41:51 user nova-compute[75066]: DEBUG nova.network.neutron [req-bcfecc77-d921-4b30-a3da-04741b75aad1 req-9a222e20-eb91-4fd2-91e3-e013cdc3124b service nova] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Updating instance_info_cache with network_info: [{"id": "5b2ebcf7-2624-49c2-bfa0-c5b694a37ec8", "address": "fa:16:3e:6e:e4:53", "network": {"id": "955d6293-ede6-4cb4-8cee-0157dbad93ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-603640322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109097a30a40419092c74f4c7a695ce4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2ebcf7-26", "ovs_interfaceid": "5b2ebcf7-2624-49c2-bfa0-c5b694a37ec8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:41:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-bcfecc77-d921-4b30-a3da-04741b75aad1 req-9a222e20-eb91-4fd2-91e3-e013cdc3124b service nova] Releasing lock "refresh_cache-1f7bbc49-b34e-4a0c-b577-7ceadf0cf288" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:41:53 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:41:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-0623e93f-0a0e-467c-a360-379477c45c98 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Acquiring lock "1f7bbc49-b34e-4a0c-b577-7ceadf0cf288" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:41:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-0623e93f-0a0e-467c-a360-379477c45c98 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "1f7bbc49-b34e-4a0c-b577-7ceadf0cf288" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:41:54 user nova-compute[75066]: DEBUG nova.objects.instance [None req-0623e93f-0a0e-467c-a360-379477c45c98 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lazy-loading 'flavor' on Instance uuid 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:41:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-0623e93f-0a0e-467c-a360-379477c45c98 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "1f7bbc49-b34e-4a0c-b577-7ceadf0cf288" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:41:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-0623e93f-0a0e-467c-a360-379477c45c98 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Acquiring lock "1f7bbc49-b34e-4a0c-b577-7ceadf0cf288" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:41:54 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-0623e93f-0a0e-467c-a360-379477c45c98 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "1f7bbc49-b34e-4a0c-b577-7ceadf0cf288" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:41:54 user nova-compute[75066]: INFO nova.compute.manager [None req-0623e93f-0a0e-467c-a360-379477c45c98 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Attaching volume 8215b1e0-f7fa-446f-b50c-63a892de2cb1 to /dev/vdb
Dec 01 19:41:54 user nova-compute[75066]: DEBUG os_brick.utils [None req-0623e93f-0a0e-467c-a360-379477c45c98 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:41:54 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:41:54 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:41:54 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[52fe2deb-7933-4479-a4ae-c6ec975e4b40]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1959854982f\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:41:54 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:41:54 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:41:54 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[251e5722-aee3-4cb4-b242-0257418db4b3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:41:54 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:41:54 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:41:54 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75d8cd7-4c05-41c6-9fc4-97dc53cc3830]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:41:54 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a6e0de-69e4-458e-8eac-8bfa3fdc958d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:41:54 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-0623e93f-0a0e-467c-a360-379477c45c98 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Running cmd (subprocess): nvme version {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:41:54 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-0623e93f-0a0e-467c-a360-379477c45c98 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] 'nvme version' failed. Not Retrying. {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:41:54 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0623e93f-0a0e-467c-a360-379477c45c98 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] nvme not present on system {{(pid=75066) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 19:41:54 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:41:55 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:41:55 user nova-compute[75066]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 19:41:55 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2820b1b-7393-4478-bdd8-644a02f23781]: (4, '') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:41:55 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-0623e93f-0a0e-467c-a360-379477c45c98 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75066) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 19:41:55 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-0623e93f-0a0e-467c-a360-379477c45c98 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 19:41:55 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-0623e93f-0a0e-467c-a360-379477c45c98 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] LIGHTOS: no hostnqn found. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 19:41:55 user nova-compute[75066]: DEBUG os_brick.utils [None req-0623e93f-0a0e-467c-a360-379477c45c98 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1959854982f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:41:55 user nova-compute[75066]: DEBUG nova.virt.block_device [None req-0623e93f-0a0e-467c-a360-379477c45c98 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Updating existing volume attachment record: e6d33c9c-674a-45da-9946-d77e05d063ae {{(pid=75066) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 19:41:55 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:41:55 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:41:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:41:58 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca841c81-e534-4f43-ba2c-88d9579b0073 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Calling os-brick to attach iSCSI Volume {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 19:41:58 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca841c81-e534-4f43-ba2c-88d9579b0073 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6b572e6d-086d-45ff-9351-17c8a8f1325d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xXVytmUK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:41:58 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-ca841c81-e534-4f43-ba2c-88d9579b0073 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:41:58 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-ca841c81-e534-4f43-ba2c-88d9579b0073 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:41:58 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-ca841c81-e534-4f43-ba2c-88d9579b0073 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:41:58 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-ca841c81-e534-4f43-ba2c-88d9579b0073 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:41:58 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-ca841c81-e534-4f43-ba2c-88d9579b0073 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b572e6d-086d-45ff-9351-17c8a8f1325d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:41:58 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-ca841c81-e534-4f43-ba2c-88d9579b0073 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b572e6d-086d-45ff-9351-17c8a8f1325d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:41:58 user nova-compute[75066]: INFO os_brick.initiator.connectors.iscsi [None req-ca841c81-e534-4f43-ba2c-88d9579b0073 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 19:41:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b572e6d-086d-45ff-9351-17c8a8f1325d -p 172.16.0.220:3260 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:41:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b572e6d-086d-45ff-9351-17c8a8f1325d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:41:58 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa891f73-9226-45f2-8dd5-35970cedeb1d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:41:58 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca841c81-e534-4f43-ba2c-88d9579b0073 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 19:41:58 user nova-compute[75066]:  {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:41:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b572e6d-086d-45ff-9351-17c8a8f1325d -p 172.16.0.220:3260 --interface default --op new {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:41:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b572e6d-086d-45ff-9351-17c8a8f1325d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:41:58 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7b6ae4-efa0-44f6-864f-5e3e2baa96d6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b572e6d-086d-45ff-9351-17c8a8f1325d] added\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:41:58 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca841c81-e534-4f43-ba2c-88d9579b0073 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b572e6d-086d-45ff-9351-17c8a8f1325d] added
Dec 01 19:41:58 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:41:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b572e6d-086d-45ff-9351-17c8a8f1325d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:41:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b572e6d-086d-45ff-9351-17c8a8f1325d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:41:58 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[184dddf6-b9a1-4a2a-a786-209489b3f1bf]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:41:58 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca841c81-e534-4f43-ba2c-88d9579b0073 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:41:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b572e6d-086d-45ff-9351-17c8a8f1325d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:41:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b572e6d-086d-45ff-9351-17c8a8f1325d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:41:58 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[31646ece-e149-475b-8ef1-2d52b40116d4]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:41:58 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca841c81-e534-4f43-ba2c-88d9579b0073 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:41:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b572e6d-086d-45ff-9351-17c8a8f1325d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xXVytmUK {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:41:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b572e6d-086d-45ff-9351-17c8a8f1325d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xXVytmUK" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:41:58 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f76f834-bed0-4e44-88d4-a074bb95766f]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:41:58 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca841c81-e534-4f43-ba2c-88d9579b0073 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xXVytmUK'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:41:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b572e6d-086d-45ff-9351-17c8a8f1325d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:41:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b572e6d-086d-45ff-9351-17c8a8f1325d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:41:58 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[19220e04-0dac-44e6-aa67-32f07c13dec0]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:41:58 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca841c81-e534-4f43-ba2c-88d9579b0073 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:41:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:41:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:41:58 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[06ef5b65-8610-4c9b-80f5-abe102e05bfc]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:41:58 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca841c81-e534-4f43-ba2c-88d9579b0073 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 01 19:41:58 user nova-compute[75066]:  {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:41:58 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca841c81-e534-4f43-ba2c-88d9579b0073 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 01 19:41:58 user nova-compute[75066]:  {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:41:58 user nova-compute[75066]: WARNING os_brick.initiator.connectors.iscsi [None req-ca841c81-e534-4f43-ba2c-88d9579b0073 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 01 19:41:58 user nova-compute[75066]: 
Dec 01 19:41:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b572e6d-086d-45ff-9351-17c8a8f1325d -p 172.16.0.220:3260 --login {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:41:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b572e6d-086d-45ff-9351-17c8a8f1325d -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:41:58 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[6256542d-b50c-4cf1-958c-c51b98f3a3d5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b572e6d-086d-45ff-9351-17c8a8f1325d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6b572e6d-086d-45ff-9351-17c8a8f1325d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:41:58 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca841c81-e534-4f43-ba2c-88d9579b0073 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b572e6d-086d-45ff-9351-17c8a8f1325d, portal: 172.16.0.220,3260]
Dec 01 19:41:58 user nova-compute[75066]: Login to [iface: default, target: iqn.2010-10.org.openstack:6b572e6d-086d-45ff-9351-17c8a8f1325d, portal: 172.16.0.220,3260] successful.
Dec 01 19:41:58 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:41:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b572e6d-086d-45ff-9351-17c8a8f1325d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:41:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b572e6d-086d-45ff-9351-17c8a8f1325d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:41:58 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9550b1-aea5-4b59-a070-9cb70198c5d4]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:41:58 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca841c81-e534-4f43-ba2c-88d9579b0073 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:41:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:41:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:41:58 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a20ba91-7e58-4ba0-98f1-ee9c8b9581dc]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b572e6d-086d-45ff-9351-17c8a8f1325d (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:41:58 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca841c81-e534-4f43-ba2c-88d9579b0073 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b572e6d-086d-45ff-9351-17c8a8f1325d (non-flash)
Dec 01 19:41:58 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:41:58 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca841c81-e534-4f43-ba2c-88d9579b0073 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b572e6d-086d-45ff-9351-17c8a8f1325d (non-flash)
Dec 01 19:41:58 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:41:58 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-ca841c81-e534-4f43-ba2c-88d9579b0073 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b572e6d-086d-45ff-9351-17c8a8f1325d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.244s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:41:58 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca841c81-e534-4f43-ba2c-88d9579b0073 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Connected to 172.16.0.220:3260 {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 19:41:58 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-ca841c81-e534-4f43-ba2c-88d9579b0073 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=75066) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 19:41:58 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-ca841c81-e534-4f43-ba2c-88d9579b0073 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75066) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 19:41:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:41:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:41:58 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[d934ebc9-1a8a-42de-bf20-0b404f7988b9]: (4, ('- - 0', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:41:58 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-ca841c81-e534-4f43-ba2c-88d9579b0073 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: None {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:41:59 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-ca841c81-e534-4f43-ba2c-88d9579b0073 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:41:59 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca841c81-e534-4f43-ba2c-88d9579b0073 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6b572e6d-086d-45ff-9351-17c8a8f1325d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xXVytmUK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 19:41:59 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-ca841c81-e534-4f43-ba2c-88d9579b0073 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.272s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:41:59 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca841c81-e534-4f43-ba2c-88d9579b0073 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] <== connect_volume: return (1274ms) {'type': 'block', 'scsi_wwn': '23039333839303930', 'path': '/dev/sdb'} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:41:59 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca841c81-e534-4f43-ba2c-88d9579b0073 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23039333839303930', 'path': '/dev/sdb'} {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 19:41:59 user nova-compute[75066]: DEBUG nova.objects.instance [None req-ca841c81-e534-4f43-ba2c-88d9579b0073 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lazy-loading 'flavor' on Instance uuid 544d6830-e6cf-4c06-95b3-151da602bc6d {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:41:59 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-ca841c81-e534-4f43-ba2c-88d9579b0073 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 19:41:59 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:41:59 user nova-compute[75066]:   <source dev="/dev/sdb"/>
Dec 01 19:41:59 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:41:59 user nova-compute[75066]:   <serial>6b572e6d-086d-45ff-9351-17c8a8f1325d</serial>
Dec 01 19:41:59 user nova-compute[75066]: </disk>
Dec 01 19:41:59 user nova-compute[75066]:  {{(pid=75066) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 19:42:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ca841c81-e534-4f43-ba2c-88d9579b0073 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:42:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ca841c81-e534-4f43-ba2c-88d9579b0073 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:42:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ca841c81-e534-4f43-ba2c-88d9579b0073 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] No VIF found with MAC fa:16:3e:b1:1b:aa, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:42:00 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:42:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ca841c81-e534-4f43-ba2c-88d9579b0073 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lock "544d6830-e6cf-4c06-95b3-151da602bc6d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.033s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:42:03 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:42:04 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0623e93f-0a0e-467c-a360-379477c45c98 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Calling os-brick to attach iSCSI Volume {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 19:42:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-0623e93f-0a0e-467c-a360-379477c45c98 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FmMjNKzs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:42:04 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-0623e93f-0a0e-467c-a360-379477c45c98 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:42:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-0623e93f-0a0e-467c-a360-379477c45c98 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:42:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-0623e93f-0a0e-467c-a360-379477c45c98 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:42:04 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-0623e93f-0a0e-467c-a360-379477c45c98 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:42:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-0623e93f-0a0e-467c-a360-379477c45c98 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:42:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-0623e93f-0a0e-467c-a360-379477c45c98 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:42:04 user nova-compute[75066]: INFO os_brick.initiator.connectors.iscsi [None req-0623e93f-0a0e-467c-a360-379477c45c98 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 19:42:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1 -p 172.16.0.220:3260 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:42:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:42:04 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[75492e91-c1ad-4e94-96ad-b49ca9f6b6fd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:42:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-0623e93f-0a0e-467c-a360-379477c45c98 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 19:42:04 user nova-compute[75066]:  {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:42:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:42:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:42:04 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7710661-0a53-4798-a714-0334fcfc4e0e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1] added\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:42:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-0623e93f-0a0e-467c-a360-379477c45c98 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1] added
Dec 01 19:42:04 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:42:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:42:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:42:04 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[78941a40-6e7f-44f0-8a7b-eefdf58ce750]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:42:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-0623e93f-0a0e-467c-a360-379477c45c98 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:42:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:42:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:42:04 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e2b963-b5a3-436b-ba72-ceee1e26b1e5]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:42:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-0623e93f-0a0e-467c-a360-379477c45c98 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:42:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FmMjNKzs {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:42:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FmMjNKzs" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:42:04 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc04d435-0a20-4300-9044-56d246af806a]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:42:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-0623e93f-0a0e-467c-a360-379477c45c98 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FmMjNKzs'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:42:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:42:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:42:04 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f2702d-d73f-4830-87e2-2863abad68ba]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:42:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-0623e93f-0a0e-467c-a360-379477c45c98 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:42:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:42:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:42:04 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c49201-45b3-48ec-996f-666daa813815]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b572e6d-086d-45ff-9351-17c8a8f1325d (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:42:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-0623e93f-0a0e-467c-a360-379477c45c98 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b572e6d-086d-45ff-9351-17c8a8f1325d (non-flash)
Dec 01 19:42:04 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:42:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-0623e93f-0a0e-467c-a360-379477c45c98 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b572e6d-086d-45ff-9351-17c8a8f1325d (non-flash)
Dec 01 19:42:04 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:42:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1 -p 172.16.0.220:3260 --login {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:42:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:42:04 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[9677422a-b390-41b3-b66c-3cb60e308704]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:42:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-0623e93f-0a0e-467c-a360-379477c45c98 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1, portal: 172.16.0.220,3260]
Dec 01 19:42:04 user nova-compute[75066]: Login to [iface: default, target: iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1, portal: 172.16.0.220,3260] successful.
Dec 01 19:42:04 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:42:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:42:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:42:04 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf2f7c2-4b3f-4b66-a5f1-9db13e1adaf7]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:42:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-0623e93f-0a0e-467c-a360-379477c45c98 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:42:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:42:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:42:04 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[db36ef6d-d6c1-4284-9abf-1bf648539578]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b572e6d-086d-45ff-9351-17c8a8f1325d (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:42:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-0623e93f-0a0e-467c-a360-379477c45c98 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b572e6d-086d-45ff-9351-17c8a8f1325d (non-flash)
Dec 01 19:42:04 user nova-compute[75066]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1 (non-flash)
Dec 01 19:42:04 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:42:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-0623e93f-0a0e-467c-a360-379477c45c98 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b572e6d-086d-45ff-9351-17c8a8f1325d (non-flash)
Dec 01 19:42:04 user nova-compute[75066]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1 (non-flash)
Dec 01 19:42:04 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:42:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-0623e93f-0a0e-467c-a360-379477c45c98 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:42:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-0623e93f-0a0e-467c-a360-379477c45c98 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Connected to 172.16.0.220:3260 {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 19:42:04 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-0623e93f-0a0e-467c-a360-379477c45c98 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] HCTL ('34', '-', '-', 0) found on session 47 with lun 0 {{(pid=75066) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 19:42:04 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-0623e93f-0a0e-467c-a360-379477c45c98 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75066) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 19:42:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:42:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:42:04 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f678c54-6b42-45ed-b488-e5ff5dfbfe37]: (4, ('- - 0', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:42:04 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-0623e93f-0a0e-467c-a360-379477c45c98 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Searching for a device in session 47 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:42:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-0623e93f-0a0e-467c-a360-379477c45c98 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FmMjNKzs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 19:42:05 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:42:05 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-0623e93f-0a0e-467c-a360-379477c45c98 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:42:05 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-0623e93f-0a0e-467c-a360-379477c45c98 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] <== connect_volume: return (1287ms) {'type': 'block', 'scsi_wwn': '26533623263353664', 'path': '/dev/sdc'} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:42:05 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0623e93f-0a0e-467c-a360-379477c45c98 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26533623263353664', 'path': '/dev/sdc'} {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 19:42:05 user nova-compute[75066]: DEBUG nova.objects.instance [None req-0623e93f-0a0e-467c-a360-379477c45c98 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lazy-loading 'flavor' on Instance uuid 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:42:05 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-0623e93f-0a0e-467c-a360-379477c45c98 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 19:42:05 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:42:05 user nova-compute[75066]:   <source dev="/dev/sdc"/>
Dec 01 19:42:05 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:42:05 user nova-compute[75066]:   <serial>8215b1e0-f7fa-446f-b50c-63a892de2cb1</serial>
Dec 01 19:42:05 user nova-compute[75066]: </disk>
Dec 01 19:42:05 user nova-compute[75066]:  {{(pid=75066) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 19:42:05 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-0623e93f-0a0e-467c-a360-379477c45c98 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:42:05 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-0623e93f-0a0e-467c-a360-379477c45c98 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:42:05 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-0623e93f-0a0e-467c-a360-379477c45c98 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] No VIF found with MAC fa:16:3e:6e:e4:53, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:42:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-0623e93f-0a0e-467c-a360-379477c45c98 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "1f7bbc49-b34e-4a0c-b577-7ceadf0cf288" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.135s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:42:07 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:42:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:42:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Acquiring lock "521a6e67-e213-4f07-94d9-f6ac1e6d40c2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:42:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "521a6e67-e213-4f07-94d9-f6ac1e6d40c2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:42:09 user nova-compute[75066]: DEBUG nova.compute.manager [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] Starting instance... {{(pid=75066) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 19:42:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:42:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:42:09 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75066) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 19:42:09 user nova-compute[75066]: INFO nova.compute.claims [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] Claim successful on node user
Dec 01 19:42:10 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:42:10 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:42:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.334s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:42:10 user nova-compute[75066]: DEBUG nova.compute.manager [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] Start building networks asynchronously for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 19:42:10 user nova-compute[75066]: DEBUG nova.compute.manager [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] Allocating IP information in the background. {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 19:42:10 user nova-compute[75066]: DEBUG nova.network.neutron [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] allocate_for_instance() {{(pid=75066) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 19:42:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:42:10 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 19:42:10 user nova-compute[75066]: DEBUG nova.compute.manager [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] Start building block device mappings for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 19:42:10 user nova-compute[75066]: DEBUG nova.policy [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b92b1beca2ee480181e771eafe1a9f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109097a30a40419092c74f4c7a695ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75066) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 19:42:10 user nova-compute[75066]: DEBUG nova.compute.manager [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] Start spawning the instance on the hypervisor. {{(pid=75066) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 19:42:10 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] Creating instance directory {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 19:42:10 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] Creating image(s)
Dec 01 19:42:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Acquiring lock "/opt/stack/data/nova/instances/521a6e67-e213-4f07-94d9-f6ac1e6d40c2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:42:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "/opt/stack/data/nova/instances/521a6e67-e213-4f07-94d9-f6ac1e6d40c2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:42:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "/opt/stack/data/nova/instances/521a6e67-e213-4f07-94d9-f6ac1e6d40c2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:42:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:42:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.170s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:42:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Acquiring lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:42:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:42:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:42:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.180s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:42:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/521a6e67-e213-4f07-94d9-f6ac1e6d40c2/disk 1073741824 {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:42:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/521a6e67-e213-4f07-94d9-f6ac1e6d40c2/disk 1073741824" returned: 0 in 0.054s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:42:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:42:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:42:10 user nova-compute[75066]: DEBUG nova.network.neutron [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] Successfully created port: e009340f-8fee-47fd-a143-911e6f07ae96 {{(pid=75066) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 19:42:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.187s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:42:11 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Checking if we can resize image /opt/stack/data/nova/instances/521a6e67-e213-4f07-94d9-f6ac1e6d40c2/disk. size=1073741824 {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 19:42:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/521a6e67-e213-4f07-94d9-f6ac1e6d40c2/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:42:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/521a6e67-e213-4f07-94d9-f6ac1e6d40c2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:42:11 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Cannot resize image /opt/stack/data/nova/instances/521a6e67-e213-4f07-94d9-f6ac1e6d40c2/disk to a smaller size. {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 19:42:11 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] Created local disks {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 19:42:11 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] Ensure instance console log exists: /opt/stack/data/nova/instances/521a6e67-e213-4f07-94d9-f6ac1e6d40c2/console.log {{(pid=75066) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 19:42:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:42:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:42:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:42:11 user nova-compute[75066]: DEBUG nova.network.neutron [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] Successfully updated port: e009340f-8fee-47fd-a143-911e6f07ae96 {{(pid=75066) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 19:42:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Acquiring lock "refresh_cache-521a6e67-e213-4f07-94d9-f6ac1e6d40c2" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:42:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Acquired lock "refresh_cache-521a6e67-e213-4f07-94d9-f6ac1e6d40c2" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:42:11 user nova-compute[75066]: DEBUG nova.network.neutron [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:42:11 user nova-compute[75066]: DEBUG nova.compute.manager [req-155c0191-58d6-43f4-8ca7-d0ec5695728f req-41173567-0787-4eb6-bd00-38e9e824825d service nova] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] Received event network-changed-e009340f-8fee-47fd-a143-911e6f07ae96 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:42:11 user nova-compute[75066]: DEBUG nova.compute.manager [req-155c0191-58d6-43f4-8ca7-d0ec5695728f req-41173567-0787-4eb6-bd00-38e9e824825d service nova] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] Refreshing instance network info cache due to event network-changed-e009340f-8fee-47fd-a143-911e6f07ae96. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:42:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-155c0191-58d6-43f4-8ca7-d0ec5695728f req-41173567-0787-4eb6-bd00-38e9e824825d service nova] Acquiring lock "refresh_cache-521a6e67-e213-4f07-94d9-f6ac1e6d40c2" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:42:11 user nova-compute[75066]: DEBUG nova.network.neutron [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:42:11 user nova-compute[75066]: DEBUG nova.network.neutron [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] Updating instance_info_cache with network_info: [{"id": "e009340f-8fee-47fd-a143-911e6f07ae96", "address": "fa:16:3e:fd:b9:2b", "network": {"id": "955d6293-ede6-4cb4-8cee-0157dbad93ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-603640322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109097a30a40419092c74f4c7a695ce4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape009340f-8f", "ovs_interfaceid": "e009340f-8fee-47fd-a143-911e6f07ae96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:42:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Releasing lock "refresh_cache-521a6e67-e213-4f07-94d9-f6ac1e6d40c2" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:42:11 user nova-compute[75066]: DEBUG nova.compute.manager [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] Instance network_info: |[{"id": "e009340f-8fee-47fd-a143-911e6f07ae96", "address": "fa:16:3e:fd:b9:2b", "network": {"id": "955d6293-ede6-4cb4-8cee-0157dbad93ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-603640322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109097a30a40419092c74f4c7a695ce4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape009340f-8f", "ovs_interfaceid": "e009340f-8fee-47fd-a143-911e6f07ae96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 19:42:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-155c0191-58d6-43f4-8ca7-d0ec5695728f req-41173567-0787-4eb6-bd00-38e9e824825d service nova] Acquired lock "refresh_cache-521a6e67-e213-4f07-94d9-f6ac1e6d40c2" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:42:11 user nova-compute[75066]: DEBUG nova.network.neutron [req-155c0191-58d6-43f4-8ca7-d0ec5695728f req-41173567-0787-4eb6-bd00-38e9e824825d service nova] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] Refreshing network info cache for port e009340f-8fee-47fd-a143-911e6f07ae96 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:42:11 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] Start _get_guest_xml network_info=[{"id": "e009340f-8fee-47fd-a143-911e6f07ae96", "address": "fa:16:3e:fd:b9:2b", "network": {"id": "955d6293-ede6-4cb4-8cee-0157dbad93ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-603640322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109097a30a40419092c74f4c7a695ce4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape009340f-8f", "ovs_interfaceid": "e009340f-8fee-47fd-a143-911e6f07ae96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'image_id': '900b237b-e99c-4fdd-a44f-dcb7a08baa86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:42:11 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:42:11 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:42:11 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:42:11 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:42:11 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:42:11 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:42:11 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:42:11 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:42:11 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:42:11 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:42:11 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:42:11 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:42:11 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:42:11 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:42:11 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:42:11 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:42:11 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:42:11 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:42:11 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:42:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1759465216',display_name='tempest-AttachVolumeNegativeTest-server-1759465216',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1759465216',id=43,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJC4iLJMP36fEwoKPyAZvkZF5PXcW9YD+tZ/NzQenpweq5LJT8QZeBN47W8agB2jI3gb/JtCB8cGwCtN/ArD2/SANYkRYa2fNktq4cSFOA503JO19aDLqb0NpFmChXIW6w==',key_name='tempest-keypair-1545077095',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='109097a30a40419092c74f4c7a695ce4',ramdisk_id='',reservation_id='r-vamzakl5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-711021602',owner_user_name='tempest-AttachVolumeNegativeTest-711021602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:42:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b92b1beca2ee480181e771eafe1a9f97',uuid=521a6e67-e213-4f07-94d9-f6ac1e6d40c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e009340f-8fee-47fd-a143-911e6f07ae96", "address": "fa:16:3e:fd:b9:2b", "network": {"id": "955d6293-ede6-4cb4-8cee-0157dbad93ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-603640322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109097a30a40419092c74f4c7a695ce4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape009340f-8f", "ovs_interfaceid": "e009340f-8fee-47fd-a143-911e6f07ae96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:42:11 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Converting VIF {"id": "e009340f-8fee-47fd-a143-911e6f07ae96", "address": "fa:16:3e:fd:b9:2b", "network": {"id": "955d6293-ede6-4cb4-8cee-0157dbad93ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-603640322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109097a30a40419092c74f4c7a695ce4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape009340f-8f", "ovs_interfaceid": "e009340f-8fee-47fd-a143-911e6f07ae96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:42:11 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:b9:2b,bridge_name='br-int',has_traffic_filtering=True,id=e009340f-8fee-47fd-a143-911e6f07ae96,network=Network(955d6293-ede6-4cb4-8cee-0157dbad93ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape009340f-8f') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:42:11 user nova-compute[75066]: DEBUG nova.objects.instance [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lazy-loading 'pci_devices' on Instance uuid 521a6e67-e213-4f07-94d9-f6ac1e6d40c2 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:42:11 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:42:11 user nova-compute[75066]:   <uuid>521a6e67-e213-4f07-94d9-f6ac1e6d40c2</uuid>
Dec 01 19:42:11 user nova-compute[75066]:   <name>instance-0000002b</name>
Dec 01 19:42:11 user nova-compute[75066]:   <memory>524288</memory>
Dec 01 19:42:11 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:42:11 user nova-compute[75066]:   <metadata>
Dec 01 19:42:11 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:42:11 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:42:11 user nova-compute[75066]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1759465216</nova:name>
Dec 01 19:42:11 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:42:11</nova:creationTime>
Dec 01 19:42:11 user nova-compute[75066]:       <nova:flavor name="m1.tiny">
Dec 01 19:42:11 user nova-compute[75066]:         <nova:memory>512</nova:memory>
Dec 01 19:42:11 user nova-compute[75066]:         <nova:disk>1</nova:disk>
Dec 01 19:42:11 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:42:11 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:42:11 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:42:11 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:42:11 user nova-compute[75066]:       <nova:owner>
Dec 01 19:42:11 user nova-compute[75066]:         <nova:user uuid="b92b1beca2ee480181e771eafe1a9f97">tempest-AttachVolumeNegativeTest-711021602-project-member</nova:user>
Dec 01 19:42:11 user nova-compute[75066]:         <nova:project uuid="109097a30a40419092c74f4c7a695ce4">tempest-AttachVolumeNegativeTest-711021602</nova:project>
Dec 01 19:42:11 user nova-compute[75066]:       </nova:owner>
Dec 01 19:42:11 user nova-compute[75066]:       <nova:root type="image" uuid="900b237b-e99c-4fdd-a44f-dcb7a08baa86"/>
Dec 01 19:42:11 user nova-compute[75066]:       <nova:ports>
Dec 01 19:42:11 user nova-compute[75066]:         <nova:port uuid="e009340f-8fee-47fd-a143-911e6f07ae96">
Dec 01 19:42:11 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Dec 01 19:42:11 user nova-compute[75066]:         </nova:port>
Dec 01 19:42:11 user nova-compute[75066]:       </nova:ports>
Dec 01 19:42:11 user nova-compute[75066]:     </nova:instance>
Dec 01 19:42:11 user nova-compute[75066]:   </metadata>
Dec 01 19:42:11 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:42:11 user nova-compute[75066]:     <system>
Dec 01 19:42:11 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:42:11 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:42:11 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:42:11 user nova-compute[75066]:       <entry name="serial">521a6e67-e213-4f07-94d9-f6ac1e6d40c2</entry>
Dec 01 19:42:11 user nova-compute[75066]:       <entry name="uuid">521a6e67-e213-4f07-94d9-f6ac1e6d40c2</entry>
Dec 01 19:42:11 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:42:11 user nova-compute[75066]:     </system>
Dec 01 19:42:11 user nova-compute[75066]:   </sysinfo>
Dec 01 19:42:11 user nova-compute[75066]:   <os>
Dec 01 19:42:11 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:42:11 user nova-compute[75066]:     <boot dev="hd"/>
Dec 01 19:42:11 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:42:11 user nova-compute[75066]:   </os>
Dec 01 19:42:11 user nova-compute[75066]:   <features>
Dec 01 19:42:11 user nova-compute[75066]:     <acpi/>
Dec 01 19:42:11 user nova-compute[75066]:     <apic/>
Dec 01 19:42:11 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:42:11 user nova-compute[75066]:   </features>
Dec 01 19:42:11 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:42:11 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:42:11 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:42:11 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:42:11 user nova-compute[75066]:   </clock>
Dec 01 19:42:11 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:42:11 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:42:11 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:42:11 user nova-compute[75066]:   </cpu>
Dec 01 19:42:11 user nova-compute[75066]:   <devices>
Dec 01 19:42:11 user nova-compute[75066]:     <disk type="file" device="disk">
Dec 01 19:42:11 user nova-compute[75066]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 19:42:11 user nova-compute[75066]:       <source file="/opt/stack/data/nova/instances/521a6e67-e213-4f07-94d9-f6ac1e6d40c2/disk"/>
Dec 01 19:42:11 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:42:11 user nova-compute[75066]:     </disk>
Dec 01 19:42:11 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:42:11 user nova-compute[75066]:       <mac address="fa:16:3e:fd:b9:2b"/>
Dec 01 19:42:11 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:42:11 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:42:11 user nova-compute[75066]:       <target dev="tape009340f-8f"/>
Dec 01 19:42:11 user nova-compute[75066]:     </interface>
Dec 01 19:42:11 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:42:11 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/521a6e67-e213-4f07-94d9-f6ac1e6d40c2/console.log" append="off"/>
Dec 01 19:42:11 user nova-compute[75066]:     </serial>
Dec 01 19:42:11 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:42:11 user nova-compute[75066]:     <video>
Dec 01 19:42:11 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:42:11 user nova-compute[75066]:     </video>
Dec 01 19:42:11 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:42:11 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:42:11 user nova-compute[75066]:     </rng>
Dec 01 19:42:11 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:42:11 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:42:11 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:42:11 user nova-compute[75066]:     </memballoon>
Dec 01 19:42:11 user nova-compute[75066]:   </devices>
Dec 01 19:42:11 user nova-compute[75066]: </domain>
Dec 01 19:42:11 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:42:11 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:42:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1759465216',display_name='tempest-AttachVolumeNegativeTest-server-1759465216',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1759465216',id=43,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJC4iLJMP36fEwoKPyAZvkZF5PXcW9YD+tZ/NzQenpweq5LJT8QZeBN47W8agB2jI3gb/JtCB8cGwCtN/ArD2/SANYkRYa2fNktq4cSFOA503JO19aDLqb0NpFmChXIW6w==',key_name='tempest-keypair-1545077095',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='109097a30a40419092c74f4c7a695ce4',ramdisk_id='',reservation_id='r-vamzakl5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-711021602',owner_user_name='tempest-AttachVolumeNegativeTest-711021602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:42:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b92b1beca2ee480181e771eafe1a9f97',uuid=521a6e67-e213-4f07-94d9-f6ac1e6d40c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e009340f-8fee-47fd-a143-911e6f07ae96", "address": "fa:16:3e:fd:b9:2b", "network": {"id": "955d6293-ede6-4cb4-8cee-0157dbad93ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-603640322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109097a30a40419092c74f4c7a695ce4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape009340f-8f", "ovs_interfaceid": "e009340f-8fee-47fd-a143-911e6f07ae96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:42:11 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Converting VIF {"id": "e009340f-8fee-47fd-a143-911e6f07ae96", "address": "fa:16:3e:fd:b9:2b", "network": {"id": "955d6293-ede6-4cb4-8cee-0157dbad93ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-603640322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109097a30a40419092c74f4c7a695ce4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape009340f-8f", "ovs_interfaceid": "e009340f-8fee-47fd-a143-911e6f07ae96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:42:11 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:b9:2b,bridge_name='br-int',has_traffic_filtering=True,id=e009340f-8fee-47fd-a143-911e6f07ae96,network=Network(955d6293-ede6-4cb4-8cee-0157dbad93ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape009340f-8f') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:42:11 user nova-compute[75066]: DEBUG os_vif [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:b9:2b,bridge_name='br-int',has_traffic_filtering=True,id=e009340f-8fee-47fd-a143-911e6f07ae96,network=Network(955d6293-ede6-4cb4-8cee-0157dbad93ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape009340f-8f') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:42:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:42:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:42:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:42:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:42:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '81504e08-7c30-503c-bd90-36fdba37d983', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:42:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:42:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:42:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:42:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape009340f-8f, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:42:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape009340f-8f, col_values=(('qos', UUID('842e4c8a-3e8f-4949-ab7e-2add3aee517b')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:42:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape009340f-8f, col_values=(('external_ids', {'iface-id': 'e009340f-8fee-47fd-a143-911e6f07ae96', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:b9:2b', 'vm-uuid': '521a6e67-e213-4f07-94d9-f6ac1e6d40c2'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:42:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:42:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:42:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:42:12 user nova-compute[75066]: INFO os_vif [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:b9:2b,bridge_name='br-int',has_traffic_filtering=True,id=e009340f-8fee-47fd-a143-911e6f07ae96,network=Network(955d6293-ede6-4cb4-8cee-0157dbad93ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape009340f-8f')
Dec 01 19:42:12 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:42:12 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] No VIF found with MAC fa:16:3e:fd:b9:2b, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:42:12 user nova-compute[75066]: DEBUG nova.network.neutron [req-155c0191-58d6-43f4-8ca7-d0ec5695728f req-41173567-0787-4eb6-bd00-38e9e824825d service nova] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] Updated VIF entry in instance network info cache for port e009340f-8fee-47fd-a143-911e6f07ae96. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:42:12 user nova-compute[75066]: DEBUG nova.network.neutron [req-155c0191-58d6-43f4-8ca7-d0ec5695728f req-41173567-0787-4eb6-bd00-38e9e824825d service nova] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] Updating instance_info_cache with network_info: [{"id": "e009340f-8fee-47fd-a143-911e6f07ae96", "address": "fa:16:3e:fd:b9:2b", "network": {"id": "955d6293-ede6-4cb4-8cee-0157dbad93ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-603640322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109097a30a40419092c74f4c7a695ce4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape009340f-8f", "ovs_interfaceid": "e009340f-8fee-47fd-a143-911e6f07ae96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:42:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-155c0191-58d6-43f4-8ca7-d0ec5695728f req-41173567-0787-4eb6-bd00-38e9e824825d service nova] Releasing lock "refresh_cache-521a6e67-e213-4f07-94d9-f6ac1e6d40c2" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:42:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:42:13 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:42:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:42:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:42:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:42:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:42:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:42:13 user nova-compute[75066]: DEBUG nova.compute.manager [req-25977ce9-4fdd-4e74-ae14-c8dbc798a7a6 req-cbc08dcb-0aa6-4dee-9247-a5c40d6cd6cb service nova] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] Received event network-vif-plugged-e009340f-8fee-47fd-a143-911e6f07ae96 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:42:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-25977ce9-4fdd-4e74-ae14-c8dbc798a7a6 req-cbc08dcb-0aa6-4dee-9247-a5c40d6cd6cb service nova] Acquiring lock "521a6e67-e213-4f07-94d9-f6ac1e6d40c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:42:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-25977ce9-4fdd-4e74-ae14-c8dbc798a7a6 req-cbc08dcb-0aa6-4dee-9247-a5c40d6cd6cb service nova] Lock "521a6e67-e213-4f07-94d9-f6ac1e6d40c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:42:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-25977ce9-4fdd-4e74-ae14-c8dbc798a7a6 req-cbc08dcb-0aa6-4dee-9247-a5c40d6cd6cb service nova] Lock "521a6e67-e213-4f07-94d9-f6ac1e6d40c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:42:13 user nova-compute[75066]: DEBUG nova.compute.manager [req-25977ce9-4fdd-4e74-ae14-c8dbc798a7a6 req-cbc08dcb-0aa6-4dee-9247-a5c40d6cd6cb service nova] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] No waiting events found dispatching network-vif-plugged-e009340f-8fee-47fd-a143-911e6f07ae96 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:42:13 user nova-compute[75066]: WARNING nova.compute.manager [req-25977ce9-4fdd-4e74-ae14-c8dbc798a7a6 req-cbc08dcb-0aa6-4dee-9247-a5c40d6cd6cb service nova] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] Received unexpected event network-vif-plugged-e009340f-8fee-47fd-a143-911e6f07ae96 for instance with vm_state building and task_state spawning.
Dec 01 19:42:13 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:42:13 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Triggering sync for uuid 544d6830-e6cf-4c06-95b3-151da602bc6d {{(pid=75066) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 19:42:13 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Triggering sync for uuid 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288 {{(pid=75066) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 19:42:13 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Triggering sync for uuid 17401a50-7650-4fb7-9b01-abcce8e7f457 {{(pid=75066) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 19:42:13 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Triggering sync for uuid 521a6e67-e213-4f07-94d9-f6ac1e6d40c2 {{(pid=75066) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 19:42:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "544d6830-e6cf-4c06-95b3-151da602bc6d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:42:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "544d6830-e6cf-4c06-95b3-151da602bc6d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:42:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "1f7bbc49-b34e-4a0c-b577-7ceadf0cf288" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:42:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "1f7bbc49-b34e-4a0c-b577-7ceadf0cf288" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:42:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "17401a50-7650-4fb7-9b01-abcce8e7f457" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:42:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "17401a50-7650-4fb7-9b01-abcce8e7f457" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:42:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "521a6e67-e213-4f07-94d9-f6ac1e6d40c2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:42:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "544d6830-e6cf-4c06-95b3-151da602bc6d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:42:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "1f7bbc49-b34e-4a0c-b577-7ceadf0cf288" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:42:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "17401a50-7650-4fb7-9b01-abcce8e7f457" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:42:15 user nova-compute[75066]: DEBUG nova.compute.manager [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] Instance event wait completed in 0 seconds for  {{(pid=75066) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 19:42:15 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] Guest created on hypervisor {{(pid=75066) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 19:42:15 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] Instance spawned successfully.
Dec 01 19:42:15 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 19:42:15 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] Found default for hw_cdrom_bus of ide {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:42:15 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] Found default for hw_disk_bus of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:42:15 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] Found default for hw_input_bus of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:42:15 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] Found default for hw_pointer_model of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:42:15 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] Found default for hw_video_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:42:15 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] Found default for hw_vif_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:42:15 user nova-compute[75066]: INFO nova.compute.manager [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] Took 5.16 seconds to spawn the instance on the hypervisor.
Dec 01 19:42:15 user nova-compute[75066]: DEBUG nova.compute.manager [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:42:15 user nova-compute[75066]: INFO nova.compute.manager [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] Took 5.91 seconds to build instance.
Dec 01 19:42:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-aac3cfd6-1474-46ec-83f4-3e5ad43bb0ca tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "521a6e67-e213-4f07-94d9-f6ac1e6d40c2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.009s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:42:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "521a6e67-e213-4f07-94d9-f6ac1e6d40c2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.946s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:42:15 user nova-compute[75066]: INFO nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] During sync_power_state the instance has a pending task (spawning). Skip.
Dec 01 19:42:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "521a6e67-e213-4f07-94d9-f6ac1e6d40c2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:42:15 user nova-compute[75066]: DEBUG nova.compute.manager [req-11545e90-7df9-4be0-abe3-de9c31c329f2 req-de3dd8c6-7f12-4c29-896b-ea55a02d77ee service nova] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] Received event network-vif-plugged-e009340f-8fee-47fd-a143-911e6f07ae96 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:42:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-11545e90-7df9-4be0-abe3-de9c31c329f2 req-de3dd8c6-7f12-4c29-896b-ea55a02d77ee service nova] Acquiring lock "521a6e67-e213-4f07-94d9-f6ac1e6d40c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:42:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-11545e90-7df9-4be0-abe3-de9c31c329f2 req-de3dd8c6-7f12-4c29-896b-ea55a02d77ee service nova] Lock "521a6e67-e213-4f07-94d9-f6ac1e6d40c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:42:15 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-11545e90-7df9-4be0-abe3-de9c31c329f2 req-de3dd8c6-7f12-4c29-896b-ea55a02d77ee service nova] Lock "521a6e67-e213-4f07-94d9-f6ac1e6d40c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:42:15 user nova-compute[75066]: DEBUG nova.compute.manager [req-11545e90-7df9-4be0-abe3-de9c31c329f2 req-de3dd8c6-7f12-4c29-896b-ea55a02d77ee service nova] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] No waiting events found dispatching network-vif-plugged-e009340f-8fee-47fd-a143-911e6f07ae96 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:42:15 user nova-compute[75066]: WARNING nova.compute.manager [req-11545e90-7df9-4be0-abe3-de9c31c329f2 req-de3dd8c6-7f12-4c29-896b-ea55a02d77ee service nova] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] Received unexpected event network-vif-plugged-e009340f-8fee-47fd-a143-911e6f07ae96 for instance with vm_state active and task_state None.
Dec 01 19:42:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:42:17 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:42:17 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75066) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 19:42:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b2723038-46fe-4989-a70f-2999565f1f42 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Acquiring lock "544d6830-e6cf-4c06-95b3-151da602bc6d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:42:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b2723038-46fe-4989-a70f-2999565f1f42 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lock "544d6830-e6cf-4c06-95b3-151da602bc6d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:42:17 user nova-compute[75066]: INFO nova.compute.manager [None req-b2723038-46fe-4989-a70f-2999565f1f42 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Detaching volume 6b572e6d-086d-45ff-9351-17c8a8f1325d
Dec 01 19:42:17 user nova-compute[75066]: INFO nova.virt.block_device [None req-b2723038-46fe-4989-a70f-2999565f1f42 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Attempting to driver detach volume 6b572e6d-086d-45ff-9351-17c8a8f1325d from mountpoint /dev/vdb
Dec 01 19:42:17 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b2723038-46fe-4989-a70f-2999565f1f42 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Attempting to detach device vdb from instance 544d6830-e6cf-4c06-95b3-151da602bc6d from the persistent domain config. {{(pid=75066) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 19:42:17 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-b2723038-46fe-4989-a70f-2999565f1f42 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 19:42:17 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:42:17 user nova-compute[75066]:   <source dev="/dev/sdb"/>
Dec 01 19:42:17 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:42:17 user nova-compute[75066]:   <serial>6b572e6d-086d-45ff-9351-17c8a8f1325d</serial>
Dec 01 19:42:17 user nova-compute[75066]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 19:42:17 user nova-compute[75066]: </disk>
Dec 01 19:42:17 user nova-compute[75066]:  {{(pid=75066) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 19:42:17 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-b2723038-46fe-4989-a70f-2999565f1f42 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Successfully detached device vdb from instance 544d6830-e6cf-4c06-95b3-151da602bc6d from the persistent domain config.
Dec 01 19:42:17 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b2723038-46fe-4989-a70f-2999565f1f42 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 544d6830-e6cf-4c06-95b3-151da602bc6d from the live domain config. {{(pid=75066) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 19:42:17 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-b2723038-46fe-4989-a70f-2999565f1f42 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 19:42:17 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:42:17 user nova-compute[75066]:   <source dev="/dev/sdb"/>
Dec 01 19:42:17 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:42:17 user nova-compute[75066]:   <serial>6b572e6d-086d-45ff-9351-17c8a8f1325d</serial>
Dec 01 19:42:17 user nova-compute[75066]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 19:42:17 user nova-compute[75066]: </disk>
Dec 01 19:42:17 user nova-compute[75066]:  {{(pid=75066) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 19:42:18 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-b2723038-46fe-4989-a70f-2999565f1f42 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 544d6830-e6cf-4c06-95b3-151da602bc6d {{(pid=75066) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 19:42:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:42:19 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:42:20 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:42:21 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:42:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:42:24 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:42:24 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:42:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:42:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:42:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:42:24 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75066) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 19:42:24 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/521a6e67-e213-4f07-94d9-f6ac1e6d40c2/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:42:24 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/521a6e67-e213-4f07-94d9-f6ac1e6d40c2/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:42:24 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/521a6e67-e213-4f07-94d9-f6ac1e6d40c2/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:42:24 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/521a6e67-e213-4f07-94d9-f6ac1e6d40c2/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:42:24 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f7bbc49-b34e-4a0c-b577-7ceadf0cf288/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:42:24 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f7bbc49-b34e-4a0c-b577-7ceadf0cf288/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:42:24 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f7bbc49-b34e-4a0c-b577-7ceadf0cf288/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:42:25 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f7bbc49-b34e-4a0c-b577-7ceadf0cf288/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:42:25 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:42:25 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17401a50-7650-4fb7-9b01-abcce8e7f457/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:42:25 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17401a50-7650-4fb7-9b01-abcce8e7f457/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:42:25 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17401a50-7650-4fb7-9b01-abcce8e7f457/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:42:25 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/17401a50-7650-4fb7-9b01-abcce8e7f457/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:42:25 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/544d6830-e6cf-4c06-95b3-151da602bc6d/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:42:25 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/544d6830-e6cf-4c06-95b3-151da602bc6d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:42:25 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/544d6830-e6cf-4c06-95b3-151da602bc6d/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:42:25 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/544d6830-e6cf-4c06-95b3-151da602bc6d/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:42:26 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:42:26 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:42:26 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Hypervisor/Node resource view: name=user free_ram=8690MB free_disk=24.86640167236328GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75066) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 19:42:26 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:42:26 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:42:26 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 544d6830-e6cf-4c06-95b3-151da602bc6d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:42:26 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:42:26 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 17401a50-7650-4fb7-9b01-abcce8e7f457 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:42:26 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 521a6e67-e213-4f07-94d9-f6ac1e6d40c2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:42:26 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 19:42:26 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 19:42:26 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:42:26 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:42:26 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Compute_service record updated for user:user {{(pid=75066) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 19:42:26 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.269s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:42:26 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:42:27 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:42:28 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:42:28 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Starting heal instance info cache {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 19:42:28 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Rebuilding the list of instances to heal {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 19:42:28 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "refresh_cache-544d6830-e6cf-4c06-95b3-151da602bc6d" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:42:28 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquired lock "refresh_cache-544d6830-e6cf-4c06-95b3-151da602bc6d" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:42:28 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Forcefully refreshing network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 19:42:28 user nova-compute[75066]: DEBUG nova.objects.instance [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lazy-loading 'info_cache' on Instance uuid 544d6830-e6cf-4c06-95b3-151da602bc6d {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:42:28 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Updating instance_info_cache with network_info: [{"id": "6a67de06-74d9-4b6a-ae10-8fbe730f6558", "address": "fa:16:3e:b1:1b:aa", "network": {"id": "10a180e0-96f5-4b54-8f70-8955d6c0e288", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1853322930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b227dfb7ede2407ba03f2840bc5de4f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a67de06-74", "ovs_interfaceid": "6a67de06-74d9-4b6a-ae10-8fbe730f6558", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:42:28 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Releasing lock "refresh_cache-544d6830-e6cf-4c06-95b3-151da602bc6d" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:42:28 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Updated the network info_cache for instance {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 19:42:29 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:42:31 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:42:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:42:37 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:42:38 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-b2723038-46fe-4989-a70f-2999565f1f42 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 544d6830-e6cf-4c06-95b3-151da602bc6d is timed out.
Dec 01 19:42:38 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-b2723038-46fe-4989-a70f-2999565f1f42 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Successfully detached device vdb from instance 544d6830-e6cf-4c06-95b3-151da602bc6d from the live domain config.
Dec 01 19:42:38 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2723038-46fe-4989-a70f-2999565f1f42 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] calling os-brick to detach iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 19:42:38 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2723038-46fe-4989-a70f-2999565f1f42 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, {'target_iqn': 'iqn.2010-10.org.openstack:6b572e6d-086d-45ff-9351-17c8a8f1325d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xXVytmUK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:42:38 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-b2723038-46fe-4989-a70f-2999565f1f42 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:42:38 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-b2723038-46fe-4989-a70f-2999565f1f42 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:42:38 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-b2723038-46fe-4989-a70f-2999565f1f42 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:42:38 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:42:38 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:42:38 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03eb24a-6e08-4cfd-b443-2da28bdc9076]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6b572e6d-086d-45ff-9351-17c8a8f1325d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:42:38 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2723038-46fe-4989-a70f-2999565f1f42 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 19:42:38 user nova-compute[75066]: No targets found.
Dec 01 19:42:38 user nova-compute[75066]: iSNS:
Dec 01 19:42:38 user nova-compute[75066]: No targets found.
Dec 01 19:42:38 user nova-compute[75066]: STATIC:
Dec 01 19:42:38 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1
Dec 01 19:42:38 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:42:38 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:42:38 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:6b572e6d-086d-45ff-9351-17c8a8f1325d
Dec 01 19:42:38 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:42:38 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:42:38 user nova-compute[75066]: FIRMWARE:
Dec 01 19:42:38 user nova-compute[75066]: No targets found.
Dec 01 19:42:38 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:42:38 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2723038-46fe-4989-a70f-2999565f1f42 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 19:42:38 user nova-compute[75066]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 19:42:38 user nova-compute[75066]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75066) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 19:42:38 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2723038-46fe-4989-a70f-2999565f1f42 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b572e6d-086d-45ff-9351-17c8a8f1325d', 0)] {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 19:42:38 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:42:38 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:42:38 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[53cfbcc3-a168-41c8-bb2e-519b881805a1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b572e6d-086d-45ff-9351-17c8a8f1325d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:42:38 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:42:38 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:42:38 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[55debe9a-b689-4e5a-a330-350ccc90c772]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b572e6d-086d-45ff-9351-17c8a8f1325d (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:42:38 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2723038-46fe-4989-a70f-2999565f1f42 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b572e6d-086d-45ff-9351-17c8a8f1325d (non-flash)
Dec 01 19:42:38 user nova-compute[75066]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1 (non-flash)
Dec 01 19:42:38 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:42:38 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2723038-46fe-4989-a70f-2999565f1f42 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b572e6d-086d-45ff-9351-17c8a8f1325d (non-flash)
Dec 01 19:42:38 user nova-compute[75066]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1 (non-flash)
Dec 01 19:42:38 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:42:38 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2723038-46fe-4989-a70f-2999565f1f42 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91707f12d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b572e6d-086d-45ff-9351-17c8a8f1325d'): ({'sdb'}, set())}) {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 19:42:38 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-b2723038-46fe-4989-a70f-2999565f1f42 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Removing single pathed devices sdb {{(pid=75066) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 19:42:38 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:42:38 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:42:38 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c58ea1e-f32e-4218-866b-8208ba233dce]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:42:38 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:42:38 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:42:38 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0588a11-5c04-409b-a6cd-64b571e5fc90]: (4, ('ok\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:42:38 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-b2723038-46fe-4989-a70f-2999565f1f42 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Flushing IO for device /dev/sdb {{(pid=75066) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 19:42:38 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:42:38 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:42:38 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e64e070-f9ca-4856-9e78-35a6b0930b13]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:42:38 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-b2723038-46fe-4989-a70f-2999565f1f42 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75066) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 19:42:38 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:42:38 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:42:38 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[85030fd3-00a7-4b29-81fe-f86fa21b8e95]: (4, ('1', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:42:38 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-b2723038-46fe-4989-a70f-2999565f1f42 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 19:42:38 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-b2723038-46fe-4989-a70f-2999565f1f42 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] SCSI volumes sdb have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 19:42:38 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2723038-46fe-4989-a70f-2999565f1f42 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b572e6d-086d-45ff-9351-17c8a8f1325d')] {{(pid=75066) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 19:42:38 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b572e6d-086d-45ff-9351-17c8a8f1325d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:42:38 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b572e6d-086d-45ff-9351-17c8a8f1325d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:42:38 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e02735b-8a55-4166-b78a-e03399c14602]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:42:38 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2723038-46fe-4989-a70f-2999565f1f42 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:42:38 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b572e6d-086d-45ff-9351-17c8a8f1325d -p 172.16.0.220:3260 --logout {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:42:38 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b572e6d-086d-45ff-9351-17c8a8f1325d -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:42:38 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd326184-dba0-405d-a286-d0c8e34227fa]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:6b572e6d-086d-45ff-9351-17c8a8f1325d, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:6b572e6d-086d-45ff-9351-17c8a8f1325d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:42:38 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2723038-46fe-4989-a70f-2999565f1f42 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:6b572e6d-086d-45ff-9351-17c8a8f1325d, portal: 172.16.0.220,3260]
Dec 01 19:42:38 user nova-compute[75066]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:6b572e6d-086d-45ff-9351-17c8a8f1325d, portal: 172.16.0.220,3260] successful.
Dec 01 19:42:38 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:42:38 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b572e6d-086d-45ff-9351-17c8a8f1325d -p 172.16.0.220:3260 --op delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:42:38 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b572e6d-086d-45ff-9351-17c8a8f1325d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:42:38 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81ad3fb-262f-4e8d-8330-41f88abb155e]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:42:38 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2723038-46fe-4989-a70f-2999565f1f42 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:42:38 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-b2723038-46fe-4989-a70f-2999565f1f42 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:42:38 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2723038-46fe-4989-a70f-2999565f1f42 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] <== disconnect_volume: return (312ms) None {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:42:38 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2723038-46fe-4989-a70f-2999565f1f42 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Disconnected iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 19:42:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:42:39 user nova-compute[75066]: DEBUG nova.objects.instance [None req-b2723038-46fe-4989-a70f-2999565f1f42 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lazy-loading 'flavor' on Instance uuid 544d6830-e6cf-4c06-95b3-151da602bc6d {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:42:39 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-b2723038-46fe-4989-a70f-2999565f1f42 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lock "544d6830-e6cf-4c06-95b3-151da602bc6d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.726s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:42:42 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:42:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:42:47 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:42:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:42:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:42:58 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-83f8a670-5863-40f7-a318-2f45e0a564d9 tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Acquiring lock "17401a50-7650-4fb7-9b01-abcce8e7f457" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:42:58 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-83f8a670-5863-40f7-a318-2f45e0a564d9 tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Lock "17401a50-7650-4fb7-9b01-abcce8e7f457" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:42:58 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-83f8a670-5863-40f7-a318-2f45e0a564d9 tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Acquiring lock "17401a50-7650-4fb7-9b01-abcce8e7f457-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:42:58 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-83f8a670-5863-40f7-a318-2f45e0a564d9 tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Lock "17401a50-7650-4fb7-9b01-abcce8e7f457-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:42:58 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-83f8a670-5863-40f7-a318-2f45e0a564d9 tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Lock "17401a50-7650-4fb7-9b01-abcce8e7f457-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:42:58 user nova-compute[75066]: INFO nova.compute.manager [None req-83f8a670-5863-40f7-a318-2f45e0a564d9 tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: 17401a50-7650-4fb7-9b01-abcce8e7f457] Terminating instance
Dec 01 19:42:58 user nova-compute[75066]: DEBUG nova.compute.manager [None req-83f8a670-5863-40f7-a318-2f45e0a564d9 tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: 17401a50-7650-4fb7-9b01-abcce8e7f457] Start destroying the instance on the hypervisor. {{(pid=75066) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 19:42:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:42:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:42:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:42:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:42:58 user nova-compute[75066]: DEBUG nova.compute.manager [req-d183766d-8804-41e7-baa9-0545a5674093 req-bac11851-5ac6-484f-9623-4d62e8131120 service nova] [instance: 17401a50-7650-4fb7-9b01-abcce8e7f457] Received event network-vif-unplugged-67af355d-32f0-4ea5-ae6d-b341aec1e169 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:42:58 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d183766d-8804-41e7-baa9-0545a5674093 req-bac11851-5ac6-484f-9623-4d62e8131120 service nova] Acquiring lock "17401a50-7650-4fb7-9b01-abcce8e7f457-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:42:58 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d183766d-8804-41e7-baa9-0545a5674093 req-bac11851-5ac6-484f-9623-4d62e8131120 service nova] Lock "17401a50-7650-4fb7-9b01-abcce8e7f457-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:42:58 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d183766d-8804-41e7-baa9-0545a5674093 req-bac11851-5ac6-484f-9623-4d62e8131120 service nova] Lock "17401a50-7650-4fb7-9b01-abcce8e7f457-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:42:58 user nova-compute[75066]: DEBUG nova.compute.manager [req-d183766d-8804-41e7-baa9-0545a5674093 req-bac11851-5ac6-484f-9623-4d62e8131120 service nova] [instance: 17401a50-7650-4fb7-9b01-abcce8e7f457] No waiting events found dispatching network-vif-unplugged-67af355d-32f0-4ea5-ae6d-b341aec1e169 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:42:58 user nova-compute[75066]: DEBUG nova.compute.manager [req-d183766d-8804-41e7-baa9-0545a5674093 req-bac11851-5ac6-484f-9623-4d62e8131120 service nova] [instance: 17401a50-7650-4fb7-9b01-abcce8e7f457] Received event network-vif-unplugged-67af355d-32f0-4ea5-ae6d-b341aec1e169 for instance with task_state deleting. {{(pid=75066) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 19:42:58 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 17401a50-7650-4fb7-9b01-abcce8e7f457] Instance destroyed successfully.
Dec 01 19:42:58 user nova-compute[75066]: DEBUG nova.objects.instance [None req-83f8a670-5863-40f7-a318-2f45e0a564d9 tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Lazy-loading 'resources' on Instance uuid 17401a50-7650-4fb7-9b01-abcce8e7f457 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:42:58 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-83f8a670-5863-40f7-a318-2f45e0a564d9 tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:41:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1374449381',display_name='tempest-VolumesActionsTest-instance-1374449381',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1374449381',id=42,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:41:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c0783de30bbc465fa27a20ae871178b8',ramdisk_id='',reservation_id='r-mw8p73r8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1936494950',owner_user_name='tempest-VolumesActionsTest-1936494950-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:41:14Z,user_data=None,user_id='259ab964702944ba980aa28a8f38d3fb',uuid=17401a50-7650-4fb7-9b01-abcce8e7f457,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "67af355d-32f0-4ea5-ae6d-b341aec1e169", "address": "fa:16:3e:3f:d2:5f", "network": {"id": "89966bbc-72a7-4613-a11f-cacdc22d2be7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-217253460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0783de30bbc465fa27a20ae871178b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67af355d-32", "ovs_interfaceid": "67af355d-32f0-4ea5-ae6d-b341aec1e169", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:42:58 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-83f8a670-5863-40f7-a318-2f45e0a564d9 tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Converting VIF {"id": "67af355d-32f0-4ea5-ae6d-b341aec1e169", "address": "fa:16:3e:3f:d2:5f", "network": {"id": "89966bbc-72a7-4613-a11f-cacdc22d2be7", "bridge": "br-int", "label": "tempest-VolumesActionsTest-217253460-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0783de30bbc465fa27a20ae871178b8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67af355d-32", "ovs_interfaceid": "67af355d-32f0-4ea5-ae6d-b341aec1e169", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:42:58 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-83f8a670-5863-40f7-a318-2f45e0a564d9 tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:d2:5f,bridge_name='br-int',has_traffic_filtering=True,id=67af355d-32f0-4ea5-ae6d-b341aec1e169,network=Network(89966bbc-72a7-4613-a11f-cacdc22d2be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67af355d-32') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:42:58 user nova-compute[75066]: DEBUG os_vif [None req-83f8a670-5863-40f7-a318-2f45e0a564d9 tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:d2:5f,bridge_name='br-int',has_traffic_filtering=True,id=67af355d-32f0-4ea5-ae6d-b341aec1e169,network=Network(89966bbc-72a7-4613-a11f-cacdc22d2be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67af355d-32') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:42:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:42:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap67af355d-32, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:42:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:42:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:42:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:42:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=602c79a0-951c-4665-af37-90d1ba83905a) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:42:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:42:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:42:58 user nova-compute[75066]: INFO os_vif [None req-83f8a670-5863-40f7-a318-2f45e0a564d9 tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:d2:5f,bridge_name='br-int',has_traffic_filtering=True,id=67af355d-32f0-4ea5-ae6d-b341aec1e169,network=Network(89966bbc-72a7-4613-a11f-cacdc22d2be7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67af355d-32')
Dec 01 19:42:58 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-83f8a670-5863-40f7-a318-2f45e0a564d9 tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: 17401a50-7650-4fb7-9b01-abcce8e7f457] Deleting instance files /opt/stack/data/nova/instances/17401a50-7650-4fb7-9b01-abcce8e7f457_del
Dec 01 19:42:58 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-83f8a670-5863-40f7-a318-2f45e0a564d9 tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: 17401a50-7650-4fb7-9b01-abcce8e7f457] Deletion of /opt/stack/data/nova/instances/17401a50-7650-4fb7-9b01-abcce8e7f457_del complete
Dec 01 19:42:59 user nova-compute[75066]: INFO nova.compute.manager [None req-83f8a670-5863-40f7-a318-2f45e0a564d9 tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] [instance: 17401a50-7650-4fb7-9b01-abcce8e7f457] Took 0.66 seconds to destroy the instance on the hypervisor.
Dec 01 19:42:59 user nova-compute[75066]: DEBUG oslo.service.loopingcall [None req-83f8a670-5863-40f7-a318-2f45e0a564d9 tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75066) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 19:42:59 user nova-compute[75066]: DEBUG nova.compute.manager [-] [instance: 17401a50-7650-4fb7-9b01-abcce8e7f457] Deallocating network for instance {{(pid=75066) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 19:42:59 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: 17401a50-7650-4fb7-9b01-abcce8e7f457] deallocate_for_instance() {{(pid=75066) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 19:42:59 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: 17401a50-7650-4fb7-9b01-abcce8e7f457] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:42:59 user nova-compute[75066]: INFO nova.compute.manager [-] [instance: 17401a50-7650-4fb7-9b01-abcce8e7f457] Took 0.40 seconds to deallocate network for instance.
Dec 01 19:42:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-83f8a670-5863-40f7-a318-2f45e0a564d9 tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:42:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-83f8a670-5863-40f7-a318-2f45e0a564d9 tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:42:59 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-83f8a670-5863-40f7-a318-2f45e0a564d9 tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:42:59 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-83f8a670-5863-40f7-a318-2f45e0a564d9 tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:42:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-83f8a670-5863-40f7-a318-2f45e0a564d9 tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.177s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:42:59 user nova-compute[75066]: INFO nova.scheduler.client.report [None req-83f8a670-5863-40f7-a318-2f45e0a564d9 tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Deleted allocations for instance 17401a50-7650-4fb7-9b01-abcce8e7f457
Dec 01 19:42:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-83f8a670-5863-40f7-a318-2f45e0a564d9 tempest-VolumesActionsTest-1936494950 tempest-VolumesActionsTest-1936494950-project-member] Lock "17401a50-7650-4fb7-9b01-abcce8e7f457" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.431s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:43:00 user nova-compute[75066]: DEBUG nova.compute.manager [req-4124da07-8f9c-4d3b-80de-c9becbc4781b req-c7bf7991-dc54-4f1a-a885-71992d46d99c service nova] [instance: 17401a50-7650-4fb7-9b01-abcce8e7f457] Received event network-vif-plugged-67af355d-32f0-4ea5-ae6d-b341aec1e169 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:43:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-4124da07-8f9c-4d3b-80de-c9becbc4781b req-c7bf7991-dc54-4f1a-a885-71992d46d99c service nova] Acquiring lock "17401a50-7650-4fb7-9b01-abcce8e7f457-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:43:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-4124da07-8f9c-4d3b-80de-c9becbc4781b req-c7bf7991-dc54-4f1a-a885-71992d46d99c service nova] Lock "17401a50-7650-4fb7-9b01-abcce8e7f457-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:43:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-4124da07-8f9c-4d3b-80de-c9becbc4781b req-c7bf7991-dc54-4f1a-a885-71992d46d99c service nova] Lock "17401a50-7650-4fb7-9b01-abcce8e7f457-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:43:00 user nova-compute[75066]: DEBUG nova.compute.manager [req-4124da07-8f9c-4d3b-80de-c9becbc4781b req-c7bf7991-dc54-4f1a-a885-71992d46d99c service nova] [instance: 17401a50-7650-4fb7-9b01-abcce8e7f457] No waiting events found dispatching network-vif-plugged-67af355d-32f0-4ea5-ae6d-b341aec1e169 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:43:00 user nova-compute[75066]: WARNING nova.compute.manager [req-4124da07-8f9c-4d3b-80de-c9becbc4781b req-c7bf7991-dc54-4f1a-a885-71992d46d99c service nova] [instance: 17401a50-7650-4fb7-9b01-abcce8e7f457] Received unexpected event network-vif-plugged-67af355d-32f0-4ea5-ae6d-b341aec1e169 for instance with vm_state deleted and task_state None.
Dec 01 19:43:00 user nova-compute[75066]: DEBUG nova.compute.manager [req-4124da07-8f9c-4d3b-80de-c9becbc4781b req-c7bf7991-dc54-4f1a-a885-71992d46d99c service nova] [instance: 17401a50-7650-4fb7-9b01-abcce8e7f457] Received event network-vif-deleted-67af355d-32f0-4ea5-ae6d-b341aec1e169 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:43:03 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:43:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:43:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-2c6f3e2c-f952-4c2e-a7bc-19eb0a7d43ab tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Acquiring lock "544d6830-e6cf-4c06-95b3-151da602bc6d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:43:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-2c6f3e2c-f952-4c2e-a7bc-19eb0a7d43ab tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lock "544d6830-e6cf-4c06-95b3-151da602bc6d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:43:10 user nova-compute[75066]: DEBUG nova.objects.instance [None req-2c6f3e2c-f952-4c2e-a7bc-19eb0a7d43ab tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lazy-loading 'flavor' on Instance uuid 544d6830-e6cf-4c06-95b3-151da602bc6d {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:43:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-2c6f3e2c-f952-4c2e-a7bc-19eb0a7d43ab tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lock "544d6830-e6cf-4c06-95b3-151da602bc6d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:43:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-2c6f3e2c-f952-4c2e-a7bc-19eb0a7d43ab tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Acquiring lock "544d6830-e6cf-4c06-95b3-151da602bc6d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:43:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-2c6f3e2c-f952-4c2e-a7bc-19eb0a7d43ab tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lock "544d6830-e6cf-4c06-95b3-151da602bc6d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:43:10 user nova-compute[75066]: INFO nova.compute.manager [None req-2c6f3e2c-f952-4c2e-a7bc-19eb0a7d43ab tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Attaching volume 86a91d86-a000-43cb-a9bd-69d7df1ccd95 to /dev/vdb
Dec 01 19:43:10 user nova-compute[75066]: DEBUG os_brick.utils [None req-2c6f3e2c-f952-4c2e-a7bc-19eb0a7d43ab tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:43:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:43:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:43:10 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[956cb34e-5f47-49e2-91bd-8bae7f855761]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1959854982f\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:43:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:43:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:43:10 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb4622d-c089-4726-bd30-dde9d32f195a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:43:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:43:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:43:10 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[b62f4d3b-011c-4afe-be52-17b5151d2323]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:43:10 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3ab06c-594a-414d-a388-2feea0a3d8c1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:43:10 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-2c6f3e2c-f952-4c2e-a7bc-19eb0a7d43ab tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Running cmd (subprocess): nvme version {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:43:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-2c6f3e2c-f952-4c2e-a7bc-19eb0a7d43ab tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] 'nvme version' failed. Not Retrying. {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:43:11 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2c6f3e2c-f952-4c2e-a7bc-19eb0a7d43ab tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] nvme not present on system {{(pid=75066) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 19:43:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:43:11 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:43:11 user nova-compute[75066]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 19:43:11 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c3ddf6f-f3b6-436b-83d4-1396eea31100]: (4, '') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:43:11 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-2c6f3e2c-f952-4c2e-a7bc-19eb0a7d43ab tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75066) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 19:43:11 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-2c6f3e2c-f952-4c2e-a7bc-19eb0a7d43ab tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 19:43:11 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-2c6f3e2c-f952-4c2e-a7bc-19eb0a7d43ab tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] LIGHTOS: no hostnqn found. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 19:43:11 user nova-compute[75066]: DEBUG os_brick.utils [None req-2c6f3e2c-f952-4c2e-a7bc-19eb0a7d43ab tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1959854982f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:43:11 user nova-compute[75066]: DEBUG nova.virt.block_device [None req-2c6f3e2c-f952-4c2e-a7bc-19eb0a7d43ab tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Updating existing volume attachment record: d7c27205-9e89-4579-96e4-0a24bd0233f2 {{(pid=75066) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 19:43:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:43:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:43:15 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:43:17 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:43:17 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75066) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 19:43:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:43:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:43:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75066) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 19:43:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:43:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:43:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:43:19 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c6f3e2c-f952-4c2e-a7bc-19eb0a7d43ab tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Calling os-brick to attach iSCSI Volume {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 19:43:19 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6f3e2c-f952-4c2e-a7bc-19eb0a7d43ab tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:86a91d86-a000-43cb-a9bd-69d7df1ccd95', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xgWjtfkA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:43:19 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-2c6f3e2c-f952-4c2e-a7bc-19eb0a7d43ab tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:43:19 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-2c6f3e2c-f952-4c2e-a7bc-19eb0a7d43ab tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:43:19 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-2c6f3e2c-f952-4c2e-a7bc-19eb0a7d43ab tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:43:19 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-2c6f3e2c-f952-4c2e-a7bc-19eb0a7d43ab tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:43:19 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-2c6f3e2c-f952-4c2e-a7bc-19eb0a7d43ab tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86a91d86-a000-43cb-a9bd-69d7df1ccd95" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:43:19 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-2c6f3e2c-f952-4c2e-a7bc-19eb0a7d43ab tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86a91d86-a000-43cb-a9bd-69d7df1ccd95" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:43:19 user nova-compute[75066]: INFO os_brick.initiator.connectors.iscsi [None req-2c6f3e2c-f952-4c2e-a7bc-19eb0a7d43ab tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 19:43:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86a91d86-a000-43cb-a9bd-69d7df1ccd95 -p 172.16.0.220:3260 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:43:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86a91d86-a000-43cb-a9bd-69d7df1ccd95 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:43:19 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb77788-4bf6-46ee-8744-8f9cecca2f09]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:43:19 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6f3e2c-f952-4c2e-a7bc-19eb0a7d43ab tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 19:43:19 user nova-compute[75066]:  {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:43:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86a91d86-a000-43cb-a9bd-69d7df1ccd95 -p 172.16.0.220:3260 --interface default --op new {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:43:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86a91d86-a000-43cb-a9bd-69d7df1ccd95 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:43:19 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee8d219-119d-4853-890b-61c8b8e27191]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:86a91d86-a000-43cb-a9bd-69d7df1ccd95] added\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:43:19 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6f3e2c-f952-4c2e-a7bc-19eb0a7d43ab tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:86a91d86-a000-43cb-a9bd-69d7df1ccd95] added
Dec 01 19:43:19 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:43:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86a91d86-a000-43cb-a9bd-69d7df1ccd95 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:43:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86a91d86-a000-43cb-a9bd-69d7df1ccd95 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:43:19 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[1556a808-3067-4b79-b7a5-2f3d7e6e4b04]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:43:19 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6f3e2c-f952-4c2e-a7bc-19eb0a7d43ab tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:43:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86a91d86-a000-43cb-a9bd-69d7df1ccd95 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:43:19 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86a91d86-a000-43cb-a9bd-69d7df1ccd95 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:43:19 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[f640ba37-eb16-445a-864f-33e5c5edf3cc]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:43:19 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6f3e2c-f952-4c2e-a7bc-19eb0a7d43ab tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:43:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86a91d86-a000-43cb-a9bd-69d7df1ccd95 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xgWjtfkA {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:43:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86a91d86-a000-43cb-a9bd-69d7df1ccd95 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xgWjtfkA" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:43:20 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b7245f-7146-4dfa-b6e0-c0ef938e4f6e]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:43:20 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6f3e2c-f952-4c2e-a7bc-19eb0a7d43ab tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xgWjtfkA'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:43:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86a91d86-a000-43cb-a9bd-69d7df1ccd95 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:43:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86a91d86-a000-43cb-a9bd-69d7df1ccd95 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:43:20 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d1fb82-44d8-4179-aeb6-f94f1ccc0a97]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:43:20 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6f3e2c-f952-4c2e-a7bc-19eb0a7d43ab tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:43:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:43:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:43:20 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e20bcc-0f84-4f04-ac2d-ee472dd220c3]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:43:20 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6f3e2c-f952-4c2e-a7bc-19eb0a7d43ab tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1 (non-flash)
Dec 01 19:43:20 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:43:20 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6f3e2c-f952-4c2e-a7bc-19eb0a7d43ab tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1 (non-flash)
Dec 01 19:43:20 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:43:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86a91d86-a000-43cb-a9bd-69d7df1ccd95 -p 172.16.0.220:3260 --login {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:43:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86a91d86-a000-43cb-a9bd-69d7df1ccd95 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:43:20 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f1c4bc-e8bd-448c-b147-01ea57250125]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:86a91d86-a000-43cb-a9bd-69d7df1ccd95, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:86a91d86-a000-43cb-a9bd-69d7df1ccd95, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:43:20 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6f3e2c-f952-4c2e-a7bc-19eb0a7d43ab tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:86a91d86-a000-43cb-a9bd-69d7df1ccd95, portal: 172.16.0.220,3260]
Dec 01 19:43:20 user nova-compute[75066]: Login to [iface: default, target: iqn.2010-10.org.openstack:86a91d86-a000-43cb-a9bd-69d7df1ccd95, portal: 172.16.0.220,3260] successful.
Dec 01 19:43:20 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:43:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86a91d86-a000-43cb-a9bd-69d7df1ccd95 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:43:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86a91d86-a000-43cb-a9bd-69d7df1ccd95 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:43:20 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[e195c351-a545-4c97-97b4-c411f1e91eee]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:43:20 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6f3e2c-f952-4c2e-a7bc-19eb0a7d43ab tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:43:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:43:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:43:20 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ed9292-88de-452c-86b5-ad24b5664064]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86a91d86-a000-43cb-a9bd-69d7df1ccd95 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:43:20 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6f3e2c-f952-4c2e-a7bc-19eb0a7d43ab tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1 (non-flash)
Dec 01 19:43:20 user nova-compute[75066]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86a91d86-a000-43cb-a9bd-69d7df1ccd95 (non-flash)
Dec 01 19:43:20 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:43:20 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6f3e2c-f952-4c2e-a7bc-19eb0a7d43ab tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1 (non-flash)
Dec 01 19:43:20 user nova-compute[75066]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86a91d86-a000-43cb-a9bd-69d7df1ccd95 (non-flash)
Dec 01 19:43:20 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:43:20 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-2c6f3e2c-f952-4c2e-a7bc-19eb0a7d43ab tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:86a91d86-a000-43cb-a9bd-69d7df1ccd95" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.240s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:43:20 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6f3e2c-f952-4c2e-a7bc-19eb0a7d43ab tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Connected to 172.16.0.220:3260 {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 19:43:20 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-2c6f3e2c-f952-4c2e-a7bc-19eb0a7d43ab tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=75066) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 19:43:20 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-2c6f3e2c-f952-4c2e-a7bc-19eb0a7d43ab tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75066) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 19:43:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:43:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:43:20 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[831df1d1-016a-456b-8e31-288d0d391019]: (4, ('- - 0', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:43:20 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-2c6f3e2c-f952-4c2e-a7bc-19eb0a7d43ab tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:43:20 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6f3e2c-f952-4c2e-a7bc-19eb0a7d43ab tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:86a91d86-a000-43cb-a9bd-69d7df1ccd95', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xgWjtfkA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 19:43:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-2c6f3e2c-f952-4c2e-a7bc-19eb0a7d43ab tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.274s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:43:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2c6f3e2c-f952-4c2e-a7bc-19eb0a7d43ab tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] <== connect_volume: return (1275ms) {'type': 'block', 'scsi_wwn': '23939633363333137', 'path': '/dev/sdb'} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:43:21 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2c6f3e2c-f952-4c2e-a7bc-19eb0a7d43ab tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23939633363333137', 'path': '/dev/sdb'} {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 19:43:21 user nova-compute[75066]: DEBUG nova.objects.instance [None req-2c6f3e2c-f952-4c2e-a7bc-19eb0a7d43ab tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lazy-loading 'flavor' on Instance uuid 544d6830-e6cf-4c06-95b3-151da602bc6d {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:43:21 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-2c6f3e2c-f952-4c2e-a7bc-19eb0a7d43ab tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 19:43:21 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:43:21 user nova-compute[75066]:   <source dev="/dev/sdb"/>
Dec 01 19:43:21 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:43:21 user nova-compute[75066]:   <serial>86a91d86-a000-43cb-a9bd-69d7df1ccd95</serial>
Dec 01 19:43:21 user nova-compute[75066]: </disk>
Dec 01 19:43:21 user nova-compute[75066]:  {{(pid=75066) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 19:43:21 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:43:21 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-2c6f3e2c-f952-4c2e-a7bc-19eb0a7d43ab tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:43:21 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-2c6f3e2c-f952-4c2e-a7bc-19eb0a7d43ab tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:43:21 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-2c6f3e2c-f952-4c2e-a7bc-19eb0a7d43ab tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] No VIF found with MAC fa:16:3e:b1:1b:aa, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:43:21 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-2c6f3e2c-f952-4c2e-a7bc-19eb0a7d43ab tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lock "544d6830-e6cf-4c06-95b3-151da602bc6d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.935s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:43:22 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:43:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:43:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:43:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dee9792d-358e-46cf-a041-42ae894719b2 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Acquiring lock "544d6830-e6cf-4c06-95b3-151da602bc6d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:43:24 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dee9792d-358e-46cf-a041-42ae894719b2 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lock "544d6830-e6cf-4c06-95b3-151da602bc6d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:43:24 user nova-compute[75066]: INFO nova.compute.manager [None req-dee9792d-358e-46cf-a041-42ae894719b2 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Detaching volume 86a91d86-a000-43cb-a9bd-69d7df1ccd95
Dec 01 19:43:24 user nova-compute[75066]: INFO nova.virt.block_device [None req-dee9792d-358e-46cf-a041-42ae894719b2 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Attempting to driver detach volume 86a91d86-a000-43cb-a9bd-69d7df1ccd95 from mountpoint /dev/vdb
Dec 01 19:43:24 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-dee9792d-358e-46cf-a041-42ae894719b2 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Attempting to detach device vdb from instance 544d6830-e6cf-4c06-95b3-151da602bc6d from the persistent domain config. {{(pid=75066) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 19:43:24 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-dee9792d-358e-46cf-a041-42ae894719b2 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 19:43:24 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:43:24 user nova-compute[75066]:   <source dev="/dev/sdb"/>
Dec 01 19:43:24 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:43:24 user nova-compute[75066]:   <serial>86a91d86-a000-43cb-a9bd-69d7df1ccd95</serial>
Dec 01 19:43:24 user nova-compute[75066]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 19:43:24 user nova-compute[75066]: </disk>
Dec 01 19:43:24 user nova-compute[75066]:  {{(pid=75066) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 19:43:24 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-dee9792d-358e-46cf-a041-42ae894719b2 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Successfully detached device vdb from instance 544d6830-e6cf-4c06-95b3-151da602bc6d from the persistent domain config.
Dec 01 19:43:24 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-dee9792d-358e-46cf-a041-42ae894719b2 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 544d6830-e6cf-4c06-95b3-151da602bc6d from the live domain config. {{(pid=75066) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 19:43:24 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-dee9792d-358e-46cf-a041-42ae894719b2 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 19:43:24 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:43:24 user nova-compute[75066]:   <source dev="/dev/sdb"/>
Dec 01 19:43:24 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:43:24 user nova-compute[75066]:   <serial>86a91d86-a000-43cb-a9bd-69d7df1ccd95</serial>
Dec 01 19:43:24 user nova-compute[75066]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 19:43:24 user nova-compute[75066]: </disk>
Dec 01 19:43:24 user nova-compute[75066]:  {{(pid=75066) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 19:43:24 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:43:24 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-dee9792d-358e-46cf-a041-42ae894719b2 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 544d6830-e6cf-4c06-95b3-151da602bc6d {{(pid=75066) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 19:43:26 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:43:26 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:43:26 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:43:26 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:43:26 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:43:26 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:43:26 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75066) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 19:43:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/521a6e67-e213-4f07-94d9-f6ac1e6d40c2/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:43:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/521a6e67-e213-4f07-94d9-f6ac1e6d40c2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:43:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/521a6e67-e213-4f07-94d9-f6ac1e6d40c2/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:43:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/521a6e67-e213-4f07-94d9-f6ac1e6d40c2/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:43:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f7bbc49-b34e-4a0c-b577-7ceadf0cf288/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:43:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f7bbc49-b34e-4a0c-b577-7ceadf0cf288/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:43:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f7bbc49-b34e-4a0c-b577-7ceadf0cf288/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:43:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f7bbc49-b34e-4a0c-b577-7ceadf0cf288/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:43:27 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:43:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/544d6830-e6cf-4c06-95b3-151da602bc6d/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:43:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/544d6830-e6cf-4c06-95b3-151da602bc6d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:43:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/544d6830-e6cf-4c06-95b3-151da602bc6d/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:43:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/544d6830-e6cf-4c06-95b3-151da602bc6d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:43:27 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:43:27 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:43:27 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Hypervisor/Node resource view: name=user free_ram=8732MB free_disk=24.865352630615234GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75066) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 19:43:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:43:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:43:28 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 544d6830-e6cf-4c06-95b3-151da602bc6d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:43:28 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:43:28 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 521a6e67-e213-4f07-94d9-f6ac1e6d40c2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:43:28 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 19:43:28 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 19:43:28 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:43:28 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:43:28 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Compute_service record updated for user:user {{(pid=75066) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 19:43:28 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.288s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:43:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:43:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:43:31 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:43:31 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Starting heal instance info cache {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 19:43:31 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "refresh_cache-1f7bbc49-b34e-4a0c-b577-7ceadf0cf288" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:43:31 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquired lock "refresh_cache-1f7bbc49-b34e-4a0c-b577-7ceadf0cf288" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:43:31 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Forcefully refreshing network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 19:43:31 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Updating instance_info_cache with network_info: [{"id": "5b2ebcf7-2624-49c2-bfa0-c5b694a37ec8", "address": "fa:16:3e:6e:e4:53", "network": {"id": "955d6293-ede6-4cb4-8cee-0157dbad93ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-603640322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109097a30a40419092c74f4c7a695ce4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2ebcf7-26", "ovs_interfaceid": "5b2ebcf7-2624-49c2-bfa0-c5b694a37ec8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:43:31 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Releasing lock "refresh_cache-1f7bbc49-b34e-4a0c-b577-7ceadf0cf288" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:43:31 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Updated the network info_cache for instance {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 19:43:31 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:43:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:43:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:43:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:43:44 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-dee9792d-358e-46cf-a041-42ae894719b2 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 544d6830-e6cf-4c06-95b3-151da602bc6d is timed out.
Dec 01 19:43:44 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-dee9792d-358e-46cf-a041-42ae894719b2 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Successfully detached device vdb from instance 544d6830-e6cf-4c06-95b3-151da602bc6d from the live domain config.
Dec 01 19:43:44 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dee9792d-358e-46cf-a041-42ae894719b2 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] calling os-brick to detach iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 19:43:44 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dee9792d-358e-46cf-a041-42ae894719b2 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, {'target_iqn': 'iqn.2010-10.org.openstack:86a91d86-a000-43cb-a9bd-69d7df1ccd95', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xgWjtfkA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:43:44 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-dee9792d-358e-46cf-a041-42ae894719b2 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:43:44 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-dee9792d-358e-46cf-a041-42ae894719b2 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:43:44 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-dee9792d-358e-46cf-a041-42ae894719b2 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:43:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:43:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:43:44 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[3349807f-1164-4b7a-9e29-7fb820d5b382]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:86a91d86-a000-43cb-a9bd-69d7df1ccd95\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:43:44 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dee9792d-358e-46cf-a041-42ae894719b2 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 19:43:44 user nova-compute[75066]: No targets found.
Dec 01 19:43:44 user nova-compute[75066]: iSNS:
Dec 01 19:43:44 user nova-compute[75066]: No targets found.
Dec 01 19:43:44 user nova-compute[75066]: STATIC:
Dec 01 19:43:44 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:86a91d86-a000-43cb-a9bd-69d7df1ccd95
Dec 01 19:43:44 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:43:44 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:43:44 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1
Dec 01 19:43:44 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:43:44 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:43:44 user nova-compute[75066]: FIRMWARE:
Dec 01 19:43:44 user nova-compute[75066]: No targets found.
Dec 01 19:43:44 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:43:44 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dee9792d-358e-46cf-a041-42ae894719b2 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 19:43:44 user nova-compute[75066]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 19:43:44 user nova-compute[75066]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75066) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 19:43:44 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dee9792d-358e-46cf-a041-42ae894719b2 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86a91d86-a000-43cb-a9bd-69d7df1ccd95', 0)] {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 19:43:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:43:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:43:44 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f39b5c-a7b3-4378-bc6b-97a155320cf4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:86a91d86-a000-43cb-a9bd-69d7df1ccd95\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:43:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:43:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:43:44 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[912d5310-cbf8-48d3-ad65-0138324b0479]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86a91d86-a000-43cb-a9bd-69d7df1ccd95 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:43:44 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dee9792d-358e-46cf-a041-42ae894719b2 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1 (non-flash)
Dec 01 19:43:44 user nova-compute[75066]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86a91d86-a000-43cb-a9bd-69d7df1ccd95 (non-flash)
Dec 01 19:43:44 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:43:44 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dee9792d-358e-46cf-a041-42ae894719b2 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1 (non-flash)
Dec 01 19:43:44 user nova-compute[75066]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:86a91d86-a000-43cb-a9bd-69d7df1ccd95 (non-flash)
Dec 01 19:43:44 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:43:44 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dee9792d-358e-46cf-a041-42ae894719b2 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9190442320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86a91d86-a000-43cb-a9bd-69d7df1ccd95'): ({'sdb'}, set())}) {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 19:43:44 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-dee9792d-358e-46cf-a041-42ae894719b2 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Removing single pathed devices sdb {{(pid=75066) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 19:43:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:43:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:43:44 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1b17a7-1a27-4426-ae20-cb22b54c6ad7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:43:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:43:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:43:44 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4fbb31-e80f-417d-83e5-108686a2cd3b]: (4, ('ok\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:43:44 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-dee9792d-358e-46cf-a041-42ae894719b2 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Flushing IO for device /dev/sdb {{(pid=75066) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 19:43:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:43:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:43:44 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[5905ccc5-673f-4f8e-97c6-bda42b492213]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:43:44 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-dee9792d-358e-46cf-a041-42ae894719b2 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75066) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 19:43:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:43:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:43:44 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f31573-3986-40ee-bc7d-435707a6d174]: (4, ('1', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:43:44 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-dee9792d-358e-46cf-a041-42ae894719b2 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 19:43:44 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-dee9792d-358e-46cf-a041-42ae894719b2 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] SCSI volumes sdb have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 19:43:44 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dee9792d-358e-46cf-a041-42ae894719b2 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:86a91d86-a000-43cb-a9bd-69d7df1ccd95')] {{(pid=75066) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 19:43:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86a91d86-a000-43cb-a9bd-69d7df1ccd95 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:43:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86a91d86-a000-43cb-a9bd-69d7df1ccd95 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:43:44 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[522786dc-db16-4e4d-9d8f-1e9b0aa0baa4]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:43:44 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dee9792d-358e-46cf-a041-42ae894719b2 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:43:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86a91d86-a000-43cb-a9bd-69d7df1ccd95 -p 172.16.0.220:3260 --logout {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:43:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86a91d86-a000-43cb-a9bd-69d7df1ccd95 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:43:44 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[204aa7a5-46e9-41ac-8f47-6392125f5176]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:86a91d86-a000-43cb-a9bd-69d7df1ccd95, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:86a91d86-a000-43cb-a9bd-69d7df1ccd95, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:43:44 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dee9792d-358e-46cf-a041-42ae894719b2 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:86a91d86-a000-43cb-a9bd-69d7df1ccd95, portal: 172.16.0.220,3260]
Dec 01 19:43:44 user nova-compute[75066]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:86a91d86-a000-43cb-a9bd-69d7df1ccd95, portal: 172.16.0.220,3260] successful.
Dec 01 19:43:44 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:43:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:86a91d86-a000-43cb-a9bd-69d7df1ccd95 -p 172.16.0.220:3260 --op delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:43:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:86a91d86-a000-43cb-a9bd-69d7df1ccd95 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:43:44 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d53fbf-af5e-493b-b488-9d9fc4ee3bd1]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:43:44 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dee9792d-358e-46cf-a041-42ae894719b2 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:43:44 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-dee9792d-358e-46cf-a041-42ae894719b2 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:43:44 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dee9792d-358e-46cf-a041-42ae894719b2 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] <== disconnect_volume: return (331ms) None {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:43:44 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dee9792d-358e-46cf-a041-42ae894719b2 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Disconnected iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 19:43:45 user nova-compute[75066]: DEBUG nova.objects.instance [None req-dee9792d-358e-46cf-a041-42ae894719b2 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lazy-loading 'flavor' on Instance uuid 544d6830-e6cf-4c06-95b3-151da602bc6d {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:43:45 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dee9792d-358e-46cf-a041-42ae894719b2 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lock "544d6830-e6cf-4c06-95b3-151da602bc6d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.837s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:43:48 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:43:53 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:43:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:44:00 user nova-compute[75066]: DEBUG nova.compute.manager [req-04bde78e-5017-409c-83bd-d121ae5ddf68 req-68657a57-4253-4f6b-93d2-9a5b2206341b service nova] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] Received event network-changed-e009340f-8fee-47fd-a143-911e6f07ae96 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:44:00 user nova-compute[75066]: DEBUG nova.compute.manager [req-04bde78e-5017-409c-83bd-d121ae5ddf68 req-68657a57-4253-4f6b-93d2-9a5b2206341b service nova] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] Refreshing instance network info cache due to event network-changed-e009340f-8fee-47fd-a143-911e6f07ae96. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:44:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-04bde78e-5017-409c-83bd-d121ae5ddf68 req-68657a57-4253-4f6b-93d2-9a5b2206341b service nova] Acquiring lock "refresh_cache-521a6e67-e213-4f07-94d9-f6ac1e6d40c2" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:44:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-04bde78e-5017-409c-83bd-d121ae5ddf68 req-68657a57-4253-4f6b-93d2-9a5b2206341b service nova] Acquired lock "refresh_cache-521a6e67-e213-4f07-94d9-f6ac1e6d40c2" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:44:00 user nova-compute[75066]: DEBUG nova.network.neutron [req-04bde78e-5017-409c-83bd-d121ae5ddf68 req-68657a57-4253-4f6b-93d2-9a5b2206341b service nova] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] Refreshing network info cache for port e009340f-8fee-47fd-a143-911e6f07ae96 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:44:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a5d5b60e-cdb2-4cac-afdd-4bdc7e7fddb1 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Acquiring lock "521a6e67-e213-4f07-94d9-f6ac1e6d40c2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:44:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a5d5b60e-cdb2-4cac-afdd-4bdc7e7fddb1 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "521a6e67-e213-4f07-94d9-f6ac1e6d40c2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:44:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a5d5b60e-cdb2-4cac-afdd-4bdc7e7fddb1 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Acquiring lock "521a6e67-e213-4f07-94d9-f6ac1e6d40c2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:44:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a5d5b60e-cdb2-4cac-afdd-4bdc7e7fddb1 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "521a6e67-e213-4f07-94d9-f6ac1e6d40c2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:44:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a5d5b60e-cdb2-4cac-afdd-4bdc7e7fddb1 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "521a6e67-e213-4f07-94d9-f6ac1e6d40c2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:44:00 user nova-compute[75066]: INFO nova.compute.manager [None req-a5d5b60e-cdb2-4cac-afdd-4bdc7e7fddb1 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] Terminating instance
Dec 01 19:44:00 user nova-compute[75066]: DEBUG nova.compute.manager [None req-a5d5b60e-cdb2-4cac-afdd-4bdc7e7fddb1 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] Start destroying the instance on the hypervisor. {{(pid=75066) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 19:44:00 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:44:00 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:44:01 user nova-compute[75066]: DEBUG nova.network.neutron [req-04bde78e-5017-409c-83bd-d121ae5ddf68 req-68657a57-4253-4f6b-93d2-9a5b2206341b service nova] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] Updated VIF entry in instance network info cache for port e009340f-8fee-47fd-a143-911e6f07ae96. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:44:01 user nova-compute[75066]: DEBUG nova.network.neutron [req-04bde78e-5017-409c-83bd-d121ae5ddf68 req-68657a57-4253-4f6b-93d2-9a5b2206341b service nova] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] Updating instance_info_cache with network_info: [{"id": "e009340f-8fee-47fd-a143-911e6f07ae96", "address": "fa:16:3e:fd:b9:2b", "network": {"id": "955d6293-ede6-4cb4-8cee-0157dbad93ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-603640322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109097a30a40419092c74f4c7a695ce4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape009340f-8f", "ovs_interfaceid": "e009340f-8fee-47fd-a143-911e6f07ae96", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:44:01 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:44:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-04bde78e-5017-409c-83bd-d121ae5ddf68 req-68657a57-4253-4f6b-93d2-9a5b2206341b service nova] Releasing lock "refresh_cache-521a6e67-e213-4f07-94d9-f6ac1e6d40c2" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:44:01 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:44:01 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] Instance destroyed successfully.
Dec 01 19:44:01 user nova-compute[75066]: DEBUG nova.objects.instance [None req-a5d5b60e-cdb2-4cac-afdd-4bdc7e7fddb1 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lazy-loading 'resources' on Instance uuid 521a6e67-e213-4f07-94d9-f6ac1e6d40c2 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:44:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-a5d5b60e-cdb2-4cac-afdd-4bdc7e7fddb1 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:42:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1759465216',display_name='tempest-AttachVolumeNegativeTest-server-1759465216',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1759465216',id=43,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJC4iLJMP36fEwoKPyAZvkZF5PXcW9YD+tZ/NzQenpweq5LJT8QZeBN47W8agB2jI3gb/JtCB8cGwCtN/ArD2/SANYkRYa2fNktq4cSFOA503JO19aDLqb0NpFmChXIW6w==',key_name='tempest-keypair-1545077095',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:42:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='109097a30a40419092c74f4c7a695ce4',ramdisk_id='',reservation_id='r-vamzakl5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-711021602',owner_user_name='tempest-AttachVolumeNegativeTest-711021602-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:42:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b92b1beca2ee480181e771eafe1a9f97',uuid=521a6e67-e213-4f07-94d9-f6ac1e6d40c2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e009340f-8fee-47fd-a143-911e6f07ae96", "address": "fa:16:3e:fd:b9:2b", "network": {"id": "955d6293-ede6-4cb4-8cee-0157dbad93ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-603640322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109097a30a40419092c74f4c7a695ce4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape009340f-8f", "ovs_interfaceid": "e009340f-8fee-47fd-a143-911e6f07ae96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:44:01 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-a5d5b60e-cdb2-4cac-afdd-4bdc7e7fddb1 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Converting VIF {"id": "e009340f-8fee-47fd-a143-911e6f07ae96", "address": "fa:16:3e:fd:b9:2b", "network": {"id": "955d6293-ede6-4cb4-8cee-0157dbad93ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-603640322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109097a30a40419092c74f4c7a695ce4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape009340f-8f", "ovs_interfaceid": "e009340f-8fee-47fd-a143-911e6f07ae96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:44:01 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-a5d5b60e-cdb2-4cac-afdd-4bdc7e7fddb1 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:b9:2b,bridge_name='br-int',has_traffic_filtering=True,id=e009340f-8fee-47fd-a143-911e6f07ae96,network=Network(955d6293-ede6-4cb4-8cee-0157dbad93ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape009340f-8f') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:44:01 user nova-compute[75066]: DEBUG os_vif [None req-a5d5b60e-cdb2-4cac-afdd-4bdc7e7fddb1 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:b9:2b,bridge_name='br-int',has_traffic_filtering=True,id=e009340f-8fee-47fd-a143-911e6f07ae96,network=Network(955d6293-ede6-4cb4-8cee-0157dbad93ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape009340f-8f') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:44:01 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:44:01 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape009340f-8f, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:44:01 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:44:01 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:44:01 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:44:01 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=842e4c8a-3e8f-4949-ab7e-2add3aee517b) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:44:01 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:44:01 user nova-compute[75066]: INFO os_vif [None req-a5d5b60e-cdb2-4cac-afdd-4bdc7e7fddb1 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:b9:2b,bridge_name='br-int',has_traffic_filtering=True,id=e009340f-8fee-47fd-a143-911e6f07ae96,network=Network(955d6293-ede6-4cb4-8cee-0157dbad93ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape009340f-8f')
Dec 01 19:44:01 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-a5d5b60e-cdb2-4cac-afdd-4bdc7e7fddb1 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] Deleting instance files /opt/stack/data/nova/instances/521a6e67-e213-4f07-94d9-f6ac1e6d40c2_del
Dec 01 19:44:01 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-a5d5b60e-cdb2-4cac-afdd-4bdc7e7fddb1 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] Deletion of /opt/stack/data/nova/instances/521a6e67-e213-4f07-94d9-f6ac1e6d40c2_del complete
Dec 01 19:44:01 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:44:01 user nova-compute[75066]: INFO nova.compute.manager [None req-a5d5b60e-cdb2-4cac-afdd-4bdc7e7fddb1 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] Took 0.67 seconds to destroy the instance on the hypervisor.
Dec 01 19:44:01 user nova-compute[75066]: DEBUG oslo.service.loopingcall [None req-a5d5b60e-cdb2-4cac-afdd-4bdc7e7fddb1 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75066) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 19:44:01 user nova-compute[75066]: DEBUG nova.compute.manager [-] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] Deallocating network for instance {{(pid=75066) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 19:44:01 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] deallocate_for_instance() {{(pid=75066) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 19:44:02 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:44:02 user nova-compute[75066]: INFO nova.compute.manager [-] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] Took 0.65 seconds to deallocate network for instance.
Dec 01 19:44:02 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a5d5b60e-cdb2-4cac-afdd-4bdc7e7fddb1 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:44:02 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a5d5b60e-cdb2-4cac-afdd-4bdc7e7fddb1 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:44:02 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-a5d5b60e-cdb2-4cac-afdd-4bdc7e7fddb1 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:44:02 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-a5d5b60e-cdb2-4cac-afdd-4bdc7e7fddb1 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:44:02 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a5d5b60e-cdb2-4cac-afdd-4bdc7e7fddb1 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.180s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:44:02 user nova-compute[75066]: DEBUG nova.compute.manager [req-c58652b9-9565-44e6-9dfd-a8521b2fe71b req-f1ba3895-5dcc-44f1-a84a-eb270c645198 service nova] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] Received event network-vif-unplugged-e009340f-8fee-47fd-a143-911e6f07ae96 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:44:02 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-c58652b9-9565-44e6-9dfd-a8521b2fe71b req-f1ba3895-5dcc-44f1-a84a-eb270c645198 service nova] Acquiring lock "521a6e67-e213-4f07-94d9-f6ac1e6d40c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:44:02 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-c58652b9-9565-44e6-9dfd-a8521b2fe71b req-f1ba3895-5dcc-44f1-a84a-eb270c645198 service nova] Lock "521a6e67-e213-4f07-94d9-f6ac1e6d40c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:44:02 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-c58652b9-9565-44e6-9dfd-a8521b2fe71b req-f1ba3895-5dcc-44f1-a84a-eb270c645198 service nova] Lock "521a6e67-e213-4f07-94d9-f6ac1e6d40c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:44:02 user nova-compute[75066]: DEBUG nova.compute.manager [req-c58652b9-9565-44e6-9dfd-a8521b2fe71b req-f1ba3895-5dcc-44f1-a84a-eb270c645198 service nova] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] No waiting events found dispatching network-vif-unplugged-e009340f-8fee-47fd-a143-911e6f07ae96 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:44:02 user nova-compute[75066]: WARNING nova.compute.manager [req-c58652b9-9565-44e6-9dfd-a8521b2fe71b req-f1ba3895-5dcc-44f1-a84a-eb270c645198 service nova] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] Received unexpected event network-vif-unplugged-e009340f-8fee-47fd-a143-911e6f07ae96 for instance with vm_state deleted and task_state None.
Dec 01 19:44:02 user nova-compute[75066]: DEBUG nova.compute.manager [req-c58652b9-9565-44e6-9dfd-a8521b2fe71b req-f1ba3895-5dcc-44f1-a84a-eb270c645198 service nova] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] Received event network-vif-plugged-e009340f-8fee-47fd-a143-911e6f07ae96 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:44:02 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-c58652b9-9565-44e6-9dfd-a8521b2fe71b req-f1ba3895-5dcc-44f1-a84a-eb270c645198 service nova] Acquiring lock "521a6e67-e213-4f07-94d9-f6ac1e6d40c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:44:02 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-c58652b9-9565-44e6-9dfd-a8521b2fe71b req-f1ba3895-5dcc-44f1-a84a-eb270c645198 service nova] Lock "521a6e67-e213-4f07-94d9-f6ac1e6d40c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:44:02 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-c58652b9-9565-44e6-9dfd-a8521b2fe71b req-f1ba3895-5dcc-44f1-a84a-eb270c645198 service nova] Lock "521a6e67-e213-4f07-94d9-f6ac1e6d40c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:44:02 user nova-compute[75066]: DEBUG nova.compute.manager [req-c58652b9-9565-44e6-9dfd-a8521b2fe71b req-f1ba3895-5dcc-44f1-a84a-eb270c645198 service nova] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] No waiting events found dispatching network-vif-plugged-e009340f-8fee-47fd-a143-911e6f07ae96 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:44:02 user nova-compute[75066]: WARNING nova.compute.manager [req-c58652b9-9565-44e6-9dfd-a8521b2fe71b req-f1ba3895-5dcc-44f1-a84a-eb270c645198 service nova] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] Received unexpected event network-vif-plugged-e009340f-8fee-47fd-a143-911e6f07ae96 for instance with vm_state deleted and task_state None.
Dec 01 19:44:02 user nova-compute[75066]: DEBUG nova.compute.manager [req-c58652b9-9565-44e6-9dfd-a8521b2fe71b req-f1ba3895-5dcc-44f1-a84a-eb270c645198 service nova] [instance: 521a6e67-e213-4f07-94d9-f6ac1e6d40c2] Received event network-vif-deleted-e009340f-8fee-47fd-a143-911e6f07ae96 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:44:02 user nova-compute[75066]: INFO nova.scheduler.client.report [None req-a5d5b60e-cdb2-4cac-afdd-4bdc7e7fddb1 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Deleted allocations for instance 521a6e67-e213-4f07-94d9-f6ac1e6d40c2
Dec 01 19:44:02 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a5d5b60e-cdb2-4cac-afdd-4bdc7e7fddb1 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "521a6e67-e213-4f07-94d9-f6ac1e6d40c2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.743s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:44:03 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:44:06 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:44:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:44:16 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:44:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:44:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dbf3a1fb-4d4d-4521-94dc-2bd46f89272e tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Acquiring lock "544d6830-e6cf-4c06-95b3-151da602bc6d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:44:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dbf3a1fb-4d4d-4521-94dc-2bd46f89272e tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lock "544d6830-e6cf-4c06-95b3-151da602bc6d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:44:17 user nova-compute[75066]: DEBUG nova.objects.instance [None req-dbf3a1fb-4d4d-4521-94dc-2bd46f89272e tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lazy-loading 'flavor' on Instance uuid 544d6830-e6cf-4c06-95b3-151da602bc6d {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:44:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dbf3a1fb-4d4d-4521-94dc-2bd46f89272e tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lock "544d6830-e6cf-4c06-95b3-151da602bc6d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:44:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dbf3a1fb-4d4d-4521-94dc-2bd46f89272e tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Acquiring lock "544d6830-e6cf-4c06-95b3-151da602bc6d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:44:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dbf3a1fb-4d4d-4521-94dc-2bd46f89272e tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lock "544d6830-e6cf-4c06-95b3-151da602bc6d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:44:17 user nova-compute[75066]: INFO nova.compute.manager [None req-dbf3a1fb-4d4d-4521-94dc-2bd46f89272e tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Attaching volume 83497aad-41ad-40dc-a0f6-65fd918bc1d7 to /dev/vdb
Dec 01 19:44:17 user nova-compute[75066]: DEBUG os_brick.utils [None req-dbf3a1fb-4d4d-4521-94dc-2bd46f89272e tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:44:17 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:44:17 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:44:17 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[969a6100-5a24-451d-aebe-b8774e8c2034]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1959854982f\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:44:17 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:44:17 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:44:17 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[72cc8324-b653-4b05-960e-a2dc299879a7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:44:17 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:44:17 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:44:17 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e85390-1e7c-4846-bbaa-3eb7bac39f4e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:44:17 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[621d603d-cbb2-40aa-9292-c77c08bd5fde]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:44:17 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-dbf3a1fb-4d4d-4521-94dc-2bd46f89272e tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Running cmd (subprocess): nvme version {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:44:17 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-dbf3a1fb-4d4d-4521-94dc-2bd46f89272e tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] 'nvme version' failed. Not Retrying. {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:44:17 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dbf3a1fb-4d4d-4521-94dc-2bd46f89272e tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] nvme not present on system {{(pid=75066) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 19:44:17 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:44:17 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:44:17 user nova-compute[75066]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 19:44:17 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f7e42b-a25b-4e96-91a7-0d2306bc3a8b]: (4, '') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:44:17 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-dbf3a1fb-4d4d-4521-94dc-2bd46f89272e tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75066) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 19:44:17 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-dbf3a1fb-4d4d-4521-94dc-2bd46f89272e tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 19:44:17 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-dbf3a1fb-4d4d-4521-94dc-2bd46f89272e tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] LIGHTOS: no hostnqn found. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 19:44:17 user nova-compute[75066]: DEBUG os_brick.utils [None req-dbf3a1fb-4d4d-4521-94dc-2bd46f89272e tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1959854982f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:44:17 user nova-compute[75066]: DEBUG nova.virt.block_device [None req-dbf3a1fb-4d4d-4521-94dc-2bd46f89272e tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Updating existing volume attachment record: 1e75745c-486b-478d-a25e-83f0a6d3988c {{(pid=75066) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 19:44:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:44:19 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:44:19 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75066) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 19:44:21 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:44:21 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:44:23 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:44:24 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:44:25 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:44:26 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:44:26 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbf3a1fb-4d4d-4521-94dc-2bd46f89272e tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Calling os-brick to attach iSCSI Volume {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 19:44:26 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf3a1fb-4d4d-4521-94dc-2bd46f89272e tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:83497aad-41ad-40dc-a0f6-65fd918bc1d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YLEwkQHX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:44:26 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-dbf3a1fb-4d4d-4521-94dc-2bd46f89272e tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:44:26 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-dbf3a1fb-4d4d-4521-94dc-2bd46f89272e tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:44:26 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-dbf3a1fb-4d4d-4521-94dc-2bd46f89272e tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:44:26 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-dbf3a1fb-4d4d-4521-94dc-2bd46f89272e tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:44:26 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-dbf3a1fb-4d4d-4521-94dc-2bd46f89272e tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83497aad-41ad-40dc-a0f6-65fd918bc1d7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:44:26 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-dbf3a1fb-4d4d-4521-94dc-2bd46f89272e tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83497aad-41ad-40dc-a0f6-65fd918bc1d7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:44:26 user nova-compute[75066]: INFO os_brick.initiator.connectors.iscsi [None req-dbf3a1fb-4d4d-4521-94dc-2bd46f89272e tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 19:44:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83497aad-41ad-40dc-a0f6-65fd918bc1d7 -p 172.16.0.220:3260 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:44:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83497aad-41ad-40dc-a0f6-65fd918bc1d7 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:44:26 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0bc71e2-8904-4f20-91d5-a74b86002e71]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:44:26 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf3a1fb-4d4d-4521-94dc-2bd46f89272e tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 19:44:26 user nova-compute[75066]:  {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:44:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83497aad-41ad-40dc-a0f6-65fd918bc1d7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:44:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83497aad-41ad-40dc-a0f6-65fd918bc1d7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:44:26 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[054ee77b-c2e4-49bb-bd89-770e6fa21a74]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83497aad-41ad-40dc-a0f6-65fd918bc1d7] added\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:44:26 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf3a1fb-4d4d-4521-94dc-2bd46f89272e tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83497aad-41ad-40dc-a0f6-65fd918bc1d7] added
Dec 01 19:44:26 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:44:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83497aad-41ad-40dc-a0f6-65fd918bc1d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:44:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83497aad-41ad-40dc-a0f6-65fd918bc1d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.039s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:44:26 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[6202d817-c2e9-49be-bac4-259d2bdebfc6]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:44:26 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf3a1fb-4d4d-4521-94dc-2bd46f89272e tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:44:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83497aad-41ad-40dc-a0f6-65fd918bc1d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:44:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83497aad-41ad-40dc-a0f6-65fd918bc1d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:44:26 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[252733b6-fcd5-4942-a86a-9632e774d907]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:44:26 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf3a1fb-4d4d-4521-94dc-2bd46f89272e tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:44:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83497aad-41ad-40dc-a0f6-65fd918bc1d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YLEwkQHX {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:44:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83497aad-41ad-40dc-a0f6-65fd918bc1d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YLEwkQHX" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:44:26 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[2810203a-5912-4bd8-ac50-608516116504]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:44:26 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf3a1fb-4d4d-4521-94dc-2bd46f89272e tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YLEwkQHX'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:44:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83497aad-41ad-40dc-a0f6-65fd918bc1d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:44:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83497aad-41ad-40dc-a0f6-65fd918bc1d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:44:26 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[e722e0cd-0b6e-4745-924e-324d3469634c]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:44:26 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf3a1fb-4d4d-4521-94dc-2bd46f89272e tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:44:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:44:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:44:26 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[563a3ff3-af68-4f55-bdf2-3e75bf09b110]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:44:26 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf3a1fb-4d4d-4521-94dc-2bd46f89272e tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1 (non-flash)
Dec 01 19:44:26 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:44:26 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf3a1fb-4d4d-4521-94dc-2bd46f89272e tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1 (non-flash)
Dec 01 19:44:26 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:44:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83497aad-41ad-40dc-a0f6-65fd918bc1d7 -p 172.16.0.220:3260 --login {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:44:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83497aad-41ad-40dc-a0f6-65fd918bc1d7 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:44:26 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3ee645-5fd4-4530-93c6-74f7ca4d8868]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:83497aad-41ad-40dc-a0f6-65fd918bc1d7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:83497aad-41ad-40dc-a0f6-65fd918bc1d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:44:26 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf3a1fb-4d4d-4521-94dc-2bd46f89272e tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:83497aad-41ad-40dc-a0f6-65fd918bc1d7, portal: 172.16.0.220,3260]
Dec 01 19:44:26 user nova-compute[75066]: Login to [iface: default, target: iqn.2010-10.org.openstack:83497aad-41ad-40dc-a0f6-65fd918bc1d7, portal: 172.16.0.220,3260] successful.
Dec 01 19:44:26 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:44:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83497aad-41ad-40dc-a0f6-65fd918bc1d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:44:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83497aad-41ad-40dc-a0f6-65fd918bc1d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:44:26 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1656573-bbc8-4ba5-b986-662874c56a77]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:44:26 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf3a1fb-4d4d-4521-94dc-2bd46f89272e tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:44:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:44:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:44:26 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e7bec5-fe66-45e7-bc2f-c18eab054cc1]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83497aad-41ad-40dc-a0f6-65fd918bc1d7 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:44:26 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf3a1fb-4d4d-4521-94dc-2bd46f89272e tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1 (non-flash)
Dec 01 19:44:26 user nova-compute[75066]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83497aad-41ad-40dc-a0f6-65fd918bc1d7 (non-flash)
Dec 01 19:44:26 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:44:26 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf3a1fb-4d4d-4521-94dc-2bd46f89272e tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1 (non-flash)
Dec 01 19:44:26 user nova-compute[75066]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83497aad-41ad-40dc-a0f6-65fd918bc1d7 (non-flash)
Dec 01 19:44:26 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:44:26 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-dbf3a1fb-4d4d-4521-94dc-2bd46f89272e tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83497aad-41ad-40dc-a0f6-65fd918bc1d7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:44:26 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf3a1fb-4d4d-4521-94dc-2bd46f89272e tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Connected to 172.16.0.220:3260 {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 19:44:26 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-dbf3a1fb-4d4d-4521-94dc-2bd46f89272e tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=75066) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 19:44:26 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-dbf3a1fb-4d4d-4521-94dc-2bd46f89272e tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75066) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 19:44:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:44:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:44:26 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83a2c88-4909-4e15-b432-a404ce945fed]: (4, ('- - 0', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:44:26 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-dbf3a1fb-4d4d-4521-94dc-2bd46f89272e tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: None {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:44:27 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:44:27 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-dbf3a1fb-4d4d-4521-94dc-2bd46f89272e tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:44:27 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf3a1fb-4d4d-4521-94dc-2bd46f89272e tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:83497aad-41ad-40dc-a0f6-65fd918bc1d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YLEwkQHX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 19:44:27 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-dbf3a1fb-4d4d-4521-94dc-2bd46f89272e tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:44:27 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbf3a1fb-4d4d-4521-94dc-2bd46f89272e tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '23366316565393433', 'path': '/dev/sdb'} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:44:27 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbf3a1fb-4d4d-4521-94dc-2bd46f89272e tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23366316565393433', 'path': '/dev/sdb'} {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 19:44:27 user nova-compute[75066]: DEBUG nova.objects.instance [None req-dbf3a1fb-4d4d-4521-94dc-2bd46f89272e tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lazy-loading 'flavor' on Instance uuid 544d6830-e6cf-4c06-95b3-151da602bc6d {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:44:27 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-dbf3a1fb-4d4d-4521-94dc-2bd46f89272e tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 19:44:27 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:44:27 user nova-compute[75066]:   <source dev="/dev/sdb"/>
Dec 01 19:44:27 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:44:27 user nova-compute[75066]:   <serial>83497aad-41ad-40dc-a0f6-65fd918bc1d7</serial>
Dec 01 19:44:27 user nova-compute[75066]: </disk>
Dec 01 19:44:27 user nova-compute[75066]:  {{(pid=75066) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 19:44:28 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:44:28 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:44:28 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:44:28 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:44:28 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75066) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 19:44:28 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-dbf3a1fb-4d4d-4521-94dc-2bd46f89272e tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:44:28 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-dbf3a1fb-4d4d-4521-94dc-2bd46f89272e tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:44:28 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-dbf3a1fb-4d4d-4521-94dc-2bd46f89272e tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] No VIF found with MAC fa:16:3e:b1:1b:aa, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:44:28 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f7bbc49-b34e-4a0c-b577-7ceadf0cf288/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:44:28 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dbf3a1fb-4d4d-4521-94dc-2bd46f89272e tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lock "544d6830-e6cf-4c06-95b3-151da602bc6d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.100s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:44:28 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f7bbc49-b34e-4a0c-b577-7ceadf0cf288/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:44:28 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f7bbc49-b34e-4a0c-b577-7ceadf0cf288/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:44:28 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f7bbc49-b34e-4a0c-b577-7ceadf0cf288/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:44:28 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:44:28 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/544d6830-e6cf-4c06-95b3-151da602bc6d/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:44:28 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/544d6830-e6cf-4c06-95b3-151da602bc6d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:44:28 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/544d6830-e6cf-4c06-95b3-151da602bc6d/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:44:29 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/544d6830-e6cf-4c06-95b3-151da602bc6d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:44:29 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:44:29 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:44:29 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:44:29 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Hypervisor/Node resource view: name=user free_ram=8826MB free_disk=24.883464813232422GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75066) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 19:44:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:44:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:44:29 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 544d6830-e6cf-4c06-95b3-151da602bc6d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:44:29 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:44:29 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 19:44:29 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 19:44:29 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:44:29 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:44:29 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Compute_service record updated for user:user {{(pid=75066) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 19:44:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.239s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:44:30 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-0379f58b-8b62-437d-99a5-912d6c410af5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Acquiring lock "544d6830-e6cf-4c06-95b3-151da602bc6d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:44:30 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-0379f58b-8b62-437d-99a5-912d6c410af5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lock "544d6830-e6cf-4c06-95b3-151da602bc6d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:44:30 user nova-compute[75066]: INFO nova.compute.manager [None req-0379f58b-8b62-437d-99a5-912d6c410af5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Detaching volume 83497aad-41ad-40dc-a0f6-65fd918bc1d7
Dec 01 19:44:30 user nova-compute[75066]: INFO nova.virt.block_device [None req-0379f58b-8b62-437d-99a5-912d6c410af5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Attempting to driver detach volume 83497aad-41ad-40dc-a0f6-65fd918bc1d7 from mountpoint /dev/vdb
Dec 01 19:44:30 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-0379f58b-8b62-437d-99a5-912d6c410af5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Attempting to detach device vdb from instance 544d6830-e6cf-4c06-95b3-151da602bc6d from the persistent domain config. {{(pid=75066) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 19:44:30 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-0379f58b-8b62-437d-99a5-912d6c410af5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 19:44:30 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:44:30 user nova-compute[75066]:   <source dev="/dev/sdb"/>
Dec 01 19:44:30 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:44:30 user nova-compute[75066]:   <serial>83497aad-41ad-40dc-a0f6-65fd918bc1d7</serial>
Dec 01 19:44:30 user nova-compute[75066]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 19:44:30 user nova-compute[75066]: </disk>
Dec 01 19:44:30 user nova-compute[75066]:  {{(pid=75066) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 19:44:30 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-0379f58b-8b62-437d-99a5-912d6c410af5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Successfully detached device vdb from instance 544d6830-e6cf-4c06-95b3-151da602bc6d from the persistent domain config.
Dec 01 19:44:30 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-0379f58b-8b62-437d-99a5-912d6c410af5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 544d6830-e6cf-4c06-95b3-151da602bc6d from the live domain config. {{(pid=75066) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 19:44:30 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-0379f58b-8b62-437d-99a5-912d6c410af5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 19:44:30 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:44:30 user nova-compute[75066]:   <source dev="/dev/sdb"/>
Dec 01 19:44:30 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:44:30 user nova-compute[75066]:   <serial>83497aad-41ad-40dc-a0f6-65fd918bc1d7</serial>
Dec 01 19:44:30 user nova-compute[75066]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 19:44:30 user nova-compute[75066]: </disk>
Dec 01 19:44:30 user nova-compute[75066]:  {{(pid=75066) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 19:44:31 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-0379f58b-8b62-437d-99a5-912d6c410af5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 544d6830-e6cf-4c06-95b3-151da602bc6d {{(pid=75066) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 19:44:31 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:44:32 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:44:32 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Starting heal instance info cache {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 19:44:32 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Didn't find any instances for network info cache update. {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 01 19:44:32 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:44:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:44:36 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:44:41 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:44:46 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:44:51 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-0379f58b-8b62-437d-99a5-912d6c410af5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 544d6830-e6cf-4c06-95b3-151da602bc6d is timed out.
Dec 01 19:44:51 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-0379f58b-8b62-437d-99a5-912d6c410af5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Successfully detached device vdb from instance 544d6830-e6cf-4c06-95b3-151da602bc6d from the live domain config.
Dec 01 19:44:51 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0379f58b-8b62-437d-99a5-912d6c410af5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] calling os-brick to detach iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 19:44:51 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-0379f58b-8b62-437d-99a5-912d6c410af5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, {'target_iqn': 'iqn.2010-10.org.openstack:83497aad-41ad-40dc-a0f6-65fd918bc1d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YLEwkQHX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:44:51 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-0379f58b-8b62-437d-99a5-912d6c410af5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:44:51 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-0379f58b-8b62-437d-99a5-912d6c410af5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:44:51 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-0379f58b-8b62-437d-99a5-912d6c410af5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:44:51 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:44:51 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:44:51 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[8762c8ee-a0ec-4032-9ff3-b078aef4f3d7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:83497aad-41ad-40dc-a0f6-65fd918bc1d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:44:51 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-0379f58b-8b62-437d-99a5-912d6c410af5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 19:44:51 user nova-compute[75066]: No targets found.
Dec 01 19:44:51 user nova-compute[75066]: iSNS:
Dec 01 19:44:51 user nova-compute[75066]: No targets found.
Dec 01 19:44:51 user nova-compute[75066]: STATIC:
Dec 01 19:44:51 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1
Dec 01 19:44:51 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:44:51 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:44:51 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:83497aad-41ad-40dc-a0f6-65fd918bc1d7
Dec 01 19:44:51 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:44:51 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:44:51 user nova-compute[75066]: FIRMWARE:
Dec 01 19:44:51 user nova-compute[75066]: No targets found.
Dec 01 19:44:51 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:44:51 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-0379f58b-8b62-437d-99a5-912d6c410af5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 19:44:51 user nova-compute[75066]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 19:44:51 user nova-compute[75066]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75066) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 19:44:51 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-0379f58b-8b62-437d-99a5-912d6c410af5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83497aad-41ad-40dc-a0f6-65fd918bc1d7', 0)] {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 19:44:51 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:44:51 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:44:51 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d97cea-769e-4d22-803a-46e902c6f705]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83497aad-41ad-40dc-a0f6-65fd918bc1d7\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:44:51 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:44:51 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:44:51 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[358fb60d-2233-41d4-8402-daf03d090315]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83497aad-41ad-40dc-a0f6-65fd918bc1d7 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:44:51 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-0379f58b-8b62-437d-99a5-912d6c410af5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1 (non-flash)
Dec 01 19:44:51 user nova-compute[75066]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83497aad-41ad-40dc-a0f6-65fd918bc1d7 (non-flash)
Dec 01 19:44:51 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:44:51 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-0379f58b-8b62-437d-99a5-912d6c410af5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1 (non-flash)
Dec 01 19:44:51 user nova-compute[75066]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83497aad-41ad-40dc-a0f6-65fd918bc1d7 (non-flash)
Dec 01 19:44:51 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:44:51 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-0379f58b-8b62-437d-99a5-912d6c410af5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91901aee60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83497aad-41ad-40dc-a0f6-65fd918bc1d7'): ({'sdb'}, set())}) {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 19:44:51 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-0379f58b-8b62-437d-99a5-912d6c410af5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Removing single pathed devices sdb {{(pid=75066) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 19:44:51 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:44:51 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:44:51 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[751aa72e-e426-4897-808d-a50e15af2248]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:44:51 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:44:51 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:44:51 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ef2bf1-b53c-4c2d-89b5-3b963f2690e4]: (4, ('ok\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:44:51 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-0379f58b-8b62-437d-99a5-912d6c410af5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Flushing IO for device /dev/sdb {{(pid=75066) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 19:44:51 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:44:51 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:44:51 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf380c7-a735-4c8e-aca2-af0aab997054]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:44:51 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-0379f58b-8b62-437d-99a5-912d6c410af5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75066) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 19:44:51 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:44:51 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:44:51 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f8d3d3-9191-42ab-9595-cb5596dc01d4]: (4, ('1', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:44:51 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-0379f58b-8b62-437d-99a5-912d6c410af5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 19:44:51 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-0379f58b-8b62-437d-99a5-912d6c410af5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] SCSI volumes sdb have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 19:44:51 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-0379f58b-8b62-437d-99a5-912d6c410af5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83497aad-41ad-40dc-a0f6-65fd918bc1d7')] {{(pid=75066) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 19:44:51 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83497aad-41ad-40dc-a0f6-65fd918bc1d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:44:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:44:51 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83497aad-41ad-40dc-a0f6-65fd918bc1d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:44:51 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf62825b-946c-407e-b855-7a8c3f770ff8]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:44:51 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-0379f58b-8b62-437d-99a5-912d6c410af5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:44:51 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83497aad-41ad-40dc-a0f6-65fd918bc1d7 -p 172.16.0.220:3260 --logout {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:44:51 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83497aad-41ad-40dc-a0f6-65fd918bc1d7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:44:51 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[f858678f-ce0b-4b1d-8eb5-cdd1482e308a]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:83497aad-41ad-40dc-a0f6-65fd918bc1d7, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:83497aad-41ad-40dc-a0f6-65fd918bc1d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:44:51 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-0379f58b-8b62-437d-99a5-912d6c410af5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:83497aad-41ad-40dc-a0f6-65fd918bc1d7, portal: 172.16.0.220,3260]
Dec 01 19:44:51 user nova-compute[75066]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:83497aad-41ad-40dc-a0f6-65fd918bc1d7, portal: 172.16.0.220,3260] successful.
Dec 01 19:44:51 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:44:51 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83497aad-41ad-40dc-a0f6-65fd918bc1d7 -p 172.16.0.220:3260 --op delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:44:51 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83497aad-41ad-40dc-a0f6-65fd918bc1d7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:44:51 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[211bb85e-beb4-43a5-a786-c9e090fec091]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:44:51 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-0379f58b-8b62-437d-99a5-912d6c410af5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:44:51 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-0379f58b-8b62-437d-99a5-912d6c410af5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:44:51 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-0379f58b-8b62-437d-99a5-912d6c410af5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] <== disconnect_volume: return (293ms) None {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:44:51 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0379f58b-8b62-437d-99a5-912d6c410af5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Disconnected iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 19:44:52 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-469317bd-1b3a-4367-97ce-e21b96ab95c8 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Acquiring lock "1f7bbc49-b34e-4a0c-b577-7ceadf0cf288" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:44:52 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-469317bd-1b3a-4367-97ce-e21b96ab95c8 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "1f7bbc49-b34e-4a0c-b577-7ceadf0cf288" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:44:52 user nova-compute[75066]: INFO nova.compute.manager [None req-469317bd-1b3a-4367-97ce-e21b96ab95c8 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Detaching volume 8215b1e0-f7fa-446f-b50c-63a892de2cb1
Dec 01 19:44:52 user nova-compute[75066]: INFO nova.virt.block_device [None req-469317bd-1b3a-4367-97ce-e21b96ab95c8 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Attempting to driver detach volume 8215b1e0-f7fa-446f-b50c-63a892de2cb1 from mountpoint /dev/vdb
Dec 01 19:44:52 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-469317bd-1b3a-4367-97ce-e21b96ab95c8 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Attempting to detach device vdb from instance 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288 from the persistent domain config. {{(pid=75066) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 19:44:52 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-469317bd-1b3a-4367-97ce-e21b96ab95c8 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 19:44:52 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:44:52 user nova-compute[75066]:   <source dev="/dev/sdc"/>
Dec 01 19:44:52 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:44:52 user nova-compute[75066]:   <serial>8215b1e0-f7fa-446f-b50c-63a892de2cb1</serial>
Dec 01 19:44:52 user nova-compute[75066]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 19:44:52 user nova-compute[75066]: </disk>
Dec 01 19:44:52 user nova-compute[75066]:  {{(pid=75066) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 19:44:52 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-469317bd-1b3a-4367-97ce-e21b96ab95c8 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Successfully detached device vdb from instance 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288 from the persistent domain config.
Dec 01 19:44:52 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-469317bd-1b3a-4367-97ce-e21b96ab95c8 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288 from the live domain config. {{(pid=75066) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 19:44:52 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-469317bd-1b3a-4367-97ce-e21b96ab95c8 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 19:44:52 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:44:52 user nova-compute[75066]:   <source dev="/dev/sdc"/>
Dec 01 19:44:52 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:44:52 user nova-compute[75066]:   <serial>8215b1e0-f7fa-446f-b50c-63a892de2cb1</serial>
Dec 01 19:44:52 user nova-compute[75066]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 19:44:52 user nova-compute[75066]: </disk>
Dec 01 19:44:52 user nova-compute[75066]:  {{(pid=75066) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 19:44:52 user nova-compute[75066]: DEBUG nova.objects.instance [None req-0379f58b-8b62-437d-99a5-912d6c410af5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lazy-loading 'flavor' on Instance uuid 544d6830-e6cf-4c06-95b3-151da602bc6d {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:44:52 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-0379f58b-8b62-437d-99a5-912d6c410af5 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lock "544d6830-e6cf-4c06-95b3-151da602bc6d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.930s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:44:52 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-469317bd-1b3a-4367-97ce-e21b96ab95c8 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288 {{(pid=75066) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 19:44:56 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:45:01 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:45:06 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:45:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:45:12 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-469317bd-1b3a-4367-97ce-e21b96ab95c8 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288 is timed out.
Dec 01 19:45:12 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-469317bd-1b3a-4367-97ce-e21b96ab95c8 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Successfully detached device vdb from instance 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288 from the live domain config.
Dec 01 19:45:12 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-469317bd-1b3a-4367-97ce-e21b96ab95c8 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] calling os-brick to detach iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 19:45:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-469317bd-1b3a-4367-97ce-e21b96ab95c8 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, {'target_iqn': 'iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FmMjNKzs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:45:12 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-469317bd-1b3a-4367-97ce-e21b96ab95c8 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:45:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-469317bd-1b3a-4367-97ce-e21b96ab95c8 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:45:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-469317bd-1b3a-4367-97ce-e21b96ab95c8 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:45:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:45:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:45:12 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[caad56bc-89e2-4e87-94d7-7bf1b802e986]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:45:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-469317bd-1b3a-4367-97ce-e21b96ab95c8 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 19:45:12 user nova-compute[75066]: No targets found.
Dec 01 19:45:12 user nova-compute[75066]: iSNS:
Dec 01 19:45:12 user nova-compute[75066]: No targets found.
Dec 01 19:45:12 user nova-compute[75066]: STATIC:
Dec 01 19:45:12 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1
Dec 01 19:45:12 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:45:12 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:45:12 user nova-compute[75066]: FIRMWARE:
Dec 01 19:45:12 user nova-compute[75066]: No targets found.
Dec 01 19:45:12 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:45:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-469317bd-1b3a-4367-97ce-e21b96ab95c8 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 19:45:12 user nova-compute[75066]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 19:45:12 user nova-compute[75066]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75066) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 19:45:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-469317bd-1b3a-4367-97ce-e21b96ab95c8 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1', 0)] {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 19:45:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:45:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:45:13 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[36cc52a0-c881-4e4d-b291-2436840e6db5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:45:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:45:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:45:13 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a45c67d-65e7-4d2a-95c7-dc7b665d2521]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:45:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-469317bd-1b3a-4367-97ce-e21b96ab95c8 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1 (non-flash)
Dec 01 19:45:13 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:45:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-469317bd-1b3a-4367-97ce-e21b96ab95c8 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1 (non-flash)
Dec 01 19:45:13 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:45:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-469317bd-1b3a-4367-97ce-e21b96ab95c8 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91901ace50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1'): ({'sdc'}, set())}) {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 19:45:13 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-469317bd-1b3a-4367-97ce-e21b96ab95c8 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Removing single pathed devices sdc {{(pid=75066) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 19:45:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:45:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:45:13 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94b183f-77e5-459f-ad19-f0e824e36a68]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:45:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:45:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:45:13 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b13582-7c2c-407b-83aa-24074f2c2b17]: (4, ('ok\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:45:13 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-469317bd-1b3a-4367-97ce-e21b96ab95c8 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Flushing IO for device /dev/sdc {{(pid=75066) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 19:45:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:45:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:45:13 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[83739504-63cd-4e36-a4c3-ce45dacad6d9]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:45:13 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-469317bd-1b3a-4367-97ce-e21b96ab95c8 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75066) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 19:45:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:45:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:45:13 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d72ea3-d1e4-41cc-8f83-ffd4ca36311d]: (4, ('1', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:45:13 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-469317bd-1b3a-4367-97ce-e21b96ab95c8 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 19:45:13 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-469317bd-1b3a-4367-97ce-e21b96ab95c8 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] SCSI volumes sdc have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 19:45:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-469317bd-1b3a-4367-97ce-e21b96ab95c8 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1')] {{(pid=75066) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 19:45:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:45:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:45:13 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[afbccd59-0083-4d0c-8b6a-29231b2631c7]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:45:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-469317bd-1b3a-4367-97ce-e21b96ab95c8 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:45:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1 -p 172.16.0.220:3260 --logout {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:45:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:45:13 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f5d6d1-859e-4a54-8e9d-8a17d8045644]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:45:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-469317bd-1b3a-4367-97ce-e21b96ab95c8 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1, portal: 172.16.0.220,3260]
Dec 01 19:45:13 user nova-compute[75066]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1, portal: 172.16.0.220,3260] successful.
Dec 01 19:45:13 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:45:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1 -p 172.16.0.220:3260 --op delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:45:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8215b1e0-f7fa-446f-b50c-63a892de2cb1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:45:13 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a55e8ae-fd86-4e0b-93ed-143bdd1a12f1]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:45:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-469317bd-1b3a-4367-97ce-e21b96ab95c8 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:45:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-469317bd-1b3a-4367-97ce-e21b96ab95c8 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:45:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-469317bd-1b3a-4367-97ce-e21b96ab95c8 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] <== disconnect_volume: return (277ms) None {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:45:13 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-469317bd-1b3a-4367-97ce-e21b96ab95c8 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Disconnected iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 19:45:14 user nova-compute[75066]: DEBUG nova.objects.instance [None req-469317bd-1b3a-4367-97ce-e21b96ab95c8 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lazy-loading 'flavor' on Instance uuid 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:45:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-469317bd-1b3a-4367-97ce-e21b96ab95c8 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "1f7bbc49-b34e-4a0c-b577-7ceadf0cf288" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.908s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:45:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:45:17 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:45:19 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:45:19 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75066) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 19:45:21 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:45:22 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:45:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:45:23 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-182d246f-40d9-4d79-82bc-7a00a3d08ad4 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Acquiring lock "544d6830-e6cf-4c06-95b3-151da602bc6d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:45:23 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-182d246f-40d9-4d79-82bc-7a00a3d08ad4 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lock "544d6830-e6cf-4c06-95b3-151da602bc6d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:45:23 user nova-compute[75066]: DEBUG nova.objects.instance [None req-182d246f-40d9-4d79-82bc-7a00a3d08ad4 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lazy-loading 'flavor' on Instance uuid 544d6830-e6cf-4c06-95b3-151da602bc6d {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:45:23 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-182d246f-40d9-4d79-82bc-7a00a3d08ad4 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lock "544d6830-e6cf-4c06-95b3-151da602bc6d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:45:23 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-182d246f-40d9-4d79-82bc-7a00a3d08ad4 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Acquiring lock "544d6830-e6cf-4c06-95b3-151da602bc6d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:45:23 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-182d246f-40d9-4d79-82bc-7a00a3d08ad4 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lock "544d6830-e6cf-4c06-95b3-151da602bc6d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:45:23 user nova-compute[75066]: INFO nova.compute.manager [None req-182d246f-40d9-4d79-82bc-7a00a3d08ad4 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Attaching volume 377d55a3-216c-4229-a160-f9e66e5306db to /dev/vdb
Dec 01 19:45:24 user nova-compute[75066]: DEBUG os_brick.utils [None req-182d246f-40d9-4d79-82bc-7a00a3d08ad4 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:45:24 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:45:24 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:45:24 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[6888dfaf-d6dc-4d19-8ee7-15a9cc34d859]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1959854982f\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:45:24 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:45:24 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:45:24 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[e982459b-9707-432e-b408-5c22dbb18d9c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:45:24 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:45:24 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:45:24 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c61a916-b987-440f-92c8-4eb08c707520]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:45:24 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[f290cb25-4727-4ace-8700-16c4d838987a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:45:24 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-182d246f-40d9-4d79-82bc-7a00a3d08ad4 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Running cmd (subprocess): nvme version {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:45:24 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-182d246f-40d9-4d79-82bc-7a00a3d08ad4 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] 'nvme version' failed. Not Retrying. {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:45:24 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.nvmeof [None req-182d246f-40d9-4d79-82bc-7a00a3d08ad4 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] nvme not present on system {{(pid=75066) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 19:45:24 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:45:24 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:45:24 user nova-compute[75066]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 19:45:24 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8ca6f9-32c2-457e-a646-f116610e3911]: (4, '') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:45:24 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-182d246f-40d9-4d79-82bc-7a00a3d08ad4 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75066) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 19:45:24 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-182d246f-40d9-4d79-82bc-7a00a3d08ad4 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 19:45:24 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-182d246f-40d9-4d79-82bc-7a00a3d08ad4 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] LIGHTOS: no hostnqn found. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 19:45:24 user nova-compute[75066]: DEBUG os_brick.utils [None req-182d246f-40d9-4d79-82bc-7a00a3d08ad4 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1959854982f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:45:24 user nova-compute[75066]: DEBUG nova.virt.block_device [None req-182d246f-40d9-4d79-82bc-7a00a3d08ad4 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Updating existing volume attachment record: fa7493da-4d68-4b7e-b238-826c34462a05 {{(pid=75066) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 19:45:24 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:45:25 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:45:26 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:45:28 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:45:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:45:29 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:45:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:45:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:45:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:45:29 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75066) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 19:45:29 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f7bbc49-b34e-4a0c-b577-7ceadf0cf288/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:45:29 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f7bbc49-b34e-4a0c-b577-7ceadf0cf288/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:45:29 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f7bbc49-b34e-4a0c-b577-7ceadf0cf288/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:45:29 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1f7bbc49-b34e-4a0c-b577-7ceadf0cf288/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:45:29 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/544d6830-e6cf-4c06-95b3-151da602bc6d/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:45:29 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/544d6830-e6cf-4c06-95b3-151da602bc6d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:45:29 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/544d6830-e6cf-4c06-95b3-151da602bc6d/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:45:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/544d6830-e6cf-4c06-95b3-151da602bc6d/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:45:30 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:45:30 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:45:30 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Hypervisor/Node resource view: name=user free_ram=8849MB free_disk=24.881515502929688GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75066) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 19:45:30 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:45:30 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:45:30 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 544d6830-e6cf-4c06-95b3-151da602bc6d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:45:30 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:45:30 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 19:45:30 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 19:45:30 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:45:30 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:45:30 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Compute_service record updated for user:user {{(pid=75066) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 19:45:30 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.190s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:45:31 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:45:31 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:45:31 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:45:33 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-182d246f-40d9-4d79-82bc-7a00a3d08ad4 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Calling os-brick to attach iSCSI Volume {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 19:45:33 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-182d246f-40d9-4d79-82bc-7a00a3d08ad4 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:377d55a3-216c-4229-a160-f9e66e5306db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GvIpJYEQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:45:33 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-182d246f-40d9-4d79-82bc-7a00a3d08ad4 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:45:33 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-182d246f-40d9-4d79-82bc-7a00a3d08ad4 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:45:33 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-182d246f-40d9-4d79-82bc-7a00a3d08ad4 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:45:33 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-182d246f-40d9-4d79-82bc-7a00a3d08ad4 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:45:33 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-182d246f-40d9-4d79-82bc-7a00a3d08ad4 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:377d55a3-216c-4229-a160-f9e66e5306db" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:45:33 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-182d246f-40d9-4d79-82bc-7a00a3d08ad4 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:377d55a3-216c-4229-a160-f9e66e5306db" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:45:33 user nova-compute[75066]: INFO os_brick.initiator.connectors.iscsi [None req-182d246f-40d9-4d79-82bc-7a00a3d08ad4 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 19:45:33 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:377d55a3-216c-4229-a160-f9e66e5306db -p 172.16.0.220:3260 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:45:33 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:377d55a3-216c-4229-a160-f9e66e5306db -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:45:33 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c7bafc2-18a3-4813-8496-795fba68827d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:45:33 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-182d246f-40d9-4d79-82bc-7a00a3d08ad4 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 19:45:33 user nova-compute[75066]:  {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:45:33 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:377d55a3-216c-4229-a160-f9e66e5306db -p 172.16.0.220:3260 --interface default --op new {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:45:33 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:377d55a3-216c-4229-a160-f9e66e5306db -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:45:33 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[42898eb0-4f29-4709-af04-d466d9a29106]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:377d55a3-216c-4229-a160-f9e66e5306db] added\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:45:33 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-182d246f-40d9-4d79-82bc-7a00a3d08ad4 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:377d55a3-216c-4229-a160-f9e66e5306db] added
Dec 01 19:45:33 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:45:33 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:377d55a3-216c-4229-a160-f9e66e5306db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:45:33 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:377d55a3-216c-4229-a160-f9e66e5306db -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:45:33 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc29628-bd47-44b5-a3c5-0d1b077f50f3]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:45:33 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-182d246f-40d9-4d79-82bc-7a00a3d08ad4 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:45:33 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:377d55a3-216c-4229-a160-f9e66e5306db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:45:33 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:377d55a3-216c-4229-a160-f9e66e5306db -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:45:33 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[26736f6b-e3b0-4a58-b53f-64145589a022]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:45:33 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-182d246f-40d9-4d79-82bc-7a00a3d08ad4 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:45:33 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:377d55a3-216c-4229-a160-f9e66e5306db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GvIpJYEQ {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:45:33 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:377d55a3-216c-4229-a160-f9e66e5306db -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GvIpJYEQ" returned: 0 in 0.025s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:45:33 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b36c68-9425-4a4e-bffd-df946eb2082e]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:45:33 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-182d246f-40d9-4d79-82bc-7a00a3d08ad4 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GvIpJYEQ'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:45:33 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:377d55a3-216c-4229-a160-f9e66e5306db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:45:33 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:377d55a3-216c-4229-a160-f9e66e5306db -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:45:33 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[bebfae2e-bb40-4b7a-9845-9623ed26cb2e]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:45:33 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-182d246f-40d9-4d79-82bc-7a00a3d08ad4 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:45:33 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:45:33 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:45:33 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e804144-204a-4973-ad59-a6119f8bd3e8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:45:33 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-182d246f-40d9-4d79-82bc-7a00a3d08ad4 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 01 19:45:33 user nova-compute[75066]:  {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:45:33 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-182d246f-40d9-4d79-82bc-7a00a3d08ad4 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 01 19:45:33 user nova-compute[75066]:  {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:45:33 user nova-compute[75066]: WARNING os_brick.initiator.connectors.iscsi [None req-182d246f-40d9-4d79-82bc-7a00a3d08ad4 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 01 19:45:33 user nova-compute[75066]: 
Dec 01 19:45:33 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:45:33 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Starting heal instance info cache {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 19:45:33 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Rebuilding the list of instances to heal {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 19:45:33 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:377d55a3-216c-4229-a160-f9e66e5306db -p 172.16.0.220:3260 --login {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:45:33 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:377d55a3-216c-4229-a160-f9e66e5306db -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:45:33 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0b940b-3aac-4ffe-b8e8-572a6e63c09f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:377d55a3-216c-4229-a160-f9e66e5306db, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:377d55a3-216c-4229-a160-f9e66e5306db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:45:33 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-182d246f-40d9-4d79-82bc-7a00a3d08ad4 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:377d55a3-216c-4229-a160-f9e66e5306db, portal: 172.16.0.220,3260]
Dec 01 19:45:33 user nova-compute[75066]: Login to [iface: default, target: iqn.2010-10.org.openstack:377d55a3-216c-4229-a160-f9e66e5306db, portal: 172.16.0.220,3260] successful.
Dec 01 19:45:33 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:45:33 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:377d55a3-216c-4229-a160-f9e66e5306db -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:45:33 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:377d55a3-216c-4229-a160-f9e66e5306db -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:45:33 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c68a064-6e39-4b54-aae9-3021b2dda6b1]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:45:33 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-182d246f-40d9-4d79-82bc-7a00a3d08ad4 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:45:33 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:45:33 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:45:33 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[306f4b27-5a75-41ca-9d91-bfd82d10345c]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:377d55a3-216c-4229-a160-f9e66e5306db (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:45:33 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-182d246f-40d9-4d79-82bc-7a00a3d08ad4 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:377d55a3-216c-4229-a160-f9e66e5306db (non-flash)
Dec 01 19:45:33 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:45:33 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-182d246f-40d9-4d79-82bc-7a00a3d08ad4 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:377d55a3-216c-4229-a160-f9e66e5306db (non-flash)
Dec 01 19:45:33 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:45:33 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-182d246f-40d9-4d79-82bc-7a00a3d08ad4 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:377d55a3-216c-4229-a160-f9e66e5306db" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:45:33 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-182d246f-40d9-4d79-82bc-7a00a3d08ad4 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Connected to 172.16.0.220:3260 {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 19:45:33 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-182d246f-40d9-4d79-82bc-7a00a3d08ad4 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=75066) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 19:45:33 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-182d246f-40d9-4d79-82bc-7a00a3d08ad4 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75066) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 19:45:33 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:45:33 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:45:33 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[45204c3d-461e-46fe-9a2c-e3fa765c3400]: (4, ('- - 0', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:45:33 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-182d246f-40d9-4d79-82bc-7a00a3d08ad4 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: None {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:45:33 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "refresh_cache-544d6830-e6cf-4c06-95b3-151da602bc6d" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:45:33 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquired lock "refresh_cache-544d6830-e6cf-4c06-95b3-151da602bc6d" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:45:33 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Forcefully refreshing network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 19:45:33 user nova-compute[75066]: DEBUG nova.objects.instance [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lazy-loading 'info_cache' on Instance uuid 544d6830-e6cf-4c06-95b3-151da602bc6d {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:45:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:45:34 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Updating instance_info_cache with network_info: [{"id": "6a67de06-74d9-4b6a-ae10-8fbe730f6558", "address": "fa:16:3e:b1:1b:aa", "network": {"id": "10a180e0-96f5-4b54-8f70-8955d6c0e288", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1853322930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b227dfb7ede2407ba03f2840bc5de4f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a67de06-74", "ovs_interfaceid": "6a67de06-74d9-4b6a-ae10-8fbe730f6558", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:45:34 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Releasing lock "refresh_cache-544d6830-e6cf-4c06-95b3-151da602bc6d" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:45:34 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Updated the network info_cache for instance {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 19:45:34 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-182d246f-40d9-4d79-82bc-7a00a3d08ad4 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:45:34 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-182d246f-40d9-4d79-82bc-7a00a3d08ad4 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:377d55a3-216c-4229-a160-f9e66e5306db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GvIpJYEQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 19:45:34 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-182d246f-40d9-4d79-82bc-7a00a3d08ad4 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.294s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:45:34 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-182d246f-40d9-4d79-82bc-7a00a3d08ad4 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '23430356633383337', 'path': '/dev/sdb'} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:45:34 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-182d246f-40d9-4d79-82bc-7a00a3d08ad4 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23430356633383337', 'path': '/dev/sdb'} {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 19:45:34 user nova-compute[75066]: DEBUG nova.objects.instance [None req-182d246f-40d9-4d79-82bc-7a00a3d08ad4 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lazy-loading 'flavor' on Instance uuid 544d6830-e6cf-4c06-95b3-151da602bc6d {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:45:34 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-182d246f-40d9-4d79-82bc-7a00a3d08ad4 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 19:45:34 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:45:34 user nova-compute[75066]:   <source dev="/dev/sdb"/>
Dec 01 19:45:34 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:45:34 user nova-compute[75066]:   <serial>377d55a3-216c-4229-a160-f9e66e5306db</serial>
Dec 01 19:45:34 user nova-compute[75066]: </disk>
Dec 01 19:45:34 user nova-compute[75066]:  {{(pid=75066) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 19:45:34 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-182d246f-40d9-4d79-82bc-7a00a3d08ad4 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:45:34 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-182d246f-40d9-4d79-82bc-7a00a3d08ad4 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:45:34 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-182d246f-40d9-4d79-82bc-7a00a3d08ad4 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] No VIF found with MAC fa:16:3e:b1:1b:aa, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:45:35 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-182d246f-40d9-4d79-82bc-7a00a3d08ad4 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lock "544d6830-e6cf-4c06-95b3-151da602bc6d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.076s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:45:36 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:45:37 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-451245b5-13fd-47c0-a9e7-e4b8c085e085 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Acquiring lock "544d6830-e6cf-4c06-95b3-151da602bc6d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:45:37 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-451245b5-13fd-47c0-a9e7-e4b8c085e085 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lock "544d6830-e6cf-4c06-95b3-151da602bc6d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:45:37 user nova-compute[75066]: INFO nova.compute.manager [None req-451245b5-13fd-47c0-a9e7-e4b8c085e085 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Detaching volume 377d55a3-216c-4229-a160-f9e66e5306db
Dec 01 19:45:37 user nova-compute[75066]: INFO nova.virt.block_device [None req-451245b5-13fd-47c0-a9e7-e4b8c085e085 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Attempting to driver detach volume 377d55a3-216c-4229-a160-f9e66e5306db from mountpoint /dev/vdb
Dec 01 19:45:37 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-451245b5-13fd-47c0-a9e7-e4b8c085e085 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Attempting to detach device vdb from instance 544d6830-e6cf-4c06-95b3-151da602bc6d from the persistent domain config. {{(pid=75066) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 19:45:37 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-451245b5-13fd-47c0-a9e7-e4b8c085e085 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 19:45:37 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:45:37 user nova-compute[75066]:   <source dev="/dev/sdb"/>
Dec 01 19:45:37 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:45:37 user nova-compute[75066]:   <serial>377d55a3-216c-4229-a160-f9e66e5306db</serial>
Dec 01 19:45:37 user nova-compute[75066]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 19:45:37 user nova-compute[75066]: </disk>
Dec 01 19:45:37 user nova-compute[75066]:  {{(pid=75066) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 19:45:37 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-451245b5-13fd-47c0-a9e7-e4b8c085e085 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Successfully detached device vdb from instance 544d6830-e6cf-4c06-95b3-151da602bc6d from the persistent domain config.
Dec 01 19:45:37 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-451245b5-13fd-47c0-a9e7-e4b8c085e085 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 544d6830-e6cf-4c06-95b3-151da602bc6d from the live domain config. {{(pid=75066) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 19:45:37 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-451245b5-13fd-47c0-a9e7-e4b8c085e085 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 19:45:37 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:45:37 user nova-compute[75066]:   <source dev="/dev/sdb"/>
Dec 01 19:45:37 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:45:37 user nova-compute[75066]:   <serial>377d55a3-216c-4229-a160-f9e66e5306db</serial>
Dec 01 19:45:37 user nova-compute[75066]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 19:45:37 user nova-compute[75066]: </disk>
Dec 01 19:45:37 user nova-compute[75066]:  {{(pid=75066) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 19:45:37 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-451245b5-13fd-47c0-a9e7-e4b8c085e085 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 544d6830-e6cf-4c06-95b3-151da602bc6d {{(pid=75066) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 19:45:37 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:45:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:45:39 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:45:41 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:45:42 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e443007a-c2fc-4750-99fe-2c8380b81d44 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Acquiring lock "1f7bbc49-b34e-4a0c-b577-7ceadf0cf288" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:45:42 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e443007a-c2fc-4750-99fe-2c8380b81d44 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "1f7bbc49-b34e-4a0c-b577-7ceadf0cf288" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:45:42 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e443007a-c2fc-4750-99fe-2c8380b81d44 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Acquiring lock "1f7bbc49-b34e-4a0c-b577-7ceadf0cf288-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:45:42 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e443007a-c2fc-4750-99fe-2c8380b81d44 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "1f7bbc49-b34e-4a0c-b577-7ceadf0cf288-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:45:42 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e443007a-c2fc-4750-99fe-2c8380b81d44 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "1f7bbc49-b34e-4a0c-b577-7ceadf0cf288-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:45:42 user nova-compute[75066]: INFO nova.compute.manager [None req-e443007a-c2fc-4750-99fe-2c8380b81d44 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Terminating instance
Dec 01 19:45:42 user nova-compute[75066]: DEBUG nova.compute.manager [None req-e443007a-c2fc-4750-99fe-2c8380b81d44 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Start destroying the instance on the hypervisor. {{(pid=75066) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 19:45:42 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:45:42 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:45:42 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:45:42 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:45:43 user nova-compute[75066]: DEBUG nova.compute.manager [req-558cda59-3f69-47f2-8373-1966c4214afb req-f6318847-93f1-4695-b086-20afc8993594 service nova] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Received event network-vif-unplugged-5b2ebcf7-2624-49c2-bfa0-c5b694a37ec8 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:45:43 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-558cda59-3f69-47f2-8373-1966c4214afb req-f6318847-93f1-4695-b086-20afc8993594 service nova] Acquiring lock "1f7bbc49-b34e-4a0c-b577-7ceadf0cf288-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:45:43 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-558cda59-3f69-47f2-8373-1966c4214afb req-f6318847-93f1-4695-b086-20afc8993594 service nova] Lock "1f7bbc49-b34e-4a0c-b577-7ceadf0cf288-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:45:43 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-558cda59-3f69-47f2-8373-1966c4214afb req-f6318847-93f1-4695-b086-20afc8993594 service nova] Lock "1f7bbc49-b34e-4a0c-b577-7ceadf0cf288-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:45:43 user nova-compute[75066]: DEBUG nova.compute.manager [req-558cda59-3f69-47f2-8373-1966c4214afb req-f6318847-93f1-4695-b086-20afc8993594 service nova] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] No waiting events found dispatching network-vif-unplugged-5b2ebcf7-2624-49c2-bfa0-c5b694a37ec8 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:45:43 user nova-compute[75066]: DEBUG nova.compute.manager [req-558cda59-3f69-47f2-8373-1966c4214afb req-f6318847-93f1-4695-b086-20afc8993594 service nova] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Received event network-vif-unplugged-5b2ebcf7-2624-49c2-bfa0-c5b694a37ec8 for instance with task_state deleting. {{(pid=75066) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 19:45:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:45:43 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Instance destroyed successfully.
Dec 01 19:45:43 user nova-compute[75066]: DEBUG nova.objects.instance [None req-e443007a-c2fc-4750-99fe-2c8380b81d44 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lazy-loading 'resources' on Instance uuid 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:45:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:45:43 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-e443007a-c2fc-4750-99fe-2c8380b81d44 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:39:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-844266273',display_name='tempest-AttachVolumeNegativeTest-server-844266273',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-844266273',id=41,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGL0PpwGNr/1F3KncgISYnszcLmd61o4+ZSxOZl7yzqOoWwyNCgsBx+FXVG7x5f8VjJS/MeNjxGAvDE9dLignxwQOiVYMezgIX/mnxD2ZtkLAwoXocFq/lYVl24wkCZtXQ==',key_name='tempest-keypair-797088992',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:40:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='109097a30a40419092c74f4c7a695ce4',ramdisk_id='',reservation_id='r-7bzyh3gp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-711021602',owner_user_name='tempest-AttachVolumeNegativeTest-711021602-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:40:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b92b1beca2ee480181e771eafe1a9f97',uuid=1f7bbc49-b34e-4a0c-b577-7ceadf0cf288,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b2ebcf7-2624-49c2-bfa0-c5b694a37ec8", "address": "fa:16:3e:6e:e4:53", "network": {"id": "955d6293-ede6-4cb4-8cee-0157dbad93ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-603640322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109097a30a40419092c74f4c7a695ce4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2ebcf7-26", "ovs_interfaceid": "5b2ebcf7-2624-49c2-bfa0-c5b694a37ec8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:45:43 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-e443007a-c2fc-4750-99fe-2c8380b81d44 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Converting VIF {"id": "5b2ebcf7-2624-49c2-bfa0-c5b694a37ec8", "address": "fa:16:3e:6e:e4:53", "network": {"id": "955d6293-ede6-4cb4-8cee-0157dbad93ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-603640322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109097a30a40419092c74f4c7a695ce4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b2ebcf7-26", "ovs_interfaceid": "5b2ebcf7-2624-49c2-bfa0-c5b694a37ec8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:45:43 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-e443007a-c2fc-4750-99fe-2c8380b81d44 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:e4:53,bridge_name='br-int',has_traffic_filtering=True,id=5b2ebcf7-2624-49c2-bfa0-c5b694a37ec8,network=Network(955d6293-ede6-4cb4-8cee-0157dbad93ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b2ebcf7-26') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:45:43 user nova-compute[75066]: DEBUG os_vif [None req-e443007a-c2fc-4750-99fe-2c8380b81d44 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:e4:53,bridge_name='br-int',has_traffic_filtering=True,id=5b2ebcf7-2624-49c2-bfa0-c5b694a37ec8,network=Network(955d6293-ede6-4cb4-8cee-0157dbad93ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b2ebcf7-26') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:45:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:45:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b2ebcf7-26, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:45:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:45:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:45:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:45:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bea6cbf3-f54c-4611-87ec-ef0e0a68e967) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:45:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:45:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:45:43 user nova-compute[75066]: INFO os_vif [None req-e443007a-c2fc-4750-99fe-2c8380b81d44 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:e4:53,bridge_name='br-int',has_traffic_filtering=True,id=5b2ebcf7-2624-49c2-bfa0-c5b694a37ec8,network=Network(955d6293-ede6-4cb4-8cee-0157dbad93ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b2ebcf7-26')
Dec 01 19:45:43 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-e443007a-c2fc-4750-99fe-2c8380b81d44 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Deleting instance files /opt/stack/data/nova/instances/1f7bbc49-b34e-4a0c-b577-7ceadf0cf288_del
Dec 01 19:45:43 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-e443007a-c2fc-4750-99fe-2c8380b81d44 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Deletion of /opt/stack/data/nova/instances/1f7bbc49-b34e-4a0c-b577-7ceadf0cf288_del complete
Dec 01 19:45:43 user nova-compute[75066]: INFO nova.compute.manager [None req-e443007a-c2fc-4750-99fe-2c8380b81d44 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Took 0.88 seconds to destroy the instance on the hypervisor.
Dec 01 19:45:43 user nova-compute[75066]: DEBUG oslo.service.loopingcall [None req-e443007a-c2fc-4750-99fe-2c8380b81d44 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75066) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 19:45:43 user nova-compute[75066]: DEBUG nova.compute.manager [-] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Deallocating network for instance {{(pid=75066) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 19:45:43 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] deallocate_for_instance() {{(pid=75066) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 19:45:44 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:45:44 user nova-compute[75066]: INFO nova.compute.manager [-] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Took 0.65 seconds to deallocate network for instance.
Dec 01 19:45:44 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e443007a-c2fc-4750-99fe-2c8380b81d44 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:45:44 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e443007a-c2fc-4750-99fe-2c8380b81d44 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:45:44 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-e443007a-c2fc-4750-99fe-2c8380b81d44 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:45:44 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-e443007a-c2fc-4750-99fe-2c8380b81d44 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:45:44 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e443007a-c2fc-4750-99fe-2c8380b81d44 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.139s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:45:44 user nova-compute[75066]: INFO nova.scheduler.client.report [None req-e443007a-c2fc-4750-99fe-2c8380b81d44 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Deleted allocations for instance 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288
Dec 01 19:45:44 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-e443007a-c2fc-4750-99fe-2c8380b81d44 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "1f7bbc49-b34e-4a0c-b577-7ceadf0cf288" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.886s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:45:44 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:45:45 user nova-compute[75066]: DEBUG nova.compute.manager [req-ecb8098e-94c4-4448-ae88-038801354994 req-d039a0d4-3625-486a-a18a-572656d3a169 service nova] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Received event network-vif-plugged-5b2ebcf7-2624-49c2-bfa0-c5b694a37ec8 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:45:45 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-ecb8098e-94c4-4448-ae88-038801354994 req-d039a0d4-3625-486a-a18a-572656d3a169 service nova] Acquiring lock "1f7bbc49-b34e-4a0c-b577-7ceadf0cf288-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:45:45 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-ecb8098e-94c4-4448-ae88-038801354994 req-d039a0d4-3625-486a-a18a-572656d3a169 service nova] Lock "1f7bbc49-b34e-4a0c-b577-7ceadf0cf288-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:45:45 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-ecb8098e-94c4-4448-ae88-038801354994 req-d039a0d4-3625-486a-a18a-572656d3a169 service nova] Lock "1f7bbc49-b34e-4a0c-b577-7ceadf0cf288-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:45:45 user nova-compute[75066]: DEBUG nova.compute.manager [req-ecb8098e-94c4-4448-ae88-038801354994 req-d039a0d4-3625-486a-a18a-572656d3a169 service nova] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] No waiting events found dispatching network-vif-plugged-5b2ebcf7-2624-49c2-bfa0-c5b694a37ec8 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:45:45 user nova-compute[75066]: WARNING nova.compute.manager [req-ecb8098e-94c4-4448-ae88-038801354994 req-d039a0d4-3625-486a-a18a-572656d3a169 service nova] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Received unexpected event network-vif-plugged-5b2ebcf7-2624-49c2-bfa0-c5b694a37ec8 for instance with vm_state deleted and task_state None.
Dec 01 19:45:45 user nova-compute[75066]: DEBUG nova.compute.manager [req-ecb8098e-94c4-4448-ae88-038801354994 req-d039a0d4-3625-486a-a18a-572656d3a169 service nova] [instance: 1f7bbc49-b34e-4a0c-b577-7ceadf0cf288] Received event network-vif-deleted-5b2ebcf7-2624-49c2-bfa0-c5b694a37ec8 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:45:48 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:45:48 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:45:53 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:45:53 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:45:57 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Acquiring lock "c30efcab-a124-422b-ac6c-6c2efa3fb890" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:45:57 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "c30efcab-a124-422b-ac6c-6c2efa3fb890" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:45:57 user nova-compute[75066]: DEBUG nova.compute.manager [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] Starting instance... {{(pid=75066) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 19:45:57 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-451245b5-13fd-47c0-a9e7-e4b8c085e085 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 544d6830-e6cf-4c06-95b3-151da602bc6d is timed out.
Dec 01 19:45:57 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-451245b5-13fd-47c0-a9e7-e4b8c085e085 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Successfully detached device vdb from instance 544d6830-e6cf-4c06-95b3-151da602bc6d from the live domain config.
Dec 01 19:45:57 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-451245b5-13fd-47c0-a9e7-e4b8c085e085 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] calling os-brick to detach iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 19:45:57 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-451245b5-13fd-47c0-a9e7-e4b8c085e085 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, {'target_iqn': 'iqn.2010-10.org.openstack:377d55a3-216c-4229-a160-f9e66e5306db', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GvIpJYEQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:45:57 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-451245b5-13fd-47c0-a9e7-e4b8c085e085 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:45:57 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-451245b5-13fd-47c0-a9e7-e4b8c085e085 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:45:57 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-451245b5-13fd-47c0-a9e7-e4b8c085e085 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:45:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:45:57 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:45:57 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:45:57 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75066) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 19:45:57 user nova-compute[75066]: INFO nova.compute.claims [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] Claim successful on node user
Dec 01 19:45:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:45:57 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[142ec84e-c692-4cef-ac8c-cebfdfcda128]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:377d55a3-216c-4229-a160-f9e66e5306db\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:45:57 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-451245b5-13fd-47c0-a9e7-e4b8c085e085 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 19:45:57 user nova-compute[75066]: No targets found.
Dec 01 19:45:57 user nova-compute[75066]: iSNS:
Dec 01 19:45:57 user nova-compute[75066]: No targets found.
Dec 01 19:45:57 user nova-compute[75066]: STATIC:
Dec 01 19:45:57 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:377d55a3-216c-4229-a160-f9e66e5306db
Dec 01 19:45:57 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:45:57 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:45:57 user nova-compute[75066]: FIRMWARE:
Dec 01 19:45:57 user nova-compute[75066]: No targets found.
Dec 01 19:45:57 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:45:57 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-451245b5-13fd-47c0-a9e7-e4b8c085e085 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 19:45:57 user nova-compute[75066]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 19:45:57 user nova-compute[75066]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75066) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 19:45:57 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-451245b5-13fd-47c0-a9e7-e4b8c085e085 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:377d55a3-216c-4229-a160-f9e66e5306db', 0)] {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 19:45:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:45:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:45:57 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[75500803-9ad9-43b9-800e-7f7d4b93cd27]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:377d55a3-216c-4229-a160-f9e66e5306db\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:45:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:45:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:45:57 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cfdfead-fe56-4162-aaf5-6559afade107]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:377d55a3-216c-4229-a160-f9e66e5306db (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:45:57 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-451245b5-13fd-47c0-a9e7-e4b8c085e085 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:377d55a3-216c-4229-a160-f9e66e5306db (non-flash)
Dec 01 19:45:57 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:45:57 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-451245b5-13fd-47c0-a9e7-e4b8c085e085 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:377d55a3-216c-4229-a160-f9e66e5306db (non-flash)
Dec 01 19:45:57 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:45:57 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-451245b5-13fd-47c0-a9e7-e4b8c085e085 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9190161630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:377d55a3-216c-4229-a160-f9e66e5306db'): ({'sdb'}, set())}) {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 19:45:57 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-451245b5-13fd-47c0-a9e7-e4b8c085e085 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Removing single pathed devices sdb {{(pid=75066) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 19:45:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:45:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:45:57 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b9bf7b-5abd-4b6c-8c42-b848f03cb84d]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:45:57 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:45:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:45:58 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[af13b0ea-3a38-4871-8262-d19d85522944]: (4, ('ok\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:45:58 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-451245b5-13fd-47c0-a9e7-e4b8c085e085 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Flushing IO for device /dev/sdb {{(pid=75066) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 19:45:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:45:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:45:58 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b84c25d-93ea-4e7e-a68c-00126c8388b5]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:45:58 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-451245b5-13fd-47c0-a9e7-e4b8c085e085 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75066) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 19:45:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:45:58 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:45:58 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:45:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:45:58 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[917121b8-de4f-49d9-8394-d5d52dfd0777]: (4, ('1', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:45:58 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-451245b5-13fd-47c0-a9e7-e4b8c085e085 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 19:45:58 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-451245b5-13fd-47c0-a9e7-e4b8c085e085 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] SCSI volumes sdb have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 19:45:58 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-451245b5-13fd-47c0-a9e7-e4b8c085e085 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:377d55a3-216c-4229-a160-f9e66e5306db')] {{(pid=75066) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 19:45:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:377d55a3-216c-4229-a160-f9e66e5306db -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:45:58 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.223s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:45:58 user nova-compute[75066]: DEBUG nova.compute.manager [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] Start building networks asynchronously for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 19:45:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:377d55a3-216c-4229-a160-f9e66e5306db -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:45:58 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea31d14d-a7e6-4848-ad08-bef37fbf6265]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:45:58 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-451245b5-13fd-47c0-a9e7-e4b8c085e085 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:45:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:377d55a3-216c-4229-a160-f9e66e5306db -p 172.16.0.220:3260 --logout {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:45:58 user nova-compute[75066]: DEBUG nova.compute.manager [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] Allocating IP information in the background. {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 19:45:58 user nova-compute[75066]: DEBUG nova.network.neutron [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] allocate_for_instance() {{(pid=75066) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 19:45:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:377d55a3-216c-4229-a160-f9e66e5306db -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:45:58 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4125184-c7a5-4555-b1d8-eebb8f248f64]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:377d55a3-216c-4229-a160-f9e66e5306db, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:377d55a3-216c-4229-a160-f9e66e5306db, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:45:58 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-451245b5-13fd-47c0-a9e7-e4b8c085e085 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:377d55a3-216c-4229-a160-f9e66e5306db, portal: 172.16.0.220,3260]
Dec 01 19:45:58 user nova-compute[75066]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:377d55a3-216c-4229-a160-f9e66e5306db, portal: 172.16.0.220,3260] successful.
Dec 01 19:45:58 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:45:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:377d55a3-216c-4229-a160-f9e66e5306db -p 172.16.0.220:3260 --op delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:45:58 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 19:45:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:377d55a3-216c-4229-a160-f9e66e5306db -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:45:58 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5cdf2c5-1c3f-4ed3-975a-7120412d1bfa]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:45:58 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-451245b5-13fd-47c0-a9e7-e4b8c085e085 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:45:58 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-451245b5-13fd-47c0-a9e7-e4b8c085e085 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.326s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:45:58 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-451245b5-13fd-47c0-a9e7-e4b8c085e085 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] <== disconnect_volume: return (327ms) None {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:45:58 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-451245b5-13fd-47c0-a9e7-e4b8c085e085 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Disconnected iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 19:45:58 user nova-compute[75066]: DEBUG nova.compute.manager [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] Start building block device mappings for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 19:45:58 user nova-compute[75066]: INFO nova.virt.block_device [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] Booting with volume snapshot 04101c2a-a8c3-4a99-b4db-b35d488e64ee at /dev/vda
Dec 01 19:45:58 user nova-compute[75066]: DEBUG nova.policy [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e30df6ccb83b4e8daaed0970c4b423d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecd2a37ec7e4dbbbe53ed6ba9ff45bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75066) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 19:45:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:45:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:45:58 user nova-compute[75066]: DEBUG nova.network.neutron [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] Successfully created port: 292167c1-237f-4f38-8034-ca9fd1feeab2 {{(pid=75066) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 19:45:59 user nova-compute[75066]: DEBUG nova.objects.instance [None req-451245b5-13fd-47c0-a9e7-e4b8c085e085 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lazy-loading 'flavor' on Instance uuid 544d6830-e6cf-4c06-95b3-151da602bc6d {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:45:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-451245b5-13fd-47c0-a9e7-e4b8c085e085 tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lock "544d6830-e6cf-4c06-95b3-151da602bc6d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.846s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:45:59 user nova-compute[75066]: DEBUG nova.network.neutron [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] Successfully updated port: 292167c1-237f-4f38-8034-ca9fd1feeab2 {{(pid=75066) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 19:45:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Acquiring lock "refresh_cache-c30efcab-a124-422b-ac6c-6c2efa3fb890" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:45:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Acquired lock "refresh_cache-c30efcab-a124-422b-ac6c-6c2efa3fb890" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:45:59 user nova-compute[75066]: DEBUG nova.network.neutron [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:45:59 user nova-compute[75066]: DEBUG nova.compute.manager [req-1a86df0a-c8f4-4fd3-9277-0273ffd998b7 req-c09d3d84-0bfe-40b1-8cac-900619ee5bfd service nova] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] Received event network-changed-292167c1-237f-4f38-8034-ca9fd1feeab2 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:45:59 user nova-compute[75066]: DEBUG nova.compute.manager [req-1a86df0a-c8f4-4fd3-9277-0273ffd998b7 req-c09d3d84-0bfe-40b1-8cac-900619ee5bfd service nova] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] Refreshing instance network info cache due to event network-changed-292167c1-237f-4f38-8034-ca9fd1feeab2. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:45:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-1a86df0a-c8f4-4fd3-9277-0273ffd998b7 req-c09d3d84-0bfe-40b1-8cac-900619ee5bfd service nova] Acquiring lock "refresh_cache-c30efcab-a124-422b-ac6c-6c2efa3fb890" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:45:59 user nova-compute[75066]: DEBUG nova.network.neutron [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:45:59 user nova-compute[75066]: DEBUG nova.network.neutron [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] Updating instance_info_cache with network_info: [{"id": "292167c1-237f-4f38-8034-ca9fd1feeab2", "address": "fa:16:3e:59:02:fa", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap292167c1-23", "ovs_interfaceid": "292167c1-237f-4f38-8034-ca9fd1feeab2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:45:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Releasing lock "refresh_cache-c30efcab-a124-422b-ac6c-6c2efa3fb890" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:45:59 user nova-compute[75066]: DEBUG nova.compute.manager [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] Instance network_info: |[{"id": "292167c1-237f-4f38-8034-ca9fd1feeab2", "address": "fa:16:3e:59:02:fa", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap292167c1-23", "ovs_interfaceid": "292167c1-237f-4f38-8034-ca9fd1feeab2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 19:45:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-1a86df0a-c8f4-4fd3-9277-0273ffd998b7 req-c09d3d84-0bfe-40b1-8cac-900619ee5bfd service nova] Acquired lock "refresh_cache-c30efcab-a124-422b-ac6c-6c2efa3fb890" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:45:59 user nova-compute[75066]: DEBUG nova.network.neutron [req-1a86df0a-c8f4-4fd3-9277-0273ffd998b7 req-c09d3d84-0bfe-40b1-8cac-900619ee5bfd service nova] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] Refreshing network info cache for port 292167c1-237f-4f38-8034-ca9fd1feeab2 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:46:00 user nova-compute[75066]: DEBUG nova.network.neutron [req-1a86df0a-c8f4-4fd3-9277-0273ffd998b7 req-c09d3d84-0bfe-40b1-8cac-900619ee5bfd service nova] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] Updated VIF entry in instance network info cache for port 292167c1-237f-4f38-8034-ca9fd1feeab2. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:46:00 user nova-compute[75066]: DEBUG nova.network.neutron [req-1a86df0a-c8f4-4fd3-9277-0273ffd998b7 req-c09d3d84-0bfe-40b1-8cac-900619ee5bfd service nova] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] Updating instance_info_cache with network_info: [{"id": "292167c1-237f-4f38-8034-ca9fd1feeab2", "address": "fa:16:3e:59:02:fa", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap292167c1-23", "ovs_interfaceid": "292167c1-237f-4f38-8034-ca9fd1feeab2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:46:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-1a86df0a-c8f4-4fd3-9277-0273ffd998b7 req-c09d3d84-0bfe-40b1-8cac-900619ee5bfd service nova] Releasing lock "refresh_cache-c30efcab-a124-422b-ac6c-6c2efa3fb890" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:46:03 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:46:03 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:46:03 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75066) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 19:46:03 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:46:03 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:46:03 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:46:03 user nova-compute[75066]: DEBUG os_brick.utils [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:46:03 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:46:03 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:46:03 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb4c604-f955-4e6f-aedf-e60f4cab927e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1959854982f\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:46:03 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:46:03 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:46:03 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[212a5c65-3424-4688-8b4c-7f7615d05b31]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:46:03 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:46:03 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:46:03 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f52092-3e05-40c7-92dd-2f4a4d110f1d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:46:03 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[be43975b-1a19-41cc-8bf1-d1d8872b0066]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:46:03 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Running cmd (subprocess): nvme version {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:46:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] 'nvme version' failed. Not Retrying. {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:46:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.nvmeof [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] nvme not present on system {{(pid=75066) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 19:46:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:46:04 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:46:04 user nova-compute[75066]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 19:46:04 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9b7252-7b49-4f13-9be6-7d1351aee90a]: (4, '') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:46:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75066) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 19:46:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 19:46:04 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] LIGHTOS: no hostnqn found. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 19:46:04 user nova-compute[75066]: DEBUG os_brick.utils [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1959854982f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:46:04 user nova-compute[75066]: DEBUG nova.virt.block_device [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] Updating existing volume attachment record: 6e6a2316-d9f6-48e9-a7d4-deebe6022183 {{(pid=75066) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 19:46:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG nova.compute.manager [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] Start spawning the instance on the hypervisor. {{(pid=75066) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] Creating instance directory {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 19:46:13 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] Creating image(s)
Dec 01 19:46:13 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] Did not create local disks {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] Ensure instance console log exists: /opt/stack/data/nova/instances/c30efcab-a124-422b-ac6c-6c2efa3fb890/console.log {{(pid=75066) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] Start _get_guest_xml network_info=[{"id": "292167c1-237f-4f38-8034-ca9fd1feeab2", "address": "fa:16:3e:59:02:fa", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap292167c1-23", "ovs_interfaceid": "292167c1-237f-4f38-8034-ca9fd1feeab2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': True, 'attachment_id': '6e6a2316-d9f6-48e9-a7d4-deebe6022183', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6bda792b-463b-4deb-8224-e891b63b09c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Watpzbwg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c30efcab-a124-422b-ac6c-6c2efa3fb890', 'attached_at': '', 'detached_at': '', 'volume_id': '6bda792b-463b-4deb-8224-e891b63b09c4', 'serial': '6bda792b-463b-4deb-8224-e891b63b09c4'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:46:13 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:46:13 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:46:13 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] Calling os-brick to attach iSCSI Volume {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6bda792b-463b-4deb-8224-e891b63b09c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Watpzbwg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:46:13 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:46:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:46:13 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:46:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6bda792b-463b-4deb-8224-e891b63b09c4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6bda792b-463b-4deb-8224-e891b63b09c4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:46:13 user nova-compute[75066]: INFO os_brick.initiator.connectors.iscsi [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 19:46:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bda792b-463b-4deb-8224-e891b63b09c4 -p 172.16.0.220:3260 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bda792b-463b-4deb-8224-e891b63b09c4 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ae25ff-6b70-4e95-84f5-0cab2204e7c1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 19:46:13 user nova-compute[75066]:  {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bda792b-463b-4deb-8224-e891b63b09c4 -p 172.16.0.220:3260 --interface default --op new {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bda792b-463b-4deb-8224-e891b63b09c4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f9c7fd-7455-4bfa-857d-e252d900750e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6bda792b-463b-4deb-8224-e891b63b09c4] added\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6bda792b-463b-4deb-8224-e891b63b09c4] added
Dec 01 19:46:13 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bda792b-463b-4deb-8224-e891b63b09c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bda792b-463b-4deb-8224-e891b63b09c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[00510bfd-f535-4e26-a91c-c673a8264e40]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bda792b-463b-4deb-8224-e891b63b09c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bda792b-463b-4deb-8224-e891b63b09c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[969483ee-3aa9-462c-9207-bbdc37a4c0f8]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bda792b-463b-4deb-8224-e891b63b09c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Watpzbwg {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bda792b-463b-4deb-8224-e891b63b09c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v Watpzbwg" returned: 0 in 0.021s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd5ac3e-68a2-40af-b1e6-fc400aaa4345]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'Watpzbwg'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bda792b-463b-4deb-8224-e891b63b09c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bda792b-463b-4deb-8224-e891b63b09c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec400ba-1821-4a77-b9a4-7f9e4087041e]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.021s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86edc7e-277e-4faa-b5e6-daaabd8ca593]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 01 19:46:13 user nova-compute[75066]:  {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 01 19:46:13 user nova-compute[75066]:  {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:46:13 user nova-compute[75066]: WARNING os_brick.initiator.connectors.iscsi [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 01 19:46:13 user nova-compute[75066]: 
Dec 01 19:46:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bda792b-463b-4deb-8224-e891b63b09c4 -p 172.16.0.220:3260 --login {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bda792b-463b-4deb-8224-e891b63b09c4 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1169563-72cd-42ce-b347-a55e2253ea2b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6bda792b-463b-4deb-8224-e891b63b09c4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6bda792b-463b-4deb-8224-e891b63b09c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6bda792b-463b-4deb-8224-e891b63b09c4, portal: 172.16.0.220,3260]
Dec 01 19:46:13 user nova-compute[75066]: Login to [iface: default, target: iqn.2010-10.org.openstack:6bda792b-463b-4deb-8224-e891b63b09c4, portal: 172.16.0.220,3260] successful.
Dec 01 19:46:13 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bda792b-463b-4deb-8224-e891b63b09c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bda792b-463b-4deb-8224-e891b63b09c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[6440a74c-c26b-40c0-b148-e8a03351732e]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[570c21d2-fc9c-4b1c-babb-295bd60f7485]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bda792b-463b-4deb-8224-e891b63b09c4 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bda792b-463b-4deb-8224-e891b63b09c4 (non-flash)
Dec 01 19:46:13 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bda792b-463b-4deb-8224-e891b63b09c4 (non-flash)
Dec 01 19:46:13 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6bda792b-463b-4deb-8224-e891b63b09c4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Connected to 172.16.0.220:3260 {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=75066) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75066) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[077bf0b6-975a-4123-951b-649391b78d74]: (4, ('- - 0', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: None {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:46:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:46:14 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:46:14 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6bda792b-463b-4deb-8224-e891b63b09c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Watpzbwg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 19:46:14 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:46:14 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '26262666333393339', 'path': '/dev/sdb'} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:46:14 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262666333393339', 'path': '/dev/sdb'} {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 19:46:14 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:45:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1792033231',display_name='tempest-TestVolumeBootPattern-server-1792033231',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1792033231',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ecd2a37ec7e4dbbbe53ed6ba9ff45bb',ramdisk_id='',reservation_id='r-o0fkhtuz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-384255364',owner_user_name='tempest-TestVolumeBootPattern-384255364-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:45:58Z,user_data=None,user_id='e30df6ccb83b4e8daaed0970c4b423d3',uuid=c30efcab-a124-422b-ac6c-6c2efa3fb890,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "292167c1-237f-4f38-8034-ca9fd1feeab2", "address": "fa:16:3e:59:02:fa", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap292167c1-23", "ovs_interfaceid": "292167c1-237f-4f38-8034-ca9fd1feeab2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:46:14 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Converting VIF {"id": "292167c1-237f-4f38-8034-ca9fd1feeab2", "address": "fa:16:3e:59:02:fa", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap292167c1-23", "ovs_interfaceid": "292167c1-237f-4f38-8034-ca9fd1feeab2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:46:14 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:02:fa,bridge_name='br-int',has_traffic_filtering=True,id=292167c1-237f-4f38-8034-ca9fd1feeab2,network=Network(2a39f486-871f-4115-88cb-176e846fe4f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap292167c1-23') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:46:14 user nova-compute[75066]: DEBUG nova.objects.instance [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lazy-loading 'pci_devices' on Instance uuid c30efcab-a124-422b-ac6c-6c2efa3fb890 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:46:14 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:46:14 user nova-compute[75066]:   <uuid>c30efcab-a124-422b-ac6c-6c2efa3fb890</uuid>
Dec 01 19:46:14 user nova-compute[75066]:   <name>instance-0000002c</name>
Dec 01 19:46:14 user nova-compute[75066]:   <memory>524288</memory>
Dec 01 19:46:14 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:46:14 user nova-compute[75066]:   <metadata>
Dec 01 19:46:14 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:46:14 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:46:14 user nova-compute[75066]:       <nova:name>tempest-TestVolumeBootPattern-server-1792033231</nova:name>
Dec 01 19:46:14 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:46:13</nova:creationTime>
Dec 01 19:46:14 user nova-compute[75066]:       <nova:flavor name="m1.tiny">
Dec 01 19:46:14 user nova-compute[75066]:         <nova:memory>512</nova:memory>
Dec 01 19:46:14 user nova-compute[75066]:         <nova:disk>1</nova:disk>
Dec 01 19:46:14 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:46:14 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:46:14 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:46:14 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:46:14 user nova-compute[75066]:       <nova:owner>
Dec 01 19:46:14 user nova-compute[75066]:         <nova:user uuid="e30df6ccb83b4e8daaed0970c4b423d3">tempest-TestVolumeBootPattern-384255364-project-member</nova:user>
Dec 01 19:46:14 user nova-compute[75066]:         <nova:project uuid="9ecd2a37ec7e4dbbbe53ed6ba9ff45bb">tempest-TestVolumeBootPattern-384255364</nova:project>
Dec 01 19:46:14 user nova-compute[75066]:       </nova:owner>
Dec 01 19:46:14 user nova-compute[75066]:       <nova:ports>
Dec 01 19:46:14 user nova-compute[75066]:         <nova:port uuid="292167c1-237f-4f38-8034-ca9fd1feeab2">
Dec 01 19:46:14 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Dec 01 19:46:14 user nova-compute[75066]:         </nova:port>
Dec 01 19:46:14 user nova-compute[75066]:       </nova:ports>
Dec 01 19:46:14 user nova-compute[75066]:     </nova:instance>
Dec 01 19:46:14 user nova-compute[75066]:   </metadata>
Dec 01 19:46:14 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:46:14 user nova-compute[75066]:     <system>
Dec 01 19:46:14 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:46:14 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:46:14 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:46:14 user nova-compute[75066]:       <entry name="serial">c30efcab-a124-422b-ac6c-6c2efa3fb890</entry>
Dec 01 19:46:14 user nova-compute[75066]:       <entry name="uuid">c30efcab-a124-422b-ac6c-6c2efa3fb890</entry>
Dec 01 19:46:14 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:46:14 user nova-compute[75066]:     </system>
Dec 01 19:46:14 user nova-compute[75066]:   </sysinfo>
Dec 01 19:46:14 user nova-compute[75066]:   <os>
Dec 01 19:46:14 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:46:14 user nova-compute[75066]:     <boot dev="hd"/>
Dec 01 19:46:14 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:46:14 user nova-compute[75066]:   </os>
Dec 01 19:46:14 user nova-compute[75066]:   <features>
Dec 01 19:46:14 user nova-compute[75066]:     <acpi/>
Dec 01 19:46:14 user nova-compute[75066]:     <apic/>
Dec 01 19:46:14 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:46:14 user nova-compute[75066]:   </features>
Dec 01 19:46:14 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:46:14 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:46:14 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:46:14 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:46:14 user nova-compute[75066]:   </clock>
Dec 01 19:46:14 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:46:14 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:46:14 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:46:14 user nova-compute[75066]:   </cpu>
Dec 01 19:46:14 user nova-compute[75066]:   <devices>
Dec 01 19:46:14 user nova-compute[75066]:     <disk type="block" device="disk">
Dec 01 19:46:14 user nova-compute[75066]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:46:14 user nova-compute[75066]:       <source dev="/dev/sdb"/>
Dec 01 19:46:14 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:46:14 user nova-compute[75066]:       <serial>6bda792b-463b-4deb-8224-e891b63b09c4</serial>
Dec 01 19:46:14 user nova-compute[75066]:     </disk>
Dec 01 19:46:14 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:46:14 user nova-compute[75066]:       <mac address="fa:16:3e:59:02:fa"/>
Dec 01 19:46:14 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:46:14 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:46:14 user nova-compute[75066]:       <target dev="tap292167c1-23"/>
Dec 01 19:46:14 user nova-compute[75066]:     </interface>
Dec 01 19:46:14 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:46:14 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/c30efcab-a124-422b-ac6c-6c2efa3fb890/console.log" append="off"/>
Dec 01 19:46:14 user nova-compute[75066]:     </serial>
Dec 01 19:46:14 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:46:14 user nova-compute[75066]:     <video>
Dec 01 19:46:14 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:46:14 user nova-compute[75066]:     </video>
Dec 01 19:46:14 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:46:14 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:46:14 user nova-compute[75066]:     </rng>
Dec 01 19:46:14 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:46:14 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:46:14 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:46:14 user nova-compute[75066]:     </memballoon>
Dec 01 19:46:14 user nova-compute[75066]:   </devices>
Dec 01 19:46:14 user nova-compute[75066]: </domain>
Dec 01 19:46:14 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:46:14 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:45:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1792033231',display_name='tempest-TestVolumeBootPattern-server-1792033231',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1792033231',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ecd2a37ec7e4dbbbe53ed6ba9ff45bb',ramdisk_id='',reservation_id='r-o0fkhtuz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-384255364',owner_user_name='tempest-TestVolumeBootPattern-384255364-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:45:58Z,user_data=None,user_id='e30df6ccb83b4e8daaed0970c4b423d3',uuid=c30efcab-a124-422b-ac6c-6c2efa3fb890,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "292167c1-237f-4f38-8034-ca9fd1feeab2", "address": "fa:16:3e:59:02:fa", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap292167c1-23", "ovs_interfaceid": "292167c1-237f-4f38-8034-ca9fd1feeab2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:46:14 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Converting VIF {"id": "292167c1-237f-4f38-8034-ca9fd1feeab2", "address": "fa:16:3e:59:02:fa", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap292167c1-23", "ovs_interfaceid": "292167c1-237f-4f38-8034-ca9fd1feeab2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:46:14 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:02:fa,bridge_name='br-int',has_traffic_filtering=True,id=292167c1-237f-4f38-8034-ca9fd1feeab2,network=Network(2a39f486-871f-4115-88cb-176e846fe4f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap292167c1-23') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:46:14 user nova-compute[75066]: DEBUG os_vif [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:02:fa,bridge_name='br-int',has_traffic_filtering=True,id=292167c1-237f-4f38-8034-ca9fd1feeab2,network=Network(2a39f486-871f-4115-88cb-176e846fe4f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap292167c1-23') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:46:14 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:46:14 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:46:14 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:46:14 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:46:14 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2bdf2900-e100-5b1a-8160-d533c06b5141', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:46:14 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:46:14 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:46:14 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:46:14 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap292167c1-23, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:46:14 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap292167c1-23, col_values=(('qos', UUID('1168e0b6-135e-45fa-819c-199e1647a1c8')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:46:14 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap292167c1-23, col_values=(('external_ids', {'iface-id': '292167c1-237f-4f38-8034-ca9fd1feeab2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:02:fa', 'vm-uuid': 'c30efcab-a124-422b-ac6c-6c2efa3fb890'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:46:14 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:46:14 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:46:14 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:46:14 user nova-compute[75066]: INFO os_vif [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:02:fa,bridge_name='br-int',has_traffic_filtering=True,id=292167c1-237f-4f38-8034-ca9fd1feeab2,network=Network(2a39f486-871f-4115-88cb-176e846fe4f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap292167c1-23')
Dec 01 19:46:14 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:46:14 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] No VIF found with MAC fa:16:3e:59:02:fa, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:46:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:46:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:46:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:46:16 user nova-compute[75066]: DEBUG nova.compute.manager [req-3cce90eb-5579-4a42-a695-585039c56ccf req-89b7801f-232d-4e63-bd2c-19d859a6d684 service nova] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] Received event network-vif-plugged-292167c1-237f-4f38-8034-ca9fd1feeab2 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:46:16 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-3cce90eb-5579-4a42-a695-585039c56ccf req-89b7801f-232d-4e63-bd2c-19d859a6d684 service nova] Acquiring lock "c30efcab-a124-422b-ac6c-6c2efa3fb890-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:46:16 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-3cce90eb-5579-4a42-a695-585039c56ccf req-89b7801f-232d-4e63-bd2c-19d859a6d684 service nova] Lock "c30efcab-a124-422b-ac6c-6c2efa3fb890-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:46:16 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-3cce90eb-5579-4a42-a695-585039c56ccf req-89b7801f-232d-4e63-bd2c-19d859a6d684 service nova] Lock "c30efcab-a124-422b-ac6c-6c2efa3fb890-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:46:16 user nova-compute[75066]: DEBUG nova.compute.manager [req-3cce90eb-5579-4a42-a695-585039c56ccf req-89b7801f-232d-4e63-bd2c-19d859a6d684 service nova] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] No waiting events found dispatching network-vif-plugged-292167c1-237f-4f38-8034-ca9fd1feeab2 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:46:16 user nova-compute[75066]: WARNING nova.compute.manager [req-3cce90eb-5579-4a42-a695-585039c56ccf req-89b7801f-232d-4e63-bd2c-19d859a6d684 service nova] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] Received unexpected event network-vif-plugged-292167c1-237f-4f38-8034-ca9fd1feeab2 for instance with vm_state building and task_state spawning.
Dec 01 19:46:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:46:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:46:16 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:46:17 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:46:17 user nova-compute[75066]: DEBUG nova.compute.manager [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] Instance event wait completed in 0 seconds for  {{(pid=75066) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 19:46:17 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] Guest created on hypervisor {{(pid=75066) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 19:46:17 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] Instance spawned successfully.
Dec 01 19:46:17 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 19:46:17 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] Found default for hw_cdrom_bus of ide {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:46:17 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] Found default for hw_disk_bus of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:46:17 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] Found default for hw_input_bus of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:46:17 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] Found default for hw_pointer_model of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:46:17 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] Found default for hw_video_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:46:17 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] Found default for hw_vif_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:46:18 user nova-compute[75066]: INFO nova.compute.manager [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] Took 5.01 seconds to spawn the instance on the hypervisor.
Dec 01 19:46:18 user nova-compute[75066]: DEBUG nova.compute.manager [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:46:18 user nova-compute[75066]: DEBUG nova.compute.manager [req-97b5970f-6753-4444-80b0-998ff4ec1052 req-d2a5cd85-9b59-4e4e-90f4-909ebb550f13 service nova] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] Received event network-vif-plugged-292167c1-237f-4f38-8034-ca9fd1feeab2 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:46:18 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-97b5970f-6753-4444-80b0-998ff4ec1052 req-d2a5cd85-9b59-4e4e-90f4-909ebb550f13 service nova] Acquiring lock "c30efcab-a124-422b-ac6c-6c2efa3fb890-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:46:18 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-97b5970f-6753-4444-80b0-998ff4ec1052 req-d2a5cd85-9b59-4e4e-90f4-909ebb550f13 service nova] Lock "c30efcab-a124-422b-ac6c-6c2efa3fb890-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:46:18 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-97b5970f-6753-4444-80b0-998ff4ec1052 req-d2a5cd85-9b59-4e4e-90f4-909ebb550f13 service nova] Lock "c30efcab-a124-422b-ac6c-6c2efa3fb890-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:46:18 user nova-compute[75066]: DEBUG nova.compute.manager [req-97b5970f-6753-4444-80b0-998ff4ec1052 req-d2a5cd85-9b59-4e4e-90f4-909ebb550f13 service nova] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] No waiting events found dispatching network-vif-plugged-292167c1-237f-4f38-8034-ca9fd1feeab2 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:46:18 user nova-compute[75066]: WARNING nova.compute.manager [req-97b5970f-6753-4444-80b0-998ff4ec1052 req-d2a5cd85-9b59-4e4e-90f4-909ebb550f13 service nova] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] Received unexpected event network-vif-plugged-292167c1-237f-4f38-8034-ca9fd1feeab2 for instance with vm_state building and task_state spawning.
Dec 01 19:46:18 user nova-compute[75066]: INFO nova.compute.manager [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] Took 20.26 seconds to build instance.
Dec 01 19:46:18 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-43025b9e-162a-4c2f-954a-d4ba3360dd7a tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "c30efcab-a124-422b-ac6c-6c2efa3fb890" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.354s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:46:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:46:19 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:46:20 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:46:20 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75066) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 01 19:46:21 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:46:21 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75066) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 19:46:23 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:46:24 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:46:25 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:46:27 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:46:28 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:46:29 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:46:31 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:46:31 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:46:31 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:46:31 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:46:31 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:46:31 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75066) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 19:46:31 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:46:31 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/544d6830-e6cf-4c06-95b3-151da602bc6d/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:46:31 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/544d6830-e6cf-4c06-95b3-151da602bc6d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:46:31 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/544d6830-e6cf-4c06-95b3-151da602bc6d/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:46:31 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/544d6830-e6cf-4c06-95b3-151da602bc6d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:46:32 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:46:32 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:46:32 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Hypervisor/Node resource view: name=user free_ram=8776MB free_disk=24.906089782714844GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75066) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 19:46:32 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:46:32 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:46:32 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 544d6830-e6cf-4c06-95b3-151da602bc6d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:46:32 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance c30efcab-a124-422b-ac6c-6c2efa3fb890 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:46:32 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 19:46:32 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 19:46:32 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Refreshing inventories for resource provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 01 19:46:32 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Updating ProviderTree inventory for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 01 19:46:32 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Updating inventory in ProviderTree for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 01 19:46:32 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Refreshing aggregate associations for resource provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62, aggregates: None {{(pid=75066) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 01 19:46:32 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Refreshing trait associations for resource provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62, traits: COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SECURITY_UEFI_SECURE_BOOT {{(pid=75066) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 01 19:46:32 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:46:32 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:46:32 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Compute_service record updated for user:user {{(pid=75066) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 19:46:32 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.430s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:46:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:46:34 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:46:35 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:46:35 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Starting heal instance info cache {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 19:46:35 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Didn't find any instances for network info cache update. {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 01 19:46:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Acquiring lock "6ae34bf8-aa8b-45e7-8e90-408b524082bc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:46:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "6ae34bf8-aa8b-45e7-8e90-408b524082bc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:46:36 user nova-compute[75066]: DEBUG nova.compute.manager [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Starting instance... {{(pid=75066) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 19:46:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:46:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:46:36 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75066) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 19:46:36 user nova-compute[75066]: INFO nova.compute.claims [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Claim successful on node user
Dec 01 19:46:36 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:46:36 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:46:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.240s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:46:36 user nova-compute[75066]: DEBUG nova.compute.manager [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Start building networks asynchronously for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 19:46:36 user nova-compute[75066]: DEBUG nova.compute.manager [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Allocating IP information in the background. {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 19:46:36 user nova-compute[75066]: DEBUG nova.network.neutron [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] allocate_for_instance() {{(pid=75066) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 19:46:36 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 19:46:36 user nova-compute[75066]: DEBUG nova.compute.manager [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Start building block device mappings for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 19:46:36 user nova-compute[75066]: DEBUG nova.policy [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b92b1beca2ee480181e771eafe1a9f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109097a30a40419092c74f4c7a695ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75066) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 19:46:36 user nova-compute[75066]: DEBUG nova.compute.manager [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Start spawning the instance on the hypervisor. {{(pid=75066) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 19:46:36 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Creating instance directory {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 19:46:36 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Creating image(s)
Dec 01 19:46:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Acquiring lock "/opt/stack/data/nova/instances/6ae34bf8-aa8b-45e7-8e90-408b524082bc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:46:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "/opt/stack/data/nova/instances/6ae34bf8-aa8b-45e7-8e90-408b524082bc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:46:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "/opt/stack/data/nova/instances/6ae34bf8-aa8b-45e7-8e90-408b524082bc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:46:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:46:37 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.189s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:46:37 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Acquiring lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:46:37 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:46:37 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:46:37 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.189s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:46:37 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/6ae34bf8-aa8b-45e7-8e90-408b524082bc/disk 1073741824 {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:46:37 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/6ae34bf8-aa8b-45e7-8e90-408b524082bc/disk 1073741824" returned: 0 in 0.058s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:46:37 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:46:37 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:46:37 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:46:37 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:46:37 user nova-compute[75066]: DEBUG nova.network.neutron [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Successfully created port: c47319de-ae0e-44ea-8525-80b61f9fdf6f {{(pid=75066) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 19:46:37 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.183s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:46:37 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6ae34bf8-aa8b-45e7-8e90-408b524082bc/disk. size=1073741824 {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 19:46:37 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae34bf8-aa8b-45e7-8e90-408b524082bc/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:46:37 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae34bf8-aa8b-45e7-8e90-408b524082bc/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:46:37 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Cannot resize image /opt/stack/data/nova/instances/6ae34bf8-aa8b-45e7-8e90-408b524082bc/disk to a smaller size. {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 19:46:37 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Created local disks {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 19:46:37 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Ensure instance console log exists: /opt/stack/data/nova/instances/6ae34bf8-aa8b-45e7-8e90-408b524082bc/console.log {{(pid=75066) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 19:46:37 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:46:37 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:46:37 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:46:38 user nova-compute[75066]: DEBUG nova.network.neutron [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Successfully updated port: c47319de-ae0e-44ea-8525-80b61f9fdf6f {{(pid=75066) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 19:46:38 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Acquiring lock "refresh_cache-6ae34bf8-aa8b-45e7-8e90-408b524082bc" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:46:38 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Acquired lock "refresh_cache-6ae34bf8-aa8b-45e7-8e90-408b524082bc" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:46:38 user nova-compute[75066]: DEBUG nova.network.neutron [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:46:38 user nova-compute[75066]: DEBUG nova.network.neutron [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:46:38 user nova-compute[75066]: DEBUG nova.compute.manager [req-898d734c-182d-4fe3-829a-e1198a8ee9d5 req-d33df375-b72e-4fd9-b453-501fb33f62fa service nova] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Received event network-changed-c47319de-ae0e-44ea-8525-80b61f9fdf6f {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:46:38 user nova-compute[75066]: DEBUG nova.compute.manager [req-898d734c-182d-4fe3-829a-e1198a8ee9d5 req-d33df375-b72e-4fd9-b453-501fb33f62fa service nova] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Refreshing instance network info cache due to event network-changed-c47319de-ae0e-44ea-8525-80b61f9fdf6f. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:46:38 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-898d734c-182d-4fe3-829a-e1198a8ee9d5 req-d33df375-b72e-4fd9-b453-501fb33f62fa service nova] Acquiring lock "refresh_cache-6ae34bf8-aa8b-45e7-8e90-408b524082bc" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:46:38 user nova-compute[75066]: DEBUG nova.network.neutron [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Updating instance_info_cache with network_info: [{"id": "c47319de-ae0e-44ea-8525-80b61f9fdf6f", "address": "fa:16:3e:22:49:95", "network": {"id": "955d6293-ede6-4cb4-8cee-0157dbad93ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-603640322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109097a30a40419092c74f4c7a695ce4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc47319de-ae", "ovs_interfaceid": "c47319de-ae0e-44ea-8525-80b61f9fdf6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:46:38 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Releasing lock "refresh_cache-6ae34bf8-aa8b-45e7-8e90-408b524082bc" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:46:38 user nova-compute[75066]: DEBUG nova.compute.manager [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Instance network_info: |[{"id": "c47319de-ae0e-44ea-8525-80b61f9fdf6f", "address": "fa:16:3e:22:49:95", "network": {"id": "955d6293-ede6-4cb4-8cee-0157dbad93ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-603640322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109097a30a40419092c74f4c7a695ce4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc47319de-ae", "ovs_interfaceid": "c47319de-ae0e-44ea-8525-80b61f9fdf6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 19:46:38 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-898d734c-182d-4fe3-829a-e1198a8ee9d5 req-d33df375-b72e-4fd9-b453-501fb33f62fa service nova] Acquired lock "refresh_cache-6ae34bf8-aa8b-45e7-8e90-408b524082bc" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:46:38 user nova-compute[75066]: DEBUG nova.network.neutron [req-898d734c-182d-4fe3-829a-e1198a8ee9d5 req-d33df375-b72e-4fd9-b453-501fb33f62fa service nova] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Refreshing network info cache for port c47319de-ae0e-44ea-8525-80b61f9fdf6f {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:46:38 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Start _get_guest_xml network_info=[{"id": "c47319de-ae0e-44ea-8525-80b61f9fdf6f", "address": "fa:16:3e:22:49:95", "network": {"id": "955d6293-ede6-4cb4-8cee-0157dbad93ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-603640322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109097a30a40419092c74f4c7a695ce4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc47319de-ae", "ovs_interfaceid": "c47319de-ae0e-44ea-8525-80b61f9fdf6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'image_id': '900b237b-e99c-4fdd-a44f-dcb7a08baa86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:46:38 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:46:38 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:46:38 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:46:38 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:46:38 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:46:38 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:46:38 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:46:38 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:46:38 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:46:38 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:46:38 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:46:38 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:46:38 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:46:38 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:46:38 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:46:38 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:46:38 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:46:38 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:46:38 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:46:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1170036720',display_name='tempest-AttachVolumeNegativeTest-server-1170036720',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1170036720',id=45,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLSmiJCHxynWozNR9MdZ3r2j30snRxAA44gPYIXDTlmNMGVyrsGMpvpaTKoLdn4t/fIW0VAMDJWNrrXxmjQjTFAf6li75xfjGarymybSvSVUL5Y8BR9Ciiet8MJmuZoZQg==',key_name='tempest-keypair-442499860',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='109097a30a40419092c74f4c7a695ce4',ramdisk_id='',reservation_id='r-0tffwwyr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-711021602',owner_user_name='tempest-AttachVolumeNegativeTest-711021602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:46:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b92b1beca2ee480181e771eafe1a9f97',uuid=6ae34bf8-aa8b-45e7-8e90-408b524082bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c47319de-ae0e-44ea-8525-80b61f9fdf6f", "address": "fa:16:3e:22:49:95", "network": {"id": "955d6293-ede6-4cb4-8cee-0157dbad93ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-603640322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109097a30a40419092c74f4c7a695ce4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc47319de-ae", "ovs_interfaceid": "c47319de-ae0e-44ea-8525-80b61f9fdf6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:46:38 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Converting VIF {"id": "c47319de-ae0e-44ea-8525-80b61f9fdf6f", "address": "fa:16:3e:22:49:95", "network": {"id": "955d6293-ede6-4cb4-8cee-0157dbad93ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-603640322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109097a30a40419092c74f4c7a695ce4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc47319de-ae", "ovs_interfaceid": "c47319de-ae0e-44ea-8525-80b61f9fdf6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:46:38 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:49:95,bridge_name='br-int',has_traffic_filtering=True,id=c47319de-ae0e-44ea-8525-80b61f9fdf6f,network=Network(955d6293-ede6-4cb4-8cee-0157dbad93ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc47319de-ae') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:46:38 user nova-compute[75066]: DEBUG nova.objects.instance [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lazy-loading 'pci_devices' on Instance uuid 6ae34bf8-aa8b-45e7-8e90-408b524082bc {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:46:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:46:38 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:46:38 user nova-compute[75066]:   <uuid>6ae34bf8-aa8b-45e7-8e90-408b524082bc</uuid>
Dec 01 19:46:38 user nova-compute[75066]:   <name>instance-0000002d</name>
Dec 01 19:46:38 user nova-compute[75066]:   <memory>524288</memory>
Dec 01 19:46:38 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:46:38 user nova-compute[75066]:   <metadata>
Dec 01 19:46:38 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:46:38 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:46:38 user nova-compute[75066]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1170036720</nova:name>
Dec 01 19:46:38 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:46:38</nova:creationTime>
Dec 01 19:46:38 user nova-compute[75066]:       <nova:flavor name="m1.tiny">
Dec 01 19:46:38 user nova-compute[75066]:         <nova:memory>512</nova:memory>
Dec 01 19:46:38 user nova-compute[75066]:         <nova:disk>1</nova:disk>
Dec 01 19:46:38 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:46:38 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:46:38 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:46:38 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:46:38 user nova-compute[75066]:       <nova:owner>
Dec 01 19:46:38 user nova-compute[75066]:         <nova:user uuid="b92b1beca2ee480181e771eafe1a9f97">tempest-AttachVolumeNegativeTest-711021602-project-member</nova:user>
Dec 01 19:46:38 user nova-compute[75066]:         <nova:project uuid="109097a30a40419092c74f4c7a695ce4">tempest-AttachVolumeNegativeTest-711021602</nova:project>
Dec 01 19:46:38 user nova-compute[75066]:       </nova:owner>
Dec 01 19:46:38 user nova-compute[75066]:       <nova:root type="image" uuid="900b237b-e99c-4fdd-a44f-dcb7a08baa86"/>
Dec 01 19:46:38 user nova-compute[75066]:       <nova:ports>
Dec 01 19:46:38 user nova-compute[75066]:         <nova:port uuid="c47319de-ae0e-44ea-8525-80b61f9fdf6f">
Dec 01 19:46:38 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Dec 01 19:46:38 user nova-compute[75066]:         </nova:port>
Dec 01 19:46:38 user nova-compute[75066]:       </nova:ports>
Dec 01 19:46:38 user nova-compute[75066]:     </nova:instance>
Dec 01 19:46:38 user nova-compute[75066]:   </metadata>
Dec 01 19:46:38 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:46:38 user nova-compute[75066]:     <system>
Dec 01 19:46:38 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:46:38 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:46:38 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:46:38 user nova-compute[75066]:       <entry name="serial">6ae34bf8-aa8b-45e7-8e90-408b524082bc</entry>
Dec 01 19:46:38 user nova-compute[75066]:       <entry name="uuid">6ae34bf8-aa8b-45e7-8e90-408b524082bc</entry>
Dec 01 19:46:38 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:46:38 user nova-compute[75066]:     </system>
Dec 01 19:46:38 user nova-compute[75066]:   </sysinfo>
Dec 01 19:46:38 user nova-compute[75066]:   <os>
Dec 01 19:46:38 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:46:38 user nova-compute[75066]:     <boot dev="hd"/>
Dec 01 19:46:38 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:46:38 user nova-compute[75066]:   </os>
Dec 01 19:46:38 user nova-compute[75066]:   <features>
Dec 01 19:46:38 user nova-compute[75066]:     <acpi/>
Dec 01 19:46:38 user nova-compute[75066]:     <apic/>
Dec 01 19:46:38 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:46:38 user nova-compute[75066]:   </features>
Dec 01 19:46:38 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:46:38 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:46:38 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:46:38 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:46:38 user nova-compute[75066]:   </clock>
Dec 01 19:46:38 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:46:38 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:46:38 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:46:38 user nova-compute[75066]:   </cpu>
Dec 01 19:46:38 user nova-compute[75066]:   <devices>
Dec 01 19:46:38 user nova-compute[75066]:     <disk type="file" device="disk">
Dec 01 19:46:38 user nova-compute[75066]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 19:46:38 user nova-compute[75066]:       <source file="/opt/stack/data/nova/instances/6ae34bf8-aa8b-45e7-8e90-408b524082bc/disk"/>
Dec 01 19:46:38 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:46:38 user nova-compute[75066]:     </disk>
Dec 01 19:46:38 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:46:38 user nova-compute[75066]:       <mac address="fa:16:3e:22:49:95"/>
Dec 01 19:46:38 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:46:38 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:46:38 user nova-compute[75066]:       <target dev="tapc47319de-ae"/>
Dec 01 19:46:38 user nova-compute[75066]:     </interface>
Dec 01 19:46:38 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:46:38 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/6ae34bf8-aa8b-45e7-8e90-408b524082bc/console.log" append="off"/>
Dec 01 19:46:38 user nova-compute[75066]:     </serial>
Dec 01 19:46:38 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:46:38 user nova-compute[75066]:     <video>
Dec 01 19:46:38 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:46:38 user nova-compute[75066]:     </video>
Dec 01 19:46:38 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:46:38 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:46:38 user nova-compute[75066]:     </rng>
Dec 01 19:46:38 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:46:38 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:46:38 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:46:38 user nova-compute[75066]:     </memballoon>
Dec 01 19:46:38 user nova-compute[75066]:   </devices>
Dec 01 19:46:38 user nova-compute[75066]: </domain>
Dec 01 19:46:38 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:46:38 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:46:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1170036720',display_name='tempest-AttachVolumeNegativeTest-server-1170036720',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1170036720',id=45,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLSmiJCHxynWozNR9MdZ3r2j30snRxAA44gPYIXDTlmNMGVyrsGMpvpaTKoLdn4t/fIW0VAMDJWNrrXxmjQjTFAf6li75xfjGarymybSvSVUL5Y8BR9Ciiet8MJmuZoZQg==',key_name='tempest-keypair-442499860',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='109097a30a40419092c74f4c7a695ce4',ramdisk_id='',reservation_id='r-0tffwwyr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-711021602',owner_user_name='tempest-AttachVolumeNegativeTest-711021602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:46:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b92b1beca2ee480181e771eafe1a9f97',uuid=6ae34bf8-aa8b-45e7-8e90-408b524082bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c47319de-ae0e-44ea-8525-80b61f9fdf6f", "address": "fa:16:3e:22:49:95", "network": {"id": "955d6293-ede6-4cb4-8cee-0157dbad93ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-603640322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109097a30a40419092c74f4c7a695ce4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc47319de-ae", "ovs_interfaceid": "c47319de-ae0e-44ea-8525-80b61f9fdf6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:46:38 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Converting VIF {"id": "c47319de-ae0e-44ea-8525-80b61f9fdf6f", "address": "fa:16:3e:22:49:95", "network": {"id": "955d6293-ede6-4cb4-8cee-0157dbad93ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-603640322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109097a30a40419092c74f4c7a695ce4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc47319de-ae", "ovs_interfaceid": "c47319de-ae0e-44ea-8525-80b61f9fdf6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:46:38 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:49:95,bridge_name='br-int',has_traffic_filtering=True,id=c47319de-ae0e-44ea-8525-80b61f9fdf6f,network=Network(955d6293-ede6-4cb4-8cee-0157dbad93ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc47319de-ae') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:46:38 user nova-compute[75066]: DEBUG os_vif [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:49:95,bridge_name='br-int',has_traffic_filtering=True,id=c47319de-ae0e-44ea-8525-80b61f9fdf6f,network=Network(955d6293-ede6-4cb4-8cee-0157dbad93ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc47319de-ae') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:46:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:46:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:46:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:46:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:46:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '07f0a1e1-bc14-52ce-a71b-8ae953b15abf', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:46:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:46:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:46:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:46:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc47319de-ae, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:46:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc47319de-ae, col_values=(('qos', UUID('0c734127-93da-4b00-a20b-9f5f84aa5418')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:46:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc47319de-ae, col_values=(('external_ids', {'iface-id': 'c47319de-ae0e-44ea-8525-80b61f9fdf6f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:49:95', 'vm-uuid': '6ae34bf8-aa8b-45e7-8e90-408b524082bc'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:46:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:46:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:46:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:46:38 user nova-compute[75066]: INFO os_vif [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:49:95,bridge_name='br-int',has_traffic_filtering=True,id=c47319de-ae0e-44ea-8525-80b61f9fdf6f,network=Network(955d6293-ede6-4cb4-8cee-0157dbad93ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc47319de-ae')
Dec 01 19:46:38 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:46:38 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] No VIF found with MAC fa:16:3e:22:49:95, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:46:38 user nova-compute[75066]: DEBUG nova.network.neutron [req-898d734c-182d-4fe3-829a-e1198a8ee9d5 req-d33df375-b72e-4fd9-b453-501fb33f62fa service nova] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Updated VIF entry in instance network info cache for port c47319de-ae0e-44ea-8525-80b61f9fdf6f. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:46:38 user nova-compute[75066]: DEBUG nova.network.neutron [req-898d734c-182d-4fe3-829a-e1198a8ee9d5 req-d33df375-b72e-4fd9-b453-501fb33f62fa service nova] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Updating instance_info_cache with network_info: [{"id": "c47319de-ae0e-44ea-8525-80b61f9fdf6f", "address": "fa:16:3e:22:49:95", "network": {"id": "955d6293-ede6-4cb4-8cee-0157dbad93ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-603640322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109097a30a40419092c74f4c7a695ce4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc47319de-ae", "ovs_interfaceid": "c47319de-ae0e-44ea-8525-80b61f9fdf6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:46:38 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-898d734c-182d-4fe3-829a-e1198a8ee9d5 req-d33df375-b72e-4fd9-b453-501fb33f62fa service nova] Releasing lock "refresh_cache-6ae34bf8-aa8b-45e7-8e90-408b524082bc" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:46:39 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:46:39 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:46:39 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:46:40 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:46:40 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:46:40 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:46:40 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:46:40 user nova-compute[75066]: DEBUG nova.compute.manager [req-e2edb364-de9d-462f-9897-2fbe7f83db58 req-0f6f95eb-c853-4a9c-9300-053ee3881b78 service nova] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Received event network-vif-plugged-c47319de-ae0e-44ea-8525-80b61f9fdf6f {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:46:40 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-e2edb364-de9d-462f-9897-2fbe7f83db58 req-0f6f95eb-c853-4a9c-9300-053ee3881b78 service nova] Acquiring lock "6ae34bf8-aa8b-45e7-8e90-408b524082bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:46:40 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-e2edb364-de9d-462f-9897-2fbe7f83db58 req-0f6f95eb-c853-4a9c-9300-053ee3881b78 service nova] Lock "6ae34bf8-aa8b-45e7-8e90-408b524082bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:46:40 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-e2edb364-de9d-462f-9897-2fbe7f83db58 req-0f6f95eb-c853-4a9c-9300-053ee3881b78 service nova] Lock "6ae34bf8-aa8b-45e7-8e90-408b524082bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:46:40 user nova-compute[75066]: DEBUG nova.compute.manager [req-e2edb364-de9d-462f-9897-2fbe7f83db58 req-0f6f95eb-c853-4a9c-9300-053ee3881b78 service nova] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] No waiting events found dispatching network-vif-plugged-c47319de-ae0e-44ea-8525-80b61f9fdf6f {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:46:40 user nova-compute[75066]: WARNING nova.compute.manager [req-e2edb364-de9d-462f-9897-2fbe7f83db58 req-0f6f95eb-c853-4a9c-9300-053ee3881b78 service nova] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Received unexpected event network-vif-plugged-c47319de-ae0e-44ea-8525-80b61f9fdf6f for instance with vm_state building and task_state spawning.
Dec 01 19:46:41 user nova-compute[75066]: DEBUG nova.compute.manager [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Instance event wait completed in 0 seconds for  {{(pid=75066) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 19:46:41 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Guest created on hypervisor {{(pid=75066) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 19:46:41 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Instance spawned successfully.
Dec 01 19:46:41 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 19:46:41 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Found default for hw_cdrom_bus of ide {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:46:41 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Found default for hw_disk_bus of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:46:41 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Found default for hw_input_bus of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:46:41 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Found default for hw_pointer_model of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:46:41 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Found default for hw_video_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:46:41 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Found default for hw_vif_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:46:42 user nova-compute[75066]: INFO nova.compute.manager [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Took 5.23 seconds to spawn the instance on the hypervisor.
Dec 01 19:46:42 user nova-compute[75066]: DEBUG nova.compute.manager [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:46:42 user nova-compute[75066]: INFO nova.compute.manager [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Took 5.81 seconds to build instance.
Dec 01 19:46:42 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-d064cbab-93ef-42e0-a191-3c6044d046c5 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "6ae34bf8-aa8b-45e7-8e90-408b524082bc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.908s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:46:42 user nova-compute[75066]: DEBUG nova.compute.manager [req-0a70826f-0d77-454e-a1c2-a35ec44e95d6 req-4e4a3c8d-66f3-47f3-8728-abf7a2659840 service nova] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Received event network-vif-plugged-c47319de-ae0e-44ea-8525-80b61f9fdf6f {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:46:42 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-0a70826f-0d77-454e-a1c2-a35ec44e95d6 req-4e4a3c8d-66f3-47f3-8728-abf7a2659840 service nova] Acquiring lock "6ae34bf8-aa8b-45e7-8e90-408b524082bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:46:42 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-0a70826f-0d77-454e-a1c2-a35ec44e95d6 req-4e4a3c8d-66f3-47f3-8728-abf7a2659840 service nova] Lock "6ae34bf8-aa8b-45e7-8e90-408b524082bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:46:42 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-0a70826f-0d77-454e-a1c2-a35ec44e95d6 req-4e4a3c8d-66f3-47f3-8728-abf7a2659840 service nova] Lock "6ae34bf8-aa8b-45e7-8e90-408b524082bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:46:42 user nova-compute[75066]: DEBUG nova.compute.manager [req-0a70826f-0d77-454e-a1c2-a35ec44e95d6 req-4e4a3c8d-66f3-47f3-8728-abf7a2659840 service nova] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] No waiting events found dispatching network-vif-plugged-c47319de-ae0e-44ea-8525-80b61f9fdf6f {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:46:42 user nova-compute[75066]: WARNING nova.compute.manager [req-0a70826f-0d77-454e-a1c2-a35ec44e95d6 req-4e4a3c8d-66f3-47f3-8728-abf7a2659840 service nova] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Received unexpected event network-vif-plugged-c47319de-ae0e-44ea-8525-80b61f9fdf6f for instance with vm_state active and task_state None.
Dec 01 19:46:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:46:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:46:48 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:46:48 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:46:52 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:46:52 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Cleaning up deleted instances {{(pid=75066) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 01 19:46:52 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] There are 0 instances to clean {{(pid=75066) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 01 19:46:53 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:46:53 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:46:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:46:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:46:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-45ea3cc9-b52d-40d8-9c36-ed24cde65e5c tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Acquiring lock "544d6830-e6cf-4c06-95b3-151da602bc6d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:46:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-45ea3cc9-b52d-40d8-9c36-ed24cde65e5c tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lock "544d6830-e6cf-4c06-95b3-151da602bc6d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:46:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-45ea3cc9-b52d-40d8-9c36-ed24cde65e5c tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Acquiring lock "544d6830-e6cf-4c06-95b3-151da602bc6d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:46:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-45ea3cc9-b52d-40d8-9c36-ed24cde65e5c tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lock "544d6830-e6cf-4c06-95b3-151da602bc6d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:46:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-45ea3cc9-b52d-40d8-9c36-ed24cde65e5c tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lock "544d6830-e6cf-4c06-95b3-151da602bc6d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:46:59 user nova-compute[75066]: INFO nova.compute.manager [None req-45ea3cc9-b52d-40d8-9c36-ed24cde65e5c tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Terminating instance
Dec 01 19:46:59 user nova-compute[75066]: DEBUG nova.compute.manager [None req-45ea3cc9-b52d-40d8-9c36-ed24cde65e5c tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Start destroying the instance on the hypervisor. {{(pid=75066) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 19:46:59 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:46:59 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:46:59 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:46:59 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:46:59 user nova-compute[75066]: DEBUG nova.compute.manager [req-7a542629-a79d-44d8-a5a7-df50ce790232 req-1bd74da5-8285-4b09-b4aa-813e50ba9492 service nova] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Received event network-vif-unplugged-6a67de06-74d9-4b6a-ae10-8fbe730f6558 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:46:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-7a542629-a79d-44d8-a5a7-df50ce790232 req-1bd74da5-8285-4b09-b4aa-813e50ba9492 service nova] Acquiring lock "544d6830-e6cf-4c06-95b3-151da602bc6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:46:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-7a542629-a79d-44d8-a5a7-df50ce790232 req-1bd74da5-8285-4b09-b4aa-813e50ba9492 service nova] Lock "544d6830-e6cf-4c06-95b3-151da602bc6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:46:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-7a542629-a79d-44d8-a5a7-df50ce790232 req-1bd74da5-8285-4b09-b4aa-813e50ba9492 service nova] Lock "544d6830-e6cf-4c06-95b3-151da602bc6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:46:59 user nova-compute[75066]: DEBUG nova.compute.manager [req-7a542629-a79d-44d8-a5a7-df50ce790232 req-1bd74da5-8285-4b09-b4aa-813e50ba9492 service nova] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] No waiting events found dispatching network-vif-unplugged-6a67de06-74d9-4b6a-ae10-8fbe730f6558 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:46:59 user nova-compute[75066]: DEBUG nova.compute.manager [req-7a542629-a79d-44d8-a5a7-df50ce790232 req-1bd74da5-8285-4b09-b4aa-813e50ba9492 service nova] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Received event network-vif-unplugged-6a67de06-74d9-4b6a-ae10-8fbe730f6558 for instance with task_state deleting. {{(pid=75066) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 19:47:00 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Instance destroyed successfully.
Dec 01 19:47:00 user nova-compute[75066]: DEBUG nova.objects.instance [None req-45ea3cc9-b52d-40d8-9c36-ed24cde65e5c tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lazy-loading 'resources' on Instance uuid 544d6830-e6cf-4c06-95b3-151da602bc6d {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:47:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-45ea3cc9-b52d-40d8-9c36-ed24cde65e5c tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:39:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1667858717',display_name='tempest-SnapshotDataIntegrityTests-server-1667858717',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1667858717',id=40,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPRo4MSB12Jo9y3Z7pVX2ycodhGdOIN/mE8U1Obwf8PwSIzzUEOgE54UiJJ65mQ8TeDYyxE8HBx4oXboklyCz4ndaGPGKvfmltRoFVkR7LlhwWmzJWoRmhesLIsX0j6m1w==',key_name='tempest-keypair-921551098',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:40:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b227dfb7ede2407ba03f2840bc5de4f5',ramdisk_id='',reservation_id='r-nhz4sxrf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-626539035',owner_user_name='tempest-SnapshotDataIntegrityTests-626539035-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:40:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='928459d1f7dd4705bc3e6f3de827fe30',uuid=544d6830-e6cf-4c06-95b3-151da602bc6d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a67de06-74d9-4b6a-ae10-8fbe730f6558", "address": "fa:16:3e:b1:1b:aa", "network": {"id": "10a180e0-96f5-4b54-8f70-8955d6c0e288", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1853322930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b227dfb7ede2407ba03f2840bc5de4f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a67de06-74", "ovs_interfaceid": "6a67de06-74d9-4b6a-ae10-8fbe730f6558", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:47:00 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-45ea3cc9-b52d-40d8-9c36-ed24cde65e5c tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Converting VIF {"id": "6a67de06-74d9-4b6a-ae10-8fbe730f6558", "address": "fa:16:3e:b1:1b:aa", "network": {"id": "10a180e0-96f5-4b54-8f70-8955d6c0e288", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1853322930-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.99", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b227dfb7ede2407ba03f2840bc5de4f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a67de06-74", "ovs_interfaceid": "6a67de06-74d9-4b6a-ae10-8fbe730f6558", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:47:00 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-45ea3cc9-b52d-40d8-9c36-ed24cde65e5c tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b1:1b:aa,bridge_name='br-int',has_traffic_filtering=True,id=6a67de06-74d9-4b6a-ae10-8fbe730f6558,network=Network(10a180e0-96f5-4b54-8f70-8955d6c0e288),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a67de06-74') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:47:00 user nova-compute[75066]: DEBUG os_vif [None req-45ea3cc9-b52d-40d8-9c36-ed24cde65e5c tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:1b:aa,bridge_name='br-int',has_traffic_filtering=True,id=6a67de06-74d9-4b6a-ae10-8fbe730f6558,network=Network(10a180e0-96f5-4b54-8f70-8955d6c0e288),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a67de06-74') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:47:00 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:47:00 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6a67de06-74, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:47:00 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:47:00 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:47:00 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:47:00 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c3ce6289-cda5-4780-bbb6-b944fc6cd443) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:47:00 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:47:00 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:47:00 user nova-compute[75066]: INFO os_vif [None req-45ea3cc9-b52d-40d8-9c36-ed24cde65e5c tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:1b:aa,bridge_name='br-int',has_traffic_filtering=True,id=6a67de06-74d9-4b6a-ae10-8fbe730f6558,network=Network(10a180e0-96f5-4b54-8f70-8955d6c0e288),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a67de06-74')
Dec 01 19:47:00 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-45ea3cc9-b52d-40d8-9c36-ed24cde65e5c tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Deleting instance files /opt/stack/data/nova/instances/544d6830-e6cf-4c06-95b3-151da602bc6d_del
Dec 01 19:47:00 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-45ea3cc9-b52d-40d8-9c36-ed24cde65e5c tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Deletion of /opt/stack/data/nova/instances/544d6830-e6cf-4c06-95b3-151da602bc6d_del complete
Dec 01 19:47:00 user nova-compute[75066]: INFO nova.compute.manager [None req-45ea3cc9-b52d-40d8-9c36-ed24cde65e5c tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Took 0.88 seconds to destroy the instance on the hypervisor.
Dec 01 19:47:00 user nova-compute[75066]: DEBUG oslo.service.loopingcall [None req-45ea3cc9-b52d-40d8-9c36-ed24cde65e5c tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75066) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 19:47:00 user nova-compute[75066]: DEBUG nova.compute.manager [-] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Deallocating network for instance {{(pid=75066) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 19:47:00 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] deallocate_for_instance() {{(pid=75066) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 19:47:01 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:47:01 user nova-compute[75066]: INFO nova.compute.manager [-] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Took 0.80 seconds to deallocate network for instance.
Dec 01 19:47:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-45ea3cc9-b52d-40d8-9c36-ed24cde65e5c tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:47:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-45ea3cc9-b52d-40d8-9c36-ed24cde65e5c tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:47:01 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-45ea3cc9-b52d-40d8-9c36-ed24cde65e5c tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:47:01 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-45ea3cc9-b52d-40d8-9c36-ed24cde65e5c tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:47:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-45ea3cc9-b52d-40d8-9c36-ed24cde65e5c tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.187s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:47:01 user nova-compute[75066]: INFO nova.scheduler.client.report [None req-45ea3cc9-b52d-40d8-9c36-ed24cde65e5c tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Deleted allocations for instance 544d6830-e6cf-4c06-95b3-151da602bc6d
Dec 01 19:47:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-45ea3cc9-b52d-40d8-9c36-ed24cde65e5c tempest-SnapshotDataIntegrityTests-626539035 tempest-SnapshotDataIntegrityTests-626539035-project-member] Lock "544d6830-e6cf-4c06-95b3-151da602bc6d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.096s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:47:01 user nova-compute[75066]: DEBUG nova.compute.manager [req-a6b0b95c-a47f-4d32-b392-38fb50ada4b7 req-153cef84-5fc7-4513-84ac-3f7f290de907 service nova] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Received event network-vif-plugged-6a67de06-74d9-4b6a-ae10-8fbe730f6558 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:47:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a6b0b95c-a47f-4d32-b392-38fb50ada4b7 req-153cef84-5fc7-4513-84ac-3f7f290de907 service nova] Acquiring lock "544d6830-e6cf-4c06-95b3-151da602bc6d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:47:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a6b0b95c-a47f-4d32-b392-38fb50ada4b7 req-153cef84-5fc7-4513-84ac-3f7f290de907 service nova] Lock "544d6830-e6cf-4c06-95b3-151da602bc6d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:47:01 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a6b0b95c-a47f-4d32-b392-38fb50ada4b7 req-153cef84-5fc7-4513-84ac-3f7f290de907 service nova] Lock "544d6830-e6cf-4c06-95b3-151da602bc6d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:47:01 user nova-compute[75066]: DEBUG nova.compute.manager [req-a6b0b95c-a47f-4d32-b392-38fb50ada4b7 req-153cef84-5fc7-4513-84ac-3f7f290de907 service nova] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] No waiting events found dispatching network-vif-plugged-6a67de06-74d9-4b6a-ae10-8fbe730f6558 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:47:01 user nova-compute[75066]: WARNING nova.compute.manager [req-a6b0b95c-a47f-4d32-b392-38fb50ada4b7 req-153cef84-5fc7-4513-84ac-3f7f290de907 service nova] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Received unexpected event network-vif-plugged-6a67de06-74d9-4b6a-ae10-8fbe730f6558 for instance with vm_state deleted and task_state None.
Dec 01 19:47:01 user nova-compute[75066]: DEBUG nova.compute.manager [req-a6b0b95c-a47f-4d32-b392-38fb50ada4b7 req-153cef84-5fc7-4513-84ac-3f7f290de907 service nova] [instance: 544d6830-e6cf-4c06-95b3-151da602bc6d] Received event network-vif-deleted-6a67de06-74d9-4b6a-ae10-8fbe730f6558 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:47:03 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:47:05 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:47:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:47:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:47:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:47:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:47:18 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:47:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:47:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:47:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75066) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 19:47:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:47:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:47:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:47:23 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:47:23 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75066) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 19:47:24 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:47:25 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:47:27 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:47:28 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:47:29 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:47:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:47:32 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:47:32 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:47:32 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:47:32 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:47:32 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75066) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 19:47:32 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:47:32 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae34bf8-aa8b-45e7-8e90-408b524082bc/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:47:32 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae34bf8-aa8b-45e7-8e90-408b524082bc/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:47:32 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae34bf8-aa8b-45e7-8e90-408b524082bc/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:47:32 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae34bf8-aa8b-45e7-8e90-408b524082bc/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:47:33 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:47:33 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:47:33 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Hypervisor/Node resource view: name=user free_ram=8788MB free_disk=24.903915405273438GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75066) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 19:47:33 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:47:33 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:47:33 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance c30efcab-a124-422b-ac6c-6c2efa3fb890 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:47:33 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 6ae34bf8-aa8b-45e7-8e90-408b524082bc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:47:33 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 19:47:33 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 19:47:33 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:47:33 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:47:33 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Compute_service record updated for user:user {{(pid=75066) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 19:47:33 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.222s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:47:34 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:47:35 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:47:35 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:47:36 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:47:36 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Starting heal instance info cache {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 19:47:36 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Rebuilding the list of instances to heal {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 19:47:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "refresh_cache-c30efcab-a124-422b-ac6c-6c2efa3fb890" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:47:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquired lock "refresh_cache-c30efcab-a124-422b-ac6c-6c2efa3fb890" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:47:36 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] Forcefully refreshing network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 19:47:36 user nova-compute[75066]: DEBUG nova.objects.instance [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lazy-loading 'info_cache' on Instance uuid c30efcab-a124-422b-ac6c-6c2efa3fb890 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:47:36 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] Updating instance_info_cache with network_info: [{"id": "292167c1-237f-4f38-8034-ca9fd1feeab2", "address": "fa:16:3e:59:02:fa", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap292167c1-23", "ovs_interfaceid": "292167c1-237f-4f38-8034-ca9fd1feeab2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:47:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Releasing lock "refresh_cache-c30efcab-a124-422b-ac6c-6c2efa3fb890" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:47:36 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] Updated the network info_cache for instance {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 19:47:40 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:47:45 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:47:48 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-f5b06e52-a3ed-408c-89ef-832ca49378e3 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Acquiring lock "c30efcab-a124-422b-ac6c-6c2efa3fb890" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:47:48 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-f5b06e52-a3ed-408c-89ef-832ca49378e3 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "c30efcab-a124-422b-ac6c-6c2efa3fb890" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:47:48 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-f5b06e52-a3ed-408c-89ef-832ca49378e3 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Acquiring lock "c30efcab-a124-422b-ac6c-6c2efa3fb890-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:47:48 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-f5b06e52-a3ed-408c-89ef-832ca49378e3 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "c30efcab-a124-422b-ac6c-6c2efa3fb890-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:47:48 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-f5b06e52-a3ed-408c-89ef-832ca49378e3 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "c30efcab-a124-422b-ac6c-6c2efa3fb890-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:47:48 user nova-compute[75066]: INFO nova.compute.manager [None req-f5b06e52-a3ed-408c-89ef-832ca49378e3 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] Terminating instance
Dec 01 19:47:48 user nova-compute[75066]: DEBUG nova.compute.manager [None req-f5b06e52-a3ed-408c-89ef-832ca49378e3 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] Start destroying the instance on the hypervisor. {{(pid=75066) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 19:47:48 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:47:48 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:47:48 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:47:48 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG nova.compute.manager [req-0a605942-216c-424c-bc38-a4d3b27f3ecf req-eb821d4d-1132-481d-a23c-76109e9cd9f1 service nova] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] Received event network-vif-unplugged-292167c1-237f-4f38-8034-ca9fd1feeab2 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-0a605942-216c-424c-bc38-a4d3b27f3ecf req-eb821d4d-1132-481d-a23c-76109e9cd9f1 service nova] Acquiring lock "c30efcab-a124-422b-ac6c-6c2efa3fb890-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-0a605942-216c-424c-bc38-a4d3b27f3ecf req-eb821d4d-1132-481d-a23c-76109e9cd9f1 service nova] Lock "c30efcab-a124-422b-ac6c-6c2efa3fb890-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-0a605942-216c-424c-bc38-a4d3b27f3ecf req-eb821d4d-1132-481d-a23c-76109e9cd9f1 service nova] Lock "c30efcab-a124-422b-ac6c-6c2efa3fb890-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG nova.compute.manager [req-0a605942-216c-424c-bc38-a4d3b27f3ecf req-eb821d4d-1132-481d-a23c-76109e9cd9f1 service nova] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] No waiting events found dispatching network-vif-unplugged-292167c1-237f-4f38-8034-ca9fd1feeab2 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG nova.compute.manager [req-0a605942-216c-424c-bc38-a4d3b27f3ecf req-eb821d4d-1132-481d-a23c-76109e9cd9f1 service nova] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] Received event network-vif-unplugged-292167c1-237f-4f38-8034-ca9fd1feeab2 for instance with task_state deleting. {{(pid=75066) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:47:49 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] Instance destroyed successfully.
Dec 01 19:47:49 user nova-compute[75066]: DEBUG nova.objects.instance [None req-f5b06e52-a3ed-408c-89ef-832ca49378e3 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lazy-loading 'resources' on Instance uuid c30efcab-a124-422b-ac6c-6c2efa3fb890 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-f5b06e52-a3ed-408c-89ef-832ca49378e3 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:45:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1792033231',display_name='tempest-TestVolumeBootPattern-server-1792033231',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1792033231',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:46:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ecd2a37ec7e4dbbbe53ed6ba9ff45bb',ramdisk_id='',reservation_id='r-o0fkhtuz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-384255364',owner_user_name='tempest-TestVolumeBootPattern-384255364-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:46:18Z,user_data=None,user_id='e30df6ccb83b4e8daaed0970c4b423d3',uuid=c30efcab-a124-422b-ac6c-6c2efa3fb890,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "292167c1-237f-4f38-8034-ca9fd1feeab2", "address": "fa:16:3e:59:02:fa", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap292167c1-23", "ovs_interfaceid": "292167c1-237f-4f38-8034-ca9fd1feeab2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-f5b06e52-a3ed-408c-89ef-832ca49378e3 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Converting VIF {"id": "292167c1-237f-4f38-8034-ca9fd1feeab2", "address": "fa:16:3e:59:02:fa", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap292167c1-23", "ovs_interfaceid": "292167c1-237f-4f38-8034-ca9fd1feeab2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-f5b06e52-a3ed-408c-89ef-832ca49378e3 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:02:fa,bridge_name='br-int',has_traffic_filtering=True,id=292167c1-237f-4f38-8034-ca9fd1feeab2,network=Network(2a39f486-871f-4115-88cb-176e846fe4f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap292167c1-23') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG os_vif [None req-f5b06e52-a3ed-408c-89ef-832ca49378e3 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:02:fa,bridge_name='br-int',has_traffic_filtering=True,id=292167c1-237f-4f38-8034-ca9fd1feeab2,network=Network(2a39f486-871f-4115-88cb-176e846fe4f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap292167c1-23') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap292167c1-23, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1168e0b6-135e-45fa-819c-199e1647a1c8) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:47:49 user nova-compute[75066]: INFO os_vif [None req-f5b06e52-a3ed-408c-89ef-832ca49378e3 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:02:fa,bridge_name='br-int',has_traffic_filtering=True,id=292167c1-237f-4f38-8034-ca9fd1feeab2,network=Network(2a39f486-871f-4115-88cb-176e846fe4f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap292167c1-23')
Dec 01 19:47:49 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5b06e52-a3ed-408c-89ef-832ca49378e3 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] calling os-brick to detach iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b06e52-a3ed-408c-89ef-832ca49378e3 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, {'target_iqn': 'iqn.2010-10.org.openstack:6bda792b-463b-4deb-8224-e891b63b09c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'Watpzbwg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:47:49 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-f5b06e52-a3ed-408c-89ef-832ca49378e3 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:47:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-f5b06e52-a3ed-408c-89ef-832ca49378e3 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-f5b06e52-a3ed-408c-89ef-832ca49378e3 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[d09661b7-f77e-4144-8440-379468d53b1d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6bda792b-463b-4deb-8224-e891b63b09c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b06e52-a3ed-408c-89ef-832ca49378e3 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 19:47:49 user nova-compute[75066]: No targets found.
Dec 01 19:47:49 user nova-compute[75066]: iSNS:
Dec 01 19:47:49 user nova-compute[75066]: No targets found.
Dec 01 19:47:49 user nova-compute[75066]: STATIC:
Dec 01 19:47:49 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:6bda792b-463b-4deb-8224-e891b63b09c4
Dec 01 19:47:49 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:47:49 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:47:49 user nova-compute[75066]: FIRMWARE:
Dec 01 19:47:49 user nova-compute[75066]: No targets found.
Dec 01 19:47:49 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b06e52-a3ed-408c-89ef-832ca49378e3 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 19:47:49 user nova-compute[75066]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 19:47:49 user nova-compute[75066]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75066) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b06e52-a3ed-408c-89ef-832ca49378e3 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6bda792b-463b-4deb-8224-e891b63b09c4', 0)] {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[80fb822f-5117-4b4a-944f-404d0a286893]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6bda792b-463b-4deb-8224-e891b63b09c4\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b6a686-80d4-423f-b41a-fbf782c6a2b7]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bda792b-463b-4deb-8224-e891b63b09c4 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b06e52-a3ed-408c-89ef-832ca49378e3 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bda792b-463b-4deb-8224-e891b63b09c4 (non-flash)
Dec 01 19:47:49 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b06e52-a3ed-408c-89ef-832ca49378e3 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bda792b-463b-4deb-8224-e891b63b09c4 (non-flash)
Dec 01 19:47:49 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b06e52-a3ed-408c-89ef-832ca49378e3 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91707f16c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6bda792b-463b-4deb-8224-e891b63b09c4'): ({'sdb'}, set())}) {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-f5b06e52-a3ed-408c-89ef-832ca49378e3 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Removing single pathed devices sdb {{(pid=75066) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[73cf1f9f-269e-4a5f-9d7f-fbbc2af3b72e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa08f2a9-076c-43c5-a7ba-4ab294a4552a]: (4, ('ok\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-f5b06e52-a3ed-408c-89ef-832ca49378e3 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Flushing IO for device /dev/sdb {{(pid=75066) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a13a9d-ccd8-418c-b017-2785b2037aa8]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-f5b06e52-a3ed-408c-89ef-832ca49378e3 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75066) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[39405357-8f9d-406b-880d-3c969687e3d0]: (4, ('1', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-f5b06e52-a3ed-408c-89ef-832ca49378e3 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-f5b06e52-a3ed-408c-89ef-832ca49378e3 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] SCSI volumes sdb have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26262666333393339', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_afde23fd', '/dev/disk/by-id/scsi-1SCST_BIOafde23fd-bbfc3939a01aca12') {{(pid=86136) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e2da17-d6fd-4837-953b-ecd0b4ffd585]: (4, None) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b06e52-a3ed-408c-89ef-832ca49378e3 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6bda792b-463b-4deb-8224-e891b63b09c4')] {{(pid=75066) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bda792b-463b-4deb-8224-e891b63b09c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bda792b-463b-4deb-8224-e891b63b09c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[5893b5c5-fab3-4ab9-8f83-2c83442bc0b7]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b06e52-a3ed-408c-89ef-832ca49378e3 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bda792b-463b-4deb-8224-e891b63b09c4 -p 172.16.0.220:3260 --logout {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bda792b-463b-4deb-8224-e891b63b09c4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb19c02-a50c-4b1b-bab5-9403e909276e]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:6bda792b-463b-4deb-8224-e891b63b09c4, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:6bda792b-463b-4deb-8224-e891b63b09c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b06e52-a3ed-408c-89ef-832ca49378e3 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:6bda792b-463b-4deb-8224-e891b63b09c4, portal: 172.16.0.220,3260]
Dec 01 19:47:49 user nova-compute[75066]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:6bda792b-463b-4deb-8224-e891b63b09c4, portal: 172.16.0.220,3260] successful.
Dec 01 19:47:49 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bda792b-463b-4deb-8224-e891b63b09c4 -p 172.16.0.220:3260 --op delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bda792b-463b-4deb-8224-e891b63b09c4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eba437d-d529-442a-9bf4-45e4d2bcadfc]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b06e52-a3ed-408c-89ef-832ca49378e3 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-f5b06e52-a3ed-408c-89ef-832ca49378e3 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5b06e52-a3ed-408c-89ef-832ca49378e3 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] <== disconnect_volume: return (295ms) None {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5b06e52-a3ed-408c-89ef-832ca49378e3 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] Disconnected iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 19:47:49 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-f5b06e52-a3ed-408c-89ef-832ca49378e3 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] Deleting instance files /opt/stack/data/nova/instances/c30efcab-a124-422b-ac6c-6c2efa3fb890_del
Dec 01 19:47:49 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-f5b06e52-a3ed-408c-89ef-832ca49378e3 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] Deletion of /opt/stack/data/nova/instances/c30efcab-a124-422b-ac6c-6c2efa3fb890_del complete
Dec 01 19:47:49 user nova-compute[75066]: INFO nova.compute.manager [None req-f5b06e52-a3ed-408c-89ef-832ca49378e3 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] Took 1.14 seconds to destroy the instance on the hypervisor.
Dec 01 19:47:49 user nova-compute[75066]: DEBUG oslo.service.loopingcall [None req-f5b06e52-a3ed-408c-89ef-832ca49378e3 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75066) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG nova.compute.manager [-] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] Deallocating network for instance {{(pid=75066) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 19:47:49 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] deallocate_for_instance() {{(pid=75066) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 19:47:50 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:47:50 user nova-compute[75066]: INFO nova.compute.manager [-] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] Took 0.46 seconds to deallocate network for instance.
Dec 01 19:47:50 user nova-compute[75066]: DEBUG nova.compute.manager [req-193cf995-ef6e-4ff5-a569-af440e63ab2a req-e258370d-f6fa-41e3-b46d-ff4b94f99dc0 service nova] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] Received event network-vif-deleted-292167c1-237f-4f38-8034-ca9fd1feeab2 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:47:51 user nova-compute[75066]: DEBUG nova.compute.manager [req-33daa700-5517-4faf-b37d-3b2052bd962a req-f8cc404d-b1dd-4c55-a7c4-cac9f73badb6 service nova] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] Received event network-vif-plugged-292167c1-237f-4f38-8034-ca9fd1feeab2 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:47:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-33daa700-5517-4faf-b37d-3b2052bd962a req-f8cc404d-b1dd-4c55-a7c4-cac9f73badb6 service nova] Acquiring lock "c30efcab-a124-422b-ac6c-6c2efa3fb890-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:47:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-33daa700-5517-4faf-b37d-3b2052bd962a req-f8cc404d-b1dd-4c55-a7c4-cac9f73badb6 service nova] Lock "c30efcab-a124-422b-ac6c-6c2efa3fb890-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:47:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-33daa700-5517-4faf-b37d-3b2052bd962a req-f8cc404d-b1dd-4c55-a7c4-cac9f73badb6 service nova] Lock "c30efcab-a124-422b-ac6c-6c2efa3fb890-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:47:51 user nova-compute[75066]: DEBUG nova.compute.manager [req-33daa700-5517-4faf-b37d-3b2052bd962a req-f8cc404d-b1dd-4c55-a7c4-cac9f73badb6 service nova] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] No waiting events found dispatching network-vif-plugged-292167c1-237f-4f38-8034-ca9fd1feeab2 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:47:51 user nova-compute[75066]: WARNING nova.compute.manager [req-33daa700-5517-4faf-b37d-3b2052bd962a req-f8cc404d-b1dd-4c55-a7c4-cac9f73badb6 service nova] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] Received unexpected event network-vif-plugged-292167c1-237f-4f38-8034-ca9fd1feeab2 for instance with vm_state active and task_state deleting.
Dec 01 19:47:51 user nova-compute[75066]: INFO nova.compute.manager [None req-f5b06e52-a3ed-408c-89ef-832ca49378e3 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] Took 0.92 seconds to detach 1 volumes for instance.
Dec 01 19:47:51 user nova-compute[75066]: DEBUG nova.compute.manager [None req-f5b06e52-a3ed-408c-89ef-832ca49378e3 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: c30efcab-a124-422b-ac6c-6c2efa3fb890] Deleting volume: 6bda792b-463b-4deb-8224-e891b63b09c4 {{(pid=75066) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Dec 01 19:47:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-f5b06e52-a3ed-408c-89ef-832ca49378e3 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:47:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-f5b06e52-a3ed-408c-89ef-832ca49378e3 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:47:51 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-f5b06e52-a3ed-408c-89ef-832ca49378e3 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:47:51 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-f5b06e52-a3ed-408c-89ef-832ca49378e3 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:47:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-f5b06e52-a3ed-408c-89ef-832ca49378e3 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.138s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:47:51 user nova-compute[75066]: INFO nova.scheduler.client.report [None req-f5b06e52-a3ed-408c-89ef-832ca49378e3 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Deleted allocations for instance c30efcab-a124-422b-ac6c-6c2efa3fb890
Dec 01 19:47:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-f5b06e52-a3ed-408c-89ef-832ca49378e3 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "c30efcab-a124-422b-ac6c-6c2efa3fb890" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.936s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:47:53 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:47:54 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:47:56 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:47:59 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:48:04 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:48:09 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:48:14 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:48:18 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:48:19 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:48:19 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:48:19 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75066) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 19:48:19 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:48:19 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:48:19 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:48:23 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:48:23 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75066) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 19:48:24 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:48:25 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:48:27 user nova-compute[75066]: DEBUG nova.compute.manager [req-0f44eb71-3f9d-4d6f-99b3-ba6950dd7e87 req-3e0dd9f1-7a96-45e7-9b89-702cac756c23 service nova] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Received event network-changed-c47319de-ae0e-44ea-8525-80b61f9fdf6f {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:48:27 user nova-compute[75066]: DEBUG nova.compute.manager [req-0f44eb71-3f9d-4d6f-99b3-ba6950dd7e87 req-3e0dd9f1-7a96-45e7-9b89-702cac756c23 service nova] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Refreshing instance network info cache due to event network-changed-c47319de-ae0e-44ea-8525-80b61f9fdf6f. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:48:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-0f44eb71-3f9d-4d6f-99b3-ba6950dd7e87 req-3e0dd9f1-7a96-45e7-9b89-702cac756c23 service nova] Acquiring lock "refresh_cache-6ae34bf8-aa8b-45e7-8e90-408b524082bc" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:48:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-0f44eb71-3f9d-4d6f-99b3-ba6950dd7e87 req-3e0dd9f1-7a96-45e7-9b89-702cac756c23 service nova] Acquired lock "refresh_cache-6ae34bf8-aa8b-45e7-8e90-408b524082bc" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:48:27 user nova-compute[75066]: DEBUG nova.network.neutron [req-0f44eb71-3f9d-4d6f-99b3-ba6950dd7e87 req-3e0dd9f1-7a96-45e7-9b89-702cac756c23 service nova] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Refreshing network info cache for port c47319de-ae0e-44ea-8525-80b61f9fdf6f {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:48:27 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:48:27 user nova-compute[75066]: DEBUG nova.network.neutron [req-0f44eb71-3f9d-4d6f-99b3-ba6950dd7e87 req-3e0dd9f1-7a96-45e7-9b89-702cac756c23 service nova] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Updated VIF entry in instance network info cache for port c47319de-ae0e-44ea-8525-80b61f9fdf6f. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:48:27 user nova-compute[75066]: DEBUG nova.network.neutron [req-0f44eb71-3f9d-4d6f-99b3-ba6950dd7e87 req-3e0dd9f1-7a96-45e7-9b89-702cac756c23 service nova] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Updating instance_info_cache with network_info: [{"id": "c47319de-ae0e-44ea-8525-80b61f9fdf6f", "address": "fa:16:3e:22:49:95", "network": {"id": "955d6293-ede6-4cb4-8cee-0157dbad93ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-603640322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109097a30a40419092c74f4c7a695ce4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc47319de-ae", "ovs_interfaceid": "c47319de-ae0e-44ea-8525-80b61f9fdf6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:48:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-0f44eb71-3f9d-4d6f-99b3-ba6950dd7e87 req-3e0dd9f1-7a96-45e7-9b89-702cac756c23 service nova] Releasing lock "refresh_cache-6ae34bf8-aa8b-45e7-8e90-408b524082bc" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:48:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:48:29 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:48:29 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:48:29 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:48:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dd68dc0a-d65e-4729-a21e-87051099dc37 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Acquiring lock "6ae34bf8-aa8b-45e7-8e90-408b524082bc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:48:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dd68dc0a-d65e-4729-a21e-87051099dc37 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "6ae34bf8-aa8b-45e7-8e90-408b524082bc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:48:29 user nova-compute[75066]: DEBUG nova.objects.instance [None req-dd68dc0a-d65e-4729-a21e-87051099dc37 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lazy-loading 'flavor' on Instance uuid 6ae34bf8-aa8b-45e7-8e90-408b524082bc {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:48:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dd68dc0a-d65e-4729-a21e-87051099dc37 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "6ae34bf8-aa8b-45e7-8e90-408b524082bc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:48:30 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dd68dc0a-d65e-4729-a21e-87051099dc37 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Acquiring lock "6ae34bf8-aa8b-45e7-8e90-408b524082bc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:48:30 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dd68dc0a-d65e-4729-a21e-87051099dc37 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "6ae34bf8-aa8b-45e7-8e90-408b524082bc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:48:30 user nova-compute[75066]: INFO nova.compute.manager [None req-dd68dc0a-d65e-4729-a21e-87051099dc37 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Attaching volume 8265fcad-19c7-4269-87f7-9aee84b053e1 to /dev/vdb
Dec 01 19:48:30 user nova-compute[75066]: DEBUG os_brick.utils [None req-dd68dc0a-d65e-4729-a21e-87051099dc37 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:48:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:48:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:48:30 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0cbbed3-8a04-41fe-8f7f-016d57900174]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1959854982f\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:48:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:48:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:48:30 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[7911ca5f-bd0a-45a1-a607-1f1fee609ed4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:48:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:48:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:48:30 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[da073b2a-062d-47ac-9541-55083f569d34]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:48:30 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[f516f5d1-09a0-4654-99fe-b02970b2638c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:48:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-dd68dc0a-d65e-4729-a21e-87051099dc37 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Running cmd (subprocess): nvme version {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:48:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-dd68dc0a-d65e-4729-a21e-87051099dc37 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] 'nvme version' failed. Not Retrying. {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:48:30 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.nvmeof [None req-dd68dc0a-d65e-4729-a21e-87051099dc37 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] nvme not present on system {{(pid=75066) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 19:48:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:48:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:48:30 user nova-compute[75066]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 19:48:30 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[480ab00d-107b-4ae6-9318-7f5d0d4c8133]: (4, '') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:48:30 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-dd68dc0a-d65e-4729-a21e-87051099dc37 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75066) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 19:48:30 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-dd68dc0a-d65e-4729-a21e-87051099dc37 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 19:48:30 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-dd68dc0a-d65e-4729-a21e-87051099dc37 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] LIGHTOS: no hostnqn found. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 19:48:30 user nova-compute[75066]: DEBUG os_brick.utils [None req-dd68dc0a-d65e-4729-a21e-87051099dc37 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1959854982f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:48:30 user nova-compute[75066]: DEBUG nova.virt.block_device [None req-dd68dc0a-d65e-4729-a21e-87051099dc37 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Updating existing volume attachment record: fe81879f-1521-4b8c-bfed-e27334482f64 {{(pid=75066) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 19:48:33 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:48:33 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:48:33 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:48:33 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:48:33 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75066) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 19:48:33 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae34bf8-aa8b-45e7-8e90-408b524082bc/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:48:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:48:33 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae34bf8-aa8b-45e7-8e90-408b524082bc/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:48:33 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae34bf8-aa8b-45e7-8e90-408b524082bc/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:48:33 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ae34bf8-aa8b-45e7-8e90-408b524082bc/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:48:34 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:48:34 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:48:34 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Hypervisor/Node resource view: name=user free_ram=8983MB free_disk=24.894309997558594GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75066) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 19:48:34 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:48:34 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:48:34 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 6ae34bf8-aa8b-45e7-8e90-408b524082bc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:48:34 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 19:48:34 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 19:48:34 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:48:34 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:48:34 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Compute_service record updated for user:user {{(pid=75066) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 19:48:34 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.195s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:48:34 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:48:36 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:48:37 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:48:37 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Starting heal instance info cache {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 19:48:37 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "refresh_cache-6ae34bf8-aa8b-45e7-8e90-408b524082bc" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:48:37 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquired lock "refresh_cache-6ae34bf8-aa8b-45e7-8e90-408b524082bc" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:48:37 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Forcefully refreshing network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 19:48:37 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Updating instance_info_cache with network_info: [{"id": "c47319de-ae0e-44ea-8525-80b61f9fdf6f", "address": "fa:16:3e:22:49:95", "network": {"id": "955d6293-ede6-4cb4-8cee-0157dbad93ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-603640322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109097a30a40419092c74f4c7a695ce4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc47319de-ae", "ovs_interfaceid": "c47319de-ae0e-44ea-8525-80b61f9fdf6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:48:37 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Releasing lock "refresh_cache-6ae34bf8-aa8b-45e7-8e90-408b524082bc" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:48:37 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Updated the network info_cache for instance {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 19:48:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:48:39 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd68dc0a-d65e-4729-a21e-87051099dc37 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Calling os-brick to attach iSCSI Volume {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 19:48:39 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd68dc0a-d65e-4729-a21e-87051099dc37 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8265fcad-19c7-4269-87f7-9aee84b053e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UAIgYHJt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:48:39 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-dd68dc0a-d65e-4729-a21e-87051099dc37 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:48:39 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-dd68dc0a-d65e-4729-a21e-87051099dc37 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:48:39 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-dd68dc0a-d65e-4729-a21e-87051099dc37 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:48:39 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-dd68dc0a-d65e-4729-a21e-87051099dc37 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:48:39 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-dd68dc0a-d65e-4729-a21e-87051099dc37 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8265fcad-19c7-4269-87f7-9aee84b053e1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:48:39 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-dd68dc0a-d65e-4729-a21e-87051099dc37 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8265fcad-19c7-4269-87f7-9aee84b053e1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:48:39 user nova-compute[75066]: INFO os_brick.initiator.connectors.iscsi [None req-dd68dc0a-d65e-4729-a21e-87051099dc37 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 19:48:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8265fcad-19c7-4269-87f7-9aee84b053e1 -p 172.16.0.220:3260 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:48:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8265fcad-19c7-4269-87f7-9aee84b053e1 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:48:39 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d2754a-baf0-4a04-ab15-4acc16e9c6d4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:48:39 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd68dc0a-d65e-4729-a21e-87051099dc37 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 19:48:39 user nova-compute[75066]:  {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:48:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8265fcad-19c7-4269-87f7-9aee84b053e1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:48:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8265fcad-19c7-4269-87f7-9aee84b053e1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:48:39 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a4828c-93e6-473f-a177-de5000a4f34a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8265fcad-19c7-4269-87f7-9aee84b053e1] added\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:48:39 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd68dc0a-d65e-4729-a21e-87051099dc37 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8265fcad-19c7-4269-87f7-9aee84b053e1] added
Dec 01 19:48:39 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:48:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8265fcad-19c7-4269-87f7-9aee84b053e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:48:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8265fcad-19c7-4269-87f7-9aee84b053e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:48:39 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[63fa164b-ef86-4673-9f63-b370297b9f9e]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:48:39 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd68dc0a-d65e-4729-a21e-87051099dc37 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:48:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8265fcad-19c7-4269-87f7-9aee84b053e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:48:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8265fcad-19c7-4269-87f7-9aee84b053e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:48:39 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6dd3931-81e8-41dc-9d69-69a125bca713]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:48:39 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd68dc0a-d65e-4729-a21e-87051099dc37 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:48:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8265fcad-19c7-4269-87f7-9aee84b053e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UAIgYHJt {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:48:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8265fcad-19c7-4269-87f7-9aee84b053e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UAIgYHJt" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:48:39 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f23b0ef-77e3-4cc6-9fe0-b6fbfd136bdd]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:48:39 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd68dc0a-d65e-4729-a21e-87051099dc37 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UAIgYHJt'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:48:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8265fcad-19c7-4269-87f7-9aee84b053e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:48:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8265fcad-19c7-4269-87f7-9aee84b053e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:48:39 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3788788-82e2-48f5-a325-dcdc7aa74765]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:48:39 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd68dc0a-d65e-4729-a21e-87051099dc37 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:48:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:48:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:48:39 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[559f8a12-7736-4cf4-8083-e7df3648bce1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:48:39 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd68dc0a-d65e-4729-a21e-87051099dc37 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 01 19:48:39 user nova-compute[75066]:  {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:48:39 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd68dc0a-d65e-4729-a21e-87051099dc37 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 01 19:48:39 user nova-compute[75066]:  {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:48:39 user nova-compute[75066]: WARNING os_brick.initiator.connectors.iscsi [None req-dd68dc0a-d65e-4729-a21e-87051099dc37 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 01 19:48:39 user nova-compute[75066]: 
Dec 01 19:48:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8265fcad-19c7-4269-87f7-9aee84b053e1 -p 172.16.0.220:3260 --login {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:48:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8265fcad-19c7-4269-87f7-9aee84b053e1 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:48:39 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2a846a3-5818-4a56-b503-cb88bf93f714]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8265fcad-19c7-4269-87f7-9aee84b053e1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8265fcad-19c7-4269-87f7-9aee84b053e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:48:39 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd68dc0a-d65e-4729-a21e-87051099dc37 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8265fcad-19c7-4269-87f7-9aee84b053e1, portal: 172.16.0.220,3260]
Dec 01 19:48:39 user nova-compute[75066]: Login to [iface: default, target: iqn.2010-10.org.openstack:8265fcad-19c7-4269-87f7-9aee84b053e1, portal: 172.16.0.220,3260] successful.
Dec 01 19:48:39 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:48:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8265fcad-19c7-4269-87f7-9aee84b053e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:48:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8265fcad-19c7-4269-87f7-9aee84b053e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:48:39 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb66f67-2a89-4bc2-a8b4-b1bebe227483]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:48:39 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd68dc0a-d65e-4729-a21e-87051099dc37 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:48:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:48:39 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:48:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.235s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:48:39 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b396683-80c4-46e9-af7e-03228b0b7df9]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8265fcad-19c7-4269-87f7-9aee84b053e1 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:48:39 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd68dc0a-d65e-4729-a21e-87051099dc37 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8265fcad-19c7-4269-87f7-9aee84b053e1 (non-flash)
Dec 01 19:48:39 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:48:39 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd68dc0a-d65e-4729-a21e-87051099dc37 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8265fcad-19c7-4269-87f7-9aee84b053e1 (non-flash)
Dec 01 19:48:39 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:48:39 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-dd68dc0a-d65e-4729-a21e-87051099dc37 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8265fcad-19c7-4269-87f7-9aee84b053e1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.464s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:48:39 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd68dc0a-d65e-4729-a21e-87051099dc37 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Connected to 172.16.0.220:3260 {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 19:48:39 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-dd68dc0a-d65e-4729-a21e-87051099dc37 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=75066) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 19:48:39 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-dd68dc0a-d65e-4729-a21e-87051099dc37 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75066) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 19:48:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:48:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:48:39 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9b3e2b-344b-4833-b3ac-bbcbe8f4bf4f]: (4, ('- - 0', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:48:39 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-dd68dc0a-d65e-4729-a21e-87051099dc37 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:48:39 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd68dc0a-d65e-4729-a21e-87051099dc37 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8265fcad-19c7-4269-87f7-9aee84b053e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UAIgYHJt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 19:48:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-dd68dc0a-d65e-4729-a21e-87051099dc37 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.494s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:48:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dd68dc0a-d65e-4729-a21e-87051099dc37 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] <== connect_volume: return (1495ms) {'type': 'block', 'scsi_wwn': '23735393339613136', 'path': '/dev/sdb'} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:48:40 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dd68dc0a-d65e-4729-a21e-87051099dc37 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23735393339613136', 'path': '/dev/sdb'} {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 19:48:40 user nova-compute[75066]: DEBUG nova.objects.instance [None req-dd68dc0a-d65e-4729-a21e-87051099dc37 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lazy-loading 'flavor' on Instance uuid 6ae34bf8-aa8b-45e7-8e90-408b524082bc {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:48:40 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-dd68dc0a-d65e-4729-a21e-87051099dc37 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 19:48:40 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:48:40 user nova-compute[75066]:   <source dev="/dev/sdb"/>
Dec 01 19:48:40 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:48:40 user nova-compute[75066]:   <serial>8265fcad-19c7-4269-87f7-9aee84b053e1</serial>
Dec 01 19:48:40 user nova-compute[75066]: </disk>
Dec 01 19:48:40 user nova-compute[75066]:  {{(pid=75066) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 19:48:40 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-dd68dc0a-d65e-4729-a21e-87051099dc37 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:48:40 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-dd68dc0a-d65e-4729-a21e-87051099dc37 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:48:40 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-dd68dc0a-d65e-4729-a21e-87051099dc37 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] No VIF found with MAC fa:16:3e:22:49:95, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:48:41 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dd68dc0a-d65e-4729-a21e-87051099dc37 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "6ae34bf8-aa8b-45e7-8e90-408b524082bc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.006s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:48:42 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-1b0a72ad-ec10-4f51-a914-a42a95508d5c tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Acquiring lock "6ae34bf8-aa8b-45e7-8e90-408b524082bc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:48:42 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-1b0a72ad-ec10-4f51-a914-a42a95508d5c tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "6ae34bf8-aa8b-45e7-8e90-408b524082bc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:48:42 user nova-compute[75066]: INFO nova.compute.manager [None req-1b0a72ad-ec10-4f51-a914-a42a95508d5c tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Detaching volume 8265fcad-19c7-4269-87f7-9aee84b053e1
Dec 01 19:48:42 user nova-compute[75066]: INFO nova.virt.block_device [None req-1b0a72ad-ec10-4f51-a914-a42a95508d5c tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Attempting to driver detach volume 8265fcad-19c7-4269-87f7-9aee84b053e1 from mountpoint /dev/vdb
Dec 01 19:48:42 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-1b0a72ad-ec10-4f51-a914-a42a95508d5c tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Attempting to detach device vdb from instance 6ae34bf8-aa8b-45e7-8e90-408b524082bc from the persistent domain config. {{(pid=75066) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 19:48:42 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-1b0a72ad-ec10-4f51-a914-a42a95508d5c tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 19:48:42 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:48:42 user nova-compute[75066]:   <source dev="/dev/sdb"/>
Dec 01 19:48:42 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:48:42 user nova-compute[75066]:   <serial>8265fcad-19c7-4269-87f7-9aee84b053e1</serial>
Dec 01 19:48:42 user nova-compute[75066]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 19:48:42 user nova-compute[75066]: </disk>
Dec 01 19:48:42 user nova-compute[75066]:  {{(pid=75066) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 19:48:42 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-1b0a72ad-ec10-4f51-a914-a42a95508d5c tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Successfully detached device vdb from instance 6ae34bf8-aa8b-45e7-8e90-408b524082bc from the persistent domain config.
Dec 01 19:48:42 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-1b0a72ad-ec10-4f51-a914-a42a95508d5c tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6ae34bf8-aa8b-45e7-8e90-408b524082bc from the live domain config. {{(pid=75066) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 19:48:42 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-1b0a72ad-ec10-4f51-a914-a42a95508d5c tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 19:48:42 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:48:42 user nova-compute[75066]:   <source dev="/dev/sdb"/>
Dec 01 19:48:42 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:48:42 user nova-compute[75066]:   <serial>8265fcad-19c7-4269-87f7-9aee84b053e1</serial>
Dec 01 19:48:42 user nova-compute[75066]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 19:48:42 user nova-compute[75066]: </disk>
Dec 01 19:48:42 user nova-compute[75066]:  {{(pid=75066) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 19:48:42 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-1b0a72ad-ec10-4f51-a914-a42a95508d5c tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6ae34bf8-aa8b-45e7-8e90-408b524082bc {{(pid=75066) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 19:48:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:48:44 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:48:49 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:48:54 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:48:55 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:48:57 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Acquiring lock "b27c80e9-9e75-41b2-b380-5cd86538f0c4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:48:57 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "b27c80e9-9e75-41b2-b380-5cd86538f0c4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:48:57 user nova-compute[75066]: DEBUG nova.compute.manager [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Starting instance... {{(pid=75066) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 19:48:57 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:48:57 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:48:57 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75066) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 19:48:57 user nova-compute[75066]: INFO nova.compute.claims [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Claim successful on node user
Dec 01 19:48:57 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:48:57 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:48:57 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.222s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:48:57 user nova-compute[75066]: DEBUG nova.compute.manager [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Start building networks asynchronously for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 19:48:57 user nova-compute[75066]: DEBUG nova.compute.manager [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Allocating IP information in the background. {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 19:48:57 user nova-compute[75066]: DEBUG nova.network.neutron [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] allocate_for_instance() {{(pid=75066) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 19:48:57 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 19:48:57 user nova-compute[75066]: DEBUG nova.compute.manager [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Start building block device mappings for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 19:48:58 user nova-compute[75066]: DEBUG nova.policy [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e30df6ccb83b4e8daaed0970c4b423d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecd2a37ec7e4dbbbe53ed6ba9ff45bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75066) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 19:48:58 user nova-compute[75066]: INFO nova.virt.block_device [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Booting with volume e425ec76-d0d3-4d82-ab8c-3990c9f5656a at /dev/vda
Dec 01 19:48:58 user nova-compute[75066]: DEBUG os_brick.utils [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:48:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:48:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:48:58 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[82163f0f-e8ee-418c-adf6-8620ef590e09]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1959854982f\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:48:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:48:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:48:58 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fda957f-6d7c-4cac-b40d-fb7c6f1d7e01]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:48:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:48:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:48:58 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[4291bc0f-7d87-44e5-aada-2db046276fd3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:48:58 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9e60b4-4010-43c5-8dd4-3c4dc22920b8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:48:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Running cmd (subprocess): nvme version {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:48:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] 'nvme version' failed. Not Retrying. {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:48:58 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] nvme not present on system {{(pid=75066) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 19:48:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:48:58 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:48:58 user nova-compute[75066]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 19:48:58 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[17fa9839-2e5e-4c43-beb5-1ff9a45f5a0d]: (4, '') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:48:58 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75066) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 19:48:58 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 19:48:58 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] LIGHTOS: no hostnqn found. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 19:48:58 user nova-compute[75066]: DEBUG os_brick.utils [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1959854982f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:48:58 user nova-compute[75066]: DEBUG nova.virt.block_device [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Updating existing volume attachment record: 611b5ae2-da9f-4870-8651-4243e8cb13fe {{(pid=75066) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 19:48:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:48:58 user nova-compute[75066]: DEBUG nova.network.neutron [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Successfully created port: 3e2fc190-28ce-414b-b435-820607838b7b {{(pid=75066) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 19:48:59 user nova-compute[75066]: DEBUG nova.network.neutron [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Successfully updated port: 3e2fc190-28ce-414b-b435-820607838b7b {{(pid=75066) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 19:48:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Acquiring lock "refresh_cache-b27c80e9-9e75-41b2-b380-5cd86538f0c4" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:48:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Acquired lock "refresh_cache-b27c80e9-9e75-41b2-b380-5cd86538f0c4" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:48:59 user nova-compute[75066]: DEBUG nova.network.neutron [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:48:59 user nova-compute[75066]: DEBUG nova.compute.manager [req-24bce98e-2b90-4917-9b3a-9ad40fa91c23 req-b14b9fb8-b225-4481-ab12-5452a2133c36 service nova] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Received event network-changed-3e2fc190-28ce-414b-b435-820607838b7b {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:48:59 user nova-compute[75066]: DEBUG nova.compute.manager [req-24bce98e-2b90-4917-9b3a-9ad40fa91c23 req-b14b9fb8-b225-4481-ab12-5452a2133c36 service nova] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Refreshing instance network info cache due to event network-changed-3e2fc190-28ce-414b-b435-820607838b7b. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:48:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-24bce98e-2b90-4917-9b3a-9ad40fa91c23 req-b14b9fb8-b225-4481-ab12-5452a2133c36 service nova] Acquiring lock "refresh_cache-b27c80e9-9e75-41b2-b380-5cd86538f0c4" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:48:59 user nova-compute[75066]: DEBUG nova.network.neutron [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:48:59 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:48:59 user nova-compute[75066]: DEBUG nova.network.neutron [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Updating instance_info_cache with network_info: [{"id": "3e2fc190-28ce-414b-b435-820607838b7b", "address": "fa:16:3e:46:86:fd", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e2fc190-28", "ovs_interfaceid": "3e2fc190-28ce-414b-b435-820607838b7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:48:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Releasing lock "refresh_cache-b27c80e9-9e75-41b2-b380-5cd86538f0c4" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:48:59 user nova-compute[75066]: DEBUG nova.compute.manager [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Instance network_info: |[{"id": "3e2fc190-28ce-414b-b435-820607838b7b", "address": "fa:16:3e:46:86:fd", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e2fc190-28", "ovs_interfaceid": "3e2fc190-28ce-414b-b435-820607838b7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 19:48:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-24bce98e-2b90-4917-9b3a-9ad40fa91c23 req-b14b9fb8-b225-4481-ab12-5452a2133c36 service nova] Acquired lock "refresh_cache-b27c80e9-9e75-41b2-b380-5cd86538f0c4" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:48:59 user nova-compute[75066]: DEBUG nova.network.neutron [req-24bce98e-2b90-4917-9b3a-9ad40fa91c23 req-b14b9fb8-b225-4481-ab12-5452a2133c36 service nova] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Refreshing network info cache for port 3e2fc190-28ce-414b-b435-820607838b7b {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:49:00 user nova-compute[75066]: DEBUG nova.network.neutron [req-24bce98e-2b90-4917-9b3a-9ad40fa91c23 req-b14b9fb8-b225-4481-ab12-5452a2133c36 service nova] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Updated VIF entry in instance network info cache for port 3e2fc190-28ce-414b-b435-820607838b7b. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:49:00 user nova-compute[75066]: DEBUG nova.network.neutron [req-24bce98e-2b90-4917-9b3a-9ad40fa91c23 req-b14b9fb8-b225-4481-ab12-5452a2133c36 service nova] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Updating instance_info_cache with network_info: [{"id": "3e2fc190-28ce-414b-b435-820607838b7b", "address": "fa:16:3e:46:86:fd", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e2fc190-28", "ovs_interfaceid": "3e2fc190-28ce-414b-b435-820607838b7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:49:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-24bce98e-2b90-4917-9b3a-9ad40fa91c23 req-b14b9fb8-b225-4481-ab12-5452a2133c36 service nova] Releasing lock "refresh_cache-b27c80e9-9e75-41b2-b380-5cd86538f0c4" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:49:02 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-1b0a72ad-ec10-4f51-a914-a42a95508d5c tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 6ae34bf8-aa8b-45e7-8e90-408b524082bc is timed out.
Dec 01 19:49:02 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-1b0a72ad-ec10-4f51-a914-a42a95508d5c tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Successfully detached device vdb from instance 6ae34bf8-aa8b-45e7-8e90-408b524082bc from the live domain config.
Dec 01 19:49:02 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b0a72ad-ec10-4f51-a914-a42a95508d5c tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] calling os-brick to detach iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 19:49:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b0a72ad-ec10-4f51-a914-a42a95508d5c tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, {'target_iqn': 'iqn.2010-10.org.openstack:8265fcad-19c7-4269-87f7-9aee84b053e1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UAIgYHJt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:49:02 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-1b0a72ad-ec10-4f51-a914-a42a95508d5c tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:49:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-1b0a72ad-ec10-4f51-a914-a42a95508d5c tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:49:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-1b0a72ad-ec10-4f51-a914-a42a95508d5c tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:49:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:49:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:49:02 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b442b47-b84f-47fe-ad1f-0e223ac9be69]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8265fcad-19c7-4269-87f7-9aee84b053e1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:49:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b0a72ad-ec10-4f51-a914-a42a95508d5c tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 19:49:02 user nova-compute[75066]: No targets found.
Dec 01 19:49:02 user nova-compute[75066]: iSNS:
Dec 01 19:49:02 user nova-compute[75066]: No targets found.
Dec 01 19:49:02 user nova-compute[75066]: STATIC:
Dec 01 19:49:02 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:8265fcad-19c7-4269-87f7-9aee84b053e1
Dec 01 19:49:02 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:49:02 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:49:02 user nova-compute[75066]: FIRMWARE:
Dec 01 19:49:02 user nova-compute[75066]: No targets found.
Dec 01 19:49:02 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:49:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b0a72ad-ec10-4f51-a914-a42a95508d5c tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 19:49:02 user nova-compute[75066]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 19:49:02 user nova-compute[75066]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75066) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 19:49:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b0a72ad-ec10-4f51-a914-a42a95508d5c tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8265fcad-19c7-4269-87f7-9aee84b053e1', 0)] {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 19:49:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:49:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:49:02 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d39e52-fde9-43cf-953a-6dc6648f403f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8265fcad-19c7-4269-87f7-9aee84b053e1\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:49:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:49:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:49:02 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5952170-de48-48db-a422-46cf7436b37c]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8265fcad-19c7-4269-87f7-9aee84b053e1 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:49:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b0a72ad-ec10-4f51-a914-a42a95508d5c tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8265fcad-19c7-4269-87f7-9aee84b053e1 (non-flash)
Dec 01 19:49:02 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:49:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b0a72ad-ec10-4f51-a914-a42a95508d5c tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8265fcad-19c7-4269-87f7-9aee84b053e1 (non-flash)
Dec 01 19:49:02 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:49:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b0a72ad-ec10-4f51-a914-a42a95508d5c tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91a01135b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8265fcad-19c7-4269-87f7-9aee84b053e1'): ({'sdb'}, set())}) {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 19:49:02 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-1b0a72ad-ec10-4f51-a914-a42a95508d5c tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Removing single pathed devices sdb {{(pid=75066) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 19:49:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:49:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:49:02 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82d4fbf-4b01-48f0-9bb1-d5f69b1f7c6e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:49:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:49:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:49:02 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[38bdfa34-5ce7-43c3-9c5a-a8d029f919a1]: (4, ('ok\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:49:02 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-1b0a72ad-ec10-4f51-a914-a42a95508d5c tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Flushing IO for device /dev/sdb {{(pid=75066) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 19:49:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:49:03 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:49:03 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc82ecff-525b-406c-8c6a-98eff623e045]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:49:03 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-1b0a72ad-ec10-4f51-a914-a42a95508d5c tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75066) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 19:49:03 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:49:03 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:49:03 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eeb8b12-61df-4eb2-95f9-50e69e15aac3]: (4, ('1', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:49:03 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-1b0a72ad-ec10-4f51-a914-a42a95508d5c tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 19:49:03 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-1b0a72ad-ec10-4f51-a914-a42a95508d5c tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] SCSI volumes sdb have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 19:49:03 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b0a72ad-ec10-4f51-a914-a42a95508d5c tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8265fcad-19c7-4269-87f7-9aee84b053e1')] {{(pid=75066) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 19:49:03 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8265fcad-19c7-4269-87f7-9aee84b053e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:49:03 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8265fcad-19c7-4269-87f7-9aee84b053e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:49:03 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed6585e-8323-4c3f-8306-08f40f815f6d]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:49:03 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b0a72ad-ec10-4f51-a914-a42a95508d5c tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:49:03 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8265fcad-19c7-4269-87f7-9aee84b053e1 -p 172.16.0.220:3260 --logout {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:49:03 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8265fcad-19c7-4269-87f7-9aee84b053e1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:49:03 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[774a8ca8-f0b9-4a7e-b18a-5fbe13f13fa2]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:8265fcad-19c7-4269-87f7-9aee84b053e1, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:8265fcad-19c7-4269-87f7-9aee84b053e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:49:03 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b0a72ad-ec10-4f51-a914-a42a95508d5c tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:8265fcad-19c7-4269-87f7-9aee84b053e1, portal: 172.16.0.220,3260]
Dec 01 19:49:03 user nova-compute[75066]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:8265fcad-19c7-4269-87f7-9aee84b053e1, portal: 172.16.0.220,3260] successful.
Dec 01 19:49:03 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:49:03 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8265fcad-19c7-4269-87f7-9aee84b053e1 -p 172.16.0.220:3260 --op delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:49:03 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8265fcad-19c7-4269-87f7-9aee84b053e1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:49:03 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[9acae391-5ed1-442d-9a47-5bf033abcc08]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:49:03 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b0a72ad-ec10-4f51-a914-a42a95508d5c tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:49:03 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-1b0a72ad-ec10-4f51-a914-a42a95508d5c tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:49:03 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b0a72ad-ec10-4f51-a914-a42a95508d5c tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] <== disconnect_volume: return (286ms) None {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:49:03 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b0a72ad-ec10-4f51-a914-a42a95508d5c tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Disconnected iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 19:49:03 user nova-compute[75066]: DEBUG nova.objects.instance [None req-1b0a72ad-ec10-4f51-a914-a42a95508d5c tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lazy-loading 'flavor' on Instance uuid 6ae34bf8-aa8b-45e7-8e90-408b524082bc {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:49:04 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-1b0a72ad-ec10-4f51-a914-a42a95508d5c tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "6ae34bf8-aa8b-45e7-8e90-408b524082bc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.733s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:49:04 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG nova.compute.manager [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Start spawning the instance on the hypervisor. {{(pid=75066) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Creating instance directory {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 19:49:07 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Creating image(s)
Dec 01 19:49:07 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Did not create local disks {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Ensure instance console log exists: /opt/stack/data/nova/instances/b27c80e9-9e75-41b2-b380-5cd86538f0c4/console.log {{(pid=75066) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Start _get_guest_xml network_info=[{"id": "3e2fc190-28ce-414b-b435-820607838b7b", "address": "fa:16:3e:46:86:fd", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e2fc190-28", "ovs_interfaceid": "3e2fc190-28ce-414b-b435-820607838b7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': True, 'attachment_id': '611b5ae2-da9f-4870-8651-4243e8cb13fe', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QcORGDko', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b27c80e9-9e75-41b2-b380-5cd86538f0c4', 'attached_at': '', 'detached_at': '', 'volume_id': 'e425ec76-d0d3-4d82-ab8c-3990c9f5656a', 'serial': 'e425ec76-d0d3-4d82-ab8c-3990c9f5656a'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:49:07 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:49:07 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:49:07 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Calling os-brick to attach iSCSI Volume {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QcORGDko', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:49:07 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:49:07 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:49:07 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:49:07 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:49:07 user nova-compute[75066]: INFO os_brick.initiator.connectors.iscsi [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 19:49:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a -p 172.16.0.220:3260 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[af994d0a-8cd1-4089-98fb-fc8dc70fda39]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 19:49:07 user nova-compute[75066]:  {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a -p 172.16.0.220:3260 --interface default --op new {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[83af6131-ae09-42a5-8e35-52638d0d2e5a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a] added\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a] added
Dec 01 19:49:07 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[329b25c5-681b-4966-a3fc-392e5786735d]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a35500c-5cbd-4c21-84f7-1b15bf488367]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QcORGDko {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QcORGDko" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[749cb004-3e9f-4ac3-9bb6-7dabbc3e5928]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QcORGDko'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d397f4-411a-4763-a5db-ab249efda185]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[935d4449-ce52-41f5-b772-bb92df3d2d28]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 01 19:49:07 user nova-compute[75066]:  {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 01 19:49:07 user nova-compute[75066]:  {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:49:07 user nova-compute[75066]: WARNING os_brick.initiator.connectors.iscsi [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 01 19:49:07 user nova-compute[75066]: 
Dec 01 19:49:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a -p 172.16.0.220:3260 --login {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4c405a-438a-4afb-be9c-37c0227c264c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a, portal: 172.16.0.220,3260]
Dec 01 19:49:07 user nova-compute[75066]: Login to [iface: default, target: iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a, portal: 172.16.0.220,3260] successful.
Dec 01 19:49:07 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[8738c254-a569-4385-b68c-b70348340f16]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8b9c6e-00b5-461a-a494-9776bbcc5df9]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a (non-flash)
Dec 01 19:49:07 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a (non-flash)
Dec 01 19:49:07 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.246s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Connected to 172.16.0.220:3260 {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=75066) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75066) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa8bf2a-3f8c-442c-a9be-2d5eff00ac6d]: (4, ('- - 0', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:49:07 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QcORGDko', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 19:49:08 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.276s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:49:08 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] <== connect_volume: return (1279ms) {'type': 'block', 'scsi_wwn': '26466383464373838', 'path': '/dev/sdb'} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:49:08 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26466383464373838', 'path': '/dev/sdb'} {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 19:49:08 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:48:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-2046517075',display_name='tempest-TestVolumeBootPattern-volume-backed-server-2046517075',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-2046517075',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG9rXlSO1UXyabMJnKDKZHq/S13abZZnNzd3QmPYLZ3b44Dud48Q9ixo5LKAwDNhAFmz8fqbxF9rDCE8tA7HrLoH//BBg5YsAQYaPsEjD/pOmltDxCRekowJasf+5v7IXw==',key_name='tempest-keypair-1116839330',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ecd2a37ec7e4dbbbe53ed6ba9ff45bb',ramdisk_id='',reservation_id='r-7bgokvad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-384255364',owner_user_name='tempest-TestVolumeBootPattern-384255364-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:48:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e30df6ccb83b4e8daaed0970c4b423d3',uuid=b27c80e9-9e75-41b2-b380-5cd86538f0c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e2fc190-28ce-414b-b435-820607838b7b", "address": "fa:16:3e:46:86:fd", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e2fc190-28", "ovs_interfaceid": "3e2fc190-28ce-414b-b435-820607838b7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:49:08 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Converting VIF {"id": "3e2fc190-28ce-414b-b435-820607838b7b", "address": "fa:16:3e:46:86:fd", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e2fc190-28", "ovs_interfaceid": "3e2fc190-28ce-414b-b435-820607838b7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:49:08 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:86:fd,bridge_name='br-int',has_traffic_filtering=True,id=3e2fc190-28ce-414b-b435-820607838b7b,network=Network(2a39f486-871f-4115-88cb-176e846fe4f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e2fc190-28') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:49:08 user nova-compute[75066]: DEBUG nova.objects.instance [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lazy-loading 'pci_devices' on Instance uuid b27c80e9-9e75-41b2-b380-5cd86538f0c4 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:49:08 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:49:08 user nova-compute[75066]:   <uuid>b27c80e9-9e75-41b2-b380-5cd86538f0c4</uuid>
Dec 01 19:49:08 user nova-compute[75066]:   <name>instance-0000002e</name>
Dec 01 19:49:08 user nova-compute[75066]:   <memory>524288</memory>
Dec 01 19:49:08 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:49:08 user nova-compute[75066]:   <metadata>
Dec 01 19:49:08 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:49:08 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:49:08 user nova-compute[75066]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-2046517075</nova:name>
Dec 01 19:49:08 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:49:07</nova:creationTime>
Dec 01 19:49:08 user nova-compute[75066]:       <nova:flavor name="m1.tiny">
Dec 01 19:49:08 user nova-compute[75066]:         <nova:memory>512</nova:memory>
Dec 01 19:49:08 user nova-compute[75066]:         <nova:disk>1</nova:disk>
Dec 01 19:49:08 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:49:08 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:49:08 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:49:08 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:49:08 user nova-compute[75066]:       <nova:owner>
Dec 01 19:49:08 user nova-compute[75066]:         <nova:user uuid="e30df6ccb83b4e8daaed0970c4b423d3">tempest-TestVolumeBootPattern-384255364-project-member</nova:user>
Dec 01 19:49:08 user nova-compute[75066]:         <nova:project uuid="9ecd2a37ec7e4dbbbe53ed6ba9ff45bb">tempest-TestVolumeBootPattern-384255364</nova:project>
Dec 01 19:49:08 user nova-compute[75066]:       </nova:owner>
Dec 01 19:49:08 user nova-compute[75066]:       <nova:ports>
Dec 01 19:49:08 user nova-compute[75066]:         <nova:port uuid="3e2fc190-28ce-414b-b435-820607838b7b">
Dec 01 19:49:08 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Dec 01 19:49:08 user nova-compute[75066]:         </nova:port>
Dec 01 19:49:08 user nova-compute[75066]:       </nova:ports>
Dec 01 19:49:08 user nova-compute[75066]:     </nova:instance>
Dec 01 19:49:08 user nova-compute[75066]:   </metadata>
Dec 01 19:49:08 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:49:08 user nova-compute[75066]:     <system>
Dec 01 19:49:08 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:49:08 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:49:08 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:49:08 user nova-compute[75066]:       <entry name="serial">b27c80e9-9e75-41b2-b380-5cd86538f0c4</entry>
Dec 01 19:49:08 user nova-compute[75066]:       <entry name="uuid">b27c80e9-9e75-41b2-b380-5cd86538f0c4</entry>
Dec 01 19:49:08 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:49:08 user nova-compute[75066]:     </system>
Dec 01 19:49:08 user nova-compute[75066]:   </sysinfo>
Dec 01 19:49:08 user nova-compute[75066]:   <os>
Dec 01 19:49:08 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:49:08 user nova-compute[75066]:     <boot dev="hd"/>
Dec 01 19:49:08 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:49:08 user nova-compute[75066]:   </os>
Dec 01 19:49:08 user nova-compute[75066]:   <features>
Dec 01 19:49:08 user nova-compute[75066]:     <acpi/>
Dec 01 19:49:08 user nova-compute[75066]:     <apic/>
Dec 01 19:49:08 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:49:08 user nova-compute[75066]:   </features>
Dec 01 19:49:08 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:49:08 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:49:08 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:49:08 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:49:08 user nova-compute[75066]:   </clock>
Dec 01 19:49:08 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:49:08 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:49:08 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:49:08 user nova-compute[75066]:   </cpu>
Dec 01 19:49:08 user nova-compute[75066]:   <devices>
Dec 01 19:49:08 user nova-compute[75066]:     <disk type="block" device="disk">
Dec 01 19:49:08 user nova-compute[75066]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:49:08 user nova-compute[75066]:       <source dev="/dev/sdb"/>
Dec 01 19:49:08 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:49:08 user nova-compute[75066]:       <serial>e425ec76-d0d3-4d82-ab8c-3990c9f5656a</serial>
Dec 01 19:49:08 user nova-compute[75066]:     </disk>
Dec 01 19:49:08 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:49:08 user nova-compute[75066]:       <mac address="fa:16:3e:46:86:fd"/>
Dec 01 19:49:08 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:49:08 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:49:08 user nova-compute[75066]:       <target dev="tap3e2fc190-28"/>
Dec 01 19:49:08 user nova-compute[75066]:     </interface>
Dec 01 19:49:08 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:49:08 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/b27c80e9-9e75-41b2-b380-5cd86538f0c4/console.log" append="off"/>
Dec 01 19:49:08 user nova-compute[75066]:     </serial>
Dec 01 19:49:08 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:49:08 user nova-compute[75066]:     <video>
Dec 01 19:49:08 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:49:08 user nova-compute[75066]:     </video>
Dec 01 19:49:08 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:49:08 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:49:08 user nova-compute[75066]:     </rng>
Dec 01 19:49:08 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:49:08 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:49:08 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:49:08 user nova-compute[75066]:     </memballoon>
Dec 01 19:49:08 user nova-compute[75066]:   </devices>
Dec 01 19:49:08 user nova-compute[75066]: </domain>
Dec 01 19:49:08 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:49:08 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:48:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-2046517075',display_name='tempest-TestVolumeBootPattern-volume-backed-server-2046517075',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-2046517075',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG9rXlSO1UXyabMJnKDKZHq/S13abZZnNzd3QmPYLZ3b44Dud48Q9ixo5LKAwDNhAFmz8fqbxF9rDCE8tA7HrLoH//BBg5YsAQYaPsEjD/pOmltDxCRekowJasf+5v7IXw==',key_name='tempest-keypair-1116839330',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ecd2a37ec7e4dbbbe53ed6ba9ff45bb',ramdisk_id='',reservation_id='r-7bgokvad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-384255364',owner_user_name='tempest-TestVolumeBootPattern-384255364-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:48:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e30df6ccb83b4e8daaed0970c4b423d3',uuid=b27c80e9-9e75-41b2-b380-5cd86538f0c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e2fc190-28ce-414b-b435-820607838b7b", "address": "fa:16:3e:46:86:fd", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e2fc190-28", "ovs_interfaceid": "3e2fc190-28ce-414b-b435-820607838b7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:49:08 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Converting VIF {"id": "3e2fc190-28ce-414b-b435-820607838b7b", "address": "fa:16:3e:46:86:fd", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e2fc190-28", "ovs_interfaceid": "3e2fc190-28ce-414b-b435-820607838b7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:49:08 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:86:fd,bridge_name='br-int',has_traffic_filtering=True,id=3e2fc190-28ce-414b-b435-820607838b7b,network=Network(2a39f486-871f-4115-88cb-176e846fe4f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e2fc190-28') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:49:08 user nova-compute[75066]: DEBUG os_vif [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:86:fd,bridge_name='br-int',has_traffic_filtering=True,id=3e2fc190-28ce-414b-b435-820607838b7b,network=Network(2a39f486-871f-4115-88cb-176e846fe4f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e2fc190-28') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:49:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:49:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:49:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:49:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:49:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ba7205d6-34d9-54d3-9fe0-d5001cc141dc', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:49:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:49:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:49:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3e2fc190-28, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:49:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3e2fc190-28, col_values=(('qos', UUID('fcde8ecf-3f83-416f-a881-6193d87d55d7')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:49:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3e2fc190-28, col_values=(('external_ids', {'iface-id': '3e2fc190-28ce-414b-b435-820607838b7b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:86:fd', 'vm-uuid': 'b27c80e9-9e75-41b2-b380-5cd86538f0c4'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:49:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:49:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:49:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:49:08 user nova-compute[75066]: INFO os_vif [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:86:fd,bridge_name='br-int',has_traffic_filtering=True,id=3e2fc190-28ce-414b-b435-820607838b7b,network=Network(2a39f486-871f-4115-88cb-176e846fe4f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e2fc190-28')
Dec 01 19:49:08 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:49:08 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] No VIF found with MAC fa:16:3e:46:86:fd, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:49:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:49:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:49:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:49:10 user nova-compute[75066]: DEBUG nova.compute.manager [req-d74c4259-6a55-4c65-ade9-f5f296088b91 req-61bd8f05-7a93-4be3-a8b4-553427f24348 service nova] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Received event network-vif-plugged-3e2fc190-28ce-414b-b435-820607838b7b {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:49:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d74c4259-6a55-4c65-ade9-f5f296088b91 req-61bd8f05-7a93-4be3-a8b4-553427f24348 service nova] Acquiring lock "b27c80e9-9e75-41b2-b380-5cd86538f0c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:49:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d74c4259-6a55-4c65-ade9-f5f296088b91 req-61bd8f05-7a93-4be3-a8b4-553427f24348 service nova] Lock "b27c80e9-9e75-41b2-b380-5cd86538f0c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:49:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d74c4259-6a55-4c65-ade9-f5f296088b91 req-61bd8f05-7a93-4be3-a8b4-553427f24348 service nova] Lock "b27c80e9-9e75-41b2-b380-5cd86538f0c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:49:10 user nova-compute[75066]: DEBUG nova.compute.manager [req-d74c4259-6a55-4c65-ade9-f5f296088b91 req-61bd8f05-7a93-4be3-a8b4-553427f24348 service nova] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] No waiting events found dispatching network-vif-plugged-3e2fc190-28ce-414b-b435-820607838b7b {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:49:10 user nova-compute[75066]: WARNING nova.compute.manager [req-d74c4259-6a55-4c65-ade9-f5f296088b91 req-61bd8f05-7a93-4be3-a8b4-553427f24348 service nova] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Received unexpected event network-vif-plugged-3e2fc190-28ce-414b-b435-820607838b7b for instance with vm_state building and task_state spawning.
Dec 01 19:49:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:49:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:49:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:49:12 user nova-compute[75066]: DEBUG nova.compute.manager [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Instance event wait completed in 0 seconds for  {{(pid=75066) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 19:49:12 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Guest created on hypervisor {{(pid=75066) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 19:49:12 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Instance spawned successfully.
Dec 01 19:49:12 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 19:49:12 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Found default for hw_cdrom_bus of ide {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:49:12 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Found default for hw_disk_bus of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:49:12 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Found default for hw_input_bus of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:49:12 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Found default for hw_pointer_model of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:49:12 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Found default for hw_video_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:49:12 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Found default for hw_vif_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:49:12 user nova-compute[75066]: INFO nova.compute.manager [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Took 4.86 seconds to spawn the instance on the hypervisor.
Dec 01 19:49:12 user nova-compute[75066]: DEBUG nova.compute.manager [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:49:12 user nova-compute[75066]: DEBUG nova.compute.manager [req-0318adf6-dc3a-42ea-baf7-d2cb51e4451a req-6f941d5c-cf19-4087-876f-0d3a12a59748 service nova] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Received event network-vif-plugged-3e2fc190-28ce-414b-b435-820607838b7b {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:49:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-0318adf6-dc3a-42ea-baf7-d2cb51e4451a req-6f941d5c-cf19-4087-876f-0d3a12a59748 service nova] Acquiring lock "b27c80e9-9e75-41b2-b380-5cd86538f0c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:49:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-0318adf6-dc3a-42ea-baf7-d2cb51e4451a req-6f941d5c-cf19-4087-876f-0d3a12a59748 service nova] Lock "b27c80e9-9e75-41b2-b380-5cd86538f0c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:49:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-0318adf6-dc3a-42ea-baf7-d2cb51e4451a req-6f941d5c-cf19-4087-876f-0d3a12a59748 service nova] Lock "b27c80e9-9e75-41b2-b380-5cd86538f0c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:49:12 user nova-compute[75066]: DEBUG nova.compute.manager [req-0318adf6-dc3a-42ea-baf7-d2cb51e4451a req-6f941d5c-cf19-4087-876f-0d3a12a59748 service nova] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] No waiting events found dispatching network-vif-plugged-3e2fc190-28ce-414b-b435-820607838b7b {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:49:12 user nova-compute[75066]: WARNING nova.compute.manager [req-0318adf6-dc3a-42ea-baf7-d2cb51e4451a req-6f941d5c-cf19-4087-876f-0d3a12a59748 service nova] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Received unexpected event network-vif-plugged-3e2fc190-28ce-414b-b435-820607838b7b for instance with vm_state building and task_state spawning.
Dec 01 19:49:12 user nova-compute[75066]: INFO nova.compute.manager [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Took 14.67 seconds to build instance.
Dec 01 19:49:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-4bac0cd6-dbaa-4a40-895a-d910e6854623 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "b27c80e9-9e75-41b2-b380-5cd86538f0c4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.761s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:49:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:49:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:49:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:49:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:49:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75066) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 19:49:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:49:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:49:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:49:19 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:49:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:49:24 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:49:24 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75066) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 19:49:26 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:49:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:49:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:49:29 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:49:29 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:49:31 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:49:32 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-2d28e4bb-2a16-499b-b0bf-5a44b3c1c34b tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Acquiring lock "6ae34bf8-aa8b-45e7-8e90-408b524082bc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:49:32 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-2d28e4bb-2a16-499b-b0bf-5a44b3c1c34b tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "6ae34bf8-aa8b-45e7-8e90-408b524082bc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:49:32 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-2d28e4bb-2a16-499b-b0bf-5a44b3c1c34b tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Acquiring lock "6ae34bf8-aa8b-45e7-8e90-408b524082bc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:49:32 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-2d28e4bb-2a16-499b-b0bf-5a44b3c1c34b tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "6ae34bf8-aa8b-45e7-8e90-408b524082bc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:49:32 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-2d28e4bb-2a16-499b-b0bf-5a44b3c1c34b tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "6ae34bf8-aa8b-45e7-8e90-408b524082bc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:49:32 user nova-compute[75066]: INFO nova.compute.manager [None req-2d28e4bb-2a16-499b-b0bf-5a44b3c1c34b tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Terminating instance
Dec 01 19:49:32 user nova-compute[75066]: DEBUG nova.compute.manager [None req-2d28e4bb-2a16-499b-b0bf-5a44b3c1c34b tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Start destroying the instance on the hypervisor. {{(pid=75066) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 19:49:32 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:49:32 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:49:32 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:49:32 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:49:32 user nova-compute[75066]: DEBUG nova.compute.manager [req-e415ec0d-2362-4135-bb4e-a027103e73ac req-29a74e6c-97c4-478f-a82b-4f2838260c84 service nova] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Received event network-vif-unplugged-c47319de-ae0e-44ea-8525-80b61f9fdf6f {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:49:32 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-e415ec0d-2362-4135-bb4e-a027103e73ac req-29a74e6c-97c4-478f-a82b-4f2838260c84 service nova] Acquiring lock "6ae34bf8-aa8b-45e7-8e90-408b524082bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:49:32 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-e415ec0d-2362-4135-bb4e-a027103e73ac req-29a74e6c-97c4-478f-a82b-4f2838260c84 service nova] Lock "6ae34bf8-aa8b-45e7-8e90-408b524082bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:49:32 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-e415ec0d-2362-4135-bb4e-a027103e73ac req-29a74e6c-97c4-478f-a82b-4f2838260c84 service nova] Lock "6ae34bf8-aa8b-45e7-8e90-408b524082bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:49:32 user nova-compute[75066]: DEBUG nova.compute.manager [req-e415ec0d-2362-4135-bb4e-a027103e73ac req-29a74e6c-97c4-478f-a82b-4f2838260c84 service nova] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] No waiting events found dispatching network-vif-unplugged-c47319de-ae0e-44ea-8525-80b61f9fdf6f {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:49:32 user nova-compute[75066]: DEBUG nova.compute.manager [req-e415ec0d-2362-4135-bb4e-a027103e73ac req-29a74e6c-97c4-478f-a82b-4f2838260c84 service nova] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Received event network-vif-unplugged-c47319de-ae0e-44ea-8525-80b61f9fdf6f for instance with task_state deleting. {{(pid=75066) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 19:49:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:49:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:49:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:49:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:49:33 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Instance destroyed successfully.
Dec 01 19:49:33 user nova-compute[75066]: DEBUG nova.objects.instance [None req-2d28e4bb-2a16-499b-b0bf-5a44b3c1c34b tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lazy-loading 'resources' on Instance uuid 6ae34bf8-aa8b-45e7-8e90-408b524082bc {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:49:33 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-2d28e4bb-2a16-499b-b0bf-5a44b3c1c34b tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:46:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1170036720',display_name='tempest-AttachVolumeNegativeTest-server-1170036720',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1170036720',id=45,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLSmiJCHxynWozNR9MdZ3r2j30snRxAA44gPYIXDTlmNMGVyrsGMpvpaTKoLdn4t/fIW0VAMDJWNrrXxmjQjTFAf6li75xfjGarymybSvSVUL5Y8BR9Ciiet8MJmuZoZQg==',key_name='tempest-keypair-442499860',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:46:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='109097a30a40419092c74f4c7a695ce4',ramdisk_id='',reservation_id='r-0tffwwyr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-711021602',owner_user_name='tempest-AttachVolumeNegativeTest-711021602-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:46:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b92b1beca2ee480181e771eafe1a9f97',uuid=6ae34bf8-aa8b-45e7-8e90-408b524082bc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c47319de-ae0e-44ea-8525-80b61f9fdf6f", "address": "fa:16:3e:22:49:95", "network": {"id": "955d6293-ede6-4cb4-8cee-0157dbad93ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-603640322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109097a30a40419092c74f4c7a695ce4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc47319de-ae", "ovs_interfaceid": "c47319de-ae0e-44ea-8525-80b61f9fdf6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:49:33 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-2d28e4bb-2a16-499b-b0bf-5a44b3c1c34b tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Converting VIF {"id": "c47319de-ae0e-44ea-8525-80b61f9fdf6f", "address": "fa:16:3e:22:49:95", "network": {"id": "955d6293-ede6-4cb4-8cee-0157dbad93ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-603640322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.22", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109097a30a40419092c74f4c7a695ce4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc47319de-ae", "ovs_interfaceid": "c47319de-ae0e-44ea-8525-80b61f9fdf6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:49:33 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-2d28e4bb-2a16-499b-b0bf-5a44b3c1c34b tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:49:95,bridge_name='br-int',has_traffic_filtering=True,id=c47319de-ae0e-44ea-8525-80b61f9fdf6f,network=Network(955d6293-ede6-4cb4-8cee-0157dbad93ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc47319de-ae') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:49:33 user nova-compute[75066]: DEBUG os_vif [None req-2d28e4bb-2a16-499b-b0bf-5a44b3c1c34b tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:49:95,bridge_name='br-int',has_traffic_filtering=True,id=c47319de-ae0e-44ea-8525-80b61f9fdf6f,network=Network(955d6293-ede6-4cb4-8cee-0157dbad93ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc47319de-ae') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:49:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:49:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc47319de-ae, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:49:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:49:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:49:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:49:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0c734127-93da-4b00-a20b-9f5f84aa5418) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:49:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:49:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:49:33 user nova-compute[75066]: INFO os_vif [None req-2d28e4bb-2a16-499b-b0bf-5a44b3c1c34b tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:49:95,bridge_name='br-int',has_traffic_filtering=True,id=c47319de-ae0e-44ea-8525-80b61f9fdf6f,network=Network(955d6293-ede6-4cb4-8cee-0157dbad93ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc47319de-ae')
Dec 01 19:49:33 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-2d28e4bb-2a16-499b-b0bf-5a44b3c1c34b tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Deleting instance files /opt/stack/data/nova/instances/6ae34bf8-aa8b-45e7-8e90-408b524082bc_del
Dec 01 19:49:33 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-2d28e4bb-2a16-499b-b0bf-5a44b3c1c34b tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Deletion of /opt/stack/data/nova/instances/6ae34bf8-aa8b-45e7-8e90-408b524082bc_del complete
Dec 01 19:49:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:49:33 user nova-compute[75066]: INFO nova.compute.manager [None req-2d28e4bb-2a16-499b-b0bf-5a44b3c1c34b tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Took 0.90 seconds to destroy the instance on the hypervisor.
Dec 01 19:49:33 user nova-compute[75066]: DEBUG oslo.service.loopingcall [None req-2d28e4bb-2a16-499b-b0bf-5a44b3c1c34b tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75066) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 19:49:33 user nova-compute[75066]: DEBUG nova.compute.manager [-] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Deallocating network for instance {{(pid=75066) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 19:49:33 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] deallocate_for_instance() {{(pid=75066) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 19:49:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:49:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:49:34 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:49:34 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:49:34 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:49:34 user nova-compute[75066]: INFO nova.compute.manager [-] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Took 1.07 seconds to deallocate network for instance.
Dec 01 19:49:34 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-2d28e4bb-2a16-499b-b0bf-5a44b3c1c34b tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:49:34 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-2d28e4bb-2a16-499b-b0bf-5a44b3c1c34b tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:49:34 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-2d28e4bb-2a16-499b-b0bf-5a44b3c1c34b tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:49:34 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-2d28e4bb-2a16-499b-b0bf-5a44b3c1c34b tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:49:34 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-2d28e4bb-2a16-499b-b0bf-5a44b3c1c34b tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.134s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:49:34 user nova-compute[75066]: INFO nova.scheduler.client.report [None req-2d28e4bb-2a16-499b-b0bf-5a44b3c1c34b tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Deleted allocations for instance 6ae34bf8-aa8b-45e7-8e90-408b524082bc
Dec 01 19:49:34 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-2d28e4bb-2a16-499b-b0bf-5a44b3c1c34b tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "6ae34bf8-aa8b-45e7-8e90-408b524082bc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.277s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:49:35 user nova-compute[75066]: DEBUG nova.compute.manager [req-d7bc50ef-dc68-4188-a34a-c399d129431f req-5e3b17b4-7a75-43b1-b814-36103bd45858 service nova] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Received event network-vif-plugged-c47319de-ae0e-44ea-8525-80b61f9fdf6f {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:49:35 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d7bc50ef-dc68-4188-a34a-c399d129431f req-5e3b17b4-7a75-43b1-b814-36103bd45858 service nova] Acquiring lock "6ae34bf8-aa8b-45e7-8e90-408b524082bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:49:35 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d7bc50ef-dc68-4188-a34a-c399d129431f req-5e3b17b4-7a75-43b1-b814-36103bd45858 service nova] Lock "6ae34bf8-aa8b-45e7-8e90-408b524082bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:49:35 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d7bc50ef-dc68-4188-a34a-c399d129431f req-5e3b17b4-7a75-43b1-b814-36103bd45858 service nova] Lock "6ae34bf8-aa8b-45e7-8e90-408b524082bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:49:35 user nova-compute[75066]: DEBUG nova.compute.manager [req-d7bc50ef-dc68-4188-a34a-c399d129431f req-5e3b17b4-7a75-43b1-b814-36103bd45858 service nova] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] No waiting events found dispatching network-vif-plugged-c47319de-ae0e-44ea-8525-80b61f9fdf6f {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:49:35 user nova-compute[75066]: WARNING nova.compute.manager [req-d7bc50ef-dc68-4188-a34a-c399d129431f req-5e3b17b4-7a75-43b1-b814-36103bd45858 service nova] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Received unexpected event network-vif-plugged-c47319de-ae0e-44ea-8525-80b61f9fdf6f for instance with vm_state deleted and task_state None.
Dec 01 19:49:35 user nova-compute[75066]: DEBUG nova.compute.manager [req-d7bc50ef-dc68-4188-a34a-c399d129431f req-5e3b17b4-7a75-43b1-b814-36103bd45858 service nova] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Received event network-vif-plugged-c47319de-ae0e-44ea-8525-80b61f9fdf6f {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:49:35 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d7bc50ef-dc68-4188-a34a-c399d129431f req-5e3b17b4-7a75-43b1-b814-36103bd45858 service nova] Acquiring lock "6ae34bf8-aa8b-45e7-8e90-408b524082bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:49:35 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d7bc50ef-dc68-4188-a34a-c399d129431f req-5e3b17b4-7a75-43b1-b814-36103bd45858 service nova] Lock "6ae34bf8-aa8b-45e7-8e90-408b524082bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:49:35 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d7bc50ef-dc68-4188-a34a-c399d129431f req-5e3b17b4-7a75-43b1-b814-36103bd45858 service nova] Lock "6ae34bf8-aa8b-45e7-8e90-408b524082bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:49:35 user nova-compute[75066]: DEBUG nova.compute.manager [req-d7bc50ef-dc68-4188-a34a-c399d129431f req-5e3b17b4-7a75-43b1-b814-36103bd45858 service nova] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] No waiting events found dispatching network-vif-plugged-c47319de-ae0e-44ea-8525-80b61f9fdf6f {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:49:35 user nova-compute[75066]: WARNING nova.compute.manager [req-d7bc50ef-dc68-4188-a34a-c399d129431f req-5e3b17b4-7a75-43b1-b814-36103bd45858 service nova] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Received unexpected event network-vif-plugged-c47319de-ae0e-44ea-8525-80b61f9fdf6f for instance with vm_state deleted and task_state None.
Dec 01 19:49:35 user nova-compute[75066]: DEBUG nova.compute.manager [req-d7bc50ef-dc68-4188-a34a-c399d129431f req-5e3b17b4-7a75-43b1-b814-36103bd45858 service nova] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Received event network-vif-plugged-c47319de-ae0e-44ea-8525-80b61f9fdf6f {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:49:35 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d7bc50ef-dc68-4188-a34a-c399d129431f req-5e3b17b4-7a75-43b1-b814-36103bd45858 service nova] Acquiring lock "6ae34bf8-aa8b-45e7-8e90-408b524082bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:49:35 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d7bc50ef-dc68-4188-a34a-c399d129431f req-5e3b17b4-7a75-43b1-b814-36103bd45858 service nova] Lock "6ae34bf8-aa8b-45e7-8e90-408b524082bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:49:35 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d7bc50ef-dc68-4188-a34a-c399d129431f req-5e3b17b4-7a75-43b1-b814-36103bd45858 service nova] Lock "6ae34bf8-aa8b-45e7-8e90-408b524082bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:49:35 user nova-compute[75066]: DEBUG nova.compute.manager [req-d7bc50ef-dc68-4188-a34a-c399d129431f req-5e3b17b4-7a75-43b1-b814-36103bd45858 service nova] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] No waiting events found dispatching network-vif-plugged-c47319de-ae0e-44ea-8525-80b61f9fdf6f {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:49:35 user nova-compute[75066]: WARNING nova.compute.manager [req-d7bc50ef-dc68-4188-a34a-c399d129431f req-5e3b17b4-7a75-43b1-b814-36103bd45858 service nova] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Received unexpected event network-vif-plugged-c47319de-ae0e-44ea-8525-80b61f9fdf6f for instance with vm_state deleted and task_state None.
Dec 01 19:49:35 user nova-compute[75066]: DEBUG nova.compute.manager [req-d7bc50ef-dc68-4188-a34a-c399d129431f req-5e3b17b4-7a75-43b1-b814-36103bd45858 service nova] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Received event network-vif-unplugged-c47319de-ae0e-44ea-8525-80b61f9fdf6f {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:49:35 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d7bc50ef-dc68-4188-a34a-c399d129431f req-5e3b17b4-7a75-43b1-b814-36103bd45858 service nova] Acquiring lock "6ae34bf8-aa8b-45e7-8e90-408b524082bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:49:35 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d7bc50ef-dc68-4188-a34a-c399d129431f req-5e3b17b4-7a75-43b1-b814-36103bd45858 service nova] Lock "6ae34bf8-aa8b-45e7-8e90-408b524082bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:49:35 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d7bc50ef-dc68-4188-a34a-c399d129431f req-5e3b17b4-7a75-43b1-b814-36103bd45858 service nova] Lock "6ae34bf8-aa8b-45e7-8e90-408b524082bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:49:35 user nova-compute[75066]: DEBUG nova.compute.manager [req-d7bc50ef-dc68-4188-a34a-c399d129431f req-5e3b17b4-7a75-43b1-b814-36103bd45858 service nova] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] No waiting events found dispatching network-vif-unplugged-c47319de-ae0e-44ea-8525-80b61f9fdf6f {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:49:35 user nova-compute[75066]: WARNING nova.compute.manager [req-d7bc50ef-dc68-4188-a34a-c399d129431f req-5e3b17b4-7a75-43b1-b814-36103bd45858 service nova] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Received unexpected event network-vif-unplugged-c47319de-ae0e-44ea-8525-80b61f9fdf6f for instance with vm_state deleted and task_state None.
Dec 01 19:49:35 user nova-compute[75066]: DEBUG nova.compute.manager [req-d7bc50ef-dc68-4188-a34a-c399d129431f req-5e3b17b4-7a75-43b1-b814-36103bd45858 service nova] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Received event network-vif-plugged-c47319de-ae0e-44ea-8525-80b61f9fdf6f {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:49:35 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d7bc50ef-dc68-4188-a34a-c399d129431f req-5e3b17b4-7a75-43b1-b814-36103bd45858 service nova] Acquiring lock "6ae34bf8-aa8b-45e7-8e90-408b524082bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:49:35 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d7bc50ef-dc68-4188-a34a-c399d129431f req-5e3b17b4-7a75-43b1-b814-36103bd45858 service nova] Lock "6ae34bf8-aa8b-45e7-8e90-408b524082bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:49:35 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d7bc50ef-dc68-4188-a34a-c399d129431f req-5e3b17b4-7a75-43b1-b814-36103bd45858 service nova] Lock "6ae34bf8-aa8b-45e7-8e90-408b524082bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:49:35 user nova-compute[75066]: DEBUG nova.compute.manager [req-d7bc50ef-dc68-4188-a34a-c399d129431f req-5e3b17b4-7a75-43b1-b814-36103bd45858 service nova] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] No waiting events found dispatching network-vif-plugged-c47319de-ae0e-44ea-8525-80b61f9fdf6f {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:49:35 user nova-compute[75066]: WARNING nova.compute.manager [req-d7bc50ef-dc68-4188-a34a-c399d129431f req-5e3b17b4-7a75-43b1-b814-36103bd45858 service nova] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Received unexpected event network-vif-plugged-c47319de-ae0e-44ea-8525-80b61f9fdf6f for instance with vm_state deleted and task_state None.
Dec 01 19:49:35 user nova-compute[75066]: DEBUG nova.compute.manager [req-d7bc50ef-dc68-4188-a34a-c399d129431f req-5e3b17b4-7a75-43b1-b814-36103bd45858 service nova] [instance: 6ae34bf8-aa8b-45e7-8e90-408b524082bc] Received event network-vif-deleted-c47319de-ae0e-44ea-8525-80b61f9fdf6f {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:49:35 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:49:35 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:49:35 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:49:35 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:49:35 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:49:35 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75066) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 19:49:35 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:49:35 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:49:35 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:49:35 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Hypervisor/Node resource view: name=user free_ram=8894MB free_disk=24.919578552246094GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75066) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 19:49:35 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:49:35 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:49:36 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance b27c80e9-9e75-41b2-b380-5cd86538f0c4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:49:36 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 19:49:36 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 19:49:36 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:49:36 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:49:36 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Compute_service record updated for user:user {{(pid=75066) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 19:49:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.229s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:49:38 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:49:38 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Starting heal instance info cache {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 19:49:38 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Rebuilding the list of instances to heal {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 19:49:38 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "refresh_cache-b27c80e9-9e75-41b2-b380-5cd86538f0c4" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:49:38 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquired lock "refresh_cache-b27c80e9-9e75-41b2-b380-5cd86538f0c4" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:49:38 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Forcefully refreshing network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 19:49:38 user nova-compute[75066]: DEBUG nova.objects.instance [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lazy-loading 'info_cache' on Instance uuid b27c80e9-9e75-41b2-b380-5cd86538f0c4 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:49:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:49:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:49:38 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Updating instance_info_cache with network_info: [{"id": "3e2fc190-28ce-414b-b435-820607838b7b", "address": "fa:16:3e:46:86:fd", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e2fc190-28", "ovs_interfaceid": "3e2fc190-28ce-414b-b435-820607838b7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:49:38 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Releasing lock "refresh_cache-b27c80e9-9e75-41b2-b380-5cd86538f0c4" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:49:38 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Updated the network info_cache for instance {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 19:49:39 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:49:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:49:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:49:48 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:49:53 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:49:53 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:49:53 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75066) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 19:49:53 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:49:53 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:49:53 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:49:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:49:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:49:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75066) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 19:49:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:49:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:49:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:50:03 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:50:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:50:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:50:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:50:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75066) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 19:50:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:50:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:50:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:50:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:50:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:50:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75066) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 19:50:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:50:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:50:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:50:21 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:50:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:50:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:50:25 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:50:25 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75066) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 19:50:25 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Acquiring lock "7f0d914d-866e-45b1-9839-a4bbe19f6eb7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:50:25 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "7f0d914d-866e-45b1-9839-a4bbe19f6eb7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:50:26 user nova-compute[75066]: DEBUG nova.compute.manager [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Starting instance... {{(pid=75066) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 19:50:26 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:50:26 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:50:26 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75066) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 19:50:26 user nova-compute[75066]: INFO nova.compute.claims [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Claim successful on node user
Dec 01 19:50:26 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:50:26 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:50:26 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.285s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:50:26 user nova-compute[75066]: DEBUG nova.compute.manager [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Start building networks asynchronously for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 19:50:26 user nova-compute[75066]: DEBUG nova.compute.manager [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Allocating IP information in the background. {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 19:50:26 user nova-compute[75066]: DEBUG nova.network.neutron [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] allocate_for_instance() {{(pid=75066) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 19:50:26 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 19:50:26 user nova-compute[75066]: DEBUG nova.compute.manager [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Start building block device mappings for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 19:50:26 user nova-compute[75066]: DEBUG nova.policy [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b92b1beca2ee480181e771eafe1a9f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '109097a30a40419092c74f4c7a695ce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75066) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 19:50:26 user nova-compute[75066]: DEBUG nova.compute.manager [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Start spawning the instance on the hypervisor. {{(pid=75066) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 19:50:26 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Creating instance directory {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 19:50:26 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Creating image(s)
Dec 01 19:50:26 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Acquiring lock "/opt/stack/data/nova/instances/7f0d914d-866e-45b1-9839-a4bbe19f6eb7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:50:26 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "/opt/stack/data/nova/instances/7f0d914d-866e-45b1-9839-a4bbe19f6eb7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:50:26 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "/opt/stack/data/nova/instances/7f0d914d-866e-45b1-9839-a4bbe19f6eb7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:50:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:50:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.176s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:50:26 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Acquiring lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:50:26 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:50:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:50:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.176s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:50:26 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/7f0d914d-866e-45b1-9839-a4bbe19f6eb7/disk 1073741824 {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:50:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/7f0d914d-866e-45b1-9839-a4bbe19f6eb7/disk 1073741824" returned: 0 in 0.050s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:50:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:50:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:50:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.167s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:50:27 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7f0d914d-866e-45b1-9839-a4bbe19f6eb7/disk. size=1073741824 {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 19:50:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f0d914d-866e-45b1-9839-a4bbe19f6eb7/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:50:27 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:50:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f0d914d-866e-45b1-9839-a4bbe19f6eb7/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:50:27 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Cannot resize image /opt/stack/data/nova/instances/7f0d914d-866e-45b1-9839-a4bbe19f6eb7/disk to a smaller size. {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 19:50:27 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Created local disks {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 19:50:27 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Ensure instance console log exists: /opt/stack/data/nova/instances/7f0d914d-866e-45b1-9839-a4bbe19f6eb7/console.log {{(pid=75066) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 19:50:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:50:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:50:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:50:27 user nova-compute[75066]: DEBUG nova.network.neutron [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Successfully created port: df573bb8-23b8-437e-83c0-ccb759d7c59a {{(pid=75066) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 19:50:28 user nova-compute[75066]: DEBUG nova.network.neutron [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Successfully updated port: df573bb8-23b8-437e-83c0-ccb759d7c59a {{(pid=75066) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 19:50:28 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Acquiring lock "refresh_cache-7f0d914d-866e-45b1-9839-a4bbe19f6eb7" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:50:28 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Acquired lock "refresh_cache-7f0d914d-866e-45b1-9839-a4bbe19f6eb7" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:50:28 user nova-compute[75066]: DEBUG nova.network.neutron [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:50:28 user nova-compute[75066]: DEBUG nova.compute.manager [req-f443661a-e4ec-4be3-a386-5b163f93c255 req-5817fa48-9a8e-489d-8e0c-a7e1d17d352a service nova] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Received event network-changed-df573bb8-23b8-437e-83c0-ccb759d7c59a {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:50:28 user nova-compute[75066]: DEBUG nova.compute.manager [req-f443661a-e4ec-4be3-a386-5b163f93c255 req-5817fa48-9a8e-489d-8e0c-a7e1d17d352a service nova] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Refreshing instance network info cache due to event network-changed-df573bb8-23b8-437e-83c0-ccb759d7c59a. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:50:28 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-f443661a-e4ec-4be3-a386-5b163f93c255 req-5817fa48-9a8e-489d-8e0c-a7e1d17d352a service nova] Acquiring lock "refresh_cache-7f0d914d-866e-45b1-9839-a4bbe19f6eb7" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:50:28 user nova-compute[75066]: DEBUG nova.network.neutron [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:50:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:50:28 user nova-compute[75066]: DEBUG nova.network.neutron [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Updating instance_info_cache with network_info: [{"id": "df573bb8-23b8-437e-83c0-ccb759d7c59a", "address": "fa:16:3e:8f:28:44", "network": {"id": "955d6293-ede6-4cb4-8cee-0157dbad93ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-603640322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109097a30a40419092c74f4c7a695ce4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf573bb8-23", "ovs_interfaceid": "df573bb8-23b8-437e-83c0-ccb759d7c59a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:50:28 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Releasing lock "refresh_cache-7f0d914d-866e-45b1-9839-a4bbe19f6eb7" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:50:28 user nova-compute[75066]: DEBUG nova.compute.manager [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Instance network_info: |[{"id": "df573bb8-23b8-437e-83c0-ccb759d7c59a", "address": "fa:16:3e:8f:28:44", "network": {"id": "955d6293-ede6-4cb4-8cee-0157dbad93ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-603640322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109097a30a40419092c74f4c7a695ce4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf573bb8-23", "ovs_interfaceid": "df573bb8-23b8-437e-83c0-ccb759d7c59a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 19:50:28 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-f443661a-e4ec-4be3-a386-5b163f93c255 req-5817fa48-9a8e-489d-8e0c-a7e1d17d352a service nova] Acquired lock "refresh_cache-7f0d914d-866e-45b1-9839-a4bbe19f6eb7" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:50:28 user nova-compute[75066]: DEBUG nova.network.neutron [req-f443661a-e4ec-4be3-a386-5b163f93c255 req-5817fa48-9a8e-489d-8e0c-a7e1d17d352a service nova] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Refreshing network info cache for port df573bb8-23b8-437e-83c0-ccb759d7c59a {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:50:28 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Start _get_guest_xml network_info=[{"id": "df573bb8-23b8-437e-83c0-ccb759d7c59a", "address": "fa:16:3e:8f:28:44", "network": {"id": "955d6293-ede6-4cb4-8cee-0157dbad93ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-603640322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109097a30a40419092c74f4c7a695ce4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf573bb8-23", "ovs_interfaceid": "df573bb8-23b8-437e-83c0-ccb759d7c59a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'image_id': '900b237b-e99c-4fdd-a44f-dcb7a08baa86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:50:28 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:50:28 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:50:28 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:50:28 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:50:28 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:50:28 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:50:28 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:50:28 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:50:28 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:50:28 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:50:28 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:50:28 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:50:28 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:50:28 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:50:28 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:50:28 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:50:28 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:50:28 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:50:28 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:50:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1916131871',display_name='tempest-AttachVolumeNegativeTest-server-1916131871',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1916131871',id=47,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFCUhc/v86rUa2J60cFzOQdhyAMZ/c34+TFi5LAc3D1o9uB1Zr4dVoNcAogt/ocQsKupH5GlBQjApMk5ON6TyKnEQmtKhp45UfBn41OdEaFCpshiOpmP7Oe8efS2N3QlyA==',key_name='tempest-keypair-357976017',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='109097a30a40419092c74f4c7a695ce4',ramdisk_id='',reservation_id='r-ch1w3y01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-711021602',owner_user_name='tempest-AttachVolumeNegativeTest-711021602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:50:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b92b1beca2ee480181e771eafe1a9f97',uuid=7f0d914d-866e-45b1-9839-a4bbe19f6eb7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df573bb8-23b8-437e-83c0-ccb759d7c59a", "address": "fa:16:3e:8f:28:44", "network": {"id": "955d6293-ede6-4cb4-8cee-0157dbad93ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-603640322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109097a30a40419092c74f4c7a695ce4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf573bb8-23", "ovs_interfaceid": "df573bb8-23b8-437e-83c0-ccb759d7c59a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:50:28 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Converting VIF {"id": "df573bb8-23b8-437e-83c0-ccb759d7c59a", "address": "fa:16:3e:8f:28:44", "network": {"id": "955d6293-ede6-4cb4-8cee-0157dbad93ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-603640322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109097a30a40419092c74f4c7a695ce4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf573bb8-23", "ovs_interfaceid": "df573bb8-23b8-437e-83c0-ccb759d7c59a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:50:28 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:28:44,bridge_name='br-int',has_traffic_filtering=True,id=df573bb8-23b8-437e-83c0-ccb759d7c59a,network=Network(955d6293-ede6-4cb4-8cee-0157dbad93ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf573bb8-23') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:50:28 user nova-compute[75066]: DEBUG nova.objects.instance [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lazy-loading 'pci_devices' on Instance uuid 7f0d914d-866e-45b1-9839-a4bbe19f6eb7 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:50:28 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:50:28 user nova-compute[75066]:   <uuid>7f0d914d-866e-45b1-9839-a4bbe19f6eb7</uuid>
Dec 01 19:50:28 user nova-compute[75066]:   <name>instance-0000002f</name>
Dec 01 19:50:28 user nova-compute[75066]:   <memory>524288</memory>
Dec 01 19:50:28 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:50:28 user nova-compute[75066]:   <metadata>
Dec 01 19:50:28 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:50:28 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:50:28 user nova-compute[75066]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1916131871</nova:name>
Dec 01 19:50:28 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:50:28</nova:creationTime>
Dec 01 19:50:28 user nova-compute[75066]:       <nova:flavor name="m1.tiny">
Dec 01 19:50:28 user nova-compute[75066]:         <nova:memory>512</nova:memory>
Dec 01 19:50:28 user nova-compute[75066]:         <nova:disk>1</nova:disk>
Dec 01 19:50:28 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:50:28 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:50:28 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:50:28 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:50:28 user nova-compute[75066]:       <nova:owner>
Dec 01 19:50:28 user nova-compute[75066]:         <nova:user uuid="b92b1beca2ee480181e771eafe1a9f97">tempest-AttachVolumeNegativeTest-711021602-project-member</nova:user>
Dec 01 19:50:28 user nova-compute[75066]:         <nova:project uuid="109097a30a40419092c74f4c7a695ce4">tempest-AttachVolumeNegativeTest-711021602</nova:project>
Dec 01 19:50:28 user nova-compute[75066]:       </nova:owner>
Dec 01 19:50:28 user nova-compute[75066]:       <nova:root type="image" uuid="900b237b-e99c-4fdd-a44f-dcb7a08baa86"/>
Dec 01 19:50:28 user nova-compute[75066]:       <nova:ports>
Dec 01 19:50:28 user nova-compute[75066]:         <nova:port uuid="df573bb8-23b8-437e-83c0-ccb759d7c59a">
Dec 01 19:50:28 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Dec 01 19:50:28 user nova-compute[75066]:         </nova:port>
Dec 01 19:50:28 user nova-compute[75066]:       </nova:ports>
Dec 01 19:50:28 user nova-compute[75066]:     </nova:instance>
Dec 01 19:50:28 user nova-compute[75066]:   </metadata>
Dec 01 19:50:28 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:50:28 user nova-compute[75066]:     <system>
Dec 01 19:50:28 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:50:28 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:50:28 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:50:28 user nova-compute[75066]:       <entry name="serial">7f0d914d-866e-45b1-9839-a4bbe19f6eb7</entry>
Dec 01 19:50:28 user nova-compute[75066]:       <entry name="uuid">7f0d914d-866e-45b1-9839-a4bbe19f6eb7</entry>
Dec 01 19:50:28 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:50:28 user nova-compute[75066]:     </system>
Dec 01 19:50:28 user nova-compute[75066]:   </sysinfo>
Dec 01 19:50:28 user nova-compute[75066]:   <os>
Dec 01 19:50:28 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:50:28 user nova-compute[75066]:     <boot dev="hd"/>
Dec 01 19:50:28 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:50:28 user nova-compute[75066]:   </os>
Dec 01 19:50:28 user nova-compute[75066]:   <features>
Dec 01 19:50:28 user nova-compute[75066]:     <acpi/>
Dec 01 19:50:28 user nova-compute[75066]:     <apic/>
Dec 01 19:50:28 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:50:28 user nova-compute[75066]:   </features>
Dec 01 19:50:28 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:50:28 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:50:28 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:50:28 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:50:28 user nova-compute[75066]:   </clock>
Dec 01 19:50:28 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:50:28 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:50:28 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:50:28 user nova-compute[75066]:   </cpu>
Dec 01 19:50:28 user nova-compute[75066]:   <devices>
Dec 01 19:50:28 user nova-compute[75066]:     <disk type="file" device="disk">
Dec 01 19:50:28 user nova-compute[75066]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 19:50:28 user nova-compute[75066]:       <source file="/opt/stack/data/nova/instances/7f0d914d-866e-45b1-9839-a4bbe19f6eb7/disk"/>
Dec 01 19:50:28 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:50:28 user nova-compute[75066]:     </disk>
Dec 01 19:50:28 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:50:28 user nova-compute[75066]:       <mac address="fa:16:3e:8f:28:44"/>
Dec 01 19:50:28 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:50:28 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:50:28 user nova-compute[75066]:       <target dev="tapdf573bb8-23"/>
Dec 01 19:50:28 user nova-compute[75066]:     </interface>
Dec 01 19:50:28 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:50:28 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/7f0d914d-866e-45b1-9839-a4bbe19f6eb7/console.log" append="off"/>
Dec 01 19:50:28 user nova-compute[75066]:     </serial>
Dec 01 19:50:28 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:50:28 user nova-compute[75066]:     <video>
Dec 01 19:50:28 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:50:28 user nova-compute[75066]:     </video>
Dec 01 19:50:28 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:50:28 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:50:28 user nova-compute[75066]:     </rng>
Dec 01 19:50:28 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:50:28 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:50:28 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:50:28 user nova-compute[75066]:     </memballoon>
Dec 01 19:50:28 user nova-compute[75066]:   </devices>
Dec 01 19:50:28 user nova-compute[75066]: </domain>
Dec 01 19:50:28 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:50:28 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:50:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1916131871',display_name='tempest-AttachVolumeNegativeTest-server-1916131871',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1916131871',id=47,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFCUhc/v86rUa2J60cFzOQdhyAMZ/c34+TFi5LAc3D1o9uB1Zr4dVoNcAogt/ocQsKupH5GlBQjApMk5ON6TyKnEQmtKhp45UfBn41OdEaFCpshiOpmP7Oe8efS2N3QlyA==',key_name='tempest-keypair-357976017',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='109097a30a40419092c74f4c7a695ce4',ramdisk_id='',reservation_id='r-ch1w3y01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-711021602',owner_user_name='tempest-AttachVolumeNegativeTest-711021602-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:50:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b92b1beca2ee480181e771eafe1a9f97',uuid=7f0d914d-866e-45b1-9839-a4bbe19f6eb7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df573bb8-23b8-437e-83c0-ccb759d7c59a", "address": "fa:16:3e:8f:28:44", "network": {"id": "955d6293-ede6-4cb4-8cee-0157dbad93ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-603640322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109097a30a40419092c74f4c7a695ce4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf573bb8-23", "ovs_interfaceid": "df573bb8-23b8-437e-83c0-ccb759d7c59a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:50:28 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Converting VIF {"id": "df573bb8-23b8-437e-83c0-ccb759d7c59a", "address": "fa:16:3e:8f:28:44", "network": {"id": "955d6293-ede6-4cb4-8cee-0157dbad93ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-603640322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109097a30a40419092c74f4c7a695ce4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf573bb8-23", "ovs_interfaceid": "df573bb8-23b8-437e-83c0-ccb759d7c59a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:50:28 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:28:44,bridge_name='br-int',has_traffic_filtering=True,id=df573bb8-23b8-437e-83c0-ccb759d7c59a,network=Network(955d6293-ede6-4cb4-8cee-0157dbad93ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf573bb8-23') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:50:28 user nova-compute[75066]: DEBUG os_vif [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:28:44,bridge_name='br-int',has_traffic_filtering=True,id=df573bb8-23b8-437e-83c0-ccb759d7c59a,network=Network(955d6293-ede6-4cb4-8cee-0157dbad93ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf573bb8-23') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:50:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:50:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:50:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:50:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:50:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e86c3c23-a9c3-5464-b93f-167d0f0f1a33', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:50:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:50:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:50:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:50:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdf573bb8-23, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:50:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdf573bb8-23, col_values=(('qos', UUID('5da8e771-0037-4800-a897-7dc7ff23cb8d')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:50:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdf573bb8-23, col_values=(('external_ids', {'iface-id': 'df573bb8-23b8-437e-83c0-ccb759d7c59a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:28:44', 'vm-uuid': '7f0d914d-866e-45b1-9839-a4bbe19f6eb7'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:50:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:50:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:50:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:50:28 user nova-compute[75066]: INFO os_vif [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:28:44,bridge_name='br-int',has_traffic_filtering=True,id=df573bb8-23b8-437e-83c0-ccb759d7c59a,network=Network(955d6293-ede6-4cb4-8cee-0157dbad93ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf573bb8-23')
Dec 01 19:50:28 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:50:28 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] No VIF found with MAC fa:16:3e:8f:28:44, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:50:28 user nova-compute[75066]: DEBUG nova.network.neutron [req-f443661a-e4ec-4be3-a386-5b163f93c255 req-5817fa48-9a8e-489d-8e0c-a7e1d17d352a service nova] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Updated VIF entry in instance network info cache for port df573bb8-23b8-437e-83c0-ccb759d7c59a. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:50:28 user nova-compute[75066]: DEBUG nova.network.neutron [req-f443661a-e4ec-4be3-a386-5b163f93c255 req-5817fa48-9a8e-489d-8e0c-a7e1d17d352a service nova] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Updating instance_info_cache with network_info: [{"id": "df573bb8-23b8-437e-83c0-ccb759d7c59a", "address": "fa:16:3e:8f:28:44", "network": {"id": "955d6293-ede6-4cb4-8cee-0157dbad93ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-603640322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109097a30a40419092c74f4c7a695ce4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf573bb8-23", "ovs_interfaceid": "df573bb8-23b8-437e-83c0-ccb759d7c59a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:50:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-f443661a-e4ec-4be3-a386-5b163f93c255 req-5817fa48-9a8e-489d-8e0c-a7e1d17d352a service nova] Releasing lock "refresh_cache-7f0d914d-866e-45b1-9839-a4bbe19f6eb7" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:50:29 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:50:29 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:50:29 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:50:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:50:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:50:30 user nova-compute[75066]: DEBUG nova.compute.manager [req-4dcbc882-2872-486f-a8bf-4e7b1cafebf6 req-4798b74e-46ed-4ad3-bd79-301554af686d service nova] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Received event network-vif-plugged-df573bb8-23b8-437e-83c0-ccb759d7c59a {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:50:30 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-4dcbc882-2872-486f-a8bf-4e7b1cafebf6 req-4798b74e-46ed-4ad3-bd79-301554af686d service nova] Acquiring lock "7f0d914d-866e-45b1-9839-a4bbe19f6eb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:50:30 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-4dcbc882-2872-486f-a8bf-4e7b1cafebf6 req-4798b74e-46ed-4ad3-bd79-301554af686d service nova] Lock "7f0d914d-866e-45b1-9839-a4bbe19f6eb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:50:30 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-4dcbc882-2872-486f-a8bf-4e7b1cafebf6 req-4798b74e-46ed-4ad3-bd79-301554af686d service nova] Lock "7f0d914d-866e-45b1-9839-a4bbe19f6eb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:50:30 user nova-compute[75066]: DEBUG nova.compute.manager [req-4dcbc882-2872-486f-a8bf-4e7b1cafebf6 req-4798b74e-46ed-4ad3-bd79-301554af686d service nova] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] No waiting events found dispatching network-vif-plugged-df573bb8-23b8-437e-83c0-ccb759d7c59a {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:50:30 user nova-compute[75066]: WARNING nova.compute.manager [req-4dcbc882-2872-486f-a8bf-4e7b1cafebf6 req-4798b74e-46ed-4ad3-bd79-301554af686d service nova] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Received unexpected event network-vif-plugged-df573bb8-23b8-437e-83c0-ccb759d7c59a for instance with vm_state building and task_state spawning.
Dec 01 19:50:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:50:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:50:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:50:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:50:32 user nova-compute[75066]: DEBUG nova.compute.manager [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Instance event wait completed in 0 seconds for  {{(pid=75066) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 19:50:32 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Guest created on hypervisor {{(pid=75066) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 19:50:32 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Instance spawned successfully.
Dec 01 19:50:32 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 19:50:32 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Found default for hw_cdrom_bus of ide {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:50:32 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Found default for hw_disk_bus of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:50:32 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Found default for hw_input_bus of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:50:32 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Found default for hw_pointer_model of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:50:32 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Found default for hw_video_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:50:32 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Found default for hw_vif_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:50:32 user nova-compute[75066]: INFO nova.compute.manager [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Took 5.59 seconds to spawn the instance on the hypervisor.
Dec 01 19:50:32 user nova-compute[75066]: DEBUG nova.compute.manager [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:50:32 user nova-compute[75066]: DEBUG nova.compute.manager [req-756e5b05-af58-48e5-8bfa-43dc9f033e69 req-25bcd18a-584a-4a3c-bb6e-f38223f5b2a0 service nova] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Received event network-vif-plugged-df573bb8-23b8-437e-83c0-ccb759d7c59a {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:50:32 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-756e5b05-af58-48e5-8bfa-43dc9f033e69 req-25bcd18a-584a-4a3c-bb6e-f38223f5b2a0 service nova] Acquiring lock "7f0d914d-866e-45b1-9839-a4bbe19f6eb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:50:32 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-756e5b05-af58-48e5-8bfa-43dc9f033e69 req-25bcd18a-584a-4a3c-bb6e-f38223f5b2a0 service nova] Lock "7f0d914d-866e-45b1-9839-a4bbe19f6eb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:50:32 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-756e5b05-af58-48e5-8bfa-43dc9f033e69 req-25bcd18a-584a-4a3c-bb6e-f38223f5b2a0 service nova] Lock "7f0d914d-866e-45b1-9839-a4bbe19f6eb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:50:32 user nova-compute[75066]: DEBUG nova.compute.manager [req-756e5b05-af58-48e5-8bfa-43dc9f033e69 req-25bcd18a-584a-4a3c-bb6e-f38223f5b2a0 service nova] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] No waiting events found dispatching network-vif-plugged-df573bb8-23b8-437e-83c0-ccb759d7c59a {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:50:32 user nova-compute[75066]: WARNING nova.compute.manager [req-756e5b05-af58-48e5-8bfa-43dc9f033e69 req-25bcd18a-584a-4a3c-bb6e-f38223f5b2a0 service nova] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Received unexpected event network-vif-plugged-df573bb8-23b8-437e-83c0-ccb759d7c59a for instance with vm_state building and task_state spawning.
Dec 01 19:50:32 user nova-compute[75066]: INFO nova.compute.manager [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Took 6.21 seconds to build instance.
Dec 01 19:50:32 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-f88a8336-ff84-411c-a8a3-830f3d6645c0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "7f0d914d-866e-45b1-9839-a4bbe19f6eb7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.332s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:50:33 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:50:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:50:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:50:36 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:50:36 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:50:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:50:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:50:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:50:36 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75066) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 19:50:36 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:50:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f0d914d-866e-45b1-9839-a4bbe19f6eb7/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:50:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f0d914d-866e-45b1-9839-a4bbe19f6eb7/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:50:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f0d914d-866e-45b1-9839-a4bbe19f6eb7/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:50:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f0d914d-866e-45b1-9839-a4bbe19f6eb7/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:50:37 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:50:37 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:50:37 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Hypervisor/Node resource view: name=user free_ram=8891MB free_disk=24.917667388916016GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75066) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 19:50:37 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:50:37 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:50:37 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance b27c80e9-9e75-41b2-b380-5cd86538f0c4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:50:37 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 7f0d914d-866e-45b1-9839-a4bbe19f6eb7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:50:37 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 19:50:37 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 19:50:37 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:50:37 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:50:37 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Compute_service record updated for user:user {{(pid=75066) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 19:50:37 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.222s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:50:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:50:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:50:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75066) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 19:50:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:50:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:50:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:50:39 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:50:39 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Starting heal instance info cache {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 19:50:39 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Rebuilding the list of instances to heal {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 19:50:39 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "refresh_cache-b27c80e9-9e75-41b2-b380-5cd86538f0c4" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:50:39 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquired lock "refresh_cache-b27c80e9-9e75-41b2-b380-5cd86538f0c4" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:50:39 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Forcefully refreshing network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 19:50:39 user nova-compute[75066]: DEBUG nova.objects.instance [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lazy-loading 'info_cache' on Instance uuid b27c80e9-9e75-41b2-b380-5cd86538f0c4 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:50:39 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Updating instance_info_cache with network_info: [{"id": "3e2fc190-28ce-414b-b435-820607838b7b", "address": "fa:16:3e:46:86:fd", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e2fc190-28", "ovs_interfaceid": "3e2fc190-28ce-414b-b435-820607838b7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:50:39 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Releasing lock "refresh_cache-b27c80e9-9e75-41b2-b380-5cd86538f0c4" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:50:39 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Updated the network info_cache for instance {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 19:50:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:50:48 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:50:48 user nova-compute[75066]: DEBUG nova.compute.manager [req-fa6b455c-b3c6-4dab-8a86-9af6e9ca2a80 req-e941d650-b702-4e52-bb4e-756828b813b8 service nova] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Received event network-changed-3e2fc190-28ce-414b-b435-820607838b7b {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:50:48 user nova-compute[75066]: DEBUG nova.compute.manager [req-fa6b455c-b3c6-4dab-8a86-9af6e9ca2a80 req-e941d650-b702-4e52-bb4e-756828b813b8 service nova] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Refreshing instance network info cache due to event network-changed-3e2fc190-28ce-414b-b435-820607838b7b. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:50:48 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-fa6b455c-b3c6-4dab-8a86-9af6e9ca2a80 req-e941d650-b702-4e52-bb4e-756828b813b8 service nova] Acquiring lock "refresh_cache-b27c80e9-9e75-41b2-b380-5cd86538f0c4" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:50:48 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-fa6b455c-b3c6-4dab-8a86-9af6e9ca2a80 req-e941d650-b702-4e52-bb4e-756828b813b8 service nova] Acquired lock "refresh_cache-b27c80e9-9e75-41b2-b380-5cd86538f0c4" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:50:48 user nova-compute[75066]: DEBUG nova.network.neutron [req-fa6b455c-b3c6-4dab-8a86-9af6e9ca2a80 req-e941d650-b702-4e52-bb4e-756828b813b8 service nova] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Refreshing network info cache for port 3e2fc190-28ce-414b-b435-820607838b7b {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:50:48 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:50:49 user nova-compute[75066]: DEBUG nova.network.neutron [req-fa6b455c-b3c6-4dab-8a86-9af6e9ca2a80 req-e941d650-b702-4e52-bb4e-756828b813b8 service nova] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Updated VIF entry in instance network info cache for port 3e2fc190-28ce-414b-b435-820607838b7b. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:50:49 user nova-compute[75066]: DEBUG nova.network.neutron [req-fa6b455c-b3c6-4dab-8a86-9af6e9ca2a80 req-e941d650-b702-4e52-bb4e-756828b813b8 service nova] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Updating instance_info_cache with network_info: [{"id": "3e2fc190-28ce-414b-b435-820607838b7b", "address": "fa:16:3e:46:86:fd", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e2fc190-28", "ovs_interfaceid": "3e2fc190-28ce-414b-b435-820607838b7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:50:49 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-fa6b455c-b3c6-4dab-8a86-9af6e9ca2a80 req-e941d650-b702-4e52-bb4e-756828b813b8 service nova] Releasing lock "refresh_cache-b27c80e9-9e75-41b2-b380-5cd86538f0c4" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:50:52 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:50:52 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:50:52 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:50:52 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:50:52 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:50:52 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:50:52 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:50:52 user nova-compute[75066]: DEBUG nova.virt.libvirt.imagecache [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Verify base images {{(pid=75066) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Dec 01 19:50:52 user nova-compute[75066]: DEBUG nova.virt.libvirt.imagecache [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Image id 900b237b-e99c-4fdd-a44f-dcb7a08baa86 yields fingerprint e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d {{(pid=75066) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Dec 01 19:50:52 user nova-compute[75066]: INFO nova.virt.libvirt.imagecache [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] image 900b237b-e99c-4fdd-a44f-dcb7a08baa86 at (/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d): checking
Dec 01 19:50:52 user nova-compute[75066]: DEBUG nova.virt.libvirt.imagecache [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] image 900b237b-e99c-4fdd-a44f-dcb7a08baa86 at (/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d): image is in use {{(pid=75066) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Dec 01 19:50:52 user nova-compute[75066]: DEBUG nova.virt.libvirt.imagecache [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75066) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Dec 01 19:50:52 user nova-compute[75066]: DEBUG nova.virt.libvirt.imagecache [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] b27c80e9-9e75-41b2-b380-5cd86538f0c4 is a valid instance name {{(pid=75066) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Dec 01 19:50:52 user nova-compute[75066]: DEBUG nova.virt.libvirt.imagecache [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] 7f0d914d-866e-45b1-9839-a4bbe19f6eb7 is a valid instance name {{(pid=75066) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Dec 01 19:50:52 user nova-compute[75066]: DEBUG nova.virt.libvirt.imagecache [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] 7f0d914d-866e-45b1-9839-a4bbe19f6eb7 has a disk file {{(pid=75066) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Dec 01 19:50:52 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f0d914d-866e-45b1-9839-a4bbe19f6eb7/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:50:52 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f0d914d-866e-45b1-9839-a4bbe19f6eb7/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:50:52 user nova-compute[75066]: DEBUG nova.virt.libvirt.imagecache [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 7f0d914d-866e-45b1-9839-a4bbe19f6eb7 is backed by e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d {{(pid=75066) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Dec 01 19:50:52 user nova-compute[75066]: WARNING nova.virt.libvirt.imagecache [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Unknown base file: /opt/stack/data/nova/instances/_base/22af62ee917ffa70f532c9e7daa88fdd37263fe0
Dec 01 19:50:52 user nova-compute[75066]: WARNING nova.virt.libvirt.imagecache [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Unknown base file: /opt/stack/data/nova/instances/_base/d9fd308ee2dc1081dec34e7f8d711d2fcf3bbb16
Dec 01 19:50:52 user nova-compute[75066]: WARNING nova.virt.libvirt.imagecache [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Unknown base file: /opt/stack/data/nova/instances/_base/6baa4c062a4b2b2913bcdfa8d3bd1e10ee669d4f
Dec 01 19:50:52 user nova-compute[75066]: WARNING nova.virt.libvirt.imagecache [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Unknown base file: /opt/stack/data/nova/instances/_base/71fb97c518f628e05f502c58238b0d7731d049ab
Dec 01 19:50:52 user nova-compute[75066]: WARNING nova.virt.libvirt.imagecache [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Unknown base file: /opt/stack/data/nova/instances/_base/0d416c5251b32eed450ffc84216db80ae55b05e6
Dec 01 19:50:52 user nova-compute[75066]: WARNING nova.virt.libvirt.imagecache [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Unknown base file: /opt/stack/data/nova/instances/_base/581b586cd6cae0145eb5a17c0c2e449e5d91efe7
Dec 01 19:50:52 user nova-compute[75066]: WARNING nova.virt.libvirt.imagecache [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Unknown base file: /opt/stack/data/nova/instances/_base/9bbb263f5c46f59f5f5cb5bdb1912b4b119eab4d
Dec 01 19:50:52 user nova-compute[75066]: WARNING nova.virt.libvirt.imagecache [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Unknown base file: /opt/stack/data/nova/instances/_base/6b039bc37a2a1b30c380ace1654e1b26ad7ae3d0
Dec 01 19:50:52 user nova-compute[75066]: WARNING nova.virt.libvirt.imagecache [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Unknown base file: /opt/stack/data/nova/instances/_base/d355c9206e88c86648ac73e02c0c25330d3bfb1c
Dec 01 19:50:52 user nova-compute[75066]: INFO nova.virt.libvirt.imagecache [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Active base files: /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d
Dec 01 19:50:52 user nova-compute[75066]: INFO nova.virt.libvirt.imagecache [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Removable base files: /opt/stack/data/nova/instances/_base/22af62ee917ffa70f532c9e7daa88fdd37263fe0 /opt/stack/data/nova/instances/_base/d9fd308ee2dc1081dec34e7f8d711d2fcf3bbb16 /opt/stack/data/nova/instances/_base/6baa4c062a4b2b2913bcdfa8d3bd1e10ee669d4f /opt/stack/data/nova/instances/_base/71fb97c518f628e05f502c58238b0d7731d049ab /opt/stack/data/nova/instances/_base/0d416c5251b32eed450ffc84216db80ae55b05e6 /opt/stack/data/nova/instances/_base/581b586cd6cae0145eb5a17c0c2e449e5d91efe7 /opt/stack/data/nova/instances/_base/9bbb263f5c46f59f5f5cb5bdb1912b4b119eab4d /opt/stack/data/nova/instances/_base/6b039bc37a2a1b30c380ace1654e1b26ad7ae3d0 /opt/stack/data/nova/instances/_base/d355c9206e88c86648ac73e02c0c25330d3bfb1c
Dec 01 19:50:52 user nova-compute[75066]: INFO nova.virt.libvirt.imagecache [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/22af62ee917ffa70f532c9e7daa88fdd37263fe0
Dec 01 19:50:52 user nova-compute[75066]: INFO nova.virt.libvirt.imagecache [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d9fd308ee2dc1081dec34e7f8d711d2fcf3bbb16
Dec 01 19:50:52 user nova-compute[75066]: INFO nova.virt.libvirt.imagecache [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/6baa4c062a4b2b2913bcdfa8d3bd1e10ee669d4f
Dec 01 19:50:52 user nova-compute[75066]: INFO nova.virt.libvirt.imagecache [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/71fb97c518f628e05f502c58238b0d7731d049ab
Dec 01 19:50:52 user nova-compute[75066]: INFO nova.virt.libvirt.imagecache [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/0d416c5251b32eed450ffc84216db80ae55b05e6
Dec 01 19:50:52 user nova-compute[75066]: INFO nova.virt.libvirt.imagecache [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/581b586cd6cae0145eb5a17c0c2e449e5d91efe7
Dec 01 19:50:52 user nova-compute[75066]: INFO nova.virt.libvirt.imagecache [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9bbb263f5c46f59f5f5cb5bdb1912b4b119eab4d
Dec 01 19:50:52 user nova-compute[75066]: INFO nova.virt.libvirt.imagecache [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/6b039bc37a2a1b30c380ace1654e1b26ad7ae3d0
Dec 01 19:50:52 user nova-compute[75066]: INFO nova.virt.libvirt.imagecache [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d355c9206e88c86648ac73e02c0c25330d3bfb1c
Dec 01 19:50:52 user nova-compute[75066]: DEBUG nova.virt.libvirt.imagecache [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Verification complete {{(pid=75066) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Dec 01 19:50:52 user nova-compute[75066]: DEBUG nova.virt.libvirt.imagecache [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Verify swap images {{(pid=75066) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Dec 01 19:50:52 user nova-compute[75066]: DEBUG nova.virt.libvirt.imagecache [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Verify ephemeral images {{(pid=75066) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Dec 01 19:50:53 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:50:53 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:50:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Acquiring lock "9f56c05b-2a04-4ff4-aebb-bc3f89d057cf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:50:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "9f56c05b-2a04-4ff4-aebb-bc3f89d057cf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:50:56 user nova-compute[75066]: DEBUG nova.compute.manager [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] Starting instance... {{(pid=75066) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 19:50:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:50:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:50:56 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75066) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 19:50:56 user nova-compute[75066]: INFO nova.compute.claims [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] Claim successful on node user
Dec 01 19:50:56 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:50:56 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:50:56 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.262s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:50:56 user nova-compute[75066]: DEBUG nova.compute.manager [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] Start building networks asynchronously for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 19:50:56 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 19:50:56 user nova-compute[75066]: DEBUG nova.compute.manager [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] Allocating IP information in the background. {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 19:50:56 user nova-compute[75066]: DEBUG nova.network.neutron [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] allocate_for_instance() {{(pid=75066) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 19:50:57 user nova-compute[75066]: DEBUG nova.compute.manager [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] Start building block device mappings for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 19:50:57 user nova-compute[75066]: INFO nova.virt.block_device [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] Booting with volume snapshot 81e28633-13bf-484b-8129-7fe3e07f0075 at /dev/vda
Dec 01 19:50:57 user nova-compute[75066]: DEBUG nova.policy [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e30df6ccb83b4e8daaed0970c4b423d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecd2a37ec7e4dbbbe53ed6ba9ff45bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75066) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 19:50:57 user nova-compute[75066]: DEBUG nova.network.neutron [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] Successfully created port: 8a18f6c0-4927-4a57-b852-0a50130a5040 {{(pid=75066) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 19:50:58 user nova-compute[75066]: DEBUG nova.network.neutron [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] Successfully updated port: 8a18f6c0-4927-4a57-b852-0a50130a5040 {{(pid=75066) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 19:50:58 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Acquiring lock "refresh_cache-9f56c05b-2a04-4ff4-aebb-bc3f89d057cf" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:50:58 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Acquired lock "refresh_cache-9f56c05b-2a04-4ff4-aebb-bc3f89d057cf" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:50:58 user nova-compute[75066]: DEBUG nova.network.neutron [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:50:58 user nova-compute[75066]: DEBUG nova.compute.manager [req-5eed01e5-1f62-49e7-919e-7648b5ccdf04 req-596743b4-941d-4afa-a862-fe0500576647 service nova] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] Received event network-changed-8a18f6c0-4927-4a57-b852-0a50130a5040 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:50:58 user nova-compute[75066]: DEBUG nova.compute.manager [req-5eed01e5-1f62-49e7-919e-7648b5ccdf04 req-596743b4-941d-4afa-a862-fe0500576647 service nova] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] Refreshing instance network info cache due to event network-changed-8a18f6c0-4927-4a57-b852-0a50130a5040. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:50:58 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-5eed01e5-1f62-49e7-919e-7648b5ccdf04 req-596743b4-941d-4afa-a862-fe0500576647 service nova] Acquiring lock "refresh_cache-9f56c05b-2a04-4ff4-aebb-bc3f89d057cf" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:50:58 user nova-compute[75066]: DEBUG nova.network.neutron [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:50:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:50:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:50:58 user nova-compute[75066]: DEBUG nova.network.neutron [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] Updating instance_info_cache with network_info: [{"id": "8a18f6c0-4927-4a57-b852-0a50130a5040", "address": "fa:16:3e:25:0b:0c", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a18f6c0-49", "ovs_interfaceid": "8a18f6c0-4927-4a57-b852-0a50130a5040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:50:58 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Releasing lock "refresh_cache-9f56c05b-2a04-4ff4-aebb-bc3f89d057cf" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:50:58 user nova-compute[75066]: DEBUG nova.compute.manager [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] Instance network_info: |[{"id": "8a18f6c0-4927-4a57-b852-0a50130a5040", "address": "fa:16:3e:25:0b:0c", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a18f6c0-49", "ovs_interfaceid": "8a18f6c0-4927-4a57-b852-0a50130a5040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 19:50:58 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-5eed01e5-1f62-49e7-919e-7648b5ccdf04 req-596743b4-941d-4afa-a862-fe0500576647 service nova] Acquired lock "refresh_cache-9f56c05b-2a04-4ff4-aebb-bc3f89d057cf" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:50:58 user nova-compute[75066]: DEBUG nova.network.neutron [req-5eed01e5-1f62-49e7-919e-7648b5ccdf04 req-596743b4-941d-4afa-a862-fe0500576647 service nova] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] Refreshing network info cache for port 8a18f6c0-4927-4a57-b852-0a50130a5040 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:50:59 user nova-compute[75066]: DEBUG nova.network.neutron [req-5eed01e5-1f62-49e7-919e-7648b5ccdf04 req-596743b4-941d-4afa-a862-fe0500576647 service nova] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] Updated VIF entry in instance network info cache for port 8a18f6c0-4927-4a57-b852-0a50130a5040. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:50:59 user nova-compute[75066]: DEBUG nova.network.neutron [req-5eed01e5-1f62-49e7-919e-7648b5ccdf04 req-596743b4-941d-4afa-a862-fe0500576647 service nova] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] Updating instance_info_cache with network_info: [{"id": "8a18f6c0-4927-4a57-b852-0a50130a5040", "address": "fa:16:3e:25:0b:0c", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a18f6c0-49", "ovs_interfaceid": "8a18f6c0-4927-4a57-b852-0a50130a5040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:50:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-5eed01e5-1f62-49e7-919e-7648b5ccdf04 req-596743b4-941d-4afa-a862-fe0500576647 service nova] Releasing lock "refresh_cache-9f56c05b-2a04-4ff4-aebb-bc3f89d057cf" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:51:02 user nova-compute[75066]: DEBUG os_brick.utils [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:51:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:51:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:51:02 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b12ef05-162c-4766-bf4b-58d4fbf19c3c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1959854982f\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:51:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:51:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:51:02 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[789552e3-d56b-4209-8429-d80eab2c2e4a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:51:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:51:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:51:02 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed0b9e4-542c-4497-b876-1d7f07141c2b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:51:02 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c4c101-bb9a-40ff-acb8-cd70de6be067]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:51:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Running cmd (subprocess): nvme version {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:51:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] 'nvme version' failed. Not Retrying. {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:51:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.nvmeof [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] nvme not present on system {{(pid=75066) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 19:51:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:51:02 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:51:02 user nova-compute[75066]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 19:51:02 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcbda8d4-0076-4a5b-8fc2-d7a92b995dbc]: (4, '') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:51:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75066) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 19:51:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 19:51:02 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] LIGHTOS: no hostnqn found. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 19:51:02 user nova-compute[75066]: DEBUG os_brick.utils [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1959854982f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:51:02 user nova-compute[75066]: DEBUG nova.virt.block_device [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] Updating existing volume attachment record: ca4300d5-e2bd-4a30-8fe1-84c3accf3b9d {{(pid=75066) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 19:51:03 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:51:03 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:51:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:51:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:51:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75066) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 19:51:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:51:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:51:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:51:11 user nova-compute[75066]: DEBUG nova.compute.manager [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] Start spawning the instance on the hypervisor. {{(pid=75066) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 19:51:11 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] Creating instance directory {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 19:51:11 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] Creating image(s)
Dec 01 19:51:11 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] Did not create local disks {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Dec 01 19:51:11 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] Ensure instance console log exists: /opt/stack/data/nova/instances/9f56c05b-2a04-4ff4-aebb-bc3f89d057cf/console.log {{(pid=75066) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 19:51:11 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] Start _get_guest_xml network_info=[{"id": "8a18f6c0-4927-4a57-b852-0a50130a5040", "address": "fa:16:3e:25:0b:0c", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a18f6c0-49", "ovs_interfaceid": "8a18f6c0-4927-4a57-b852-0a50130a5040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-12-01T19:50:50Z,direct_url=<?>,disk_format='qcow2',id=c7982ad3-5a8c-4dce-b1ea-0e963756676a,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1552691333',owner='9ecd2a37ec7e4dbbbe53ed6ba9ff45bb',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-12-01T19:50:51Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': True, 'attachment_id': 'ca4300d5-e2bd-4a30-8fe1-84c3accf3b9d', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:32f95ce9-8cdb-4165-a13e-38d3167e8178', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bjgDfPsR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9f56c05b-2a04-4ff4-aebb-bc3f89d057cf', 'attached_at': '', 'detached_at': '', 'volume_id': '32f95ce9-8cdb-4165-a13e-38d3167e8178', 'serial': '32f95ce9-8cdb-4165-a13e-38d3167e8178'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:51:12 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:51:12 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:51:12 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-12-01T19:50:50Z,direct_url=<?>,disk_format='qcow2',id=c7982ad3-5a8c-4dce-b1ea-0e963756676a,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1552691333',owner='9ecd2a37ec7e4dbbbe53ed6ba9ff45bb',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-12-01T19:50:51Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] Calling os-brick to attach iSCSI Volume {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:32f95ce9-8cdb-4165-a13e-38d3167e8178', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bjgDfPsR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:51:12 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:51:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:51:12 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:51:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32f95ce9-8cdb-4165-a13e-38d3167e8178" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32f95ce9-8cdb-4165-a13e-38d3167e8178" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:51:12 user nova-compute[75066]: INFO os_brick.initiator.connectors.iscsi [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 19:51:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32f95ce9-8cdb-4165-a13e-38d3167e8178 -p 172.16.0.220:3260 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32f95ce9-8cdb-4165-a13e-38d3167e8178 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[188e3d5b-9e64-4ca3-b00c-ecd3efc4fba5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 19:51:12 user nova-compute[75066]:  {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32f95ce9-8cdb-4165-a13e-38d3167e8178 -p 172.16.0.220:3260 --interface default --op new {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32f95ce9-8cdb-4165-a13e-38d3167e8178 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a257e19-bfb0-4169-86c6-bbfe1acedd0d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32f95ce9-8cdb-4165-a13e-38d3167e8178] added\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32f95ce9-8cdb-4165-a13e-38d3167e8178] added
Dec 01 19:51:12 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32f95ce9-8cdb-4165-a13e-38d3167e8178 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32f95ce9-8cdb-4165-a13e-38d3167e8178 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3cd1631-6d93-4985-bb11-fbe30d68ec4e]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32f95ce9-8cdb-4165-a13e-38d3167e8178 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32f95ce9-8cdb-4165-a13e-38d3167e8178 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[996b00cf-9c36-496b-ae55-4d72bd5d7df4]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32f95ce9-8cdb-4165-a13e-38d3167e8178 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bjgDfPsR {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32f95ce9-8cdb-4165-a13e-38d3167e8178 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bjgDfPsR" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9acd00c-8cdd-4c82-b167-a3cb0a98d9b3]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bjgDfPsR'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32f95ce9-8cdb-4165-a13e-38d3167e8178 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32f95ce9-8cdb-4165-a13e-38d3167e8178 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b2314e-5667-4201-9ac7-89cce22e13d9]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b56adaf-ebd8-42f9-ac06-6e46a54d9d8d]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a (non-flash)
Dec 01 19:51:12 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a (non-flash)
Dec 01 19:51:12 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32f95ce9-8cdb-4165-a13e-38d3167e8178 -p 172.16.0.220:3260 --login {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32f95ce9-8cdb-4165-a13e-38d3167e8178 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[d93e1849-05ed-40f4-8f35-0c7fd0aeeeef]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:32f95ce9-8cdb-4165-a13e-38d3167e8178, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:32f95ce9-8cdb-4165-a13e-38d3167e8178, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:32f95ce9-8cdb-4165-a13e-38d3167e8178, portal: 172.16.0.220,3260]
Dec 01 19:51:12 user nova-compute[75066]: Login to [iface: default, target: iqn.2010-10.org.openstack:32f95ce9-8cdb-4165-a13e-38d3167e8178, portal: 172.16.0.220,3260] successful.
Dec 01 19:51:12 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32f95ce9-8cdb-4165-a13e-38d3167e8178 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32f95ce9-8cdb-4165-a13e-38d3167e8178 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[c58f7604-2511-47e2-9eac-84c8b013fbac]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4ef2c0-3174-489d-9ddd-682ec45bb004]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32f95ce9-8cdb-4165-a13e-38d3167e8178 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a (non-flash)
Dec 01 19:51:12 user nova-compute[75066]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32f95ce9-8cdb-4165-a13e-38d3167e8178 (non-flash)
Dec 01 19:51:12 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a (non-flash)
Dec 01 19:51:12 user nova-compute[75066]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32f95ce9-8cdb-4165-a13e-38d3167e8178 (non-flash)
Dec 01 19:51:12 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32f95ce9-8cdb-4165-a13e-38d3167e8178" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Connected to 172.16.0.220:3260 {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] HCTL ('34', '-', '-', 0) found on session 55 with lun 0 {{(pid=75066) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75066) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27b1f67-fe64-44b4-a338-49c6bcafd754]: (4, ('- - 0', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:51:12 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: None {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:51:13 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:51:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:32f95ce9-8cdb-4165-a13e-38d3167e8178', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bjgDfPsR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 19:51:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:51:13 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] <== connect_volume: return (1327ms) {'type': 'block', 'scsi_wwn': '23333323738306134', 'path': '/dev/sdc'} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:51:13 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333323738306134', 'path': '/dev/sdc'} {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 19:51:13 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:50:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-145536218',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-145536218',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-145536218',id=48,image_ref='c7982ad3-5a8c-4dce-b1ea-0e963756676a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOT0cTmYr4iHSeklLXjZFRZINTVRJArfjO4uhozDFwXl9cs1GcOMDrwj5d3Sb4psijIwneKywdG/LMtv4byMZGUGGN3LoNPDSn8daqA9F84Fxku6PAJHkjBwn5ORexxdKA==',key_name='tempest-keypair-580662870',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ecd2a37ec7e4dbbbe53ed6ba9ff45bb',ramdisk_id='',reservation_id='r-85jqw1sz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-384255364',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-384255364-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-384255364',owner_user_name='tempest-TestVolumeBootPattern-384255364-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:50:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e30df6ccb83b4e8daaed0970c4b423d3',uuid=9f56c05b-2a04-4ff4-aebb-bc3f89d057cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a18f6c0-4927-4a57-b852-0a50130a5040", "address": "fa:16:3e:25:0b:0c", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a18f6c0-49", "ovs_interfaceid": "8a18f6c0-4927-4a57-b852-0a50130a5040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:51:13 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Converting VIF {"id": "8a18f6c0-4927-4a57-b852-0a50130a5040", "address": "fa:16:3e:25:0b:0c", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a18f6c0-49", "ovs_interfaceid": "8a18f6c0-4927-4a57-b852-0a50130a5040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:51:13 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:0b:0c,bridge_name='br-int',has_traffic_filtering=True,id=8a18f6c0-4927-4a57-b852-0a50130a5040,network=Network(2a39f486-871f-4115-88cb-176e846fe4f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a18f6c0-49') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:51:13 user nova-compute[75066]: DEBUG nova.objects.instance [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lazy-loading 'pci_devices' on Instance uuid 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:51:13 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:51:13 user nova-compute[75066]:   <uuid>9f56c05b-2a04-4ff4-aebb-bc3f89d057cf</uuid>
Dec 01 19:51:13 user nova-compute[75066]:   <name>instance-00000030</name>
Dec 01 19:51:13 user nova-compute[75066]:   <memory>524288</memory>
Dec 01 19:51:13 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:51:13 user nova-compute[75066]:   <metadata>
Dec 01 19:51:13 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:51:13 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:51:13 user nova-compute[75066]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-145536218</nova:name>
Dec 01 19:51:13 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:51:12</nova:creationTime>
Dec 01 19:51:13 user nova-compute[75066]:       <nova:flavor name="m1.tiny">
Dec 01 19:51:13 user nova-compute[75066]:         <nova:memory>512</nova:memory>
Dec 01 19:51:13 user nova-compute[75066]:         <nova:disk>1</nova:disk>
Dec 01 19:51:13 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:51:13 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:51:13 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:51:13 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:51:13 user nova-compute[75066]:       <nova:owner>
Dec 01 19:51:13 user nova-compute[75066]:         <nova:user uuid="e30df6ccb83b4e8daaed0970c4b423d3">tempest-TestVolumeBootPattern-384255364-project-member</nova:user>
Dec 01 19:51:13 user nova-compute[75066]:         <nova:project uuid="9ecd2a37ec7e4dbbbe53ed6ba9ff45bb">tempest-TestVolumeBootPattern-384255364</nova:project>
Dec 01 19:51:13 user nova-compute[75066]:       </nova:owner>
Dec 01 19:51:13 user nova-compute[75066]:       <nova:root type="image" uuid="c7982ad3-5a8c-4dce-b1ea-0e963756676a"/>
Dec 01 19:51:13 user nova-compute[75066]:       <nova:ports>
Dec 01 19:51:13 user nova-compute[75066]:         <nova:port uuid="8a18f6c0-4927-4a57-b852-0a50130a5040">
Dec 01 19:51:13 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 01 19:51:13 user nova-compute[75066]:         </nova:port>
Dec 01 19:51:13 user nova-compute[75066]:       </nova:ports>
Dec 01 19:51:13 user nova-compute[75066]:     </nova:instance>
Dec 01 19:51:13 user nova-compute[75066]:   </metadata>
Dec 01 19:51:13 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:51:13 user nova-compute[75066]:     <system>
Dec 01 19:51:13 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:51:13 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:51:13 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:51:13 user nova-compute[75066]:       <entry name="serial">9f56c05b-2a04-4ff4-aebb-bc3f89d057cf</entry>
Dec 01 19:51:13 user nova-compute[75066]:       <entry name="uuid">9f56c05b-2a04-4ff4-aebb-bc3f89d057cf</entry>
Dec 01 19:51:13 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:51:13 user nova-compute[75066]:     </system>
Dec 01 19:51:13 user nova-compute[75066]:   </sysinfo>
Dec 01 19:51:13 user nova-compute[75066]:   <os>
Dec 01 19:51:13 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:51:13 user nova-compute[75066]:     <boot dev="hd"/>
Dec 01 19:51:13 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:51:13 user nova-compute[75066]:   </os>
Dec 01 19:51:13 user nova-compute[75066]:   <features>
Dec 01 19:51:13 user nova-compute[75066]:     <acpi/>
Dec 01 19:51:13 user nova-compute[75066]:     <apic/>
Dec 01 19:51:13 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:51:13 user nova-compute[75066]:   </features>
Dec 01 19:51:13 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:51:13 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:51:13 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:51:13 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:51:13 user nova-compute[75066]:   </clock>
Dec 01 19:51:13 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:51:13 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:51:13 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:51:13 user nova-compute[75066]:   </cpu>
Dec 01 19:51:13 user nova-compute[75066]:   <devices>
Dec 01 19:51:13 user nova-compute[75066]:     <disk type="block" device="disk">
Dec 01 19:51:13 user nova-compute[75066]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:51:13 user nova-compute[75066]:       <source dev="/dev/sdc"/>
Dec 01 19:51:13 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:51:13 user nova-compute[75066]:       <serial>32f95ce9-8cdb-4165-a13e-38d3167e8178</serial>
Dec 01 19:51:13 user nova-compute[75066]:     </disk>
Dec 01 19:51:13 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:51:13 user nova-compute[75066]:       <mac address="fa:16:3e:25:0b:0c"/>
Dec 01 19:51:13 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:51:13 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:51:13 user nova-compute[75066]:       <target dev="tap8a18f6c0-49"/>
Dec 01 19:51:13 user nova-compute[75066]:     </interface>
Dec 01 19:51:13 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:51:13 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/9f56c05b-2a04-4ff4-aebb-bc3f89d057cf/console.log" append="off"/>
Dec 01 19:51:13 user nova-compute[75066]:     </serial>
Dec 01 19:51:13 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:51:13 user nova-compute[75066]:     <video>
Dec 01 19:51:13 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:51:13 user nova-compute[75066]:     </video>
Dec 01 19:51:13 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:51:13 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:51:13 user nova-compute[75066]:     </rng>
Dec 01 19:51:13 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:51:13 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:51:13 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:51:13 user nova-compute[75066]:     </memballoon>
Dec 01 19:51:13 user nova-compute[75066]:   </devices>
Dec 01 19:51:13 user nova-compute[75066]: </domain>
Dec 01 19:51:13 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:51:13 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:50:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-145536218',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-145536218',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-145536218',id=48,image_ref='c7982ad3-5a8c-4dce-b1ea-0e963756676a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOT0cTmYr4iHSeklLXjZFRZINTVRJArfjO4uhozDFwXl9cs1GcOMDrwj5d3Sb4psijIwneKywdG/LMtv4byMZGUGGN3LoNPDSn8daqA9F84Fxku6PAJHkjBwn5ORexxdKA==',key_name='tempest-keypair-580662870',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ecd2a37ec7e4dbbbe53ed6ba9ff45bb',ramdisk_id='',reservation_id='r-85jqw1sz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-384255364',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-384255364-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-384255364',owner_user_name='tempest-TestVolumeBootPattern-384255364-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:50:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e30df6ccb83b4e8daaed0970c4b423d3',uuid=9f56c05b-2a04-4ff4-aebb-bc3f89d057cf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a18f6c0-4927-4a57-b852-0a50130a5040", "address": "fa:16:3e:25:0b:0c", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a18f6c0-49", "ovs_interfaceid": "8a18f6c0-4927-4a57-b852-0a50130a5040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:51:13 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Converting VIF {"id": "8a18f6c0-4927-4a57-b852-0a50130a5040", "address": "fa:16:3e:25:0b:0c", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a18f6c0-49", "ovs_interfaceid": "8a18f6c0-4927-4a57-b852-0a50130a5040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:51:13 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:0b:0c,bridge_name='br-int',has_traffic_filtering=True,id=8a18f6c0-4927-4a57-b852-0a50130a5040,network=Network(2a39f486-871f-4115-88cb-176e846fe4f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a18f6c0-49') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:51:13 user nova-compute[75066]: DEBUG os_vif [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:0b:0c,bridge_name='br-int',has_traffic_filtering=True,id=8a18f6c0-4927-4a57-b852-0a50130a5040,network=Network(2a39f486-871f-4115-88cb-176e846fe4f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a18f6c0-49') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:51:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:51:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:51:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:51:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:51:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3686384b-a162-5eb8-ae3f-7d21a5149233', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:51:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:51:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:51:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:51:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a18f6c0-49, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:51:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8a18f6c0-49, col_values=(('qos', UUID('85ecc84a-3c19-4850-b2e3-303a06ffb9e1')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:51:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8a18f6c0-49, col_values=(('external_ids', {'iface-id': '8a18f6c0-4927-4a57-b852-0a50130a5040', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:0b:0c', 'vm-uuid': '9f56c05b-2a04-4ff4-aebb-bc3f89d057cf'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:51:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:51:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:51:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:51:13 user nova-compute[75066]: INFO os_vif [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:0b:0c,bridge_name='br-int',has_traffic_filtering=True,id=8a18f6c0-4927-4a57-b852-0a50130a5040,network=Network(2a39f486-871f-4115-88cb-176e846fe4f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a18f6c0-49')
Dec 01 19:51:13 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:51:13 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] No VIF found with MAC fa:16:3e:25:0b:0c, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:51:14 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:51:14 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:51:14 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:51:14 user nova-compute[75066]: DEBUG nova.compute.manager [req-d42a9f76-4955-453e-b2d2-c9e9ceda9a25 req-5cfdb0ab-33c2-4b1b-b328-aba89a7df382 service nova] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] Received event network-vif-plugged-8a18f6c0-4927-4a57-b852-0a50130a5040 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:51:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d42a9f76-4955-453e-b2d2-c9e9ceda9a25 req-5cfdb0ab-33c2-4b1b-b328-aba89a7df382 service nova] Acquiring lock "9f56c05b-2a04-4ff4-aebb-bc3f89d057cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:51:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d42a9f76-4955-453e-b2d2-c9e9ceda9a25 req-5cfdb0ab-33c2-4b1b-b328-aba89a7df382 service nova] Lock "9f56c05b-2a04-4ff4-aebb-bc3f89d057cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:51:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d42a9f76-4955-453e-b2d2-c9e9ceda9a25 req-5cfdb0ab-33c2-4b1b-b328-aba89a7df382 service nova] Lock "9f56c05b-2a04-4ff4-aebb-bc3f89d057cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:51:14 user nova-compute[75066]: DEBUG nova.compute.manager [req-d42a9f76-4955-453e-b2d2-c9e9ceda9a25 req-5cfdb0ab-33c2-4b1b-b328-aba89a7df382 service nova] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] No waiting events found dispatching network-vif-plugged-8a18f6c0-4927-4a57-b852-0a50130a5040 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:51:14 user nova-compute[75066]: WARNING nova.compute.manager [req-d42a9f76-4955-453e-b2d2-c9e9ceda9a25 req-5cfdb0ab-33c2-4b1b-b328-aba89a7df382 service nova] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] Received unexpected event network-vif-plugged-8a18f6c0-4927-4a57-b852-0a50130a5040 for instance with vm_state building and task_state spawning.
Dec 01 19:51:14 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:51:16 user nova-compute[75066]: DEBUG nova.compute.manager [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] Instance event wait completed in 0 seconds for  {{(pid=75066) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 19:51:16 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] Guest created on hypervisor {{(pid=75066) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 19:51:16 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] Instance spawned successfully.
Dec 01 19:51:16 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 19:51:16 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] Found default for hw_input_bus of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:51:16 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] Found default for hw_pointer_model of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:51:16 user nova-compute[75066]: INFO nova.compute.manager [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] Took 4.89 seconds to spawn the instance on the hypervisor.
Dec 01 19:51:16 user nova-compute[75066]: DEBUG nova.compute.manager [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:51:16 user nova-compute[75066]: INFO nova.compute.manager [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] Took 20.33 seconds to build instance.
Dec 01 19:51:16 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-db27ef9c-43fa-4464-a3ba-cfad9bf81e43 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "9f56c05b-2a04-4ff4-aebb-bc3f89d057cf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.434s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:51:16 user nova-compute[75066]: DEBUG nova.compute.manager [req-ca7e1e17-01bc-4f5c-bfd5-5285c661d4bd req-b01b5290-ce66-4b70-af71-7e3b52838d14 service nova] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] Received event network-vif-plugged-8a18f6c0-4927-4a57-b852-0a50130a5040 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:51:16 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-ca7e1e17-01bc-4f5c-bfd5-5285c661d4bd req-b01b5290-ce66-4b70-af71-7e3b52838d14 service nova] Acquiring lock "9f56c05b-2a04-4ff4-aebb-bc3f89d057cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:51:16 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-ca7e1e17-01bc-4f5c-bfd5-5285c661d4bd req-b01b5290-ce66-4b70-af71-7e3b52838d14 service nova] Lock "9f56c05b-2a04-4ff4-aebb-bc3f89d057cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:51:16 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-ca7e1e17-01bc-4f5c-bfd5-5285c661d4bd req-b01b5290-ce66-4b70-af71-7e3b52838d14 service nova] Lock "9f56c05b-2a04-4ff4-aebb-bc3f89d057cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:51:16 user nova-compute[75066]: DEBUG nova.compute.manager [req-ca7e1e17-01bc-4f5c-bfd5-5285c661d4bd req-b01b5290-ce66-4b70-af71-7e3b52838d14 service nova] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] No waiting events found dispatching network-vif-plugged-8a18f6c0-4927-4a57-b852-0a50130a5040 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:51:16 user nova-compute[75066]: WARNING nova.compute.manager [req-ca7e1e17-01bc-4f5c-bfd5-5285c661d4bd req-b01b5290-ce66-4b70-af71-7e3b52838d14 service nova] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] Received unexpected event network-vif-plugged-8a18f6c0-4927-4a57-b852-0a50130a5040 for instance with vm_state active and task_state None.
Dec 01 19:51:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:51:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:51:20 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:51:20 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75066) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 01 19:51:21 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:51:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:51:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:51:25 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:51:25 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75066) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 19:51:28 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:51:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:51:29 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:51:30 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:51:33 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:51:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:51:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:51:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75066) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 19:51:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:51:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:51:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:51:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:51:36 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:51:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:51:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:51:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:51:36 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75066) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 19:51:36 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:51:36 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:51:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f0d914d-866e-45b1-9839-a4bbe19f6eb7/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:51:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f0d914d-866e-45b1-9839-a4bbe19f6eb7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:51:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f0d914d-866e-45b1-9839-a4bbe19f6eb7/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:51:36 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f0d914d-866e-45b1-9839-a4bbe19f6eb7/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:51:37 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:51:37 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:51:37 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Hypervisor/Node resource view: name=user free_ram=8725MB free_disk=24.879989624023438GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75066) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 19:51:37 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:51:37 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:51:37 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance b27c80e9-9e75-41b2-b380-5cd86538f0c4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:51:37 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 7f0d914d-866e-45b1-9839-a4bbe19f6eb7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:51:37 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:51:37 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 19:51:37 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 19:51:37 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Refreshing inventories for resource provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 01 19:51:37 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Updating ProviderTree inventory for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 01 19:51:37 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Updating inventory in ProviderTree for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 01 19:51:37 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Refreshing aggregate associations for resource provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62, aggregates: None {{(pid=75066) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 01 19:51:37 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Refreshing trait associations for resource provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62, traits: COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SECURITY_UEFI_SECURE_BOOT {{(pid=75066) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 01 19:51:37 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:51:37 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:51:37 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Compute_service record updated for user:user {{(pid=75066) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 19:51:37 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.435s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:51:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:51:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:51:39 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:51:39 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Starting heal instance info cache {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 19:51:39 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "refresh_cache-7f0d914d-866e-45b1-9839-a4bbe19f6eb7" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:51:39 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquired lock "refresh_cache-7f0d914d-866e-45b1-9839-a4bbe19f6eb7" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:51:39 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Forcefully refreshing network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 19:51:40 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Updating instance_info_cache with network_info: [{"id": "df573bb8-23b8-437e-83c0-ccb759d7c59a", "address": "fa:16:3e:8f:28:44", "network": {"id": "955d6293-ede6-4cb4-8cee-0157dbad93ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-603640322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109097a30a40419092c74f4c7a695ce4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf573bb8-23", "ovs_interfaceid": "df573bb8-23b8-437e-83c0-ccb759d7c59a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:51:40 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Releasing lock "refresh_cache-7f0d914d-866e-45b1-9839-a4bbe19f6eb7" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:51:40 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Updated the network info_cache for instance {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 19:51:40 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:51:42 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:51:42 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:51:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:51:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:51:48 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:51:48 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:51:53 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:51:53 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:51:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:51:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:52:02 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:52:02 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Cleaning up deleted instances {{(pid=75066) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 01 19:52:02 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] There are 0 instances to clean {{(pid=75066) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 01 19:52:03 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:52:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:52:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:52:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75066) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 19:52:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:52:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:52:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:52:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:52:14 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:52:14 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Triggering sync for uuid b27c80e9-9e75-41b2-b380-5cd86538f0c4 {{(pid=75066) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 19:52:14 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Triggering sync for uuid 7f0d914d-866e-45b1-9839-a4bbe19f6eb7 {{(pid=75066) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 19:52:14 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Triggering sync for uuid 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf {{(pid=75066) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Dec 01 19:52:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "b27c80e9-9e75-41b2-b380-5cd86538f0c4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:52:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "b27c80e9-9e75-41b2-b380-5cd86538f0c4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:52:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "7f0d914d-866e-45b1-9839-a4bbe19f6eb7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:52:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "7f0d914d-866e-45b1-9839-a4bbe19f6eb7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:52:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "9f56c05b-2a04-4ff4-aebb-bc3f89d057cf" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:52:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "9f56c05b-2a04-4ff4-aebb-bc3f89d057cf" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:52:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "b27c80e9-9e75-41b2-b380-5cd86538f0c4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:52:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "7f0d914d-866e-45b1-9839-a4bbe19f6eb7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:52:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "9f56c05b-2a04-4ff4-aebb-bc3f89d057cf" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:52:16 user nova-compute[75066]: DEBUG nova.compute.manager [req-ac784d25-0c08-4be1-abad-18e45984bfac req-cd28ab3e-1c15-4f3b-a40f-3fce9ed1d110 service nova] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Received event network-changed-df573bb8-23b8-437e-83c0-ccb759d7c59a {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:52:16 user nova-compute[75066]: DEBUG nova.compute.manager [req-ac784d25-0c08-4be1-abad-18e45984bfac req-cd28ab3e-1c15-4f3b-a40f-3fce9ed1d110 service nova] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Refreshing instance network info cache due to event network-changed-df573bb8-23b8-437e-83c0-ccb759d7c59a. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:52:16 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-ac784d25-0c08-4be1-abad-18e45984bfac req-cd28ab3e-1c15-4f3b-a40f-3fce9ed1d110 service nova] Acquiring lock "refresh_cache-7f0d914d-866e-45b1-9839-a4bbe19f6eb7" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:52:16 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-ac784d25-0c08-4be1-abad-18e45984bfac req-cd28ab3e-1c15-4f3b-a40f-3fce9ed1d110 service nova] Acquired lock "refresh_cache-7f0d914d-866e-45b1-9839-a4bbe19f6eb7" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:52:16 user nova-compute[75066]: DEBUG nova.network.neutron [req-ac784d25-0c08-4be1-abad-18e45984bfac req-cd28ab3e-1c15-4f3b-a40f-3fce9ed1d110 service nova] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Refreshing network info cache for port df573bb8-23b8-437e-83c0-ccb759d7c59a {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:52:17 user nova-compute[75066]: DEBUG nova.network.neutron [req-ac784d25-0c08-4be1-abad-18e45984bfac req-cd28ab3e-1c15-4f3b-a40f-3fce9ed1d110 service nova] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Updated VIF entry in instance network info cache for port df573bb8-23b8-437e-83c0-ccb759d7c59a. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:52:17 user nova-compute[75066]: DEBUG nova.network.neutron [req-ac784d25-0c08-4be1-abad-18e45984bfac req-cd28ab3e-1c15-4f3b-a40f-3fce9ed1d110 service nova] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Updating instance_info_cache with network_info: [{"id": "df573bb8-23b8-437e-83c0-ccb759d7c59a", "address": "fa:16:3e:8f:28:44", "network": {"id": "955d6293-ede6-4cb4-8cee-0157dbad93ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-603640322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109097a30a40419092c74f4c7a695ce4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf573bb8-23", "ovs_interfaceid": "df573bb8-23b8-437e-83c0-ccb759d7c59a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:52:17 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-ac784d25-0c08-4be1-abad-18e45984bfac req-cd28ab3e-1c15-4f3b-a40f-3fce9ed1d110 service nova] Releasing lock "refresh_cache-7f0d914d-866e-45b1-9839-a4bbe19f6eb7" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:52:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:52:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:52:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75066) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 19:52:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:52:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:52:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:52:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:52:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-2ce76aa2-b612-40d9-a6db-b9bd9688e328 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Acquiring lock "7f0d914d-866e-45b1-9839-a4bbe19f6eb7" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:52:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-2ce76aa2-b612-40d9-a6db-b9bd9688e328 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "7f0d914d-866e-45b1-9839-a4bbe19f6eb7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:52:20 user nova-compute[75066]: DEBUG nova.objects.instance [None req-2ce76aa2-b612-40d9-a6db-b9bd9688e328 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lazy-loading 'flavor' on Instance uuid 7f0d914d-866e-45b1-9839-a4bbe19f6eb7 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:52:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-2ce76aa2-b612-40d9-a6db-b9bd9688e328 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "7f0d914d-866e-45b1-9839-a4bbe19f6eb7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.087s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:52:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-2ce76aa2-b612-40d9-a6db-b9bd9688e328 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Acquiring lock "7f0d914d-866e-45b1-9839-a4bbe19f6eb7" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:52:20 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-2ce76aa2-b612-40d9-a6db-b9bd9688e328 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "7f0d914d-866e-45b1-9839-a4bbe19f6eb7" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:52:20 user nova-compute[75066]: INFO nova.compute.manager [None req-2ce76aa2-b612-40d9-a6db-b9bd9688e328 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Attaching volume 9932f6f7-cd7d-43d7-88f8-ffc397947f9b to /dev/vdb
Dec 01 19:52:20 user nova-compute[75066]: DEBUG os_brick.utils [None req-2ce76aa2-b612-40d9-a6db-b9bd9688e328 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:52:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:52:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:52:20 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[55eec935-4068-4600-98a1-3f1050629821]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1959854982f\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:52:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:52:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:52:20 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a9efee-045a-4f45-8cfd-224021af1415]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:52:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:52:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:52:20 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[6201d542-4ca3-4a67-92a2-0d2b76b776c0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:52:20 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16abf88-ec41-4ce9-9544-f6fc4346fbc1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:52:20 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-2ce76aa2-b612-40d9-a6db-b9bd9688e328 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Running cmd (subprocess): nvme version {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:52:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-2ce76aa2-b612-40d9-a6db-b9bd9688e328 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] 'nvme version' failed. Not Retrying. {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:52:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2ce76aa2-b612-40d9-a6db-b9bd9688e328 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] nvme not present on system {{(pid=75066) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 19:52:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:52:21 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:52:21 user nova-compute[75066]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 19:52:21 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c26e4d-f030-490d-8b5a-24773852a993]: (4, '') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:52:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-2ce76aa2-b612-40d9-a6db-b9bd9688e328 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75066) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 19:52:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-2ce76aa2-b612-40d9-a6db-b9bd9688e328 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 19:52:21 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-2ce76aa2-b612-40d9-a6db-b9bd9688e328 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] LIGHTOS: no hostnqn found. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 19:52:21 user nova-compute[75066]: DEBUG os_brick.utils [None req-2ce76aa2-b612-40d9-a6db-b9bd9688e328 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1959854982f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:52:21 user nova-compute[75066]: DEBUG nova.virt.block_device [None req-2ce76aa2-b612-40d9-a6db-b9bd9688e328 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Updating existing volume attachment record: 4f4e264a-f006-4d55-af4b-3dd26aaa1daf {{(pid=75066) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 19:52:22 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:52:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:52:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:52:26 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:52:26 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75066) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 19:52:28 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:52:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:52:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:52:29 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:52:29 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ce76aa2-b612-40d9-a6db-b9bd9688e328 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Calling os-brick to attach iSCSI Volume {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 19:52:29 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce76aa2-b612-40d9-a6db-b9bd9688e328 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9932f6f7-cd7d-43d7-88f8-ffc397947f9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fkIKWrZC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:52:29 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-2ce76aa2-b612-40d9-a6db-b9bd9688e328 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:52:29 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-2ce76aa2-b612-40d9-a6db-b9bd9688e328 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:52:29 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-2ce76aa2-b612-40d9-a6db-b9bd9688e328 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:52:29 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-2ce76aa2-b612-40d9-a6db-b9bd9688e328 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:52:29 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-2ce76aa2-b612-40d9-a6db-b9bd9688e328 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9932f6f7-cd7d-43d7-88f8-ffc397947f9b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:52:29 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-2ce76aa2-b612-40d9-a6db-b9bd9688e328 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9932f6f7-cd7d-43d7-88f8-ffc397947f9b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:52:29 user nova-compute[75066]: INFO os_brick.initiator.connectors.iscsi [None req-2ce76aa2-b612-40d9-a6db-b9bd9688e328 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 19:52:29 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9932f6f7-cd7d-43d7-88f8-ffc397947f9b -p 172.16.0.220:3260 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:52:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9932f6f7-cd7d-43d7-88f8-ffc397947f9b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:52:30 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ca0c9e-05ea-4689-bfa3-7c4bba7fb008]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:52:30 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce76aa2-b612-40d9-a6db-b9bd9688e328 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 19:52:30 user nova-compute[75066]:  {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:52:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9932f6f7-cd7d-43d7-88f8-ffc397947f9b -p 172.16.0.220:3260 --interface default --op new {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:52:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9932f6f7-cd7d-43d7-88f8-ffc397947f9b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:52:30 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e6e1c33-a1ef-4b64-b98c-e3fe43a572d7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9932f6f7-cd7d-43d7-88f8-ffc397947f9b] added\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:52:30 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce76aa2-b612-40d9-a6db-b9bd9688e328 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9932f6f7-cd7d-43d7-88f8-ffc397947f9b] added
Dec 01 19:52:30 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:52:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9932f6f7-cd7d-43d7-88f8-ffc397947f9b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:52:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9932f6f7-cd7d-43d7-88f8-ffc397947f9b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:52:30 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[c349a6fd-5592-438e-8367-3328b0083bf1]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:52:30 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce76aa2-b612-40d9-a6db-b9bd9688e328 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:52:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9932f6f7-cd7d-43d7-88f8-ffc397947f9b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:52:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9932f6f7-cd7d-43d7-88f8-ffc397947f9b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:52:30 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1207520-a2a7-4b3a-af06-9ff10f278042]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:52:30 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce76aa2-b612-40d9-a6db-b9bd9688e328 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:52:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9932f6f7-cd7d-43d7-88f8-ffc397947f9b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fkIKWrZC {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:52:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9932f6f7-cd7d-43d7-88f8-ffc397947f9b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fkIKWrZC" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:52:30 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22cf2e3-2364-44ae-adb7-e6a3d143a8d5]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:52:30 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce76aa2-b612-40d9-a6db-b9bd9688e328 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fkIKWrZC'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:52:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9932f6f7-cd7d-43d7-88f8-ffc397947f9b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:52:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9932f6f7-cd7d-43d7-88f8-ffc397947f9b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:52:30 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f956d8-1074-4dc9-a192-d3f604d2549c]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:52:30 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce76aa2-b612-40d9-a6db-b9bd9688e328 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:52:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:52:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:52:30 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[1216fe35-2189-42cb-b4bc-46e143b74927]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32f95ce9-8cdb-4165-a13e-38d3167e8178 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:52:30 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce76aa2-b612-40d9-a6db-b9bd9688e328 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a (non-flash)
Dec 01 19:52:30 user nova-compute[75066]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32f95ce9-8cdb-4165-a13e-38d3167e8178 (non-flash)
Dec 01 19:52:30 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:52:30 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce76aa2-b612-40d9-a6db-b9bd9688e328 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a (non-flash)
Dec 01 19:52:30 user nova-compute[75066]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32f95ce9-8cdb-4165-a13e-38d3167e8178 (non-flash)
Dec 01 19:52:30 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:52:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9932f6f7-cd7d-43d7-88f8-ffc397947f9b -p 172.16.0.220:3260 --login {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:52:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9932f6f7-cd7d-43d7-88f8-ffc397947f9b -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:52:30 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[520673df-7b75-45df-b89d-57940829adb6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9932f6f7-cd7d-43d7-88f8-ffc397947f9b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9932f6f7-cd7d-43d7-88f8-ffc397947f9b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:52:30 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce76aa2-b612-40d9-a6db-b9bd9688e328 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9932f6f7-cd7d-43d7-88f8-ffc397947f9b, portal: 172.16.0.220,3260]
Dec 01 19:52:30 user nova-compute[75066]: Login to [iface: default, target: iqn.2010-10.org.openstack:9932f6f7-cd7d-43d7-88f8-ffc397947f9b, portal: 172.16.0.220,3260] successful.
Dec 01 19:52:30 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:52:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9932f6f7-cd7d-43d7-88f8-ffc397947f9b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:52:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9932f6f7-cd7d-43d7-88f8-ffc397947f9b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:52:30 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3640ca-4070-4f2a-9986-da4461420721]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:52:30 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce76aa2-b612-40d9-a6db-b9bd9688e328 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:52:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:52:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:52:30 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[73422bf2-a55e-46d6-886d-363a0ca8b8cb]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32f95ce9-8cdb-4165-a13e-38d3167e8178 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9932f6f7-cd7d-43d7-88f8-ffc397947f9b (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:52:30 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce76aa2-b612-40d9-a6db-b9bd9688e328 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a (non-flash)
Dec 01 19:52:30 user nova-compute[75066]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32f95ce9-8cdb-4165-a13e-38d3167e8178 (non-flash)
Dec 01 19:52:30 user nova-compute[75066]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9932f6f7-cd7d-43d7-88f8-ffc397947f9b (non-flash)
Dec 01 19:52:30 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:52:30 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce76aa2-b612-40d9-a6db-b9bd9688e328 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a (non-flash)
Dec 01 19:52:30 user nova-compute[75066]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32f95ce9-8cdb-4165-a13e-38d3167e8178 (non-flash)
Dec 01 19:52:30 user nova-compute[75066]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9932f6f7-cd7d-43d7-88f8-ffc397947f9b (non-flash)
Dec 01 19:52:30 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:52:30 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-2ce76aa2-b612-40d9-a6db-b9bd9688e328 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9932f6f7-cd7d-43d7-88f8-ffc397947f9b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:52:30 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce76aa2-b612-40d9-a6db-b9bd9688e328 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Connected to 172.16.0.220:3260 {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 19:52:30 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-2ce76aa2-b612-40d9-a6db-b9bd9688e328 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] HCTL ('35', '-', '-', 0) found on session 56 with lun 0 {{(pid=75066) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 19:52:30 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-2ce76aa2-b612-40d9-a6db-b9bd9688e328 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75066) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 19:52:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:52:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:52:30 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b815eb6-452f-4289-aa6f-9b7d70aa5f86]: (4, ('- - 0', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:52:30 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-2ce76aa2-b612-40d9-a6db-b9bd9688e328 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Searching for a device in session 56 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:52:30 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce76aa2-b612-40d9-a6db-b9bd9688e328 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:9932f6f7-cd7d-43d7-88f8-ffc397947f9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fkIKWrZC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 19:52:31 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-2ce76aa2-b612-40d9-a6db-b9bd9688e328 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:52:31 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2ce76aa2-b612-40d9-a6db-b9bd9688e328 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23835336535616262', 'path': '/dev/sdd'} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:52:31 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2ce76aa2-b612-40d9-a6db-b9bd9688e328 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23835336535616262', 'path': '/dev/sdd'} {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 19:52:31 user nova-compute[75066]: DEBUG nova.objects.instance [None req-2ce76aa2-b612-40d9-a6db-b9bd9688e328 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lazy-loading 'flavor' on Instance uuid 7f0d914d-866e-45b1-9839-a4bbe19f6eb7 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:52:31 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-2ce76aa2-b612-40d9-a6db-b9bd9688e328 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] attach device xml: <disk type="block" device="disk">
Dec 01 19:52:31 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:52:31 user nova-compute[75066]:   <source dev="/dev/sdd"/>
Dec 01 19:52:31 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:52:31 user nova-compute[75066]:   <serial>9932f6f7-cd7d-43d7-88f8-ffc397947f9b</serial>
Dec 01 19:52:31 user nova-compute[75066]: </disk>
Dec 01 19:52:31 user nova-compute[75066]:  {{(pid=75066) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Dec 01 19:52:31 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-2ce76aa2-b612-40d9-a6db-b9bd9688e328 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:52:31 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-2ce76aa2-b612-40d9-a6db-b9bd9688e328 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:52:31 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-2ce76aa2-b612-40d9-a6db-b9bd9688e328 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] No VIF found with MAC fa:16:3e:8f:28:44, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:52:31 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-2ce76aa2-b612-40d9-a6db-b9bd9688e328 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "7f0d914d-866e-45b1-9839-a4bbe19f6eb7" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.033s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:52:32 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:52:33 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-90dd4d32-bd10-44ad-ab75-de5b07df76c7 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Acquiring lock "7f0d914d-866e-45b1-9839-a4bbe19f6eb7" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:52:33 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-90dd4d32-bd10-44ad-ab75-de5b07df76c7 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "7f0d914d-866e-45b1-9839-a4bbe19f6eb7" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:52:33 user nova-compute[75066]: INFO nova.compute.manager [None req-90dd4d32-bd10-44ad-ab75-de5b07df76c7 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Detaching volume 9932f6f7-cd7d-43d7-88f8-ffc397947f9b
Dec 01 19:52:33 user nova-compute[75066]: INFO nova.virt.block_device [None req-90dd4d32-bd10-44ad-ab75-de5b07df76c7 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Attempting to driver detach volume 9932f6f7-cd7d-43d7-88f8-ffc397947f9b from mountpoint /dev/vdb
Dec 01 19:52:33 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-90dd4d32-bd10-44ad-ab75-de5b07df76c7 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Attempting to detach device vdb from instance 7f0d914d-866e-45b1-9839-a4bbe19f6eb7 from the persistent domain config. {{(pid=75066) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2483}}
Dec 01 19:52:33 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-90dd4d32-bd10-44ad-ab75-de5b07df76c7 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 19:52:33 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:52:33 user nova-compute[75066]:   <source dev="/dev/sdd"/>
Dec 01 19:52:33 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:52:33 user nova-compute[75066]:   <serial>9932f6f7-cd7d-43d7-88f8-ffc397947f9b</serial>
Dec 01 19:52:33 user nova-compute[75066]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 19:52:33 user nova-compute[75066]: </disk>
Dec 01 19:52:33 user nova-compute[75066]:  {{(pid=75066) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 19:52:33 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-90dd4d32-bd10-44ad-ab75-de5b07df76c7 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Successfully detached device vdb from instance 7f0d914d-866e-45b1-9839-a4bbe19f6eb7 from the persistent domain config.
Dec 01 19:52:33 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-90dd4d32-bd10-44ad-ab75-de5b07df76c7 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7f0d914d-866e-45b1-9839-a4bbe19f6eb7 from the live domain config. {{(pid=75066) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2519}}
Dec 01 19:52:33 user nova-compute[75066]: DEBUG nova.virt.libvirt.guest [None req-90dd4d32-bd10-44ad-ab75-de5b07df76c7 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] detach device xml: <disk type="block" device="disk">
Dec 01 19:52:33 user nova-compute[75066]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:52:33 user nova-compute[75066]:   <source dev="/dev/sdd"/>
Dec 01 19:52:33 user nova-compute[75066]:   <target dev="vdb" bus="virtio"/>
Dec 01 19:52:33 user nova-compute[75066]:   <serial>9932f6f7-cd7d-43d7-88f8-ffc397947f9b</serial>
Dec 01 19:52:33 user nova-compute[75066]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Dec 01 19:52:33 user nova-compute[75066]: </disk>
Dec 01 19:52:33 user nova-compute[75066]:  {{(pid=75066) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Dec 01 19:52:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:52:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:52:33 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-90dd4d32-bd10-44ad-ab75-de5b07df76c7 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7f0d914d-866e-45b1-9839-a4bbe19f6eb7 {{(pid=75066) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2595}}
Dec 01 19:52:34 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:52:38 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:52:38 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:52:38 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:52:38 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:52:38 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75066) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 19:52:38 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:52:38 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:52:38 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f0d914d-866e-45b1-9839-a4bbe19f6eb7/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:52:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:52:38 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f0d914d-866e-45b1-9839-a4bbe19f6eb7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:52:38 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f0d914d-866e-45b1-9839-a4bbe19f6eb7/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:52:38 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f0d914d-866e-45b1-9839-a4bbe19f6eb7/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:52:39 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:52:39 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:52:39 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Hypervisor/Node resource view: name=user free_ram=8816MB free_disk=24.878833770751953GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75066) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 19:52:39 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:52:39 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:52:39 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance b27c80e9-9e75-41b2-b380-5cd86538f0c4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:52:39 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 7f0d914d-866e-45b1-9839-a4bbe19f6eb7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:52:39 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:52:39 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 19:52:39 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 19:52:39 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:52:39 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:52:39 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Compute_service record updated for user:user {{(pid=75066) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 19:52:39 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.262s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:52:40 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:52:40 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Starting heal instance info cache {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 19:52:40 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Rebuilding the list of instances to heal {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 19:52:40 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "refresh_cache-b27c80e9-9e75-41b2-b380-5cd86538f0c4" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:52:40 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquired lock "refresh_cache-b27c80e9-9e75-41b2-b380-5cd86538f0c4" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:52:40 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Forcefully refreshing network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 19:52:40 user nova-compute[75066]: DEBUG nova.objects.instance [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lazy-loading 'info_cache' on Instance uuid b27c80e9-9e75-41b2-b380-5cd86538f0c4 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:52:40 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Updating instance_info_cache with network_info: [{"id": "3e2fc190-28ce-414b-b435-820607838b7b", "address": "fa:16:3e:46:86:fd", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e2fc190-28", "ovs_interfaceid": "3e2fc190-28ce-414b-b435-820607838b7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:52:40 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Releasing lock "refresh_cache-b27c80e9-9e75-41b2-b380-5cd86538f0c4" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:52:40 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Updated the network info_cache for instance {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 19:52:40 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:52:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:52:47 user nova-compute[75066]: DEBUG nova.compute.manager [req-9b1f2bd9-1f51-4998-8851-3afc9093ab00 req-b4163104-c549-4fa2-8693-9ae5b2918fec service nova] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] Received event network-changed-8a18f6c0-4927-4a57-b852-0a50130a5040 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:52:47 user nova-compute[75066]: DEBUG nova.compute.manager [req-9b1f2bd9-1f51-4998-8851-3afc9093ab00 req-b4163104-c549-4fa2-8693-9ae5b2918fec service nova] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] Refreshing instance network info cache due to event network-changed-8a18f6c0-4927-4a57-b852-0a50130a5040. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:52:47 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-9b1f2bd9-1f51-4998-8851-3afc9093ab00 req-b4163104-c549-4fa2-8693-9ae5b2918fec service nova] Acquiring lock "refresh_cache-9f56c05b-2a04-4ff4-aebb-bc3f89d057cf" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:52:47 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-9b1f2bd9-1f51-4998-8851-3afc9093ab00 req-b4163104-c549-4fa2-8693-9ae5b2918fec service nova] Acquired lock "refresh_cache-9f56c05b-2a04-4ff4-aebb-bc3f89d057cf" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:52:47 user nova-compute[75066]: DEBUG nova.network.neutron [req-9b1f2bd9-1f51-4998-8851-3afc9093ab00 req-b4163104-c549-4fa2-8693-9ae5b2918fec service nova] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] Refreshing network info cache for port 8a18f6c0-4927-4a57-b852-0a50130a5040 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:52:48 user nova-compute[75066]: DEBUG nova.network.neutron [req-9b1f2bd9-1f51-4998-8851-3afc9093ab00 req-b4163104-c549-4fa2-8693-9ae5b2918fec service nova] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] Updated VIF entry in instance network info cache for port 8a18f6c0-4927-4a57-b852-0a50130a5040. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:52:48 user nova-compute[75066]: DEBUG nova.network.neutron [req-9b1f2bd9-1f51-4998-8851-3afc9093ab00 req-b4163104-c549-4fa2-8693-9ae5b2918fec service nova] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] Updating instance_info_cache with network_info: [{"id": "8a18f6c0-4927-4a57-b852-0a50130a5040", "address": "fa:16:3e:25:0b:0c", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a18f6c0-49", "ovs_interfaceid": "8a18f6c0-4927-4a57-b852-0a50130a5040", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:52:48 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-bd8267f3-009e-431d-8fc1-5783ca929ce6 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Acquiring lock "9f56c05b-2a04-4ff4-aebb-bc3f89d057cf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:52:48 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-bd8267f3-009e-431d-8fc1-5783ca929ce6 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "9f56c05b-2a04-4ff4-aebb-bc3f89d057cf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:52:48 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-bd8267f3-009e-431d-8fc1-5783ca929ce6 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Acquiring lock "9f56c05b-2a04-4ff4-aebb-bc3f89d057cf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:52:48 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-bd8267f3-009e-431d-8fc1-5783ca929ce6 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "9f56c05b-2a04-4ff4-aebb-bc3f89d057cf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:52:48 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-bd8267f3-009e-431d-8fc1-5783ca929ce6 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "9f56c05b-2a04-4ff4-aebb-bc3f89d057cf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:52:48 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-9b1f2bd9-1f51-4998-8851-3afc9093ab00 req-b4163104-c549-4fa2-8693-9ae5b2918fec service nova] Releasing lock "refresh_cache-9f56c05b-2a04-4ff4-aebb-bc3f89d057cf" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:52:48 user nova-compute[75066]: INFO nova.compute.manager [None req-bd8267f3-009e-431d-8fc1-5783ca929ce6 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] Terminating instance
Dec 01 19:52:48 user nova-compute[75066]: DEBUG nova.compute.manager [None req-bd8267f3-009e-431d-8fc1-5783ca929ce6 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] Start destroying the instance on the hypervisor. {{(pid=75066) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 19:52:48 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:52:48 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:52:48 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:52:48 user nova-compute[75066]: DEBUG nova.compute.manager [req-73665b09-b976-4710-8b84-a885a741dea7 req-deb0dbe0-75d9-4218-ad3e-506de7aec75b service nova] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] Received event network-vif-unplugged-8a18f6c0-4927-4a57-b852-0a50130a5040 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:52:48 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-73665b09-b976-4710-8b84-a885a741dea7 req-deb0dbe0-75d9-4218-ad3e-506de7aec75b service nova] Acquiring lock "9f56c05b-2a04-4ff4-aebb-bc3f89d057cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:52:48 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-73665b09-b976-4710-8b84-a885a741dea7 req-deb0dbe0-75d9-4218-ad3e-506de7aec75b service nova] Lock "9f56c05b-2a04-4ff4-aebb-bc3f89d057cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:52:48 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-73665b09-b976-4710-8b84-a885a741dea7 req-deb0dbe0-75d9-4218-ad3e-506de7aec75b service nova] Lock "9f56c05b-2a04-4ff4-aebb-bc3f89d057cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:52:48 user nova-compute[75066]: DEBUG nova.compute.manager [req-73665b09-b976-4710-8b84-a885a741dea7 req-deb0dbe0-75d9-4218-ad3e-506de7aec75b service nova] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] No waiting events found dispatching network-vif-unplugged-8a18f6c0-4927-4a57-b852-0a50130a5040 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:52:48 user nova-compute[75066]: DEBUG nova.compute.manager [req-73665b09-b976-4710-8b84-a885a741dea7 req-deb0dbe0-75d9-4218-ad3e-506de7aec75b service nova] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] Received event network-vif-unplugged-8a18f6c0-4927-4a57-b852-0a50130a5040 for instance with task_state deleting. {{(pid=75066) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 19:52:48 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:52:48 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:52:48 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:52:48 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:52:49 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] Instance destroyed successfully.
Dec 01 19:52:49 user nova-compute[75066]: DEBUG nova.objects.instance [None req-bd8267f3-009e-431d-8fc1-5783ca929ce6 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lazy-loading 'resources' on Instance uuid 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:52:49 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-bd8267f3-009e-431d-8fc1-5783ca929ce6 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:50:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-145536218',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-145536218',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-145536218',id=48,image_ref='c7982ad3-5a8c-4dce-b1ea-0e963756676a',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOT0cTmYr4iHSeklLXjZFRZINTVRJArfjO4uhozDFwXl9cs1GcOMDrwj5d3Sb4psijIwneKywdG/LMtv4byMZGUGGN3LoNPDSn8daqA9F84Fxku6PAJHkjBwn5ORexxdKA==',key_name='tempest-keypair-580662870',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:51:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ecd2a37ec7e4dbbbe53ed6ba9ff45bb',ramdisk_id='',reservation_id='r-85jqw1sz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-384255364',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-384255364-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-384255364',owner_user_name='tempest-TestVolumeBootPattern-384255364-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:51:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e30df6ccb83b4e8daaed0970c4b423d3',uuid=9f56c05b-2a04-4ff4-aebb-bc3f89d057cf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a18f6c0-4927-4a57-b852-0a50130a5040", "address": "fa:16:3e:25:0b:0c", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a18f6c0-49", "ovs_interfaceid": "8a18f6c0-4927-4a57-b852-0a50130a5040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:52:49 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-bd8267f3-009e-431d-8fc1-5783ca929ce6 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Converting VIF {"id": "8a18f6c0-4927-4a57-b852-0a50130a5040", "address": "fa:16:3e:25:0b:0c", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a18f6c0-49", "ovs_interfaceid": "8a18f6c0-4927-4a57-b852-0a50130a5040", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:52:49 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-bd8267f3-009e-431d-8fc1-5783ca929ce6 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:0b:0c,bridge_name='br-int',has_traffic_filtering=True,id=8a18f6c0-4927-4a57-b852-0a50130a5040,network=Network(2a39f486-871f-4115-88cb-176e846fe4f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a18f6c0-49') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:52:49 user nova-compute[75066]: DEBUG os_vif [None req-bd8267f3-009e-431d-8fc1-5783ca929ce6 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:0b:0c,bridge_name='br-int',has_traffic_filtering=True,id=8a18f6c0-4927-4a57-b852-0a50130a5040,network=Network(2a39f486-871f-4115-88cb-176e846fe4f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a18f6c0-49') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:52:49 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:52:49 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a18f6c0-49, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:52:49 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:52:49 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:52:49 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:52:49 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=85ecc84a-3c19-4850-b2e3-303a06ffb9e1) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:52:49 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:52:49 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:52:49 user nova-compute[75066]: INFO os_vif [None req-bd8267f3-009e-431d-8fc1-5783ca929ce6 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:0b:0c,bridge_name='br-int',has_traffic_filtering=True,id=8a18f6c0-4927-4a57-b852-0a50130a5040,network=Network(2a39f486-871f-4115-88cb-176e846fe4f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a18f6c0-49')
Dec 01 19:52:49 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd8267f3-009e-431d-8fc1-5783ca929ce6 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] calling os-brick to detach iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 19:52:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8267f3-009e-431d-8fc1-5783ca929ce6 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, {'target_iqn': 'iqn.2010-10.org.openstack:32f95ce9-8cdb-4165-a13e-38d3167e8178', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bjgDfPsR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:52:49 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-bd8267f3-009e-431d-8fc1-5783ca929ce6 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:52:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-bd8267f3-009e-431d-8fc1-5783ca929ce6 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:52:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-bd8267f3-009e-431d-8fc1-5783ca929ce6 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:52:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:52:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:52:49 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c5457c-6f75-467b-94d5-22f0e63d008c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9932f6f7-cd7d-43d7-88f8-ffc397947f9b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:32f95ce9-8cdb-4165-a13e-38d3167e8178\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:52:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8267f3-009e-431d-8fc1-5783ca929ce6 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 19:52:49 user nova-compute[75066]: No targets found.
Dec 01 19:52:49 user nova-compute[75066]: iSNS:
Dec 01 19:52:49 user nova-compute[75066]: No targets found.
Dec 01 19:52:49 user nova-compute[75066]: STATIC:
Dec 01 19:52:49 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:9932f6f7-cd7d-43d7-88f8-ffc397947f9b
Dec 01 19:52:49 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:52:49 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:52:49 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a
Dec 01 19:52:49 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:52:49 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:52:49 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:32f95ce9-8cdb-4165-a13e-38d3167e8178
Dec 01 19:52:49 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:52:49 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:52:49 user nova-compute[75066]: FIRMWARE:
Dec 01 19:52:49 user nova-compute[75066]: No targets found.
Dec 01 19:52:49 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:52:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8267f3-009e-431d-8fc1-5783ca929ce6 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 19:52:49 user nova-compute[75066]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 19:52:49 user nova-compute[75066]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75066) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 19:52:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8267f3-009e-431d-8fc1-5783ca929ce6 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32f95ce9-8cdb-4165-a13e-38d3167e8178', 0)] {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 19:52:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:52:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:52:49 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dcadaf7-14c1-480a-978f-c5f49e229eab]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32f95ce9-8cdb-4165-a13e-38d3167e8178\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9932f6f7-cd7d-43d7-88f8-ffc397947f9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:52:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:52:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:52:49 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef34d99c-cde6-4271-8dfc-9105ab5d847d]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32f95ce9-8cdb-4165-a13e-38d3167e8178 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9932f6f7-cd7d-43d7-88f8-ffc397947f9b (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:52:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8267f3-009e-431d-8fc1-5783ca929ce6 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a (non-flash)
Dec 01 19:52:49 user nova-compute[75066]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32f95ce9-8cdb-4165-a13e-38d3167e8178 (non-flash)
Dec 01 19:52:49 user nova-compute[75066]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9932f6f7-cd7d-43d7-88f8-ffc397947f9b (non-flash)
Dec 01 19:52:49 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:52:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8267f3-009e-431d-8fc1-5783ca929ce6 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a (non-flash)
Dec 01 19:52:49 user nova-compute[75066]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32f95ce9-8cdb-4165-a13e-38d3167e8178 (non-flash)
Dec 01 19:52:49 user nova-compute[75066]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9932f6f7-cd7d-43d7-88f8-ffc397947f9b (non-flash)
Dec 01 19:52:49 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:52:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8267f3-009e-431d-8fc1-5783ca929ce6 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f919016a8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32f95ce9-8cdb-4165-a13e-38d3167e8178'): ({'sdc'}, set())}) {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 19:52:49 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-bd8267f3-009e-431d-8fc1-5783ca929ce6 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Removing single pathed devices sdc {{(pid=75066) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 19:52:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:52:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:52:49 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7d6f3ed-f97d-4163-a786-bd0a91b13034]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:52:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:52:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:52:49 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[08be1464-eee9-4392-988e-febaaef9a641]: (4, ('ok\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:52:49 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-bd8267f3-009e-431d-8fc1-5783ca929ce6 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Flushing IO for device /dev/sdc {{(pid=75066) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 19:52:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:52:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:52:49 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c8f68a-de3e-4962-bd34-e1235bc1ac05]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:52:49 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-bd8267f3-009e-431d-8fc1-5783ca929ce6 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75066) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 19:52:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:52:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.060s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:52:49 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff522303-7b10-493c-83c8-0af9c0673475]: (4, ('1', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:52:49 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-bd8267f3-009e-431d-8fc1-5783ca929ce6 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 19:52:49 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-bd8267f3-009e-431d-8fc1-5783ca929ce6 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] SCSI volumes sdc have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 19:52:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8267f3-009e-431d-8fc1-5783ca929ce6 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32f95ce9-8cdb-4165-a13e-38d3167e8178')] {{(pid=75066) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 19:52:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32f95ce9-8cdb-4165-a13e-38d3167e8178 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:52:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32f95ce9-8cdb-4165-a13e-38d3167e8178 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:52:49 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52dee70-e151-4b31-88a9-550e41b45720]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:52:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8267f3-009e-431d-8fc1-5783ca929ce6 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:52:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32f95ce9-8cdb-4165-a13e-38d3167e8178 -p 172.16.0.220:3260 --logout {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:52:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32f95ce9-8cdb-4165-a13e-38d3167e8178 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:52:49 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[95bf0437-ea7e-4cbb-a9d9-4f76337f4501]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:32f95ce9-8cdb-4165-a13e-38d3167e8178, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:32f95ce9-8cdb-4165-a13e-38d3167e8178, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:52:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8267f3-009e-431d-8fc1-5783ca929ce6 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:32f95ce9-8cdb-4165-a13e-38d3167e8178, portal: 172.16.0.220,3260]
Dec 01 19:52:49 user nova-compute[75066]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:32f95ce9-8cdb-4165-a13e-38d3167e8178, portal: 172.16.0.220,3260] successful.
Dec 01 19:52:49 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:52:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32f95ce9-8cdb-4165-a13e-38d3167e8178 -p 172.16.0.220:3260 --op delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:52:49 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32f95ce9-8cdb-4165-a13e-38d3167e8178 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:52:49 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ef9b09-6a99-4c02-b96e-eb0470ac13c6]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:52:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8267f3-009e-431d-8fc1-5783ca929ce6 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:52:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-bd8267f3-009e-431d-8fc1-5783ca929ce6 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:52:49 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd8267f3-009e-431d-8fc1-5783ca929ce6 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] <== disconnect_volume: return (341ms) None {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:52:49 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd8267f3-009e-431d-8fc1-5783ca929ce6 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] Disconnected iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 19:52:49 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-bd8267f3-009e-431d-8fc1-5783ca929ce6 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] Deleting instance files /opt/stack/data/nova/instances/9f56c05b-2a04-4ff4-aebb-bc3f89d057cf_del
Dec 01 19:52:49 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-bd8267f3-009e-431d-8fc1-5783ca929ce6 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] Deletion of /opt/stack/data/nova/instances/9f56c05b-2a04-4ff4-aebb-bc3f89d057cf_del complete
Dec 01 19:52:49 user nova-compute[75066]: INFO nova.compute.manager [None req-bd8267f3-009e-431d-8fc1-5783ca929ce6 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] Took 1.18 seconds to destroy the instance on the hypervisor.
Dec 01 19:52:49 user nova-compute[75066]: DEBUG oslo.service.loopingcall [None req-bd8267f3-009e-431d-8fc1-5783ca929ce6 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75066) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 19:52:49 user nova-compute[75066]: DEBUG nova.compute.manager [-] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] Deallocating network for instance {{(pid=75066) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 19:52:49 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] deallocate_for_instance() {{(pid=75066) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 19:52:50 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:52:50 user nova-compute[75066]: INFO nova.compute.manager [-] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] Took 0.67 seconds to deallocate network for instance.
Dec 01 19:52:50 user nova-compute[75066]: DEBUG nova.compute.manager [req-a86574f5-597b-4c4a-bae8-9c6402f2c71c req-0d45df9c-6150-43c7-b97c-d2a8d7a8afaa service nova] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] Received event network-vif-deleted-8a18f6c0-4927-4a57-b852-0a50130a5040 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:52:50 user nova-compute[75066]: DEBUG nova.compute.manager [req-df6aeada-9718-402b-9abd-47329aa1691f req-9d9b004d-9d10-4f25-94ea-b47ed7c2cec1 service nova] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] Received event network-vif-plugged-8a18f6c0-4927-4a57-b852-0a50130a5040 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:52:50 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-df6aeada-9718-402b-9abd-47329aa1691f req-9d9b004d-9d10-4f25-94ea-b47ed7c2cec1 service nova] Acquiring lock "9f56c05b-2a04-4ff4-aebb-bc3f89d057cf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:52:50 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-df6aeada-9718-402b-9abd-47329aa1691f req-9d9b004d-9d10-4f25-94ea-b47ed7c2cec1 service nova] Lock "9f56c05b-2a04-4ff4-aebb-bc3f89d057cf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:52:50 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-df6aeada-9718-402b-9abd-47329aa1691f req-9d9b004d-9d10-4f25-94ea-b47ed7c2cec1 service nova] Lock "9f56c05b-2a04-4ff4-aebb-bc3f89d057cf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:52:50 user nova-compute[75066]: DEBUG nova.compute.manager [req-df6aeada-9718-402b-9abd-47329aa1691f req-9d9b004d-9d10-4f25-94ea-b47ed7c2cec1 service nova] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] No waiting events found dispatching network-vif-plugged-8a18f6c0-4927-4a57-b852-0a50130a5040 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:52:50 user nova-compute[75066]: WARNING nova.compute.manager [req-df6aeada-9718-402b-9abd-47329aa1691f req-9d9b004d-9d10-4f25-94ea-b47ed7c2cec1 service nova] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] Received unexpected event network-vif-plugged-8a18f6c0-4927-4a57-b852-0a50130a5040 for instance with vm_state active and task_state deleting.
Dec 01 19:52:50 user nova-compute[75066]: INFO nova.compute.manager [None req-bd8267f3-009e-431d-8fc1-5783ca929ce6 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] Took 0.82 seconds to detach 1 volumes for instance.
Dec 01 19:52:50 user nova-compute[75066]: DEBUG nova.compute.manager [None req-bd8267f3-009e-431d-8fc1-5783ca929ce6 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf] Deleting volume: 32f95ce9-8cdb-4165-a13e-38d3167e8178 {{(pid=75066) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Dec 01 19:52:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-bd8267f3-009e-431d-8fc1-5783ca929ce6 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:52:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-bd8267f3-009e-431d-8fc1-5783ca929ce6 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:52:51 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-bd8267f3-009e-431d-8fc1-5783ca929ce6 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:52:51 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-bd8267f3-009e-431d-8fc1-5783ca929ce6 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:52:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-bd8267f3-009e-431d-8fc1-5783ca929ce6 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.181s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:52:51 user nova-compute[75066]: INFO nova.scheduler.client.report [None req-bd8267f3-009e-431d-8fc1-5783ca929ce6 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Deleted allocations for instance 9f56c05b-2a04-4ff4-aebb-bc3f89d057cf
Dec 01 19:52:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-bd8267f3-009e-431d-8fc1-5783ca929ce6 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "9f56c05b-2a04-4ff4-aebb-bc3f89d057cf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.161s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:52:53 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-90dd4d32-bd10-44ad-ab75-de5b07df76c7 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7f0d914d-866e-45b1-9839-a4bbe19f6eb7 is timed out.
Dec 01 19:52:53 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-90dd4d32-bd10-44ad-ab75-de5b07df76c7 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Successfully detached device vdb from instance 7f0d914d-866e-45b1-9839-a4bbe19f6eb7 from the live domain config.
Dec 01 19:52:53 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90dd4d32-bd10-44ad-ab75-de5b07df76c7 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] calling os-brick to detach iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 19:52:53 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-90dd4d32-bd10-44ad-ab75-de5b07df76c7 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, {'target_iqn': 'iqn.2010-10.org.openstack:9932f6f7-cd7d-43d7-88f8-ffc397947f9b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fkIKWrZC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:52:53 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-90dd4d32-bd10-44ad-ab75-de5b07df76c7 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:52:53 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-90dd4d32-bd10-44ad-ab75-de5b07df76c7 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:52:53 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-90dd4d32-bd10-44ad-ab75-de5b07df76c7 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:52:53 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:52:53 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:52:53 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae2f4a3-d79d-4bb5-bdb0-afab268e6df4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9932f6f7-cd7d-43d7-88f8-ffc397947f9b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:52:53 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-90dd4d32-bd10-44ad-ab75-de5b07df76c7 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 19:52:53 user nova-compute[75066]: No targets found.
Dec 01 19:52:53 user nova-compute[75066]: iSNS:
Dec 01 19:52:53 user nova-compute[75066]: No targets found.
Dec 01 19:52:53 user nova-compute[75066]: STATIC:
Dec 01 19:52:53 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:9932f6f7-cd7d-43d7-88f8-ffc397947f9b
Dec 01 19:52:53 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:52:53 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:52:53 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a
Dec 01 19:52:53 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:52:53 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:52:53 user nova-compute[75066]: FIRMWARE:
Dec 01 19:52:53 user nova-compute[75066]: No targets found.
Dec 01 19:52:53 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:52:53 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-90dd4d32-bd10-44ad-ab75-de5b07df76c7 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 19:52:53 user nova-compute[75066]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 19:52:53 user nova-compute[75066]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75066) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 19:52:53 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-90dd4d32-bd10-44ad-ab75-de5b07df76c7 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9932f6f7-cd7d-43d7-88f8-ffc397947f9b', 0)] {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 19:52:53 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:52:53 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:52:53 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[5720622b-b7bf-4fee-b871-9656e1b25448]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9932f6f7-cd7d-43d7-88f8-ffc397947f9b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:52:53 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:52:53 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:52:53 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1aa7796-c7c3-43ef-b532-2d5eef3d3b44]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9932f6f7-cd7d-43d7-88f8-ffc397947f9b (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:52:53 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-90dd4d32-bd10-44ad-ab75-de5b07df76c7 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a (non-flash)
Dec 01 19:52:53 user nova-compute[75066]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9932f6f7-cd7d-43d7-88f8-ffc397947f9b (non-flash)
Dec 01 19:52:53 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:52:53 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-90dd4d32-bd10-44ad-ab75-de5b07df76c7 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a (non-flash)
Dec 01 19:52:53 user nova-compute[75066]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9932f6f7-cd7d-43d7-88f8-ffc397947f9b (non-flash)
Dec 01 19:52:53 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:52:53 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-90dd4d32-bd10-44ad-ab75-de5b07df76c7 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91901ac310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9932f6f7-cd7d-43d7-88f8-ffc397947f9b'): ({'sdd'}, set())}) {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 19:52:53 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-90dd4d32-bd10-44ad-ab75-de5b07df76c7 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Removing single pathed devices sdd {{(pid=75066) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 19:52:53 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:52:53 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:52:53 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34b2350-f0ed-43bb-b7b2-2fd05d0fc886]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:52:53 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:52:53 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:52:53 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d89f31b-9078-44b2-a99f-40ce93d7df20]: (4, ('ok\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:52:53 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-90dd4d32-bd10-44ad-ab75-de5b07df76c7 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Flushing IO for device /dev/sdd {{(pid=75066) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 19:52:53 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:52:53 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:52:53 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ceca2d-3445-4c8a-975e-ab7adcddd716]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:52:53 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-90dd4d32-bd10-44ad-ab75-de5b07df76c7 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75066) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 19:52:53 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:52:53 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:52:53 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64e7c0b-3742-4d55-8354-5fe353fb748f]: (4, ('1', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:52:53 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-90dd4d32-bd10-44ad-ab75-de5b07df76c7 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 19:52:53 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-90dd4d32-bd10-44ad-ab75-de5b07df76c7 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] SCSI volumes sdd have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 19:52:53 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-90dd4d32-bd10-44ad-ab75-de5b07df76c7 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9932f6f7-cd7d-43d7-88f8-ffc397947f9b')] {{(pid=75066) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 19:52:53 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9932f6f7-cd7d-43d7-88f8-ffc397947f9b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:52:53 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9932f6f7-cd7d-43d7-88f8-ffc397947f9b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:52:53 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4a2541-f7ef-4bc4-85ad-f0fc6817e7a9]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:52:53 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-90dd4d32-bd10-44ad-ab75-de5b07df76c7 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:52:53 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9932f6f7-cd7d-43d7-88f8-ffc397947f9b -p 172.16.0.220:3260 --logout {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:52:53 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9932f6f7-cd7d-43d7-88f8-ffc397947f9b -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:52:53 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8dc0b3b-049f-46a7-91b3-25f48f8c2dd9]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:9932f6f7-cd7d-43d7-88f8-ffc397947f9b, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:9932f6f7-cd7d-43d7-88f8-ffc397947f9b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:52:53 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-90dd4d32-bd10-44ad-ab75-de5b07df76c7 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:9932f6f7-cd7d-43d7-88f8-ffc397947f9b, portal: 172.16.0.220,3260]
Dec 01 19:52:53 user nova-compute[75066]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:9932f6f7-cd7d-43d7-88f8-ffc397947f9b, portal: 172.16.0.220,3260] successful.
Dec 01 19:52:53 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:52:53 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9932f6f7-cd7d-43d7-88f8-ffc397947f9b -p 172.16.0.220:3260 --op delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:52:53 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9932f6f7-cd7d-43d7-88f8-ffc397947f9b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:52:53 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[818d8576-737e-4222-98d5-b7189b4fbc4e]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:52:53 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-90dd4d32-bd10-44ad-ab75-de5b07df76c7 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:52:53 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-90dd4d32-bd10-44ad-ab75-de5b07df76c7 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:52:53 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-90dd4d32-bd10-44ad-ab75-de5b07df76c7 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] <== disconnect_volume: return (287ms) None {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:52:53 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90dd4d32-bd10-44ad-ab75-de5b07df76c7 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Disconnected iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 19:52:54 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:52:55 user nova-compute[75066]: DEBUG nova.objects.instance [None req-90dd4d32-bd10-44ad-ab75-de5b07df76c7 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lazy-loading 'flavor' on Instance uuid 7f0d914d-866e-45b1-9839-a4bbe19f6eb7 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:52:55 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-90dd4d32-bd10-44ad-ab75-de5b07df76c7 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "7f0d914d-866e-45b1-9839-a4bbe19f6eb7" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.971s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:52:59 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:53:04 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:53:09 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:53:09 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:53:09 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75066) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 19:53:09 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:53:09 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:53:09 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:53:14 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:53:14 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:53:14 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75066) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 19:53:14 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:53:14 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:53:14 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:53:19 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:53:22 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:53:23 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dc9412e2-ff09-44d2-9d70-68234c35c6b0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Acquiring lock "7f0d914d-866e-45b1-9839-a4bbe19f6eb7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:53:23 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dc9412e2-ff09-44d2-9d70-68234c35c6b0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "7f0d914d-866e-45b1-9839-a4bbe19f6eb7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:53:23 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dc9412e2-ff09-44d2-9d70-68234c35c6b0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Acquiring lock "7f0d914d-866e-45b1-9839-a4bbe19f6eb7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:53:23 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dc9412e2-ff09-44d2-9d70-68234c35c6b0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "7f0d914d-866e-45b1-9839-a4bbe19f6eb7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:53:23 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dc9412e2-ff09-44d2-9d70-68234c35c6b0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "7f0d914d-866e-45b1-9839-a4bbe19f6eb7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:53:23 user nova-compute[75066]: INFO nova.compute.manager [None req-dc9412e2-ff09-44d2-9d70-68234c35c6b0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Terminating instance
Dec 01 19:53:23 user nova-compute[75066]: DEBUG nova.compute.manager [None req-dc9412e2-ff09-44d2-9d70-68234c35c6b0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Start destroying the instance on the hypervisor. {{(pid=75066) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 19:53:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:53:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:53:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:53:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:53:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:53:23 user nova-compute[75066]: DEBUG nova.compute.manager [req-f5891340-863f-47ae-8309-5823ab3381eb req-9ef6f1dc-b2be-4986-9347-ced1e893b7e6 service nova] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Received event network-vif-unplugged-df573bb8-23b8-437e-83c0-ccb759d7c59a {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:53:23 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-f5891340-863f-47ae-8309-5823ab3381eb req-9ef6f1dc-b2be-4986-9347-ced1e893b7e6 service nova] Acquiring lock "7f0d914d-866e-45b1-9839-a4bbe19f6eb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:53:23 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-f5891340-863f-47ae-8309-5823ab3381eb req-9ef6f1dc-b2be-4986-9347-ced1e893b7e6 service nova] Lock "7f0d914d-866e-45b1-9839-a4bbe19f6eb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:53:23 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-f5891340-863f-47ae-8309-5823ab3381eb req-9ef6f1dc-b2be-4986-9347-ced1e893b7e6 service nova] Lock "7f0d914d-866e-45b1-9839-a4bbe19f6eb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:53:23 user nova-compute[75066]: DEBUG nova.compute.manager [req-f5891340-863f-47ae-8309-5823ab3381eb req-9ef6f1dc-b2be-4986-9347-ced1e893b7e6 service nova] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] No waiting events found dispatching network-vif-unplugged-df573bb8-23b8-437e-83c0-ccb759d7c59a {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:53:23 user nova-compute[75066]: DEBUG nova.compute.manager [req-f5891340-863f-47ae-8309-5823ab3381eb req-9ef6f1dc-b2be-4986-9347-ced1e893b7e6 service nova] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Received event network-vif-unplugged-df573bb8-23b8-437e-83c0-ccb759d7c59a for instance with task_state deleting. {{(pid=75066) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 19:53:24 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:53:24 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Instance destroyed successfully.
Dec 01 19:53:24 user nova-compute[75066]: DEBUG nova.objects.instance [None req-dc9412e2-ff09-44d2-9d70-68234c35c6b0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lazy-loading 'resources' on Instance uuid 7f0d914d-866e-45b1-9839-a4bbe19f6eb7 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:53:24 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-dc9412e2-ff09-44d2-9d70-68234c35c6b0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:50:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1916131871',display_name='tempest-AttachVolumeNegativeTest-server-1916131871',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1916131871',id=47,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFCUhc/v86rUa2J60cFzOQdhyAMZ/c34+TFi5LAc3D1o9uB1Zr4dVoNcAogt/ocQsKupH5GlBQjApMk5ON6TyKnEQmtKhp45UfBn41OdEaFCpshiOpmP7Oe8efS2N3QlyA==',key_name='tempest-keypair-357976017',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:50:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='109097a30a40419092c74f4c7a695ce4',ramdisk_id='',reservation_id='r-ch1w3y01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-711021602',owner_user_name='tempest-AttachVolumeNegativeTest-711021602-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:50:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b92b1beca2ee480181e771eafe1a9f97',uuid=7f0d914d-866e-45b1-9839-a4bbe19f6eb7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "df573bb8-23b8-437e-83c0-ccb759d7c59a", "address": "fa:16:3e:8f:28:44", "network": {"id": "955d6293-ede6-4cb4-8cee-0157dbad93ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-603640322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109097a30a40419092c74f4c7a695ce4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf573bb8-23", "ovs_interfaceid": "df573bb8-23b8-437e-83c0-ccb759d7c59a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:53:24 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-dc9412e2-ff09-44d2-9d70-68234c35c6b0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Converting VIF {"id": "df573bb8-23b8-437e-83c0-ccb759d7c59a", "address": "fa:16:3e:8f:28:44", "network": {"id": "955d6293-ede6-4cb4-8cee-0157dbad93ae", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-603640322-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "109097a30a40419092c74f4c7a695ce4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf573bb8-23", "ovs_interfaceid": "df573bb8-23b8-437e-83c0-ccb759d7c59a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:53:24 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-dc9412e2-ff09-44d2-9d70-68234c35c6b0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:28:44,bridge_name='br-int',has_traffic_filtering=True,id=df573bb8-23b8-437e-83c0-ccb759d7c59a,network=Network(955d6293-ede6-4cb4-8cee-0157dbad93ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf573bb8-23') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:53:24 user nova-compute[75066]: DEBUG os_vif [None req-dc9412e2-ff09-44d2-9d70-68234c35c6b0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:28:44,bridge_name='br-int',has_traffic_filtering=True,id=df573bb8-23b8-437e-83c0-ccb759d7c59a,network=Network(955d6293-ede6-4cb4-8cee-0157dbad93ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf573bb8-23') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:53:24 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:53:24 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdf573bb8-23, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:53:24 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:53:24 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:53:24 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:53:24 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5da8e771-0037-4800-a897-7dc7ff23cb8d) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:53:24 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:53:24 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:53:24 user nova-compute[75066]: INFO os_vif [None req-dc9412e2-ff09-44d2-9d70-68234c35c6b0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:28:44,bridge_name='br-int',has_traffic_filtering=True,id=df573bb8-23b8-437e-83c0-ccb759d7c59a,network=Network(955d6293-ede6-4cb4-8cee-0157dbad93ae),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf573bb8-23')
Dec 01 19:53:24 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-dc9412e2-ff09-44d2-9d70-68234c35c6b0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Deleting instance files /opt/stack/data/nova/instances/7f0d914d-866e-45b1-9839-a4bbe19f6eb7_del
Dec 01 19:53:24 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-dc9412e2-ff09-44d2-9d70-68234c35c6b0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Deletion of /opt/stack/data/nova/instances/7f0d914d-866e-45b1-9839-a4bbe19f6eb7_del complete
Dec 01 19:53:24 user nova-compute[75066]: INFO nova.compute.manager [None req-dc9412e2-ff09-44d2-9d70-68234c35c6b0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Took 0.86 seconds to destroy the instance on the hypervisor.
Dec 01 19:53:24 user nova-compute[75066]: DEBUG oslo.service.loopingcall [None req-dc9412e2-ff09-44d2-9d70-68234c35c6b0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75066) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 19:53:24 user nova-compute[75066]: DEBUG nova.compute.manager [-] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Deallocating network for instance {{(pid=75066) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 19:53:24 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] deallocate_for_instance() {{(pid=75066) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 19:53:24 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:53:24 user nova-compute[75066]: INFO nova.compute.manager [-] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Took 0.66 seconds to deallocate network for instance.
Dec 01 19:53:24 user nova-compute[75066]: DEBUG nova.compute.manager [req-3f480640-d778-4d20-916a-b371356e792f req-96575f2e-329c-4fe9-8004-4a18738adaa1 service nova] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Received event network-vif-deleted-df573bb8-23b8-437e-83c0-ccb759d7c59a {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:53:25 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dc9412e2-ff09-44d2-9d70-68234c35c6b0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:53:25 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dc9412e2-ff09-44d2-9d70-68234c35c6b0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:53:25 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-dc9412e2-ff09-44d2-9d70-68234c35c6b0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:53:25 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-dc9412e2-ff09-44d2-9d70-68234c35c6b0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:53:25 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dc9412e2-ff09-44d2-9d70-68234c35c6b0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.163s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:53:25 user nova-compute[75066]: INFO nova.scheduler.client.report [None req-dc9412e2-ff09-44d2-9d70-68234c35c6b0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Deleted allocations for instance 7f0d914d-866e-45b1-9839-a4bbe19f6eb7
Dec 01 19:53:25 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dc9412e2-ff09-44d2-9d70-68234c35c6b0 tempest-AttachVolumeNegativeTest-711021602 tempest-AttachVolumeNegativeTest-711021602-project-member] Lock "7f0d914d-866e-45b1-9839-a4bbe19f6eb7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.873s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:53:25 user nova-compute[75066]: DEBUG nova.compute.manager [req-a2e7350d-5faf-4aa0-b2c8-769e7eb33c1e req-ee8a56bc-9458-4b6c-9713-b1cdc6bffdcd service nova] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Received event network-vif-plugged-df573bb8-23b8-437e-83c0-ccb759d7c59a {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:53:25 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a2e7350d-5faf-4aa0-b2c8-769e7eb33c1e req-ee8a56bc-9458-4b6c-9713-b1cdc6bffdcd service nova] Acquiring lock "7f0d914d-866e-45b1-9839-a4bbe19f6eb7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:53:25 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a2e7350d-5faf-4aa0-b2c8-769e7eb33c1e req-ee8a56bc-9458-4b6c-9713-b1cdc6bffdcd service nova] Lock "7f0d914d-866e-45b1-9839-a4bbe19f6eb7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:53:25 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a2e7350d-5faf-4aa0-b2c8-769e7eb33c1e req-ee8a56bc-9458-4b6c-9713-b1cdc6bffdcd service nova] Lock "7f0d914d-866e-45b1-9839-a4bbe19f6eb7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:53:25 user nova-compute[75066]: DEBUG nova.compute.manager [req-a2e7350d-5faf-4aa0-b2c8-769e7eb33c1e req-ee8a56bc-9458-4b6c-9713-b1cdc6bffdcd service nova] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] No waiting events found dispatching network-vif-plugged-df573bb8-23b8-437e-83c0-ccb759d7c59a {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:53:25 user nova-compute[75066]: WARNING nova.compute.manager [req-a2e7350d-5faf-4aa0-b2c8-769e7eb33c1e req-ee8a56bc-9458-4b6c-9713-b1cdc6bffdcd service nova] [instance: 7f0d914d-866e-45b1-9839-a4bbe19f6eb7] Received unexpected event network-vif-plugged-df573bb8-23b8-437e-83c0-ccb759d7c59a for instance with vm_state deleted and task_state None.
Dec 01 19:53:28 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:53:28 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75066) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 19:53:29 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:53:29 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:53:30 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:53:34 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:53:34 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:53:36 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:53:39 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:53:39 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:53:39 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75066) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 19:53:39 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:53:39 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:53:39 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:53:40 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:53:40 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:53:40 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:53:40 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:53:40 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75066) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 19:53:40 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:53:40 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:53:40 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:53:40 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Hypervisor/Node resource view: name=user free_ram=8980MB free_disk=24.905677795410156GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75066) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 19:53:40 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:53:40 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:53:40 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance b27c80e9-9e75-41b2-b380-5cd86538f0c4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:53:40 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 19:53:40 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 19:53:40 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:53:40 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:53:40 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Compute_service record updated for user:user {{(pid=75066) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 19:53:40 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.179s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:53:41 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:53:41 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Starting heal instance info cache {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 19:53:41 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Didn't find any instances for network info cache update. {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 01 19:53:41 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:53:43 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-0ddbb37c-7b5b-44b2-9fea-9b691b1bf154 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Acquiring lock "b27c80e9-9e75-41b2-b380-5cd86538f0c4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:53:43 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-0ddbb37c-7b5b-44b2-9fea-9b691b1bf154 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "b27c80e9-9e75-41b2-b380-5cd86538f0c4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:53:43 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-0ddbb37c-7b5b-44b2-9fea-9b691b1bf154 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Acquiring lock "b27c80e9-9e75-41b2-b380-5cd86538f0c4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:53:43 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-0ddbb37c-7b5b-44b2-9fea-9b691b1bf154 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "b27c80e9-9e75-41b2-b380-5cd86538f0c4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:53:43 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-0ddbb37c-7b5b-44b2-9fea-9b691b1bf154 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "b27c80e9-9e75-41b2-b380-5cd86538f0c4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:53:43 user nova-compute[75066]: INFO nova.compute.manager [None req-0ddbb37c-7b5b-44b2-9fea-9b691b1bf154 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Terminating instance
Dec 01 19:53:43 user nova-compute[75066]: DEBUG nova.compute.manager [None req-0ddbb37c-7b5b-44b2-9fea-9b691b1bf154 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Start destroying the instance on the hypervisor. {{(pid=75066) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 19:53:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:53:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:53:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:53:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:53:43 user nova-compute[75066]: DEBUG nova.compute.manager [req-63332ba2-1325-4189-acbb-62e0a6061c70 req-abe64c9a-d1b8-4fae-9993-9eb01bab97c1 service nova] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Received event network-vif-unplugged-3e2fc190-28ce-414b-b435-820607838b7b {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:53:43 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-63332ba2-1325-4189-acbb-62e0a6061c70 req-abe64c9a-d1b8-4fae-9993-9eb01bab97c1 service nova] Acquiring lock "b27c80e9-9e75-41b2-b380-5cd86538f0c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:53:43 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-63332ba2-1325-4189-acbb-62e0a6061c70 req-abe64c9a-d1b8-4fae-9993-9eb01bab97c1 service nova] Lock "b27c80e9-9e75-41b2-b380-5cd86538f0c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:53:43 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-63332ba2-1325-4189-acbb-62e0a6061c70 req-abe64c9a-d1b8-4fae-9993-9eb01bab97c1 service nova] Lock "b27c80e9-9e75-41b2-b380-5cd86538f0c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:53:43 user nova-compute[75066]: DEBUG nova.compute.manager [req-63332ba2-1325-4189-acbb-62e0a6061c70 req-abe64c9a-d1b8-4fae-9993-9eb01bab97c1 service nova] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] No waiting events found dispatching network-vif-unplugged-3e2fc190-28ce-414b-b435-820607838b7b {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:53:43 user nova-compute[75066]: DEBUG nova.compute.manager [req-63332ba2-1325-4189-acbb-62e0a6061c70 req-abe64c9a-d1b8-4fae-9993-9eb01bab97c1 service nova] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Received event network-vif-unplugged-3e2fc190-28ce-414b-b435-820607838b7b for instance with task_state deleting. {{(pid=75066) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 19:53:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:53:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:53:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:53:43 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Instance destroyed successfully.
Dec 01 19:53:43 user nova-compute[75066]: DEBUG nova.objects.instance [None req-0ddbb37c-7b5b-44b2-9fea-9b691b1bf154 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lazy-loading 'resources' on Instance uuid b27c80e9-9e75-41b2-b380-5cd86538f0c4 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:53:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:53:43 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-0ddbb37c-7b5b-44b2-9fea-9b691b1bf154 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:48:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-2046517075',display_name='tempest-TestVolumeBootPattern-volume-backed-server-2046517075',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-2046517075',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG9rXlSO1UXyabMJnKDKZHq/S13abZZnNzd3QmPYLZ3b44Dud48Q9ixo5LKAwDNhAFmz8fqbxF9rDCE8tA7HrLoH//BBg5YsAQYaPsEjD/pOmltDxCRekowJasf+5v7IXw==',key_name='tempest-keypair-1116839330',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:49:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ecd2a37ec7e4dbbbe53ed6ba9ff45bb',ramdisk_id='',reservation_id='r-7bgokvad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-384255364',owner_user_name='tempest-TestVolumeBootPattern-384255364-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:49:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e30df6ccb83b4e8daaed0970c4b423d3',uuid=b27c80e9-9e75-41b2-b380-5cd86538f0c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e2fc190-28ce-414b-b435-820607838b7b", "address": "fa:16:3e:46:86:fd", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e2fc190-28", "ovs_interfaceid": "3e2fc190-28ce-414b-b435-820607838b7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:53:43 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-0ddbb37c-7b5b-44b2-9fea-9b691b1bf154 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Converting VIF {"id": "3e2fc190-28ce-414b-b435-820607838b7b", "address": "fa:16:3e:46:86:fd", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e2fc190-28", "ovs_interfaceid": "3e2fc190-28ce-414b-b435-820607838b7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:53:43 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-0ddbb37c-7b5b-44b2-9fea-9b691b1bf154 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:46:86:fd,bridge_name='br-int',has_traffic_filtering=True,id=3e2fc190-28ce-414b-b435-820607838b7b,network=Network(2a39f486-871f-4115-88cb-176e846fe4f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e2fc190-28') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:53:43 user nova-compute[75066]: DEBUG os_vif [None req-0ddbb37c-7b5b-44b2-9fea-9b691b1bf154 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:86:fd,bridge_name='br-int',has_traffic_filtering=True,id=3e2fc190-28ce-414b-b435-820607838b7b,network=Network(2a39f486-871f-4115-88cb-176e846fe4f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e2fc190-28') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:53:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:53:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3e2fc190-28, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:53:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:53:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:53:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:53:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:53:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fcde8ecf-3f83-416f-a881-6193d87d55d7) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:53:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:53:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:53:43 user nova-compute[75066]: INFO os_vif [None req-0ddbb37c-7b5b-44b2-9fea-9b691b1bf154 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:46:86:fd,bridge_name='br-int',has_traffic_filtering=True,id=3e2fc190-28ce-414b-b435-820607838b7b,network=Network(2a39f486-871f-4115-88cb-176e846fe4f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e2fc190-28')
Dec 01 19:53:43 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ddbb37c-7b5b-44b2-9fea-9b691b1bf154 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] calling os-brick to detach iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 19:53:43 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ddbb37c-7b5b-44b2-9fea-9b691b1bf154 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, {'target_iqn': 'iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QcORGDko', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:53:43 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-0ddbb37c-7b5b-44b2-9fea-9b691b1bf154 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:53:43 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-0ddbb37c-7b5b-44b2-9fea-9b691b1bf154 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:53:43 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-0ddbb37c-7b5b-44b2-9fea-9b691b1bf154 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:53:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:53:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:53:43 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f9292e4-846e-48ff-a6d9-9c6f271d0854]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:53:43 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ddbb37c-7b5b-44b2-9fea-9b691b1bf154 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 19:53:43 user nova-compute[75066]: No targets found.
Dec 01 19:53:43 user nova-compute[75066]: iSNS:
Dec 01 19:53:43 user nova-compute[75066]: No targets found.
Dec 01 19:53:43 user nova-compute[75066]: STATIC:
Dec 01 19:53:43 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a
Dec 01 19:53:43 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:53:43 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:53:43 user nova-compute[75066]: FIRMWARE:
Dec 01 19:53:43 user nova-compute[75066]: No targets found.
Dec 01 19:53:43 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:53:43 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ddbb37c-7b5b-44b2-9fea-9b691b1bf154 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 19:53:43 user nova-compute[75066]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 19:53:43 user nova-compute[75066]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75066) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 19:53:43 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ddbb37c-7b5b-44b2-9fea-9b691b1bf154 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a', 0)] {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 19:53:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:53:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:53:43 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc2585b-175c-4b6f-96ac-6ab68a67ee51]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:53:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:53:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:53:43 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f89fc7-3fa7-4582-949b-2f7a949f7a97]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:53:43 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ddbb37c-7b5b-44b2-9fea-9b691b1bf154 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a (non-flash)
Dec 01 19:53:43 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:53:43 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ddbb37c-7b5b-44b2-9fea-9b691b1bf154 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a (non-flash)
Dec 01 19:53:43 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:53:43 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ddbb37c-7b5b-44b2-9fea-9b691b1bf154 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9190175e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a'): ({'sdb'}, set())}) {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 19:53:43 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-0ddbb37c-7b5b-44b2-9fea-9b691b1bf154 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Removing single pathed devices sdb {{(pid=75066) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 19:53:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:53:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:53:43 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7782cd-0314-4c0c-bb5b-511a012e4032]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:53:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:53:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:53:43 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f8b2bf3-2858-4fab-84fc-6d910e42eea9]: (4, ('ok\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:53:43 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-0ddbb37c-7b5b-44b2-9fea-9b691b1bf154 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Flushing IO for device /dev/sdb {{(pid=75066) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 19:53:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:53:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:53:43 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19c7827-fb05-42aa-98c9-5cbe2e6efe4f]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:53:43 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-0ddbb37c-7b5b-44b2-9fea-9b691b1bf154 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75066) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 19:53:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:53:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:53:44 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbe4d1b-9d67-4599-a613-b5f7202e0302]: (4, ('1', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:53:44 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-0ddbb37c-7b5b-44b2-9fea-9b691b1bf154 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 19:53:44 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-0ddbb37c-7b5b-44b2-9fea-9b691b1bf154 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] SCSI volumes sdb have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 19:53:44 user nova-compute[75066]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26466383464373838', '/dev/disk/by-id/scsi-1SCST_BIOb1ff3bbf-df84d7888a9c2595', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_b1ff3bbf') {{(pid=86136) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Dec 01 19:53:44 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8e6440-f6db-4d7a-9279-15571e2cb697]: (4, None) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:53:44 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ddbb37c-7b5b-44b2-9fea-9b691b1bf154 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a')] {{(pid=75066) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 19:53:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:53:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:53:44 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b229e9-2799-461b-b2cd-9a8c8e7c8f6f]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:53:44 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ddbb37c-7b5b-44b2-9fea-9b691b1bf154 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:53:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a -p 172.16.0.220:3260 --logout {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:53:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:53:44 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e958382-3f3d-4eaa-b1e2-8342add172c3]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:53:44 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ddbb37c-7b5b-44b2-9fea-9b691b1bf154 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a, portal: 172.16.0.220,3260]
Dec 01 19:53:44 user nova-compute[75066]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a, portal: 172.16.0.220,3260] successful.
Dec 01 19:53:44 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:53:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a -p 172.16.0.220:3260 --op delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:53:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e425ec76-d0d3-4d82-ab8c-3990c9f5656a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:53:44 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e31143e-0e0d-4020-a538-c4695a80a2be]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:53:44 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ddbb37c-7b5b-44b2-9fea-9b691b1bf154 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:53:44 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-0ddbb37c-7b5b-44b2-9fea-9b691b1bf154 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.306s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:53:44 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-0ddbb37c-7b5b-44b2-9fea-9b691b1bf154 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] <== disconnect_volume: return (307ms) None {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:53:44 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0ddbb37c-7b5b-44b2-9fea-9b691b1bf154 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Disconnected iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 19:53:44 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-0ddbb37c-7b5b-44b2-9fea-9b691b1bf154 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Deleting instance files /opt/stack/data/nova/instances/b27c80e9-9e75-41b2-b380-5cd86538f0c4_del
Dec 01 19:53:44 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-0ddbb37c-7b5b-44b2-9fea-9b691b1bf154 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Deletion of /opt/stack/data/nova/instances/b27c80e9-9e75-41b2-b380-5cd86538f0c4_del complete
Dec 01 19:53:44 user nova-compute[75066]: INFO nova.compute.manager [None req-0ddbb37c-7b5b-44b2-9fea-9b691b1bf154 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Took 1.16 seconds to destroy the instance on the hypervisor.
Dec 01 19:53:44 user nova-compute[75066]: DEBUG oslo.service.loopingcall [None req-0ddbb37c-7b5b-44b2-9fea-9b691b1bf154 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75066) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 19:53:44 user nova-compute[75066]: DEBUG nova.compute.manager [-] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Deallocating network for instance {{(pid=75066) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 19:53:44 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] deallocate_for_instance() {{(pid=75066) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 19:53:44 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:53:44 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:53:44 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:53:44 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:53:44 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:53:45 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:53:45 user nova-compute[75066]: INFO nova.compute.manager [-] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Took 0.98 seconds to deallocate network for instance.
Dec 01 19:53:45 user nova-compute[75066]: DEBUG nova.compute.manager [req-a4832c22-6da2-4ad6-b2d1-e08669485b26 req-37411530-7384-4153-9b26-82747544def0 service nova] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Received event network-vif-plugged-3e2fc190-28ce-414b-b435-820607838b7b {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:53:45 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a4832c22-6da2-4ad6-b2d1-e08669485b26 req-37411530-7384-4153-9b26-82747544def0 service nova] Acquiring lock "b27c80e9-9e75-41b2-b380-5cd86538f0c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:53:45 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a4832c22-6da2-4ad6-b2d1-e08669485b26 req-37411530-7384-4153-9b26-82747544def0 service nova] Lock "b27c80e9-9e75-41b2-b380-5cd86538f0c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:53:45 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a4832c22-6da2-4ad6-b2d1-e08669485b26 req-37411530-7384-4153-9b26-82747544def0 service nova] Lock "b27c80e9-9e75-41b2-b380-5cd86538f0c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:53:45 user nova-compute[75066]: DEBUG nova.compute.manager [req-a4832c22-6da2-4ad6-b2d1-e08669485b26 req-37411530-7384-4153-9b26-82747544def0 service nova] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] No waiting events found dispatching network-vif-plugged-3e2fc190-28ce-414b-b435-820607838b7b {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:53:45 user nova-compute[75066]: WARNING nova.compute.manager [req-a4832c22-6da2-4ad6-b2d1-e08669485b26 req-37411530-7384-4153-9b26-82747544def0 service nova] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Received unexpected event network-vif-plugged-3e2fc190-28ce-414b-b435-820607838b7b for instance with vm_state active and task_state deleting.
Dec 01 19:53:45 user nova-compute[75066]: DEBUG nova.compute.manager [req-a4832c22-6da2-4ad6-b2d1-e08669485b26 req-37411530-7384-4153-9b26-82747544def0 service nova] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Received event network-vif-plugged-3e2fc190-28ce-414b-b435-820607838b7b {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:53:45 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a4832c22-6da2-4ad6-b2d1-e08669485b26 req-37411530-7384-4153-9b26-82747544def0 service nova] Acquiring lock "b27c80e9-9e75-41b2-b380-5cd86538f0c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:53:45 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a4832c22-6da2-4ad6-b2d1-e08669485b26 req-37411530-7384-4153-9b26-82747544def0 service nova] Lock "b27c80e9-9e75-41b2-b380-5cd86538f0c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:53:45 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a4832c22-6da2-4ad6-b2d1-e08669485b26 req-37411530-7384-4153-9b26-82747544def0 service nova] Lock "b27c80e9-9e75-41b2-b380-5cd86538f0c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:53:45 user nova-compute[75066]: DEBUG nova.compute.manager [req-a4832c22-6da2-4ad6-b2d1-e08669485b26 req-37411530-7384-4153-9b26-82747544def0 service nova] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] No waiting events found dispatching network-vif-plugged-3e2fc190-28ce-414b-b435-820607838b7b {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:53:45 user nova-compute[75066]: WARNING nova.compute.manager [req-a4832c22-6da2-4ad6-b2d1-e08669485b26 req-37411530-7384-4153-9b26-82747544def0 service nova] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Received unexpected event network-vif-plugged-3e2fc190-28ce-414b-b435-820607838b7b for instance with vm_state active and task_state deleting.
Dec 01 19:53:45 user nova-compute[75066]: DEBUG nova.compute.manager [req-a4832c22-6da2-4ad6-b2d1-e08669485b26 req-37411530-7384-4153-9b26-82747544def0 service nova] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Received event network-vif-plugged-3e2fc190-28ce-414b-b435-820607838b7b {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:53:45 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a4832c22-6da2-4ad6-b2d1-e08669485b26 req-37411530-7384-4153-9b26-82747544def0 service nova] Acquiring lock "b27c80e9-9e75-41b2-b380-5cd86538f0c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:53:45 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a4832c22-6da2-4ad6-b2d1-e08669485b26 req-37411530-7384-4153-9b26-82747544def0 service nova] Lock "b27c80e9-9e75-41b2-b380-5cd86538f0c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:53:45 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a4832c22-6da2-4ad6-b2d1-e08669485b26 req-37411530-7384-4153-9b26-82747544def0 service nova] Lock "b27c80e9-9e75-41b2-b380-5cd86538f0c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:53:45 user nova-compute[75066]: DEBUG nova.compute.manager [req-a4832c22-6da2-4ad6-b2d1-e08669485b26 req-37411530-7384-4153-9b26-82747544def0 service nova] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] No waiting events found dispatching network-vif-plugged-3e2fc190-28ce-414b-b435-820607838b7b {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:53:45 user nova-compute[75066]: WARNING nova.compute.manager [req-a4832c22-6da2-4ad6-b2d1-e08669485b26 req-37411530-7384-4153-9b26-82747544def0 service nova] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Received unexpected event network-vif-plugged-3e2fc190-28ce-414b-b435-820607838b7b for instance with vm_state active and task_state deleting.
Dec 01 19:53:45 user nova-compute[75066]: DEBUG nova.compute.manager [req-a4832c22-6da2-4ad6-b2d1-e08669485b26 req-37411530-7384-4153-9b26-82747544def0 service nova] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Received event network-vif-unplugged-3e2fc190-28ce-414b-b435-820607838b7b {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:53:45 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a4832c22-6da2-4ad6-b2d1-e08669485b26 req-37411530-7384-4153-9b26-82747544def0 service nova] Acquiring lock "b27c80e9-9e75-41b2-b380-5cd86538f0c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:53:45 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a4832c22-6da2-4ad6-b2d1-e08669485b26 req-37411530-7384-4153-9b26-82747544def0 service nova] Lock "b27c80e9-9e75-41b2-b380-5cd86538f0c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:53:45 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a4832c22-6da2-4ad6-b2d1-e08669485b26 req-37411530-7384-4153-9b26-82747544def0 service nova] Lock "b27c80e9-9e75-41b2-b380-5cd86538f0c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:53:45 user nova-compute[75066]: DEBUG nova.compute.manager [req-a4832c22-6da2-4ad6-b2d1-e08669485b26 req-37411530-7384-4153-9b26-82747544def0 service nova] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] No waiting events found dispatching network-vif-unplugged-3e2fc190-28ce-414b-b435-820607838b7b {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:53:45 user nova-compute[75066]: DEBUG nova.compute.manager [req-a4832c22-6da2-4ad6-b2d1-e08669485b26 req-37411530-7384-4153-9b26-82747544def0 service nova] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Received event network-vif-unplugged-3e2fc190-28ce-414b-b435-820607838b7b for instance with task_state deleting. {{(pid=75066) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 19:53:45 user nova-compute[75066]: DEBUG nova.compute.manager [req-a4832c22-6da2-4ad6-b2d1-e08669485b26 req-37411530-7384-4153-9b26-82747544def0 service nova] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Received event network-vif-plugged-3e2fc190-28ce-414b-b435-820607838b7b {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:53:45 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a4832c22-6da2-4ad6-b2d1-e08669485b26 req-37411530-7384-4153-9b26-82747544def0 service nova] Acquiring lock "b27c80e9-9e75-41b2-b380-5cd86538f0c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:53:45 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a4832c22-6da2-4ad6-b2d1-e08669485b26 req-37411530-7384-4153-9b26-82747544def0 service nova] Lock "b27c80e9-9e75-41b2-b380-5cd86538f0c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:53:45 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a4832c22-6da2-4ad6-b2d1-e08669485b26 req-37411530-7384-4153-9b26-82747544def0 service nova] Lock "b27c80e9-9e75-41b2-b380-5cd86538f0c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:53:45 user nova-compute[75066]: DEBUG nova.compute.manager [req-a4832c22-6da2-4ad6-b2d1-e08669485b26 req-37411530-7384-4153-9b26-82747544def0 service nova] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] No waiting events found dispatching network-vif-plugged-3e2fc190-28ce-414b-b435-820607838b7b {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:53:45 user nova-compute[75066]: WARNING nova.compute.manager [req-a4832c22-6da2-4ad6-b2d1-e08669485b26 req-37411530-7384-4153-9b26-82747544def0 service nova] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Received unexpected event network-vif-plugged-3e2fc190-28ce-414b-b435-820607838b7b for instance with vm_state active and task_state deleting.
Dec 01 19:53:45 user nova-compute[75066]: DEBUG nova.compute.manager [req-a4832c22-6da2-4ad6-b2d1-e08669485b26 req-37411530-7384-4153-9b26-82747544def0 service nova] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Received event network-vif-deleted-3e2fc190-28ce-414b-b435-820607838b7b {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:53:45 user nova-compute[75066]: INFO nova.compute.manager [None req-0ddbb37c-7b5b-44b2-9fea-9b691b1bf154 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Took 0.79 seconds to detach 1 volumes for instance.
Dec 01 19:53:45 user nova-compute[75066]: DEBUG nova.compute.manager [None req-0ddbb37c-7b5b-44b2-9fea-9b691b1bf154 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: b27c80e9-9e75-41b2-b380-5cd86538f0c4] Deleting volume: e425ec76-d0d3-4d82-ab8c-3990c9f5656a {{(pid=75066) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Dec 01 19:53:46 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-0ddbb37c-7b5b-44b2-9fea-9b691b1bf154 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:53:46 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-0ddbb37c-7b5b-44b2-9fea-9b691b1bf154 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:53:46 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-0ddbb37c-7b5b-44b2-9fea-9b691b1bf154 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:53:46 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-0ddbb37c-7b5b-44b2-9fea-9b691b1bf154 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:53:46 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-0ddbb37c-7b5b-44b2-9fea-9b691b1bf154 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.121s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:53:46 user nova-compute[75066]: INFO nova.scheduler.client.report [None req-0ddbb37c-7b5b-44b2-9fea-9b691b1bf154 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Deleted allocations for instance b27c80e9-9e75-41b2-b380-5cd86538f0c4
Dec 01 19:53:46 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-0ddbb37c-7b5b-44b2-9fea-9b691b1bf154 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "b27c80e9-9e75-41b2-b380-5cd86538f0c4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.322s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:53:46 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:53:48 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:53:53 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:53:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:54:03 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:54:03 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:54:03 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75066) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 19:54:03 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:54:03 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:54:03 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:54:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:54:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:54:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75066) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 19:54:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:54:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:54:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:54:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:54:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:54:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75066) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 19:54:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:54:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:54:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:54:14 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:54:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:54:23 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:54:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:54:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:54:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:54:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75066) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 19:54:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:54:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:54:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:54:29 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:54:29 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:54:29 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75066) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 19:54:30 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:54:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:54:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:54:36 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:54:38 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:54:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:54:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:54:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75066) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 19:54:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:54:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:54:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:54:41 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:54:41 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Starting heal instance info cache {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 19:54:41 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Rebuilding the list of instances to heal {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 19:54:41 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Didn't find any instances for network info cache update. {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 01 19:54:42 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:54:42 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:54:42 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:54:42 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:54:42 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:54:42 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75066) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 19:54:42 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:54:42 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:54:42 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Hypervisor/Node resource view: name=user free_ram=9137MB free_disk=24.90355682373047GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75066) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 19:54:42 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:54:42 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:54:42 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 19:54:42 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 19:54:42 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:54:42 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:54:42 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Compute_service record updated for user:user {{(pid=75066) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 19:54:42 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.133s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:54:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:54:46 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Acquiring lock "cb1b24cd-fa7e-4116-9fb2-9656be239a3a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:54:46 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "cb1b24cd-fa7e-4116-9fb2-9656be239a3a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:54:46 user nova-compute[75066]: DEBUG nova.compute.manager [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Starting instance... {{(pid=75066) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 19:54:46 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:54:46 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:54:46 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75066) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 19:54:46 user nova-compute[75066]: INFO nova.compute.claims [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Claim successful on node user
Dec 01 19:54:46 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:54:46 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:54:46 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.291s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:54:46 user nova-compute[75066]: DEBUG nova.compute.manager [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Start building networks asynchronously for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 19:54:46 user nova-compute[75066]: DEBUG nova.compute.manager [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Allocating IP information in the background. {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 19:54:46 user nova-compute[75066]: DEBUG nova.network.neutron [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] allocate_for_instance() {{(pid=75066) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 19:54:46 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 19:54:46 user nova-compute[75066]: DEBUG nova.compute.manager [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Start building block device mappings for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 19:54:46 user nova-compute[75066]: DEBUG nova.policy [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e30df6ccb83b4e8daaed0970c4b423d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecd2a37ec7e4dbbbe53ed6ba9ff45bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75066) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 19:54:46 user nova-compute[75066]: INFO nova.virt.block_device [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Booting with volume c4546286-72f1-4c81-ab90-f4ac1b75d637 at /dev/vda
Dec 01 19:54:47 user nova-compute[75066]: DEBUG os_brick.utils [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:54:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:54:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:54:47 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[f05c5b5b-34de-42f5-a70c-ea7dafabb9e1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1959854982f\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:54:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:54:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:54:47 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08bb442-66da-4419-b806-4af4abeef8a6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:54:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:54:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:54:47 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[791834a7-fa0d-4a4d-bf20-7f5e058009d6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:54:47 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[203dc1be-4e39-466b-bedd-99faabc51add]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:54:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Running cmd (subprocess): nvme version {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:54:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] 'nvme version' failed. Not Retrying. {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:54:47 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] nvme not present on system {{(pid=75066) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 19:54:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:54:47 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:54:47 user nova-compute[75066]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 19:54:47 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6f2c58-af62-4a7f-b417-49da6cf26f01]: (4, '') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:54:47 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75066) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 19:54:47 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 19:54:47 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] LIGHTOS: no hostnqn found. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 19:54:47 user nova-compute[75066]: DEBUG os_brick.utils [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1959854982f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:54:47 user nova-compute[75066]: DEBUG nova.virt.block_device [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Updating existing volume attachment record: 6312f57d-26af-4434-8bea-3e35de357551 {{(pid=75066) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 19:54:48 user nova-compute[75066]: DEBUG nova.network.neutron [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Successfully created port: 5c6acb09-c4b4-4819-9968-18094e9044f8 {{(pid=75066) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 19:54:48 user nova-compute[75066]: DEBUG nova.network.neutron [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Successfully updated port: 5c6acb09-c4b4-4819-9968-18094e9044f8 {{(pid=75066) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 19:54:48 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Acquiring lock "refresh_cache-cb1b24cd-fa7e-4116-9fb2-9656be239a3a" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:54:48 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Acquired lock "refresh_cache-cb1b24cd-fa7e-4116-9fb2-9656be239a3a" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:54:48 user nova-compute[75066]: DEBUG nova.network.neutron [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:54:48 user nova-compute[75066]: DEBUG nova.compute.manager [req-e1f600f6-98dc-412a-bc3c-ca04724326ef req-485fff54-05f8-4100-8cf0-b2ad11b59259 service nova] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Received event network-changed-5c6acb09-c4b4-4819-9968-18094e9044f8 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:54:48 user nova-compute[75066]: DEBUG nova.compute.manager [req-e1f600f6-98dc-412a-bc3c-ca04724326ef req-485fff54-05f8-4100-8cf0-b2ad11b59259 service nova] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Refreshing instance network info cache due to event network-changed-5c6acb09-c4b4-4819-9968-18094e9044f8. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:54:48 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-e1f600f6-98dc-412a-bc3c-ca04724326ef req-485fff54-05f8-4100-8cf0-b2ad11b59259 service nova] Acquiring lock "refresh_cache-cb1b24cd-fa7e-4116-9fb2-9656be239a3a" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:54:48 user nova-compute[75066]: DEBUG nova.network.neutron [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:54:48 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:54:48 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:54:48 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75066) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 19:54:48 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:54:48 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:54:48 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:54:49 user nova-compute[75066]: DEBUG nova.network.neutron [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Updating instance_info_cache with network_info: [{"id": "5c6acb09-c4b4-4819-9968-18094e9044f8", "address": "fa:16:3e:5c:87:e8", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6acb09-c4", "ovs_interfaceid": "5c6acb09-c4b4-4819-9968-18094e9044f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:54:49 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Releasing lock "refresh_cache-cb1b24cd-fa7e-4116-9fb2-9656be239a3a" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:54:49 user nova-compute[75066]: DEBUG nova.compute.manager [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Instance network_info: |[{"id": "5c6acb09-c4b4-4819-9968-18094e9044f8", "address": "fa:16:3e:5c:87:e8", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6acb09-c4", "ovs_interfaceid": "5c6acb09-c4b4-4819-9968-18094e9044f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 19:54:49 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-e1f600f6-98dc-412a-bc3c-ca04724326ef req-485fff54-05f8-4100-8cf0-b2ad11b59259 service nova] Acquired lock "refresh_cache-cb1b24cd-fa7e-4116-9fb2-9656be239a3a" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:54:49 user nova-compute[75066]: DEBUG nova.network.neutron [req-e1f600f6-98dc-412a-bc3c-ca04724326ef req-485fff54-05f8-4100-8cf0-b2ad11b59259 service nova] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Refreshing network info cache for port 5c6acb09-c4b4-4819-9968-18094e9044f8 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:54:49 user nova-compute[75066]: DEBUG nova.network.neutron [req-e1f600f6-98dc-412a-bc3c-ca04724326ef req-485fff54-05f8-4100-8cf0-b2ad11b59259 service nova] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Updated VIF entry in instance network info cache for port 5c6acb09-c4b4-4819-9968-18094e9044f8. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:54:49 user nova-compute[75066]: DEBUG nova.network.neutron [req-e1f600f6-98dc-412a-bc3c-ca04724326ef req-485fff54-05f8-4100-8cf0-b2ad11b59259 service nova] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Updating instance_info_cache with network_info: [{"id": "5c6acb09-c4b4-4819-9968-18094e9044f8", "address": "fa:16:3e:5c:87:e8", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6acb09-c4", "ovs_interfaceid": "5c6acb09-c4b4-4819-9968-18094e9044f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:54:49 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-e1f600f6-98dc-412a-bc3c-ca04724326ef req-485fff54-05f8-4100-8cf0-b2ad11b59259 service nova] Releasing lock "refresh_cache-cb1b24cd-fa7e-4116-9fb2-9656be239a3a" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:54:53 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:54:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG nova.compute.manager [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Start spawning the instance on the hypervisor. {{(pid=75066) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Creating instance directory {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 19:55:00 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Creating image(s)
Dec 01 19:55:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Did not create local disks {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Ensure instance console log exists: /opt/stack/data/nova/instances/cb1b24cd-fa7e-4116-9fb2-9656be239a3a/console.log {{(pid=75066) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Start _get_guest_xml network_info=[{"id": "5c6acb09-c4b4-4819-9968-18094e9044f8", "address": "fa:16:3e:5c:87:e8", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6acb09-c4", "ovs_interfaceid": "5c6acb09-c4b4-4819-9968-18094e9044f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': False, 'attachment_id': '6312f57d-26af-4434-8bea-3e35de357551', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jRnTPfIF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cb1b24cd-fa7e-4116-9fb2-9656be239a3a', 'attached_at': '', 'detached_at': '', 'volume_id': 'c4546286-72f1-4c81-ab90-f4ac1b75d637', 'serial': 'c4546286-72f1-4c81-ab90-f4ac1b75d637'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:55:00 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:55:00 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:55:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Calling os-brick to attach iSCSI Volume {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jRnTPfIF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:55:00 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:55:00 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:55:00 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:55:00 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:55:00 user nova-compute[75066]: INFO os_brick.initiator.connectors.iscsi [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 19:55:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637 -p 172.16.0.220:3260 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[c723cf44-1492-4972-ad63-d50d341ff54f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 19:55:00 user nova-compute[75066]:  {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637 -p 172.16.0.220:3260 --interface default --op new {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d9d220-f974-4e9d-9cd0-e94cdd123826]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637] added\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637] added
Dec 01 19:55:00 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d06561-e770-41a2-ae0e-839a04420633]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[989513e3-d0af-422a-a0ce-5ce36ab0982d]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jRnTPfIF {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jRnTPfIF" returned: 0 in 0.022s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34d22d2-1f92-4f5a-b353-1732ba5b039c]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jRnTPfIF'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac59a95-3df2-48be-8eb5-cb4a1ca8c20c]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71b5c32-18c2-4631-a53c-b6f203310622]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 01 19:55:00 user nova-compute[75066]:  {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 01 19:55:00 user nova-compute[75066]:  {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:55:00 user nova-compute[75066]: WARNING os_brick.initiator.connectors.iscsi [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 01 19:55:00 user nova-compute[75066]: 
Dec 01 19:55:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637 -p 172.16.0.220:3260 --login {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf9369f-5e61-4760-9651-1681b838b8e1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637, portal: 172.16.0.220,3260]
Dec 01 19:55:00 user nova-compute[75066]: Login to [iface: default, target: iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637, portal: 172.16.0.220,3260] successful.
Dec 01 19:55:00 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[74fccb0e-b0c5-41b2-970c-01a9a13cfde6]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b3e7a3-5fba-4e96-bf07-db5ec5c4a256]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637 (non-flash)
Dec 01 19:55:00 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637 (non-flash)
Dec 01 19:55:00 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Connected to 172.16.0.220:3260 {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=75066) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75066) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[045757ff-3cf3-4def-a95e-46941c2be43f]: (4, ('- - 0', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:55:00 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: None {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:55:01 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:55:01 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jRnTPfIF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 19:55:01 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:55:01 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '26165633364356236', 'path': '/dev/sdb'} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:55:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26165633364356236', 'path': '/dev/sdb'} {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 19:55:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:54:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2009433842',display_name='tempest-TestVolumeBootPattern-server-2009433842',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2009433842',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZcmGQdNdh6+W54hnJSMhAIooZ4bmsPXXZPcCaY7NKHvMIJlYzKiEjMggTY/19P2NraKOnZ+VbgwHFLbwZLt3G3n793gjxICMApkHMa4sEV8tQKTYNdlc+ayjZ4vJIxug==',key_name='tempest-TestVolumeBootPattern-959495540',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ecd2a37ec7e4dbbbe53ed6ba9ff45bb',ramdisk_id='',reservation_id='r-ila7shbt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-384255364',owner_user_name='tempest-TestVolumeBootPattern-384255364-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:54:47Z,user_data=None,user_id='e30df6ccb83b4e8daaed0970c4b423d3',uuid=cb1b24cd-fa7e-4116-9fb2-9656be239a3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c6acb09-c4b4-4819-9968-18094e9044f8", "address": "fa:16:3e:5c:87:e8", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6acb09-c4", "ovs_interfaceid": "5c6acb09-c4b4-4819-9968-18094e9044f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:55:01 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Converting VIF {"id": "5c6acb09-c4b4-4819-9968-18094e9044f8", "address": "fa:16:3e:5c:87:e8", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6acb09-c4", "ovs_interfaceid": "5c6acb09-c4b4-4819-9968-18094e9044f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:55:01 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:87:e8,bridge_name='br-int',has_traffic_filtering=True,id=5c6acb09-c4b4-4819-9968-18094e9044f8,network=Network(2a39f486-871f-4115-88cb-176e846fe4f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c6acb09-c4') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:55:01 user nova-compute[75066]: DEBUG nova.objects.instance [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lazy-loading 'pci_devices' on Instance uuid cb1b24cd-fa7e-4116-9fb2-9656be239a3a {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:55:01 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:55:01 user nova-compute[75066]:   <uuid>cb1b24cd-fa7e-4116-9fb2-9656be239a3a</uuid>
Dec 01 19:55:01 user nova-compute[75066]:   <name>instance-00000031</name>
Dec 01 19:55:01 user nova-compute[75066]:   <memory>524288</memory>
Dec 01 19:55:01 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:55:01 user nova-compute[75066]:   <metadata>
Dec 01 19:55:01 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:55:01 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:55:01 user nova-compute[75066]:       <nova:name>tempest-TestVolumeBootPattern-server-2009433842</nova:name>
Dec 01 19:55:01 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:55:00</nova:creationTime>
Dec 01 19:55:01 user nova-compute[75066]:       <nova:flavor name="m1.tiny">
Dec 01 19:55:01 user nova-compute[75066]:         <nova:memory>512</nova:memory>
Dec 01 19:55:01 user nova-compute[75066]:         <nova:disk>1</nova:disk>
Dec 01 19:55:01 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:55:01 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:55:01 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:55:01 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:55:01 user nova-compute[75066]:       <nova:owner>
Dec 01 19:55:01 user nova-compute[75066]:         <nova:user uuid="e30df6ccb83b4e8daaed0970c4b423d3">tempest-TestVolumeBootPattern-384255364-project-member</nova:user>
Dec 01 19:55:01 user nova-compute[75066]:         <nova:project uuid="9ecd2a37ec7e4dbbbe53ed6ba9ff45bb">tempest-TestVolumeBootPattern-384255364</nova:project>
Dec 01 19:55:01 user nova-compute[75066]:       </nova:owner>
Dec 01 19:55:01 user nova-compute[75066]:       <nova:ports>
Dec 01 19:55:01 user nova-compute[75066]:         <nova:port uuid="5c6acb09-c4b4-4819-9968-18094e9044f8">
Dec 01 19:55:01 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Dec 01 19:55:01 user nova-compute[75066]:         </nova:port>
Dec 01 19:55:01 user nova-compute[75066]:       </nova:ports>
Dec 01 19:55:01 user nova-compute[75066]:     </nova:instance>
Dec 01 19:55:01 user nova-compute[75066]:   </metadata>
Dec 01 19:55:01 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:55:01 user nova-compute[75066]:     <system>
Dec 01 19:55:01 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:55:01 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:55:01 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:55:01 user nova-compute[75066]:       <entry name="serial">cb1b24cd-fa7e-4116-9fb2-9656be239a3a</entry>
Dec 01 19:55:01 user nova-compute[75066]:       <entry name="uuid">cb1b24cd-fa7e-4116-9fb2-9656be239a3a</entry>
Dec 01 19:55:01 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:55:01 user nova-compute[75066]:     </system>
Dec 01 19:55:01 user nova-compute[75066]:   </sysinfo>
Dec 01 19:55:01 user nova-compute[75066]:   <os>
Dec 01 19:55:01 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:55:01 user nova-compute[75066]:     <boot dev="hd"/>
Dec 01 19:55:01 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:55:01 user nova-compute[75066]:   </os>
Dec 01 19:55:01 user nova-compute[75066]:   <features>
Dec 01 19:55:01 user nova-compute[75066]:     <acpi/>
Dec 01 19:55:01 user nova-compute[75066]:     <apic/>
Dec 01 19:55:01 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:55:01 user nova-compute[75066]:   </features>
Dec 01 19:55:01 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:55:01 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:55:01 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:55:01 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:55:01 user nova-compute[75066]:   </clock>
Dec 01 19:55:01 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:55:01 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:55:01 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:55:01 user nova-compute[75066]:   </cpu>
Dec 01 19:55:01 user nova-compute[75066]:   <devices>
Dec 01 19:55:01 user nova-compute[75066]:     <disk type="block" device="disk">
Dec 01 19:55:01 user nova-compute[75066]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:55:01 user nova-compute[75066]:       <source dev="/dev/sdb"/>
Dec 01 19:55:01 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:55:01 user nova-compute[75066]:       <serial>c4546286-72f1-4c81-ab90-f4ac1b75d637</serial>
Dec 01 19:55:01 user nova-compute[75066]:     </disk>
Dec 01 19:55:01 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:55:01 user nova-compute[75066]:       <mac address="fa:16:3e:5c:87:e8"/>
Dec 01 19:55:01 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:55:01 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:55:01 user nova-compute[75066]:       <target dev="tap5c6acb09-c4"/>
Dec 01 19:55:01 user nova-compute[75066]:     </interface>
Dec 01 19:55:01 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:55:01 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/cb1b24cd-fa7e-4116-9fb2-9656be239a3a/console.log" append="off"/>
Dec 01 19:55:01 user nova-compute[75066]:     </serial>
Dec 01 19:55:01 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:55:01 user nova-compute[75066]:     <video>
Dec 01 19:55:01 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:55:01 user nova-compute[75066]:     </video>
Dec 01 19:55:01 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:55:01 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:55:01 user nova-compute[75066]:     </rng>
Dec 01 19:55:01 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:55:01 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:55:01 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:55:01 user nova-compute[75066]:     </memballoon>
Dec 01 19:55:01 user nova-compute[75066]:   </devices>
Dec 01 19:55:01 user nova-compute[75066]: </domain>
Dec 01 19:55:01 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:55:02 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:54:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2009433842',display_name='tempest-TestVolumeBootPattern-server-2009433842',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2009433842',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZcmGQdNdh6+W54hnJSMhAIooZ4bmsPXXZPcCaY7NKHvMIJlYzKiEjMggTY/19P2NraKOnZ+VbgwHFLbwZLt3G3n793gjxICMApkHMa4sEV8tQKTYNdlc+ayjZ4vJIxug==',key_name='tempest-TestVolumeBootPattern-959495540',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ecd2a37ec7e4dbbbe53ed6ba9ff45bb',ramdisk_id='',reservation_id='r-ila7shbt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-384255364',owner_user_name='tempest-TestVolumeBootPattern-384255364-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:54:47Z,user_data=None,user_id='e30df6ccb83b4e8daaed0970c4b423d3',uuid=cb1b24cd-fa7e-4116-9fb2-9656be239a3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c6acb09-c4b4-4819-9968-18094e9044f8", "address": "fa:16:3e:5c:87:e8", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6acb09-c4", "ovs_interfaceid": "5c6acb09-c4b4-4819-9968-18094e9044f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:55:02 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Converting VIF {"id": "5c6acb09-c4b4-4819-9968-18094e9044f8", "address": "fa:16:3e:5c:87:e8", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6acb09-c4", "ovs_interfaceid": "5c6acb09-c4b4-4819-9968-18094e9044f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:55:02 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:87:e8,bridge_name='br-int',has_traffic_filtering=True,id=5c6acb09-c4b4-4819-9968-18094e9044f8,network=Network(2a39f486-871f-4115-88cb-176e846fe4f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c6acb09-c4') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:55:02 user nova-compute[75066]: DEBUG os_vif [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:87:e8,bridge_name='br-int',has_traffic_filtering=True,id=5c6acb09-c4b4-4819-9968-18094e9044f8,network=Network(2a39f486-871f-4115-88cb-176e846fe4f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c6acb09-c4') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:55:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:55:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:55:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:55:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:55:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5101eefa-60c9-5231-8077-c62eda7fccd0', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:55:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:55:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:55:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:55:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5c6acb09-c4, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:55:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5c6acb09-c4, col_values=(('qos', UUID('f316b6b2-dc15-4e69-8a33-f499da828eb9')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:55:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5c6acb09-c4, col_values=(('external_ids', {'iface-id': '5c6acb09-c4b4-4819-9968-18094e9044f8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:87:e8', 'vm-uuid': 'cb1b24cd-fa7e-4116-9fb2-9656be239a3a'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:55:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:55:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:55:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:55:02 user nova-compute[75066]: INFO os_vif [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:87:e8,bridge_name='br-int',has_traffic_filtering=True,id=5c6acb09-c4b4-4819-9968-18094e9044f8,network=Network(2a39f486-871f-4115-88cb-176e846fe4f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c6acb09-c4')
Dec 01 19:55:02 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:55:02 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] No VIF found with MAC fa:16:3e:5c:87:e8, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:55:03 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:55:03 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:55:03 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:55:03 user nova-compute[75066]: DEBUG nova.compute.manager [req-61b724b5-b016-4aea-9258-db8585b779da req-f269d162-4059-4945-9c34-4a672c490590 service nova] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Received event network-vif-plugged-5c6acb09-c4b4-4819-9968-18094e9044f8 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:55:03 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-61b724b5-b016-4aea-9258-db8585b779da req-f269d162-4059-4945-9c34-4a672c490590 service nova] Acquiring lock "cb1b24cd-fa7e-4116-9fb2-9656be239a3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:55:03 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-61b724b5-b016-4aea-9258-db8585b779da req-f269d162-4059-4945-9c34-4a672c490590 service nova] Lock "cb1b24cd-fa7e-4116-9fb2-9656be239a3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:55:03 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-61b724b5-b016-4aea-9258-db8585b779da req-f269d162-4059-4945-9c34-4a672c490590 service nova] Lock "cb1b24cd-fa7e-4116-9fb2-9656be239a3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:55:03 user nova-compute[75066]: DEBUG nova.compute.manager [req-61b724b5-b016-4aea-9258-db8585b779da req-f269d162-4059-4945-9c34-4a672c490590 service nova] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] No waiting events found dispatching network-vif-plugged-5c6acb09-c4b4-4819-9968-18094e9044f8 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:55:03 user nova-compute[75066]: WARNING nova.compute.manager [req-61b724b5-b016-4aea-9258-db8585b779da req-f269d162-4059-4945-9c34-4a672c490590 service nova] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Received unexpected event network-vif-plugged-5c6acb09-c4b4-4819-9968-18094e9044f8 for instance with vm_state building and task_state spawning.
Dec 01 19:55:03 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:55:03 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:55:04 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:55:05 user nova-compute[75066]: DEBUG nova.compute.manager [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Instance event wait completed in 0 seconds for  {{(pid=75066) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 19:55:05 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Guest created on hypervisor {{(pid=75066) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 19:55:05 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Instance spawned successfully.
Dec 01 19:55:05 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 19:55:05 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Found default for hw_cdrom_bus of ide {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:55:05 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Found default for hw_disk_bus of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:55:05 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Found default for hw_input_bus of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:55:05 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Found default for hw_pointer_model of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:55:05 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Found default for hw_video_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:55:05 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Found default for hw_vif_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:55:05 user nova-compute[75066]: INFO nova.compute.manager [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Took 5.00 seconds to spawn the instance on the hypervisor.
Dec 01 19:55:05 user nova-compute[75066]: DEBUG nova.compute.manager [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:55:05 user nova-compute[75066]: INFO nova.compute.manager [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Took 19.33 seconds to build instance.
Dec 01 19:55:05 user nova-compute[75066]: DEBUG nova.compute.manager [req-037e94b5-1a1b-4630-b284-ba80a8ef5d3a req-e1f27e41-a701-4557-9f70-b6740198ddaa service nova] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Received event network-vif-plugged-5c6acb09-c4b4-4819-9968-18094e9044f8 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:55:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-037e94b5-1a1b-4630-b284-ba80a8ef5d3a req-e1f27e41-a701-4557-9f70-b6740198ddaa service nova] Acquiring lock "cb1b24cd-fa7e-4116-9fb2-9656be239a3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:55:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-037e94b5-1a1b-4630-b284-ba80a8ef5d3a req-e1f27e41-a701-4557-9f70-b6740198ddaa service nova] Lock "cb1b24cd-fa7e-4116-9fb2-9656be239a3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:55:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-037e94b5-1a1b-4630-b284-ba80a8ef5d3a req-e1f27e41-a701-4557-9f70-b6740198ddaa service nova] Lock "cb1b24cd-fa7e-4116-9fb2-9656be239a3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:55:05 user nova-compute[75066]: DEBUG nova.compute.manager [req-037e94b5-1a1b-4630-b284-ba80a8ef5d3a req-e1f27e41-a701-4557-9f70-b6740198ddaa service nova] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] No waiting events found dispatching network-vif-plugged-5c6acb09-c4b4-4819-9968-18094e9044f8 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:55:05 user nova-compute[75066]: WARNING nova.compute.manager [req-037e94b5-1a1b-4630-b284-ba80a8ef5d3a req-e1f27e41-a701-4557-9f70-b6740198ddaa service nova] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Received unexpected event network-vif-plugged-5c6acb09-c4b4-4819-9968-18094e9044f8 for instance with vm_state active and task_state None.
Dec 01 19:55:05 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-a8ac132f-1146-4479-ba19-293bb7515e81 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "cb1b24cd-fa7e-4116-9fb2-9656be239a3a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.493s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:55:07 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:55:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:55:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:55:17 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:55:22 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:55:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:55:25 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:55:27 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:55:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:55:29 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:55:29 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75066) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 19:55:31 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:55:31 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:55:32 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:55:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:55:36 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:55:37 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:55:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:55:39 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:55:42 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:55:43 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:55:43 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Starting heal instance info cache {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 19:55:43 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Rebuilding the list of instances to heal {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 19:55:43 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "refresh_cache-cb1b24cd-fa7e-4116-9fb2-9656be239a3a" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:55:43 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquired lock "refresh_cache-cb1b24cd-fa7e-4116-9fb2-9656be239a3a" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:55:43 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Forcefully refreshing network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 19:55:43 user nova-compute[75066]: DEBUG nova.objects.instance [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lazy-loading 'info_cache' on Instance uuid cb1b24cd-fa7e-4116-9fb2-9656be239a3a {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:55:43 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Updating instance_info_cache with network_info: [{"id": "5c6acb09-c4b4-4819-9968-18094e9044f8", "address": "fa:16:3e:5c:87:e8", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6acb09-c4", "ovs_interfaceid": "5c6acb09-c4b4-4819-9968-18094e9044f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:55:43 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Releasing lock "refresh_cache-cb1b24cd-fa7e-4116-9fb2-9656be239a3a" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:55:43 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Updated the network info_cache for instance {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 19:55:43 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:55:43 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:55:43 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:55:43 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:55:43 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:55:43 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75066) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 19:55:44 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:55:44 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:55:44 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:55:44 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Hypervisor/Node resource view: name=user free_ram=8960MB free_disk=24.89284896850586GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75066) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 19:55:44 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:55:44 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:55:44 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance cb1b24cd-fa7e-4116-9fb2-9656be239a3a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:55:44 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 19:55:44 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 19:55:44 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:55:44 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:55:44 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Compute_service record updated for user:user {{(pid=75066) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 19:55:44 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.188s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:55:47 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:55:51 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:55:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:55:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:56:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:56:03 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:56:07 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:56:08 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Acquiring lock "dccf4752-fd71-4462-8342-2553e2397b3b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:56:08 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Lock "dccf4752-fd71-4462-8342-2553e2397b3b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:56:08 user nova-compute[75066]: DEBUG nova.compute.manager [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] Starting instance... {{(pid=75066) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 19:56:08 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:56:08 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:56:08 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75066) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 19:56:08 user nova-compute[75066]: INFO nova.compute.claims [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] Claim successful on node user
Dec 01 19:56:08 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:56:08 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:56:08 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.406s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:56:08 user nova-compute[75066]: DEBUG nova.compute.manager [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] Start building networks asynchronously for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 19:56:08 user nova-compute[75066]: DEBUG nova.compute.manager [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] Allocating IP information in the background. {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 19:56:08 user nova-compute[75066]: DEBUG nova.network.neutron [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] allocate_for_instance() {{(pid=75066) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 19:56:08 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 19:56:08 user nova-compute[75066]: DEBUG nova.compute.manager [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] Start building block device mappings for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 19:56:08 user nova-compute[75066]: DEBUG nova.policy [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '88b8f86250664f92a1f03d3542bac5a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f759f3c0a36e4c89ab7f4dcc716e53cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75066) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 19:56:08 user nova-compute[75066]: DEBUG nova.compute.manager [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] Start spawning the instance on the hypervisor. {{(pid=75066) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 19:56:08 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] Creating instance directory {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 19:56:08 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] Creating image(s)
Dec 01 19:56:08 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Acquiring lock "/opt/stack/data/nova/instances/dccf4752-fd71-4462-8342-2553e2397b3b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:56:08 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Lock "/opt/stack/data/nova/instances/dccf4752-fd71-4462-8342-2553e2397b3b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:56:08 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Lock "/opt/stack/data/nova/instances/dccf4752-fd71-4462-8342-2553e2397b3b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:56:08 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:56:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.186s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:56:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Acquiring lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:56:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:56:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:56:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.178s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:56:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/dccf4752-fd71-4462-8342-2553e2397b3b/disk 1073741824 {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:56:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d,backing_fmt=raw /opt/stack/data/nova/instances/dccf4752-fd71-4462-8342-2553e2397b3b/disk 1073741824" returned: 0 in 0.146s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:56:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Lock "e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.331s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:56:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:56:09 user nova-compute[75066]: DEBUG nova.network.neutron [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] Successfully created port: d60fceda-d24e-42db-aea5-2f4098c3a01c {{(pid=75066) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 19:56:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e788a263986e0f5ba3fb7e5a25a0ededfe3a8f1d --force-share --output=json" returned: 0 in 0.186s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:56:09 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dccf4752-fd71-4462-8342-2553e2397b3b/disk. size=1073741824 {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Dec 01 19:56:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dccf4752-fd71-4462-8342-2553e2397b3b/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:56:09 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dccf4752-fd71-4462-8342-2553e2397b3b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:56:09 user nova-compute[75066]: DEBUG nova.virt.disk.api [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Cannot resize image /opt/stack/data/nova/instances/dccf4752-fd71-4462-8342-2553e2397b3b/disk to a smaller size. {{(pid=75066) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Dec 01 19:56:09 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] Created local disks {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4857}}
Dec 01 19:56:09 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] Ensure instance console log exists: /opt/stack/data/nova/instances/dccf4752-fd71-4462-8342-2553e2397b3b/console.log {{(pid=75066) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 19:56:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:56:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:56:09 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:56:10 user nova-compute[75066]: DEBUG nova.network.neutron [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] Successfully updated port: d60fceda-d24e-42db-aea5-2f4098c3a01c {{(pid=75066) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 19:56:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Acquiring lock "refresh_cache-dccf4752-fd71-4462-8342-2553e2397b3b" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:56:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Acquired lock "refresh_cache-dccf4752-fd71-4462-8342-2553e2397b3b" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:56:10 user nova-compute[75066]: DEBUG nova.network.neutron [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:56:10 user nova-compute[75066]: DEBUG nova.compute.manager [req-a9b61d18-c3fe-4dfa-ad08-d67a336fefc0 req-9965b241-c531-45b7-9828-7f807e6dac3d service nova] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] Received event network-changed-d60fceda-d24e-42db-aea5-2f4098c3a01c {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:56:10 user nova-compute[75066]: DEBUG nova.compute.manager [req-a9b61d18-c3fe-4dfa-ad08-d67a336fefc0 req-9965b241-c531-45b7-9828-7f807e6dac3d service nova] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] Refreshing instance network info cache due to event network-changed-d60fceda-d24e-42db-aea5-2f4098c3a01c. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:56:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a9b61d18-c3fe-4dfa-ad08-d67a336fefc0 req-9965b241-c531-45b7-9828-7f807e6dac3d service nova] Acquiring lock "refresh_cache-dccf4752-fd71-4462-8342-2553e2397b3b" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:56:10 user nova-compute[75066]: DEBUG nova.network.neutron [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:56:10 user nova-compute[75066]: DEBUG nova.network.neutron [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] Updating instance_info_cache with network_info: [{"id": "d60fceda-d24e-42db-aea5-2f4098c3a01c", "address": "fa:16:3e:ce:01:d4", "network": {"id": "32ec818e-2f50-4c31-bf47-eb6ccde82061", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "14931108c4054c56b5a4759e9e5e53bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd60fceda-d2", "ovs_interfaceid": "d60fceda-d24e-42db-aea5-2f4098c3a01c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:56:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Releasing lock "refresh_cache-dccf4752-fd71-4462-8342-2553e2397b3b" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:56:10 user nova-compute[75066]: DEBUG nova.compute.manager [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] Instance network_info: |[{"id": "d60fceda-d24e-42db-aea5-2f4098c3a01c", "address": "fa:16:3e:ce:01:d4", "network": {"id": "32ec818e-2f50-4c31-bf47-eb6ccde82061", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "14931108c4054c56b5a4759e9e5e53bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd60fceda-d2", "ovs_interfaceid": "d60fceda-d24e-42db-aea5-2f4098c3a01c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 19:56:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a9b61d18-c3fe-4dfa-ad08-d67a336fefc0 req-9965b241-c531-45b7-9828-7f807e6dac3d service nova] Acquired lock "refresh_cache-dccf4752-fd71-4462-8342-2553e2397b3b" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:56:10 user nova-compute[75066]: DEBUG nova.network.neutron [req-a9b61d18-c3fe-4dfa-ad08-d67a336fefc0 req-9965b241-c531-45b7-9828-7f807e6dac3d service nova] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] Refreshing network info cache for port d60fceda-d24e-42db-aea5-2f4098c3a01c {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:56:10 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] Start _get_guest_xml network_info=[{"id": "d60fceda-d24e-42db-aea5-2f4098c3a01c", "address": "fa:16:3e:ce:01:d4", "network": {"id": "32ec818e-2f50-4c31-bf47-eb6ccde82061", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "14931108c4054c56b5a4759e9e5e53bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd60fceda-d2", "ovs_interfaceid": "d60fceda-d24e-42db-aea5-2f4098c3a01c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'size': 0, 'encryption_secret_uuid': None, 'encrypted': False, 'encryption_format': None, 'boot_index': 0, 'guest_format': None, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_options': None, 'device_type': 'disk', 'image_id': '900b237b-e99c-4fdd-a44f-dcb7a08baa86'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:56:10 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:56:10 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:56:10 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:56:10 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:56:10 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:56:10 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:56:10 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:56:10 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-12-01T19:11:21Z,direct_url=<?>,disk_format='qcow2',id=900b237b-e99c-4fdd-a44f-dcb7a08baa86,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='14931108c4054c56b5a4759e9e5e53bd',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-12-01T19:11:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:56:10 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:56:10 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:56:10 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:56:10 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:56:10 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:56:10 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:56:10 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:56:10 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:56:10 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:56:10 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:56:10 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:56:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1404342115',display_name='tempest-VolumesNegativeTest-instance-1404342115',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1404342115',id=50,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f759f3c0a36e4c89ab7f4dcc716e53cb',ramdisk_id='',reservation_id='r-s3fu649k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1384563593',owner_user_name='tempest-VolumesNegativeTest-1384563593-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:56:09Z,user_data=None,user_id='88b8f86250664f92a1f03d3542bac5a5',uuid=dccf4752-fd71-4462-8342-2553e2397b3b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d60fceda-d24e-42db-aea5-2f4098c3a01c", "address": "fa:16:3e:ce:01:d4", "network": {"id": "32ec818e-2f50-4c31-bf47-eb6ccde82061", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "14931108c4054c56b5a4759e9e5e53bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd60fceda-d2", "ovs_interfaceid": "d60fceda-d24e-42db-aea5-2f4098c3a01c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:56:10 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Converting VIF {"id": "d60fceda-d24e-42db-aea5-2f4098c3a01c", "address": "fa:16:3e:ce:01:d4", "network": {"id": "32ec818e-2f50-4c31-bf47-eb6ccde82061", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "14931108c4054c56b5a4759e9e5e53bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd60fceda-d2", "ovs_interfaceid": "d60fceda-d24e-42db-aea5-2f4098c3a01c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:56:10 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:01:d4,bridge_name='br-int',has_traffic_filtering=True,id=d60fceda-d24e-42db-aea5-2f4098c3a01c,network=Network(32ec818e-2f50-4c31-bf47-eb6ccde82061),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd60fceda-d2') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:56:10 user nova-compute[75066]: DEBUG nova.objects.instance [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Lazy-loading 'pci_devices' on Instance uuid dccf4752-fd71-4462-8342-2553e2397b3b {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:56:10 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:56:10 user nova-compute[75066]:   <uuid>dccf4752-fd71-4462-8342-2553e2397b3b</uuid>
Dec 01 19:56:10 user nova-compute[75066]:   <name>instance-00000032</name>
Dec 01 19:56:10 user nova-compute[75066]:   <memory>524288</memory>
Dec 01 19:56:10 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:56:10 user nova-compute[75066]:   <metadata>
Dec 01 19:56:10 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:56:10 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:56:10 user nova-compute[75066]:       <nova:name>tempest-VolumesNegativeTest-instance-1404342115</nova:name>
Dec 01 19:56:10 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:56:10</nova:creationTime>
Dec 01 19:56:10 user nova-compute[75066]:       <nova:flavor name="m1.tiny">
Dec 01 19:56:10 user nova-compute[75066]:         <nova:memory>512</nova:memory>
Dec 01 19:56:10 user nova-compute[75066]:         <nova:disk>1</nova:disk>
Dec 01 19:56:10 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:56:10 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:56:10 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:56:10 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:56:10 user nova-compute[75066]:       <nova:owner>
Dec 01 19:56:10 user nova-compute[75066]:         <nova:user uuid="88b8f86250664f92a1f03d3542bac5a5">tempest-VolumesNegativeTest-1384563593-project-member</nova:user>
Dec 01 19:56:10 user nova-compute[75066]:         <nova:project uuid="f759f3c0a36e4c89ab7f4dcc716e53cb">tempest-VolumesNegativeTest-1384563593</nova:project>
Dec 01 19:56:10 user nova-compute[75066]:       </nova:owner>
Dec 01 19:56:10 user nova-compute[75066]:       <nova:root type="image" uuid="900b237b-e99c-4fdd-a44f-dcb7a08baa86"/>
Dec 01 19:56:10 user nova-compute[75066]:       <nova:ports>
Dec 01 19:56:10 user nova-compute[75066]:         <nova:port uuid="d60fceda-d24e-42db-aea5-2f4098c3a01c">
Dec 01 19:56:10 user nova-compute[75066]:           <nova:ip type="fixed" address="192.168.233.254" ipVersion="4"/>
Dec 01 19:56:10 user nova-compute[75066]:         </nova:port>
Dec 01 19:56:10 user nova-compute[75066]:       </nova:ports>
Dec 01 19:56:10 user nova-compute[75066]:     </nova:instance>
Dec 01 19:56:10 user nova-compute[75066]:   </metadata>
Dec 01 19:56:10 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:56:10 user nova-compute[75066]:     <system>
Dec 01 19:56:10 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:56:10 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:56:10 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:56:10 user nova-compute[75066]:       <entry name="serial">dccf4752-fd71-4462-8342-2553e2397b3b</entry>
Dec 01 19:56:10 user nova-compute[75066]:       <entry name="uuid">dccf4752-fd71-4462-8342-2553e2397b3b</entry>
Dec 01 19:56:10 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:56:10 user nova-compute[75066]:     </system>
Dec 01 19:56:10 user nova-compute[75066]:   </sysinfo>
Dec 01 19:56:10 user nova-compute[75066]:   <os>
Dec 01 19:56:10 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:56:10 user nova-compute[75066]:     <boot dev="hd"/>
Dec 01 19:56:10 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:56:10 user nova-compute[75066]:   </os>
Dec 01 19:56:10 user nova-compute[75066]:   <features>
Dec 01 19:56:10 user nova-compute[75066]:     <acpi/>
Dec 01 19:56:10 user nova-compute[75066]:     <apic/>
Dec 01 19:56:10 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:56:10 user nova-compute[75066]:   </features>
Dec 01 19:56:10 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:56:10 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:56:10 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:56:10 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:56:10 user nova-compute[75066]:   </clock>
Dec 01 19:56:10 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:56:10 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:56:10 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:56:10 user nova-compute[75066]:   </cpu>
Dec 01 19:56:10 user nova-compute[75066]:   <devices>
Dec 01 19:56:10 user nova-compute[75066]:     <disk type="file" device="disk">
Dec 01 19:56:10 user nova-compute[75066]:       <driver name="qemu" type="qcow2" cache="none"/>
Dec 01 19:56:10 user nova-compute[75066]:       <source file="/opt/stack/data/nova/instances/dccf4752-fd71-4462-8342-2553e2397b3b/disk"/>
Dec 01 19:56:10 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:56:10 user nova-compute[75066]:     </disk>
Dec 01 19:56:10 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:56:10 user nova-compute[75066]:       <mac address="fa:16:3e:ce:01:d4"/>
Dec 01 19:56:10 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:56:10 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:56:10 user nova-compute[75066]:       <target dev="tapd60fceda-d2"/>
Dec 01 19:56:10 user nova-compute[75066]:     </interface>
Dec 01 19:56:10 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:56:10 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/dccf4752-fd71-4462-8342-2553e2397b3b/console.log" append="off"/>
Dec 01 19:56:10 user nova-compute[75066]:     </serial>
Dec 01 19:56:10 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:56:10 user nova-compute[75066]:     <video>
Dec 01 19:56:10 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:56:10 user nova-compute[75066]:     </video>
Dec 01 19:56:10 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:56:10 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:56:10 user nova-compute[75066]:     </rng>
Dec 01 19:56:10 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:56:10 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:56:10 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:56:10 user nova-compute[75066]:     </memballoon>
Dec 01 19:56:10 user nova-compute[75066]:   </devices>
Dec 01 19:56:10 user nova-compute[75066]: </domain>
Dec 01 19:56:10 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:56:10 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:56:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1404342115',display_name='tempest-VolumesNegativeTest-instance-1404342115',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1404342115',id=50,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f759f3c0a36e4c89ab7f4dcc716e53cb',ramdisk_id='',reservation_id='r-s3fu649k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1384563593',owner_user_name='tempest-VolumesNegativeTest-1384563593-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:56:09Z,user_data=None,user_id='88b8f86250664f92a1f03d3542bac5a5',uuid=dccf4752-fd71-4462-8342-2553e2397b3b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d60fceda-d24e-42db-aea5-2f4098c3a01c", "address": "fa:16:3e:ce:01:d4", "network": {"id": "32ec818e-2f50-4c31-bf47-eb6ccde82061", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "14931108c4054c56b5a4759e9e5e53bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd60fceda-d2", "ovs_interfaceid": "d60fceda-d24e-42db-aea5-2f4098c3a01c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:56:10 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Converting VIF {"id": "d60fceda-d24e-42db-aea5-2f4098c3a01c", "address": "fa:16:3e:ce:01:d4", "network": {"id": "32ec818e-2f50-4c31-bf47-eb6ccde82061", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "14931108c4054c56b5a4759e9e5e53bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd60fceda-d2", "ovs_interfaceid": "d60fceda-d24e-42db-aea5-2f4098c3a01c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:56:10 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:01:d4,bridge_name='br-int',has_traffic_filtering=True,id=d60fceda-d24e-42db-aea5-2f4098c3a01c,network=Network(32ec818e-2f50-4c31-bf47-eb6ccde82061),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd60fceda-d2') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:56:10 user nova-compute[75066]: DEBUG os_vif [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:01:d4,bridge_name='br-int',has_traffic_filtering=True,id=d60fceda-d24e-42db-aea5-2f4098c3a01c,network=Network(32ec818e-2f50-4c31-bf47-eb6ccde82061),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd60fceda-d2') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:56:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:56:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:56:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:56:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:56:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5d6d373c-445b-587c-868f-4f3e3b2e7f08', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:56:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:56:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:56:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:56:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd60fceda-d2, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:56:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd60fceda-d2, col_values=(('qos', UUID('cce57f95-b66d-41da-ae57-99d7081cf75b')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:56:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd60fceda-d2, col_values=(('external_ids', {'iface-id': 'd60fceda-d24e-42db-aea5-2f4098c3a01c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:01:d4', 'vm-uuid': 'dccf4752-fd71-4462-8342-2553e2397b3b'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:56:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:56:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:56:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:56:10 user nova-compute[75066]: INFO os_vif [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:01:d4,bridge_name='br-int',has_traffic_filtering=True,id=d60fceda-d24e-42db-aea5-2f4098c3a01c,network=Network(32ec818e-2f50-4c31-bf47-eb6ccde82061),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd60fceda-d2')
Dec 01 19:56:10 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:56:10 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] No VIF found with MAC fa:16:3e:ce:01:d4, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:56:10 user nova-compute[75066]: DEBUG nova.network.neutron [req-a9b61d18-c3fe-4dfa-ad08-d67a336fefc0 req-9965b241-c531-45b7-9828-7f807e6dac3d service nova] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] Updated VIF entry in instance network info cache for port d60fceda-d24e-42db-aea5-2f4098c3a01c. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:56:10 user nova-compute[75066]: DEBUG nova.network.neutron [req-a9b61d18-c3fe-4dfa-ad08-d67a336fefc0 req-9965b241-c531-45b7-9828-7f807e6dac3d service nova] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] Updating instance_info_cache with network_info: [{"id": "d60fceda-d24e-42db-aea5-2f4098c3a01c", "address": "fa:16:3e:ce:01:d4", "network": {"id": "32ec818e-2f50-4c31-bf47-eb6ccde82061", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "14931108c4054c56b5a4759e9e5e53bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd60fceda-d2", "ovs_interfaceid": "d60fceda-d24e-42db-aea5-2f4098c3a01c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:56:10 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-a9b61d18-c3fe-4dfa-ad08-d67a336fefc0 req-9965b241-c531-45b7-9828-7f807e6dac3d service nova] Releasing lock "refresh_cache-dccf4752-fd71-4462-8342-2553e2397b3b" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:56:11 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:56:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:56:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:56:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:56:12 user nova-compute[75066]: DEBUG nova.compute.manager [req-77b6f439-dfba-44b5-a113-5a4d9194070d req-a4732dfa-6855-45ac-a037-c12fb56788df service nova] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] Received event network-vif-plugged-d60fceda-d24e-42db-aea5-2f4098c3a01c {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:56:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-77b6f439-dfba-44b5-a113-5a4d9194070d req-a4732dfa-6855-45ac-a037-c12fb56788df service nova] Acquiring lock "dccf4752-fd71-4462-8342-2553e2397b3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:56:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-77b6f439-dfba-44b5-a113-5a4d9194070d req-a4732dfa-6855-45ac-a037-c12fb56788df service nova] Lock "dccf4752-fd71-4462-8342-2553e2397b3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:56:12 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-77b6f439-dfba-44b5-a113-5a4d9194070d req-a4732dfa-6855-45ac-a037-c12fb56788df service nova] Lock "dccf4752-fd71-4462-8342-2553e2397b3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:56:12 user nova-compute[75066]: DEBUG nova.compute.manager [req-77b6f439-dfba-44b5-a113-5a4d9194070d req-a4732dfa-6855-45ac-a037-c12fb56788df service nova] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] No waiting events found dispatching network-vif-plugged-d60fceda-d24e-42db-aea5-2f4098c3a01c {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:56:12 user nova-compute[75066]: WARNING nova.compute.manager [req-77b6f439-dfba-44b5-a113-5a4d9194070d req-a4732dfa-6855-45ac-a037-c12fb56788df service nova] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] Received unexpected event network-vif-plugged-d60fceda-d24e-42db-aea5-2f4098c3a01c for instance with vm_state building and task_state spawning.
Dec 01 19:56:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:56:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:56:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:56:14 user nova-compute[75066]: DEBUG nova.compute.manager [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] Instance event wait completed in 0 seconds for  {{(pid=75066) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 19:56:14 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] Guest created on hypervisor {{(pid=75066) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 19:56:14 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] Instance spawned successfully.
Dec 01 19:56:14 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 19:56:14 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] Found default for hw_cdrom_bus of ide {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:56:14 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] Found default for hw_disk_bus of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:56:14 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] Found default for hw_input_bus of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:56:14 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] Found default for hw_pointer_model of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:56:14 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] Found default for hw_video_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:56:14 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] Found default for hw_vif_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:56:14 user nova-compute[75066]: DEBUG nova.compute.manager [req-726f4337-3f52-4deb-b205-fa12e51bf986 req-cd794346-4d14-4bf8-a23c-b000fcbc7168 service nova] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] Received event network-vif-plugged-d60fceda-d24e-42db-aea5-2f4098c3a01c {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:56:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-726f4337-3f52-4deb-b205-fa12e51bf986 req-cd794346-4d14-4bf8-a23c-b000fcbc7168 service nova] Acquiring lock "dccf4752-fd71-4462-8342-2553e2397b3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:56:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-726f4337-3f52-4deb-b205-fa12e51bf986 req-cd794346-4d14-4bf8-a23c-b000fcbc7168 service nova] Lock "dccf4752-fd71-4462-8342-2553e2397b3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:56:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-726f4337-3f52-4deb-b205-fa12e51bf986 req-cd794346-4d14-4bf8-a23c-b000fcbc7168 service nova] Lock "dccf4752-fd71-4462-8342-2553e2397b3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:56:14 user nova-compute[75066]: DEBUG nova.compute.manager [req-726f4337-3f52-4deb-b205-fa12e51bf986 req-cd794346-4d14-4bf8-a23c-b000fcbc7168 service nova] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] No waiting events found dispatching network-vif-plugged-d60fceda-d24e-42db-aea5-2f4098c3a01c {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:56:14 user nova-compute[75066]: WARNING nova.compute.manager [req-726f4337-3f52-4deb-b205-fa12e51bf986 req-cd794346-4d14-4bf8-a23c-b000fcbc7168 service nova] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] Received unexpected event network-vif-plugged-d60fceda-d24e-42db-aea5-2f4098c3a01c for instance with vm_state building and task_state spawning.
Dec 01 19:56:14 user nova-compute[75066]: INFO nova.compute.manager [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] Took 5.42 seconds to spawn the instance on the hypervisor.
Dec 01 19:56:14 user nova-compute[75066]: DEBUG nova.compute.manager [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:56:14 user nova-compute[75066]: INFO nova.compute.manager [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] Took 6.25 seconds to build instance.
Dec 01 19:56:14 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-039648a1-9277-4545-b98f-b2f566acfc12 tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Lock "dccf4752-fd71-4462-8342-2553e2397b3b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.357s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:56:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:56:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:56:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:56:24 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:56:24 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75066) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 01 19:56:25 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:56:25 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:56:25 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75066) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 19:56:25 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:56:25 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:56:25 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:56:26 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:56:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:56:29 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:56:29 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75066) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 19:56:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:56:31 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:56:32 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:56:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:56:35 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:56:38 user nova-compute[75066]: DEBUG nova.compute.manager [req-df2da528-dc69-482e-91da-ddc1d92a9158 req-4a8e53d1-4b7a-418d-81f7-1efdf69bf237 service nova] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Received event network-changed-5c6acb09-c4b4-4819-9968-18094e9044f8 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:56:38 user nova-compute[75066]: DEBUG nova.compute.manager [req-df2da528-dc69-482e-91da-ddc1d92a9158 req-4a8e53d1-4b7a-418d-81f7-1efdf69bf237 service nova] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Refreshing instance network info cache due to event network-changed-5c6acb09-c4b4-4819-9968-18094e9044f8. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:56:38 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-df2da528-dc69-482e-91da-ddc1d92a9158 req-4a8e53d1-4b7a-418d-81f7-1efdf69bf237 service nova] Acquiring lock "refresh_cache-cb1b24cd-fa7e-4116-9fb2-9656be239a3a" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:56:38 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-df2da528-dc69-482e-91da-ddc1d92a9158 req-4a8e53d1-4b7a-418d-81f7-1efdf69bf237 service nova] Acquired lock "refresh_cache-cb1b24cd-fa7e-4116-9fb2-9656be239a3a" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:56:38 user nova-compute[75066]: DEBUG nova.network.neutron [req-df2da528-dc69-482e-91da-ddc1d92a9158 req-4a8e53d1-4b7a-418d-81f7-1efdf69bf237 service nova] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Refreshing network info cache for port 5c6acb09-c4b4-4819-9968-18094e9044f8 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:56:38 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:56:38 user nova-compute[75066]: DEBUG nova.network.neutron [req-df2da528-dc69-482e-91da-ddc1d92a9158 req-4a8e53d1-4b7a-418d-81f7-1efdf69bf237 service nova] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Updated VIF entry in instance network info cache for port 5c6acb09-c4b4-4819-9968-18094e9044f8. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:56:38 user nova-compute[75066]: DEBUG nova.network.neutron [req-df2da528-dc69-482e-91da-ddc1d92a9158 req-4a8e53d1-4b7a-418d-81f7-1efdf69bf237 service nova] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Updating instance_info_cache with network_info: [{"id": "5c6acb09-c4b4-4819-9968-18094e9044f8", "address": "fa:16:3e:5c:87:e8", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6acb09-c4", "ovs_interfaceid": "5c6acb09-c4b4-4819-9968-18094e9044f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:56:38 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-df2da528-dc69-482e-91da-ddc1d92a9158 req-4a8e53d1-4b7a-418d-81f7-1efdf69bf237 service nova] Releasing lock "refresh_cache-cb1b24cd-fa7e-4116-9fb2-9656be239a3a" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:56:38 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-27e6c7be-a667-4c6d-a9cd-168dd64a3494 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Acquiring lock "cb1b24cd-fa7e-4116-9fb2-9656be239a3a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:56:38 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-27e6c7be-a667-4c6d-a9cd-168dd64a3494 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "cb1b24cd-fa7e-4116-9fb2-9656be239a3a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:56:38 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-27e6c7be-a667-4c6d-a9cd-168dd64a3494 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Acquiring lock "cb1b24cd-fa7e-4116-9fb2-9656be239a3a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:56:38 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-27e6c7be-a667-4c6d-a9cd-168dd64a3494 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "cb1b24cd-fa7e-4116-9fb2-9656be239a3a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:56:38 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-27e6c7be-a667-4c6d-a9cd-168dd64a3494 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "cb1b24cd-fa7e-4116-9fb2-9656be239a3a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:56:38 user nova-compute[75066]: INFO nova.compute.manager [None req-27e6c7be-a667-4c6d-a9cd-168dd64a3494 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Terminating instance
Dec 01 19:56:38 user nova-compute[75066]: DEBUG nova.compute.manager [None req-27e6c7be-a667-4c6d-a9cd-168dd64a3494 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Start destroying the instance on the hypervisor. {{(pid=75066) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 19:56:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:56:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:56:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:56:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:56:38 user nova-compute[75066]: DEBUG nova.compute.manager [req-d264f146-8def-419e-881e-28694f84f2a5 req-557aac4b-8a37-41d2-9415-d0eb0ce60940 service nova] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Received event network-vif-unplugged-5c6acb09-c4b4-4819-9968-18094e9044f8 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:56:38 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d264f146-8def-419e-881e-28694f84f2a5 req-557aac4b-8a37-41d2-9415-d0eb0ce60940 service nova] Acquiring lock "cb1b24cd-fa7e-4116-9fb2-9656be239a3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:56:38 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d264f146-8def-419e-881e-28694f84f2a5 req-557aac4b-8a37-41d2-9415-d0eb0ce60940 service nova] Lock "cb1b24cd-fa7e-4116-9fb2-9656be239a3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:56:38 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d264f146-8def-419e-881e-28694f84f2a5 req-557aac4b-8a37-41d2-9415-d0eb0ce60940 service nova] Lock "cb1b24cd-fa7e-4116-9fb2-9656be239a3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:56:38 user nova-compute[75066]: DEBUG nova.compute.manager [req-d264f146-8def-419e-881e-28694f84f2a5 req-557aac4b-8a37-41d2-9415-d0eb0ce60940 service nova] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] No waiting events found dispatching network-vif-unplugged-5c6acb09-c4b4-4819-9968-18094e9044f8 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:56:38 user nova-compute[75066]: DEBUG nova.compute.manager [req-d264f146-8def-419e-881e-28694f84f2a5 req-557aac4b-8a37-41d2-9415-d0eb0ce60940 service nova] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Received event network-vif-unplugged-5c6acb09-c4b4-4819-9968-18094e9044f8 for instance with task_state deleting. {{(pid=75066) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 19:56:39 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Instance destroyed successfully.
Dec 01 19:56:39 user nova-compute[75066]: DEBUG nova.objects.instance [None req-27e6c7be-a667-4c6d-a9cd-168dd64a3494 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lazy-loading 'resources' on Instance uuid cb1b24cd-fa7e-4116-9fb2-9656be239a3a {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:56:39 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-27e6c7be-a667-4c6d-a9cd-168dd64a3494 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:54:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2009433842',display_name='tempest-TestVolumeBootPattern-server-2009433842',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2009433842',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZcmGQdNdh6+W54hnJSMhAIooZ4bmsPXXZPcCaY7NKHvMIJlYzKiEjMggTY/19P2NraKOnZ+VbgwHFLbwZLt3G3n793gjxICMApkHMa4sEV8tQKTYNdlc+ayjZ4vJIxug==',key_name='tempest-TestVolumeBootPattern-959495540',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:55:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ecd2a37ec7e4dbbbe53ed6ba9ff45bb',ramdisk_id='',reservation_id='r-ila7shbt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-384255364',owner_user_name='tempest-TestVolumeBootPattern-384255364-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:55:06Z,user_data=None,user_id='e30df6ccb83b4e8daaed0970c4b423d3',uuid=cb1b24cd-fa7e-4116-9fb2-9656be239a3a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5c6acb09-c4b4-4819-9968-18094e9044f8", "address": "fa:16:3e:5c:87:e8", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6acb09-c4", "ovs_interfaceid": "5c6acb09-c4b4-4819-9968-18094e9044f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:56:39 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-27e6c7be-a667-4c6d-a9cd-168dd64a3494 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Converting VIF {"id": "5c6acb09-c4b4-4819-9968-18094e9044f8", "address": "fa:16:3e:5c:87:e8", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c6acb09-c4", "ovs_interfaceid": "5c6acb09-c4b4-4819-9968-18094e9044f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:56:39 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-27e6c7be-a667-4c6d-a9cd-168dd64a3494 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:87:e8,bridge_name='br-int',has_traffic_filtering=True,id=5c6acb09-c4b4-4819-9968-18094e9044f8,network=Network(2a39f486-871f-4115-88cb-176e846fe4f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c6acb09-c4') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:56:39 user nova-compute[75066]: DEBUG os_vif [None req-27e6c7be-a667-4c6d-a9cd-168dd64a3494 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:87:e8,bridge_name='br-int',has_traffic_filtering=True,id=5c6acb09-c4b4-4819-9968-18094e9044f8,network=Network(2a39f486-871f-4115-88cb-176e846fe4f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c6acb09-c4') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:56:39 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:56:39 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5c6acb09-c4, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:56:39 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:56:39 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:56:39 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:56:39 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f316b6b2-dc15-4e69-8a33-f499da828eb9) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:56:39 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:56:39 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:56:39 user nova-compute[75066]: INFO os_vif [None req-27e6c7be-a667-4c6d-a9cd-168dd64a3494 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:87:e8,bridge_name='br-int',has_traffic_filtering=True,id=5c6acb09-c4b4-4819-9968-18094e9044f8,network=Network(2a39f486-871f-4115-88cb-176e846fe4f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c6acb09-c4')
Dec 01 19:56:39 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27e6c7be-a667-4c6d-a9cd-168dd64a3494 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] calling os-brick to detach iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 19:56:39 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e6c7be-a667-4c6d-a9cd-168dd64a3494 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, {'target_iqn': 'iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jRnTPfIF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:56:39 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-27e6c7be-a667-4c6d-a9cd-168dd64a3494 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:56:39 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-27e6c7be-a667-4c6d-a9cd-168dd64a3494 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:56:39 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-27e6c7be-a667-4c6d-a9cd-168dd64a3494 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:56:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:56:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:56:39 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[116088d6-836c-4919-b7f0-8ffb37fdde80]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:56:39 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e6c7be-a667-4c6d-a9cd-168dd64a3494 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 19:56:39 user nova-compute[75066]: No targets found.
Dec 01 19:56:39 user nova-compute[75066]: iSNS:
Dec 01 19:56:39 user nova-compute[75066]: No targets found.
Dec 01 19:56:39 user nova-compute[75066]: STATIC:
Dec 01 19:56:39 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637
Dec 01 19:56:39 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 19:56:39 user nova-compute[75066]:                 Iface Name: default
Dec 01 19:56:39 user nova-compute[75066]: FIRMWARE:
Dec 01 19:56:39 user nova-compute[75066]: No targets found.
Dec 01 19:56:39 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:56:39 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e6c7be-a667-4c6d-a9cd-168dd64a3494 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 19:56:39 user nova-compute[75066]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 19:56:39 user nova-compute[75066]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75066) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 19:56:39 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e6c7be-a667-4c6d-a9cd-168dd64a3494 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637', 0)] {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 19:56:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:56:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:56:39 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba6b105f-d053-40e7-a4d1-0adae8130f5c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:56:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:56:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:56:39 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b1da2e-b449-4c3a-a3ff-97ec5784e6e3]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:56:39 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e6c7be-a667-4c6d-a9cd-168dd64a3494 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637 (non-flash)
Dec 01 19:56:39 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:56:39 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e6c7be-a667-4c6d-a9cd-168dd64a3494 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637 (non-flash)
Dec 01 19:56:39 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:56:39 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e6c7be-a667-4c6d-a9cd-168dd64a3494 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91707592d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637'): ({'sdb'}, set())}) {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 19:56:39 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-27e6c7be-a667-4c6d-a9cd-168dd64a3494 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Removing single pathed devices sdb {{(pid=75066) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 19:56:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:56:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:56:39 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[31792e1d-3177-4206-913f-8a1392e145c5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:56:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:56:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:56:39 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[c10990be-bb40-4f5f-9695-dca5dd7fc50f]: (4, ('ok\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:56:39 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-27e6c7be-a667-4c6d-a9cd-168dd64a3494 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Flushing IO for device /dev/sdb {{(pid=75066) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 19:56:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:56:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:56:39 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca33935b-1bb8-480a-9cef-561af216f617]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:56:39 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-27e6c7be-a667-4c6d-a9cd-168dd64a3494 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75066) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 19:56:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:56:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:56:39 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[a733ef99-6ac5-4705-86de-0a9676918e16]: (4, ('1', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:56:39 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-27e6c7be-a667-4c6d-a9cd-168dd64a3494 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 19:56:39 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-27e6c7be-a667-4c6d-a9cd-168dd64a3494 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] SCSI volumes sdb have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 19:56:39 user nova-compute[75066]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26165633364356236', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_a1942ddd', '/dev/disk/by-id/scsi-1SCST_BIOa1942ddd-aec3d5b65e5c1f81') {{(pid=86136) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Dec 01 19:56:39 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bdabb59-b049-4bd4-96c5-3c0947424702]: (4, None) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:56:39 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e6c7be-a667-4c6d-a9cd-168dd64a3494 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637')] {{(pid=75066) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 19:56:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:56:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:56:39 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3533495-7519-4950-8d0a-fc608cf86831]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:56:39 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e6c7be-a667-4c6d-a9cd-168dd64a3494 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:56:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637 -p 172.16.0.220:3260 --logout {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:56:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:56:39 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[287f334a-d091-4c53-94b9-619a15f0d01d]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:56:39 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e6c7be-a667-4c6d-a9cd-168dd64a3494 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637, portal: 172.16.0.220,3260]
Dec 01 19:56:39 user nova-compute[75066]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637, portal: 172.16.0.220,3260] successful.
Dec 01 19:56:39 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:56:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637 -p 172.16.0.220:3260 --op delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:56:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:56:39 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f5f607-c6b3-4b84-b4d9-c43b91390c37]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:56:39 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e6c7be-a667-4c6d-a9cd-168dd64a3494 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:56:39 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-27e6c7be-a667-4c6d-a9cd-168dd64a3494 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:56:39 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-27e6c7be-a667-4c6d-a9cd-168dd64a3494 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] <== disconnect_volume: return (295ms) None {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:56:39 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27e6c7be-a667-4c6d-a9cd-168dd64a3494 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Disconnected iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 19:56:39 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-27e6c7be-a667-4c6d-a9cd-168dd64a3494 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Deleting instance files /opt/stack/data/nova/instances/cb1b24cd-fa7e-4116-9fb2-9656be239a3a_del
Dec 01 19:56:39 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-27e6c7be-a667-4c6d-a9cd-168dd64a3494 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Deletion of /opt/stack/data/nova/instances/cb1b24cd-fa7e-4116-9fb2-9656be239a3a_del complete
Dec 01 19:56:39 user nova-compute[75066]: INFO nova.compute.manager [None req-27e6c7be-a667-4c6d-a9cd-168dd64a3494 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Took 1.15 seconds to destroy the instance on the hypervisor.
Dec 01 19:56:39 user nova-compute[75066]: DEBUG oslo.service.loopingcall [None req-27e6c7be-a667-4c6d-a9cd-168dd64a3494 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75066) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 19:56:39 user nova-compute[75066]: DEBUG nova.compute.manager [-] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Deallocating network for instance {{(pid=75066) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 19:56:39 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] deallocate_for_instance() {{(pid=75066) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 19:56:40 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:56:40 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:56:40 user nova-compute[75066]: INFO nova.compute.manager [-] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Took 0.75 seconds to deallocate network for instance.
Dec 01 19:56:41 user nova-compute[75066]: DEBUG nova.compute.manager [req-d51cb0af-d8e3-42a5-b50b-e863edb65a8a req-a6de9e1c-5655-4a39-820d-7f1549db1e74 service nova] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Received event network-vif-plugged-5c6acb09-c4b4-4819-9968-18094e9044f8 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:56:41 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d51cb0af-d8e3-42a5-b50b-e863edb65a8a req-a6de9e1c-5655-4a39-820d-7f1549db1e74 service nova] Acquiring lock "cb1b24cd-fa7e-4116-9fb2-9656be239a3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:56:41 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d51cb0af-d8e3-42a5-b50b-e863edb65a8a req-a6de9e1c-5655-4a39-820d-7f1549db1e74 service nova] Lock "cb1b24cd-fa7e-4116-9fb2-9656be239a3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:56:41 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d51cb0af-d8e3-42a5-b50b-e863edb65a8a req-a6de9e1c-5655-4a39-820d-7f1549db1e74 service nova] Lock "cb1b24cd-fa7e-4116-9fb2-9656be239a3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:56:41 user nova-compute[75066]: DEBUG nova.compute.manager [req-d51cb0af-d8e3-42a5-b50b-e863edb65a8a req-a6de9e1c-5655-4a39-820d-7f1549db1e74 service nova] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] No waiting events found dispatching network-vif-plugged-5c6acb09-c4b4-4819-9968-18094e9044f8 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:56:41 user nova-compute[75066]: WARNING nova.compute.manager [req-d51cb0af-d8e3-42a5-b50b-e863edb65a8a req-a6de9e1c-5655-4a39-820d-7f1549db1e74 service nova] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Received unexpected event network-vif-plugged-5c6acb09-c4b4-4819-9968-18094e9044f8 for instance with vm_state active and task_state deleting.
Dec 01 19:56:41 user nova-compute[75066]: DEBUG nova.compute.manager [req-d51cb0af-d8e3-42a5-b50b-e863edb65a8a req-a6de9e1c-5655-4a39-820d-7f1549db1e74 service nova] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Received event network-vif-deleted-5c6acb09-c4b4-4819-9968-18094e9044f8 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:56:41 user nova-compute[75066]: INFO nova.compute.manager [None req-27e6c7be-a667-4c6d-a9cd-168dd64a3494 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: cb1b24cd-fa7e-4116-9fb2-9656be239a3a] Took 0.83 seconds to detach 1 volumes for instance.
Dec 01 19:56:41 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-27e6c7be-a667-4c6d-a9cd-168dd64a3494 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:56:41 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-27e6c7be-a667-4c6d-a9cd-168dd64a3494 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:56:41 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-27e6c7be-a667-4c6d-a9cd-168dd64a3494 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Refreshing inventories for resource provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 01 19:56:41 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-27e6c7be-a667-4c6d-a9cd-168dd64a3494 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Updating ProviderTree inventory for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 01 19:56:41 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-27e6c7be-a667-4c6d-a9cd-168dd64a3494 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Updating inventory in ProviderTree for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 01 19:56:41 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-27e6c7be-a667-4c6d-a9cd-168dd64a3494 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Refreshing aggregate associations for resource provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62, aggregates: None {{(pid=75066) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 01 19:56:41 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-27e6c7be-a667-4c6d-a9cd-168dd64a3494 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Refreshing trait associations for resource provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62, traits: COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SECURITY_UEFI_SECURE_BOOT {{(pid=75066) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 01 19:56:41 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-27e6c7be-a667-4c6d-a9cd-168dd64a3494 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:56:41 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-27e6c7be-a667-4c6d-a9cd-168dd64a3494 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:56:41 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-27e6c7be-a667-4c6d-a9cd-168dd64a3494 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.317s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:56:41 user nova-compute[75066]: INFO nova.scheduler.client.report [None req-27e6c7be-a667-4c6d-a9cd-168dd64a3494 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Deleted allocations for instance cb1b24cd-fa7e-4116-9fb2-9656be239a3a
Dec 01 19:56:41 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-27e6c7be-a667-4c6d-a9cd-168dd64a3494 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "cb1b24cd-fa7e-4116-9fb2-9656be239a3a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.249s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:56:43 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:56:43 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:56:43 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:56:43 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:56:43 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:56:43 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75066) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 19:56:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:56:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dccf4752-fd71-4462-8342-2553e2397b3b/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:56:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dccf4752-fd71-4462-8342-2553e2397b3b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:56:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dccf4752-fd71-4462-8342-2553e2397b3b/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:56:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dccf4752-fd71-4462-8342-2553e2397b3b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:56:44 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:56:44 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:56:44 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:56:44 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Hypervisor/Node resource view: name=user free_ram=8920MB free_disk=24.862445831298828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75066) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 19:56:44 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:56:44 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:56:44 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance dccf4752-fd71-4462-8342-2553e2397b3b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:56:44 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 19:56:44 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 19:56:44 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:56:44 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:56:44 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Compute_service record updated for user:user {{(pid=75066) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 19:56:44 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.220s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:56:46 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:56:46 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Starting heal instance info cache {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 19:56:46 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Rebuilding the list of instances to heal {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 19:56:46 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "refresh_cache-dccf4752-fd71-4462-8342-2553e2397b3b" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:56:46 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquired lock "refresh_cache-dccf4752-fd71-4462-8342-2553e2397b3b" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:56:46 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] Forcefully refreshing network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 19:56:46 user nova-compute[75066]: DEBUG nova.objects.instance [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lazy-loading 'info_cache' on Instance uuid dccf4752-fd71-4462-8342-2553e2397b3b {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:56:47 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] Updating instance_info_cache with network_info: [{"id": "d60fceda-d24e-42db-aea5-2f4098c3a01c", "address": "fa:16:3e:ce:01:d4", "network": {"id": "32ec818e-2f50-4c31-bf47-eb6ccde82061", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "14931108c4054c56b5a4759e9e5e53bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd60fceda-d2", "ovs_interfaceid": "d60fceda-d24e-42db-aea5-2f4098c3a01c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:56:47 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Releasing lock "refresh_cache-dccf4752-fd71-4462-8342-2553e2397b3b" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:56:47 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] Updated the network info_cache for instance {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 19:56:47 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:56:48 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:56:49 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:56:54 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:56:59 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:57:04 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:57:09 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:57:10 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:57:10 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Cleaning up deleted instances {{(pid=75066) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 01 19:57:10 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] There are 0 instances to clean {{(pid=75066) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 01 19:57:14 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:57:14 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:57:14 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75066) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 19:57:14 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:57:14 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:57:14 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:57:19 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:57:24 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:57:24 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:57:24 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75066) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 19:57:24 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:57:24 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:57:24 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:57:26 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:57:29 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:57:29 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75066) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 19:57:29 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:57:30 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Acquiring lock "fbfd4364-9b46-4b2b-9f20-e8593c85ead9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:57:30 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "fbfd4364-9b46-4b2b-9f20-e8593c85ead9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:57:30 user nova-compute[75066]: DEBUG nova.compute.manager [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Starting instance... {{(pid=75066) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 19:57:30 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:57:30 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:57:30 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75066) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 19:57:30 user nova-compute[75066]: INFO nova.compute.claims [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Claim successful on node user
Dec 01 19:57:30 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:57:30 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:57:30 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.238s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:57:30 user nova-compute[75066]: DEBUG nova.compute.manager [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Start building networks asynchronously for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 19:57:30 user nova-compute[75066]: DEBUG nova.compute.manager [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Allocating IP information in the background. {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 19:57:30 user nova-compute[75066]: DEBUG nova.network.neutron [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] allocate_for_instance() {{(pid=75066) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 19:57:30 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 19:57:30 user nova-compute[75066]: DEBUG nova.compute.manager [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Start building block device mappings for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 19:57:30 user nova-compute[75066]: INFO nova.virt.block_device [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Booting with volume c4546286-72f1-4c81-ab90-f4ac1b75d637 at /dev/vda
Dec 01 19:57:30 user nova-compute[75066]: DEBUG nova.policy [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e30df6ccb83b4e8daaed0970c4b423d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecd2a37ec7e4dbbbe53ed6ba9ff45bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75066) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 19:57:30 user nova-compute[75066]: DEBUG os_brick.utils [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:57:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:57:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:57:30 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[58fddf96-2ca8-46c2-bd70-38ccf5485e09]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1959854982f\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:57:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:57:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:57:30 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[01dc4999-84a4-4894-aef6-92a92b290ad6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:57:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:57:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:57:30 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[6193a2b5-747f-4d60-bbfb-cf0790eb63a1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:57:30 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[de567482-d5c6-440c-86a0-08d81ade6b1d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:57:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Running cmd (subprocess): nvme version {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:57:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] 'nvme version' failed. Not Retrying. {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:57:30 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.nvmeof [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] nvme not present on system {{(pid=75066) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 19:57:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:57:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:57:30 user nova-compute[75066]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 19:57:30 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb601cc1-99cf-461e-8151-a2f9661cb538]: (4, '') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:57:30 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75066) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 19:57:30 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 19:57:30 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] LIGHTOS: no hostnqn found. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 19:57:30 user nova-compute[75066]: DEBUG os_brick.utils [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1959854982f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:57:30 user nova-compute[75066]: DEBUG nova.virt.block_device [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Updating existing volume attachment record: 02e5bbdb-cdf6-482f-a37e-2aba1288a048 {{(pid=75066) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 19:57:31 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:57:31 user nova-compute[75066]: DEBUG nova.network.neutron [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Successfully created port: c013f887-6106-4298-84be-4305658e94a4 {{(pid=75066) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 19:57:31 user nova-compute[75066]: DEBUG nova.network.neutron [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Successfully updated port: c013f887-6106-4298-84be-4305658e94a4 {{(pid=75066) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 19:57:31 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Acquiring lock "refresh_cache-fbfd4364-9b46-4b2b-9f20-e8593c85ead9" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:57:31 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Acquired lock "refresh_cache-fbfd4364-9b46-4b2b-9f20-e8593c85ead9" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:57:31 user nova-compute[75066]: DEBUG nova.network.neutron [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:57:31 user nova-compute[75066]: DEBUG nova.compute.manager [req-3057b9b1-7b74-47b4-80c6-0aad8bfde43f req-b4fc68bb-c380-44e1-892e-e8522c670b73 service nova] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Received event network-changed-c013f887-6106-4298-84be-4305658e94a4 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:57:31 user nova-compute[75066]: DEBUG nova.compute.manager [req-3057b9b1-7b74-47b4-80c6-0aad8bfde43f req-b4fc68bb-c380-44e1-892e-e8522c670b73 service nova] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Refreshing instance network info cache due to event network-changed-c013f887-6106-4298-84be-4305658e94a4. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:57:31 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-3057b9b1-7b74-47b4-80c6-0aad8bfde43f req-b4fc68bb-c380-44e1-892e-e8522c670b73 service nova] Acquiring lock "refresh_cache-fbfd4364-9b46-4b2b-9f20-e8593c85ead9" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:57:31 user nova-compute[75066]: DEBUG nova.network.neutron [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:57:32 user nova-compute[75066]: DEBUG nova.network.neutron [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Updating instance_info_cache with network_info: [{"id": "c013f887-6106-4298-84be-4305658e94a4", "address": "fa:16:3e:b0:b9:57", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc013f887-61", "ovs_interfaceid": "c013f887-6106-4298-84be-4305658e94a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:57:32 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Releasing lock "refresh_cache-fbfd4364-9b46-4b2b-9f20-e8593c85ead9" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:57:32 user nova-compute[75066]: DEBUG nova.compute.manager [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Instance network_info: |[{"id": "c013f887-6106-4298-84be-4305658e94a4", "address": "fa:16:3e:b0:b9:57", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc013f887-61", "ovs_interfaceid": "c013f887-6106-4298-84be-4305658e94a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 19:57:32 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-3057b9b1-7b74-47b4-80c6-0aad8bfde43f req-b4fc68bb-c380-44e1-892e-e8522c670b73 service nova] Acquired lock "refresh_cache-fbfd4364-9b46-4b2b-9f20-e8593c85ead9" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:57:32 user nova-compute[75066]: DEBUG nova.network.neutron [req-3057b9b1-7b74-47b4-80c6-0aad8bfde43f req-b4fc68bb-c380-44e1-892e-e8522c670b73 service nova] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Refreshing network info cache for port c013f887-6106-4298-84be-4305658e94a4 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:57:32 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:57:32 user nova-compute[75066]: DEBUG nova.network.neutron [req-3057b9b1-7b74-47b4-80c6-0aad8bfde43f req-b4fc68bb-c380-44e1-892e-e8522c670b73 service nova] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Updated VIF entry in instance network info cache for port c013f887-6106-4298-84be-4305658e94a4. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:57:32 user nova-compute[75066]: DEBUG nova.network.neutron [req-3057b9b1-7b74-47b4-80c6-0aad8bfde43f req-b4fc68bb-c380-44e1-892e-e8522c670b73 service nova] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Updating instance_info_cache with network_info: [{"id": "c013f887-6106-4298-84be-4305658e94a4", "address": "fa:16:3e:b0:b9:57", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc013f887-61", "ovs_interfaceid": "c013f887-6106-4298-84be-4305658e94a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:57:32 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-3057b9b1-7b74-47b4-80c6-0aad8bfde43f req-b4fc68bb-c380-44e1-892e-e8522c670b73 service nova] Releasing lock "refresh_cache-fbfd4364-9b46-4b2b-9f20-e8593c85ead9" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:57:33 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:57:34 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG nova.compute.manager [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Start spawning the instance on the hypervisor. {{(pid=75066) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Creating instance directory {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 19:57:39 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Creating image(s)
Dec 01 19:57:39 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Did not create local disks {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Ensure instance console log exists: /opt/stack/data/nova/instances/fbfd4364-9b46-4b2b-9f20-e8593c85ead9/console.log {{(pid=75066) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Start _get_guest_xml network_info=[{"id": "c013f887-6106-4298-84be-4305658e94a4", "address": "fa:16:3e:b0:b9:57", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc013f887-61", "ovs_interfaceid": "c013f887-6106-4298-84be-4305658e94a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': False, 'attachment_id': '02e5bbdb-cdf6-482f-a37e-2aba1288a048', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jRnTPfIF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fbfd4364-9b46-4b2b-9f20-e8593c85ead9', 'attached_at': '', 'detached_at': '', 'volume_id': 'c4546286-72f1-4c81-ab90-f4ac1b75d637', 'serial': 'c4546286-72f1-4c81-ab90-f4ac1b75d637'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:57:39 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:57:39 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:57:39 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Calling os-brick to attach iSCSI Volume {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jRnTPfIF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:57:39 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:57:39 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:57:39 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:57:39 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:57:39 user nova-compute[75066]: INFO os_brick.initiator.connectors.iscsi [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 19:57:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637 -p 172.16.0.220:3260 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[15fcef5a-ff9f-45b6-a0d2-84b459fd7446]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 19:57:39 user nova-compute[75066]:  {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637 -p 172.16.0.220:3260 --interface default --op new {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e335495-7bad-4f11-95a2-4501d89929e9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637] added\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637] added
Dec 01 19:57:39 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1cb43e-208e-4898-a521-4dd33c4d7c22]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff6a8b7-6e41-4c3b-b353-09f3125c4996]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jRnTPfIF {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jRnTPfIF" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[b661dc95-fbef-4997-adc6-2ca017187a2d]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jRnTPfIF'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[2425c3c0-c26b-483c-9a43-e359cfba7413]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa531dde-16f2-4722-9cd5-bd07da7e678a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Dec 01 19:57:39 user nova-compute[75066]:  {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Dec 01 19:57:39 user nova-compute[75066]:  {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:57:39 user nova-compute[75066]: WARNING os_brick.initiator.connectors.iscsi [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Dec 01 19:57:39 user nova-compute[75066]: 
Dec 01 19:57:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637 -p 172.16.0.220:3260 --login {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637 -p 172.16.0.220:3260 --login" returned: 0 in 0.042s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea36a0a2-9f68-4a2a-a665-a75f30e5878a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637, portal: 172.16.0.220,3260]
Dec 01 19:57:39 user nova-compute[75066]: Login to [iface: default, target: iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637, portal: 172.16.0.220,3260] successful.
Dec 01 19:57:39 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e85e6f-5fe5-46b9-8b49-b248e113d47c]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[1506e471-f23b-44c4-ad4b-b2824de53bd2]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637 (non-flash)
Dec 01 19:57:39 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637 (non-flash)
Dec 01 19:57:39 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.241s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Connected to 172.16.0.220:3260 {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=75066) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75066) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc41fcd-01c4-403f-955a-c532c335de5c]: (4, ('- - 0', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:57:39 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: None {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:57:40 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:57:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jRnTPfIF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 19:57:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.268s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:57:40 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] <== connect_volume: return (1269ms) {'type': 'block', 'scsi_wwn': '26165633364356236', 'path': '/dev/sdb'} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:57:40 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26165633364356236', 'path': '/dev/sdb'} {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 19:57:40 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:57:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-686358611',display_name='tempest-TestVolumeBootPattern-server-686358611',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-686358611',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZcmGQdNdh6+W54hnJSMhAIooZ4bmsPXXZPcCaY7NKHvMIJlYzKiEjMggTY/19P2NraKOnZ+VbgwHFLbwZLt3G3n793gjxICMApkHMa4sEV8tQKTYNdlc+ayjZ4vJIxug==',key_name='tempest-TestVolumeBootPattern-959495540',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ecd2a37ec7e4dbbbe53ed6ba9ff45bb',ramdisk_id='',reservation_id='r-vln4zy9d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-384255364',owner_user_name='tempest-TestVolumeBootPattern-384255364-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:57:31Z,user_data=None,user_id='e30df6ccb83b4e8daaed0970c4b423d3',uuid=fbfd4364-9b46-4b2b-9f20-e8593c85ead9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c013f887-6106-4298-84be-4305658e94a4", "address": "fa:16:3e:b0:b9:57", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc013f887-61", "ovs_interfaceid": "c013f887-6106-4298-84be-4305658e94a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:57:40 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Converting VIF {"id": "c013f887-6106-4298-84be-4305658e94a4", "address": "fa:16:3e:b0:b9:57", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc013f887-61", "ovs_interfaceid": "c013f887-6106-4298-84be-4305658e94a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:57:40 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:b9:57,bridge_name='br-int',has_traffic_filtering=True,id=c013f887-6106-4298-84be-4305658e94a4,network=Network(2a39f486-871f-4115-88cb-176e846fe4f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc013f887-61') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:57:40 user nova-compute[75066]: DEBUG nova.objects.instance [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lazy-loading 'pci_devices' on Instance uuid fbfd4364-9b46-4b2b-9f20-e8593c85ead9 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:57:40 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:57:40 user nova-compute[75066]:   <uuid>fbfd4364-9b46-4b2b-9f20-e8593c85ead9</uuid>
Dec 01 19:57:40 user nova-compute[75066]:   <name>instance-00000033</name>
Dec 01 19:57:40 user nova-compute[75066]:   <memory>524288</memory>
Dec 01 19:57:40 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:57:40 user nova-compute[75066]:   <metadata>
Dec 01 19:57:40 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:57:40 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:57:40 user nova-compute[75066]:       <nova:name>tempest-TestVolumeBootPattern-server-686358611</nova:name>
Dec 01 19:57:40 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:57:39</nova:creationTime>
Dec 01 19:57:40 user nova-compute[75066]:       <nova:flavor name="m1.tiny">
Dec 01 19:57:40 user nova-compute[75066]:         <nova:memory>512</nova:memory>
Dec 01 19:57:40 user nova-compute[75066]:         <nova:disk>1</nova:disk>
Dec 01 19:57:40 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:57:40 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:57:40 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:57:40 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:57:40 user nova-compute[75066]:       <nova:owner>
Dec 01 19:57:40 user nova-compute[75066]:         <nova:user uuid="e30df6ccb83b4e8daaed0970c4b423d3">tempest-TestVolumeBootPattern-384255364-project-member</nova:user>
Dec 01 19:57:40 user nova-compute[75066]:         <nova:project uuid="9ecd2a37ec7e4dbbbe53ed6ba9ff45bb">tempest-TestVolumeBootPattern-384255364</nova:project>
Dec 01 19:57:40 user nova-compute[75066]:       </nova:owner>
Dec 01 19:57:40 user nova-compute[75066]:       <nova:ports>
Dec 01 19:57:40 user nova-compute[75066]:         <nova:port uuid="c013f887-6106-4298-84be-4305658e94a4">
Dec 01 19:57:40 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Dec 01 19:57:40 user nova-compute[75066]:         </nova:port>
Dec 01 19:57:40 user nova-compute[75066]:       </nova:ports>
Dec 01 19:57:40 user nova-compute[75066]:     </nova:instance>
Dec 01 19:57:40 user nova-compute[75066]:   </metadata>
Dec 01 19:57:40 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:57:40 user nova-compute[75066]:     <system>
Dec 01 19:57:40 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:57:40 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:57:40 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:57:40 user nova-compute[75066]:       <entry name="serial">fbfd4364-9b46-4b2b-9f20-e8593c85ead9</entry>
Dec 01 19:57:40 user nova-compute[75066]:       <entry name="uuid">fbfd4364-9b46-4b2b-9f20-e8593c85ead9</entry>
Dec 01 19:57:40 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:57:40 user nova-compute[75066]:     </system>
Dec 01 19:57:40 user nova-compute[75066]:   </sysinfo>
Dec 01 19:57:40 user nova-compute[75066]:   <os>
Dec 01 19:57:40 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:57:40 user nova-compute[75066]:     <boot dev="hd"/>
Dec 01 19:57:40 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:57:40 user nova-compute[75066]:   </os>
Dec 01 19:57:40 user nova-compute[75066]:   <features>
Dec 01 19:57:40 user nova-compute[75066]:     <acpi/>
Dec 01 19:57:40 user nova-compute[75066]:     <apic/>
Dec 01 19:57:40 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:57:40 user nova-compute[75066]:   </features>
Dec 01 19:57:40 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:57:40 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:57:40 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:57:40 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:57:40 user nova-compute[75066]:   </clock>
Dec 01 19:57:40 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:57:40 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:57:40 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:57:40 user nova-compute[75066]:   </cpu>
Dec 01 19:57:40 user nova-compute[75066]:   <devices>
Dec 01 19:57:40 user nova-compute[75066]:     <disk type="block" device="disk">
Dec 01 19:57:40 user nova-compute[75066]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:57:40 user nova-compute[75066]:       <source dev="/dev/sdb"/>
Dec 01 19:57:40 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:57:40 user nova-compute[75066]:       <serial>c4546286-72f1-4c81-ab90-f4ac1b75d637</serial>
Dec 01 19:57:40 user nova-compute[75066]:     </disk>
Dec 01 19:57:40 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:57:40 user nova-compute[75066]:       <mac address="fa:16:3e:b0:b9:57"/>
Dec 01 19:57:40 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:57:40 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:57:40 user nova-compute[75066]:       <target dev="tapc013f887-61"/>
Dec 01 19:57:40 user nova-compute[75066]:     </interface>
Dec 01 19:57:40 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:57:40 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/fbfd4364-9b46-4b2b-9f20-e8593c85ead9/console.log" append="off"/>
Dec 01 19:57:40 user nova-compute[75066]:     </serial>
Dec 01 19:57:40 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:57:40 user nova-compute[75066]:     <video>
Dec 01 19:57:40 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:57:40 user nova-compute[75066]:     </video>
Dec 01 19:57:40 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:57:40 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:57:40 user nova-compute[75066]:     </rng>
Dec 01 19:57:40 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:57:40 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:57:40 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:57:40 user nova-compute[75066]:     </memballoon>
Dec 01 19:57:40 user nova-compute[75066]:   </devices>
Dec 01 19:57:40 user nova-compute[75066]: </domain>
Dec 01 19:57:40 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:57:40 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:57:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-686358611',display_name='tempest-TestVolumeBootPattern-server-686358611',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-686358611',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZcmGQdNdh6+W54hnJSMhAIooZ4bmsPXXZPcCaY7NKHvMIJlYzKiEjMggTY/19P2NraKOnZ+VbgwHFLbwZLt3G3n793gjxICMApkHMa4sEV8tQKTYNdlc+ayjZ4vJIxug==',key_name='tempest-TestVolumeBootPattern-959495540',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ecd2a37ec7e4dbbbe53ed6ba9ff45bb',ramdisk_id='',reservation_id='r-vln4zy9d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-384255364',owner_user_name='tempest-TestVolumeBootPattern-384255364-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:57:31Z,user_data=None,user_id='e30df6ccb83b4e8daaed0970c4b423d3',uuid=fbfd4364-9b46-4b2b-9f20-e8593c85ead9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c013f887-6106-4298-84be-4305658e94a4", "address": "fa:16:3e:b0:b9:57", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc013f887-61", "ovs_interfaceid": "c013f887-6106-4298-84be-4305658e94a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:57:40 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Converting VIF {"id": "c013f887-6106-4298-84be-4305658e94a4", "address": "fa:16:3e:b0:b9:57", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc013f887-61", "ovs_interfaceid": "c013f887-6106-4298-84be-4305658e94a4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:57:40 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b0:b9:57,bridge_name='br-int',has_traffic_filtering=True,id=c013f887-6106-4298-84be-4305658e94a4,network=Network(2a39f486-871f-4115-88cb-176e846fe4f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc013f887-61') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:57:40 user nova-compute[75066]: DEBUG os_vif [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:b9:57,bridge_name='br-int',has_traffic_filtering=True,id=c013f887-6106-4298-84be-4305658e94a4,network=Network(2a39f486-871f-4115-88cb-176e846fe4f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc013f887-61') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:57:40 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:57:40 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:57:40 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:57:40 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:57:40 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9237af1b-70d1-58e1-b511-67b55a8e8cb6', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:57:40 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:57:40 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:57:40 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:57:40 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc013f887-61, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:57:40 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc013f887-61, col_values=(('qos', UUID('21d29ada-ec1e-41d2-9ad5-c71a0b3057d0')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:57:40 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc013f887-61, col_values=(('external_ids', {'iface-id': 'c013f887-6106-4298-84be-4305658e94a4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b0:b9:57', 'vm-uuid': 'fbfd4364-9b46-4b2b-9f20-e8593c85ead9'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:57:40 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:57:40 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:57:40 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:57:40 user nova-compute[75066]: INFO os_vif [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b0:b9:57,bridge_name='br-int',has_traffic_filtering=True,id=c013f887-6106-4298-84be-4305658e94a4,network=Network(2a39f486-871f-4115-88cb-176e846fe4f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc013f887-61')
Dec 01 19:57:40 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:57:40 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] No VIF found with MAC fa:16:3e:b0:b9:57, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:57:41 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:57:42 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:57:42 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:57:42 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:57:42 user nova-compute[75066]: DEBUG nova.compute.manager [req-f6f193d4-4c93-4f0a-95c6-98d67f4431d0 req-52364860-b995-4b00-9f30-1b11a78fcb78 service nova] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Received event network-vif-plugged-c013f887-6106-4298-84be-4305658e94a4 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:57:42 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-f6f193d4-4c93-4f0a-95c6-98d67f4431d0 req-52364860-b995-4b00-9f30-1b11a78fcb78 service nova] Acquiring lock "fbfd4364-9b46-4b2b-9f20-e8593c85ead9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:57:42 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-f6f193d4-4c93-4f0a-95c6-98d67f4431d0 req-52364860-b995-4b00-9f30-1b11a78fcb78 service nova] Lock "fbfd4364-9b46-4b2b-9f20-e8593c85ead9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:57:42 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-f6f193d4-4c93-4f0a-95c6-98d67f4431d0 req-52364860-b995-4b00-9f30-1b11a78fcb78 service nova] Lock "fbfd4364-9b46-4b2b-9f20-e8593c85ead9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:57:42 user nova-compute[75066]: DEBUG nova.compute.manager [req-f6f193d4-4c93-4f0a-95c6-98d67f4431d0 req-52364860-b995-4b00-9f30-1b11a78fcb78 service nova] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] No waiting events found dispatching network-vif-plugged-c013f887-6106-4298-84be-4305658e94a4 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:57:42 user nova-compute[75066]: WARNING nova.compute.manager [req-f6f193d4-4c93-4f0a-95c6-98d67f4431d0 req-52364860-b995-4b00-9f30-1b11a78fcb78 service nova] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Received unexpected event network-vif-plugged-c013f887-6106-4298-84be-4305658e94a4 for instance with vm_state building and task_state spawning.
Dec 01 19:57:42 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:57:42 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:57:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:57:44 user nova-compute[75066]: DEBUG nova.compute.manager [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Instance event wait completed in 0 seconds for  {{(pid=75066) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 19:57:44 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Guest created on hypervisor {{(pid=75066) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 19:57:44 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Instance spawned successfully.
Dec 01 19:57:44 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 19:57:44 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Found default for hw_cdrom_bus of ide {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:57:44 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Found default for hw_disk_bus of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:57:44 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Found default for hw_input_bus of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:57:44 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Found default for hw_pointer_model of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:57:44 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Found default for hw_video_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:57:44 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Found default for hw_vif_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:57:44 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:57:44 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:57:44 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:57:44 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:57:44 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:57:44 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75066) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 19:57:44 user nova-compute[75066]: INFO nova.compute.manager [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Took 4.87 seconds to spawn the instance on the hypervisor.
Dec 01 19:57:44 user nova-compute[75066]: DEBUG nova.compute.manager [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:57:44 user nova-compute[75066]: DEBUG nova.compute.manager [req-941e992e-5494-492b-8f95-b7a61bc81c2d req-f1247a5f-17b9-4800-a48b-bc77064e6496 service nova] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Received event network-vif-plugged-c013f887-6106-4298-84be-4305658e94a4 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:57:44 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-941e992e-5494-492b-8f95-b7a61bc81c2d req-f1247a5f-17b9-4800-a48b-bc77064e6496 service nova] Acquiring lock "fbfd4364-9b46-4b2b-9f20-e8593c85ead9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:57:44 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-941e992e-5494-492b-8f95-b7a61bc81c2d req-f1247a5f-17b9-4800-a48b-bc77064e6496 service nova] Lock "fbfd4364-9b46-4b2b-9f20-e8593c85ead9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:57:44 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-941e992e-5494-492b-8f95-b7a61bc81c2d req-f1247a5f-17b9-4800-a48b-bc77064e6496 service nova] Lock "fbfd4364-9b46-4b2b-9f20-e8593c85ead9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:57:44 user nova-compute[75066]: DEBUG nova.compute.manager [req-941e992e-5494-492b-8f95-b7a61bc81c2d req-f1247a5f-17b9-4800-a48b-bc77064e6496 service nova] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] No waiting events found dispatching network-vif-plugged-c013f887-6106-4298-84be-4305658e94a4 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:57:44 user nova-compute[75066]: WARNING nova.compute.manager [req-941e992e-5494-492b-8f95-b7a61bc81c2d req-f1247a5f-17b9-4800-a48b-bc77064e6496 service nova] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Received unexpected event network-vif-plugged-c013f887-6106-4298-84be-4305658e94a4 for instance with vm_state building and task_state spawning.
Dec 01 19:57:44 user nova-compute[75066]: INFO nova.compute.manager [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Took 14.21 seconds to build instance.
Dec 01 19:57:44 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:57:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dccf4752-fd71-4462-8342-2553e2397b3b/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:57:44 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-573e00e2-7e53-467e-9c07-31a1b35f3fed tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "fbfd4364-9b46-4b2b-9f20-e8593c85ead9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.353s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:57:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dccf4752-fd71-4462-8342-2553e2397b3b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:57:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dccf4752-fd71-4462-8342-2553e2397b3b/disk --force-share --output=json {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:57:44 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dccf4752-fd71-4462-8342-2553e2397b3b/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:57:45 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:57:45 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:57:45 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Hypervisor/Node resource view: name=user free_ram=8903MB free_disk=24.86077117919922GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75066) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 19:57:45 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:57:45 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:57:45 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance dccf4752-fd71-4462-8342-2553e2397b3b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:57:45 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance fbfd4364-9b46-4b2b-9f20-e8593c85ead9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:57:45 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 19:57:45 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 19:57:45 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:57:45 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:57:45 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Compute_service record updated for user:user {{(pid=75066) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 19:57:45 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.234s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:57:45 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:57:47 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:57:47 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Starting heal instance info cache {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 19:57:47 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Rebuilding the list of instances to heal {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 19:57:47 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "refresh_cache-dccf4752-fd71-4462-8342-2553e2397b3b" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:57:47 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquired lock "refresh_cache-dccf4752-fd71-4462-8342-2553e2397b3b" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:57:47 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] Forcefully refreshing network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 19:57:47 user nova-compute[75066]: DEBUG nova.objects.instance [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lazy-loading 'info_cache' on Instance uuid dccf4752-fd71-4462-8342-2553e2397b3b {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:57:47 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] Updating instance_info_cache with network_info: [{"id": "d60fceda-d24e-42db-aea5-2f4098c3a01c", "address": "fa:16:3e:ce:01:d4", "network": {"id": "32ec818e-2f50-4c31-bf47-eb6ccde82061", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "14931108c4054c56b5a4759e9e5e53bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd60fceda-d2", "ovs_interfaceid": "d60fceda-d24e-42db-aea5-2f4098c3a01c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:57:48 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Releasing lock "refresh_cache-dccf4752-fd71-4462-8342-2553e2397b3b" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:57:48 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] Updated the network info_cache for instance {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 19:57:48 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:57:50 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:57:53 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:57:55 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:57:58 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-01e554e0-d291-42ce-ac62-9d2b98de399f tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Acquiring lock "dccf4752-fd71-4462-8342-2553e2397b3b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:57:58 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-01e554e0-d291-42ce-ac62-9d2b98de399f tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Lock "dccf4752-fd71-4462-8342-2553e2397b3b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:57:58 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-01e554e0-d291-42ce-ac62-9d2b98de399f tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Acquiring lock "dccf4752-fd71-4462-8342-2553e2397b3b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:57:58 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-01e554e0-d291-42ce-ac62-9d2b98de399f tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Lock "dccf4752-fd71-4462-8342-2553e2397b3b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:57:58 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-01e554e0-d291-42ce-ac62-9d2b98de399f tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Lock "dccf4752-fd71-4462-8342-2553e2397b3b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:57:58 user nova-compute[75066]: INFO nova.compute.manager [None req-01e554e0-d291-42ce-ac62-9d2b98de399f tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] Terminating instance
Dec 01 19:57:58 user nova-compute[75066]: DEBUG nova.compute.manager [None req-01e554e0-d291-42ce-ac62-9d2b98de399f tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] Start destroying the instance on the hypervisor. {{(pid=75066) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 19:57:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:57:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:57:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:57:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:57:58 user nova-compute[75066]: DEBUG nova.compute.manager [req-e4249bac-13bb-426c-b7e4-689c26ad6f6d req-18fa998b-1c31-43da-abfb-65378dc7d602 service nova] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] Received event network-vif-unplugged-d60fceda-d24e-42db-aea5-2f4098c3a01c {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:57:58 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-e4249bac-13bb-426c-b7e4-689c26ad6f6d req-18fa998b-1c31-43da-abfb-65378dc7d602 service nova] Acquiring lock "dccf4752-fd71-4462-8342-2553e2397b3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:57:58 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-e4249bac-13bb-426c-b7e4-689c26ad6f6d req-18fa998b-1c31-43da-abfb-65378dc7d602 service nova] Lock "dccf4752-fd71-4462-8342-2553e2397b3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:57:58 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-e4249bac-13bb-426c-b7e4-689c26ad6f6d req-18fa998b-1c31-43da-abfb-65378dc7d602 service nova] Lock "dccf4752-fd71-4462-8342-2553e2397b3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:57:58 user nova-compute[75066]: DEBUG nova.compute.manager [req-e4249bac-13bb-426c-b7e4-689c26ad6f6d req-18fa998b-1c31-43da-abfb-65378dc7d602 service nova] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] No waiting events found dispatching network-vif-unplugged-d60fceda-d24e-42db-aea5-2f4098c3a01c {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:57:58 user nova-compute[75066]: DEBUG nova.compute.manager [req-e4249bac-13bb-426c-b7e4-689c26ad6f6d req-18fa998b-1c31-43da-abfb-65378dc7d602 service nova] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] Received event network-vif-unplugged-d60fceda-d24e-42db-aea5-2f4098c3a01c for instance with task_state deleting. {{(pid=75066) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 19:57:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:57:58 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] Instance destroyed successfully.
Dec 01 19:57:58 user nova-compute[75066]: DEBUG nova.objects.instance [None req-01e554e0-d291-42ce-ac62-9d2b98de399f tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Lazy-loading 'resources' on Instance uuid dccf4752-fd71-4462-8342-2553e2397b3b {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:57:58 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-01e554e0-d291-42ce-ac62-9d2b98de399f tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:56:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1404342115',display_name='tempest-VolumesNegativeTest-instance-1404342115',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1404342115',id=50,image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:56:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f759f3c0a36e4c89ab7f4dcc716e53cb',ramdisk_id='',reservation_id='r-s3fu649k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='900b237b-e99c-4fdd-a44f-dcb7a08baa86',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1384563593',owner_user_name='tempest-VolumesNegativeTest-1384563593-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:56:14Z,user_data=None,user_id='88b8f86250664f92a1f03d3542bac5a5',uuid=dccf4752-fd71-4462-8342-2553e2397b3b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d60fceda-d24e-42db-aea5-2f4098c3a01c", "address": "fa:16:3e:ce:01:d4", "network": {"id": "32ec818e-2f50-4c31-bf47-eb6ccde82061", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "14931108c4054c56b5a4759e9e5e53bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd60fceda-d2", "ovs_interfaceid": "d60fceda-d24e-42db-aea5-2f4098c3a01c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 19:57:58 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-01e554e0-d291-42ce-ac62-9d2b98de399f tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Converting VIF {"id": "d60fceda-d24e-42db-aea5-2f4098c3a01c", "address": "fa:16:3e:ce:01:d4", "network": {"id": "32ec818e-2f50-4c31-bf47-eb6ccde82061", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.254", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "14931108c4054c56b5a4759e9e5e53bd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd60fceda-d2", "ovs_interfaceid": "d60fceda-d24e-42db-aea5-2f4098c3a01c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:57:58 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-01e554e0-d291-42ce-ac62-9d2b98de399f tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ce:01:d4,bridge_name='br-int',has_traffic_filtering=True,id=d60fceda-d24e-42db-aea5-2f4098c3a01c,network=Network(32ec818e-2f50-4c31-bf47-eb6ccde82061),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd60fceda-d2') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:57:58 user nova-compute[75066]: DEBUG os_vif [None req-01e554e0-d291-42ce-ac62-9d2b98de399f tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:01:d4,bridge_name='br-int',has_traffic_filtering=True,id=d60fceda-d24e-42db-aea5-2f4098c3a01c,network=Network(32ec818e-2f50-4c31-bf47-eb6ccde82061),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd60fceda-d2') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 19:57:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:57:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd60fceda-d2, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:57:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:57:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:57:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:57:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cce57f95-b66d-41da-ae57-99d7081cf75b) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:57:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:57:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:57:58 user nova-compute[75066]: INFO os_vif [None req-01e554e0-d291-42ce-ac62-9d2b98de399f tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:01:d4,bridge_name='br-int',has_traffic_filtering=True,id=d60fceda-d24e-42db-aea5-2f4098c3a01c,network=Network(32ec818e-2f50-4c31-bf47-eb6ccde82061),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd60fceda-d2')
Dec 01 19:57:58 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-01e554e0-d291-42ce-ac62-9d2b98de399f tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] Deleting instance files /opt/stack/data/nova/instances/dccf4752-fd71-4462-8342-2553e2397b3b_del
Dec 01 19:57:58 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-01e554e0-d291-42ce-ac62-9d2b98de399f tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] Deletion of /opt/stack/data/nova/instances/dccf4752-fd71-4462-8342-2553e2397b3b_del complete
Dec 01 19:57:58 user nova-compute[75066]: INFO nova.compute.manager [None req-01e554e0-d291-42ce-ac62-9d2b98de399f tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] Took 0.68 seconds to destroy the instance on the hypervisor.
Dec 01 19:57:58 user nova-compute[75066]: DEBUG oslo.service.loopingcall [None req-01e554e0-d291-42ce-ac62-9d2b98de399f tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75066) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 19:57:58 user nova-compute[75066]: DEBUG nova.compute.manager [-] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] Deallocating network for instance {{(pid=75066) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 19:57:58 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] deallocate_for_instance() {{(pid=75066) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 19:57:59 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:57:59 user nova-compute[75066]: INFO nova.compute.manager [-] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] Took 0.46 seconds to deallocate network for instance.
Dec 01 19:57:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-01e554e0-d291-42ce-ac62-9d2b98de399f tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:57:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-01e554e0-d291-42ce-ac62-9d2b98de399f tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:57:59 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-01e554e0-d291-42ce-ac62-9d2b98de399f tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:57:59 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-01e554e0-d291-42ce-ac62-9d2b98de399f tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:57:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-01e554e0-d291-42ce-ac62-9d2b98de399f tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.154s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:57:59 user nova-compute[75066]: INFO nova.scheduler.client.report [None req-01e554e0-d291-42ce-ac62-9d2b98de399f tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Deleted allocations for instance dccf4752-fd71-4462-8342-2553e2397b3b
Dec 01 19:57:59 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-01e554e0-d291-42ce-ac62-9d2b98de399f tempest-VolumesNegativeTest-1384563593 tempest-VolumesNegativeTest-1384563593-project-member] Lock "dccf4752-fd71-4462-8342-2553e2397b3b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.481s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:58:00 user nova-compute[75066]: DEBUG nova.compute.manager [req-f8dd5626-f135-4419-8c56-80b1a1e01983 req-20ab27f6-298b-4f44-8868-b76ba7bd9b07 service nova] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] Received event network-vif-plugged-d60fceda-d24e-42db-aea5-2f4098c3a01c {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:58:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-f8dd5626-f135-4419-8c56-80b1a1e01983 req-20ab27f6-298b-4f44-8868-b76ba7bd9b07 service nova] Acquiring lock "dccf4752-fd71-4462-8342-2553e2397b3b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:58:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-f8dd5626-f135-4419-8c56-80b1a1e01983 req-20ab27f6-298b-4f44-8868-b76ba7bd9b07 service nova] Lock "dccf4752-fd71-4462-8342-2553e2397b3b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:58:00 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-f8dd5626-f135-4419-8c56-80b1a1e01983 req-20ab27f6-298b-4f44-8868-b76ba7bd9b07 service nova] Lock "dccf4752-fd71-4462-8342-2553e2397b3b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:58:00 user nova-compute[75066]: DEBUG nova.compute.manager [req-f8dd5626-f135-4419-8c56-80b1a1e01983 req-20ab27f6-298b-4f44-8868-b76ba7bd9b07 service nova] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] No waiting events found dispatching network-vif-plugged-d60fceda-d24e-42db-aea5-2f4098c3a01c {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:58:00 user nova-compute[75066]: WARNING nova.compute.manager [req-f8dd5626-f135-4419-8c56-80b1a1e01983 req-20ab27f6-298b-4f44-8868-b76ba7bd9b07 service nova] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] Received unexpected event network-vif-plugged-d60fceda-d24e-42db-aea5-2f4098c3a01c for instance with vm_state deleted and task_state None.
Dec 01 19:58:00 user nova-compute[75066]: DEBUG nova.compute.manager [req-f8dd5626-f135-4419-8c56-80b1a1e01983 req-20ab27f6-298b-4f44-8868-b76ba7bd9b07 service nova] [instance: dccf4752-fd71-4462-8342-2553e2397b3b] Received event network-vif-deleted-d60fceda-d24e-42db-aea5-2f4098c3a01c {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:58:03 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:58:03 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:58:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:58:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:58:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:58:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:58:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:58:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:58:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:58:27 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:58:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:58:29 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:58:29 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75066) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 19:58:33 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:58:33 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:58:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:58:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:58:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75066) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 19:58:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:58:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:58:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:58:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:58:39 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:58:41 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:58:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:58:44 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:58:44 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:58:44 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:58:44 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:58:44 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75066) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 19:58:44 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:58:44 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:58:44 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:58:44 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Hypervisor/Node resource view: name=user free_ram=8938MB free_disk=24.887882232666016GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75066) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 19:58:44 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:58:44 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:58:44 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance fbfd4364-9b46-4b2b-9f20-e8593c85ead9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:58:44 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 19:58:44 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 19:58:44 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:58:44 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:58:44 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Compute_service record updated for user:user {{(pid=75066) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 19:58:44 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.188s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:58:45 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:58:46 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:58:46 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Starting heal instance info cache {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 19:58:46 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "refresh_cache-fbfd4364-9b46-4b2b-9f20-e8593c85ead9" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:58:46 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquired lock "refresh_cache-fbfd4364-9b46-4b2b-9f20-e8593c85ead9" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:58:46 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Forcefully refreshing network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 19:58:46 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Updating instance_info_cache with network_info: [{"id": "c013f887-6106-4298-84be-4305658e94a4", "address": "fa:16:3e:b0:b9:57", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc013f887-61", "ovs_interfaceid": "c013f887-6106-4298-84be-4305658e94a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:58:46 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Releasing lock "refresh_cache-fbfd4364-9b46-4b2b-9f20-e8593c85ead9" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:58:46 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Updated the network info_cache for instance {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 19:58:48 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:58:53 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:58:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:58:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:58:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75066) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 19:58:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:58:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:58:58 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:58:59 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:59:03 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:59:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:59:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:59:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:59:22 user nova-compute[75066]: DEBUG nova.compute.manager [req-44c777dd-c902-4a50-adab-9df2375500cc req-68290e0d-5f37-4bf4-ac6e-cc9119876297 service nova] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Received event network-changed-c013f887-6106-4298-84be-4305658e94a4 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:59:22 user nova-compute[75066]: DEBUG nova.compute.manager [req-44c777dd-c902-4a50-adab-9df2375500cc req-68290e0d-5f37-4bf4-ac6e-cc9119876297 service nova] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Refreshing instance network info cache due to event network-changed-c013f887-6106-4298-84be-4305658e94a4. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:59:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-44c777dd-c902-4a50-adab-9df2375500cc req-68290e0d-5f37-4bf4-ac6e-cc9119876297 service nova] Acquiring lock "refresh_cache-fbfd4364-9b46-4b2b-9f20-e8593c85ead9" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:59:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-44c777dd-c902-4a50-adab-9df2375500cc req-68290e0d-5f37-4bf4-ac6e-cc9119876297 service nova] Acquired lock "refresh_cache-fbfd4364-9b46-4b2b-9f20-e8593c85ead9" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:59:22 user nova-compute[75066]: DEBUG nova.network.neutron [req-44c777dd-c902-4a50-adab-9df2375500cc req-68290e0d-5f37-4bf4-ac6e-cc9119876297 service nova] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Refreshing network info cache for port c013f887-6106-4298-84be-4305658e94a4 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:59:22 user nova-compute[75066]: DEBUG nova.network.neutron [req-44c777dd-c902-4a50-adab-9df2375500cc req-68290e0d-5f37-4bf4-ac6e-cc9119876297 service nova] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Updated VIF entry in instance network info cache for port c013f887-6106-4298-84be-4305658e94a4. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:59:22 user nova-compute[75066]: DEBUG nova.network.neutron [req-44c777dd-c902-4a50-adab-9df2375500cc req-68290e0d-5f37-4bf4-ac6e-cc9119876297 service nova] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Updating instance_info_cache with network_info: [{"id": "c013f887-6106-4298-84be-4305658e94a4", "address": "fa:16:3e:b0:b9:57", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc013f887-61", "ovs_interfaceid": "c013f887-6106-4298-84be-4305658e94a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:59:22 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-44c777dd-c902-4a50-adab-9df2375500cc req-68290e0d-5f37-4bf4-ac6e-cc9119876297 service nova] Releasing lock "refresh_cache-fbfd4364-9b46-4b2b-9f20-e8593c85ead9" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:59:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:59:23 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:59:28 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:59:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:59:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:59:30 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:59:30 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75066) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 19:59:33 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:59:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:59:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:59:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5009 ms, sending inactivity probe {{(pid=75066) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 19:59:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:59:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 19:59:33 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:59:33 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Acquiring lock "999f9881-40ae-46bf-8d74-00745516af80" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:59:33 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "999f9881-40ae-46bf-8d74-00745516af80" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:59:33 user nova-compute[75066]: DEBUG nova.compute.manager [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Starting instance... {{(pid=75066) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Dec 01 19:59:33 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:59:33 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:59:33 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75066) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2416}}
Dec 01 19:59:33 user nova-compute[75066]: INFO nova.compute.claims [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Claim successful on node user
Dec 01 19:59:34 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:59:34 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:59:34 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.199s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:59:34 user nova-compute[75066]: DEBUG nova.compute.manager [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Start building networks asynchronously for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Dec 01 19:59:34 user nova-compute[75066]: DEBUG nova.compute.manager [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Allocating IP information in the background. {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Dec 01 19:59:34 user nova-compute[75066]: DEBUG nova.network.neutron [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 999f9881-40ae-46bf-8d74-00745516af80] allocate_for_instance() {{(pid=75066) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Dec 01 19:59:34 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Dec 01 19:59:34 user nova-compute[75066]: DEBUG nova.compute.manager [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Start building block device mappings for instance. {{(pid=75066) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Dec 01 19:59:34 user nova-compute[75066]: DEBUG nova.policy [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e30df6ccb83b4e8daaed0970c4b423d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ecd2a37ec7e4dbbbe53ed6ba9ff45bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75066) authorize /opt/stack/nova/nova/policy.py:203}}
Dec 01 19:59:34 user nova-compute[75066]: INFO nova.virt.block_device [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Booting with volume 8eccd526-eb00-4206-ba93-59abc84663dd at /dev/vda
Dec 01 19:59:34 user nova-compute[75066]: DEBUG os_brick.utils [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:59:34 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:59:34 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:59:34 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[be2b97bd-b8c6-41fe-8ba5-720240813475]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:1959854982f\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:59:34 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:59:34 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.030s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:59:34 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67d5e88-1848-44ce-aeda-7fa6b55bcc6e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:59:34 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:59:34 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:59:34 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[99cfec37-8334-42ff-8412-a3aedf55dd96]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:59:34 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f15c862-cffd-4603-a691-0a2d7e3a43b2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:59:34 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Running cmd (subprocess): nvme version {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:59:34 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] 'nvme version' failed. Not Retrying. {{(pid=75066) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:59:34 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] nvme not present on system {{(pid=75066) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Dec 01 19:59:34 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:59:34 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Dec 01 19:59:34 user nova-compute[75066]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Dec 01 19:59:34 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c1adc7-4ed5-4c7b-bcad-63080cfad8a5]: (4, '') {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:59:34 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75066) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Dec 01 19:59:34 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Dec 01 19:59:34 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.lightos [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] LIGHTOS: no hostnqn found. {{(pid=75066) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Dec 01 19:59:34 user nova-compute[75066]: DEBUG os_brick.utils [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:1959854982f', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:59:34 user nova-compute[75066]: DEBUG nova.virt.block_device [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Updating existing volume attachment record: 22383613-e39e-4268-aed9-cf93cd459cdf {{(pid=75066) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Dec 01 19:59:34 user nova-compute[75066]: DEBUG nova.network.neutron [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Successfully created port: 491104c5-2c05-4523-950e-937667f5e91f {{(pid=75066) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Dec 01 19:59:35 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:59:35 user nova-compute[75066]: DEBUG nova.network.neutron [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Successfully updated port: 491104c5-2c05-4523-950e-937667f5e91f {{(pid=75066) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Dec 01 19:59:35 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Acquiring lock "refresh_cache-999f9881-40ae-46bf-8d74-00745516af80" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:59:35 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Acquired lock "refresh_cache-999f9881-40ae-46bf-8d74-00745516af80" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:59:35 user nova-compute[75066]: DEBUG nova.network.neutron [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Building network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Dec 01 19:59:35 user nova-compute[75066]: DEBUG nova.compute.manager [req-d3fb6646-bf85-4e4e-b265-13a42f294caa req-42af3014-4590-4fd1-9635-93d9dede2c7e service nova] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Received event network-changed-491104c5-2c05-4523-950e-937667f5e91f {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:59:35 user nova-compute[75066]: DEBUG nova.compute.manager [req-d3fb6646-bf85-4e4e-b265-13a42f294caa req-42af3014-4590-4fd1-9635-93d9dede2c7e service nova] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Refreshing instance network info cache due to event network-changed-491104c5-2c05-4523-950e-937667f5e91f. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 19:59:35 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d3fb6646-bf85-4e4e-b265-13a42f294caa req-42af3014-4590-4fd1-9635-93d9dede2c7e service nova] Acquiring lock "refresh_cache-999f9881-40ae-46bf-8d74-00745516af80" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:59:35 user nova-compute[75066]: DEBUG nova.network.neutron [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Instance cache missing network info. {{(pid=75066) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Dec 01 19:59:36 user nova-compute[75066]: DEBUG nova.network.neutron [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Updating instance_info_cache with network_info: [{"id": "491104c5-2c05-4523-950e-937667f5e91f", "address": "fa:16:3e:a8:15:f8", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491104c5-2c", "ovs_interfaceid": "491104c5-2c05-4523-950e-937667f5e91f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:59:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Releasing lock "refresh_cache-999f9881-40ae-46bf-8d74-00745516af80" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:59:36 user nova-compute[75066]: DEBUG nova.compute.manager [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Instance network_info: |[{"id": "491104c5-2c05-4523-950e-937667f5e91f", "address": "fa:16:3e:a8:15:f8", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491104c5-2c", "ovs_interfaceid": "491104c5-2c05-4523-950e-937667f5e91f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75066) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Dec 01 19:59:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d3fb6646-bf85-4e4e-b265-13a42f294caa req-42af3014-4590-4fd1-9635-93d9dede2c7e service nova] Acquired lock "refresh_cache-999f9881-40ae-46bf-8d74-00745516af80" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:59:36 user nova-compute[75066]: DEBUG nova.network.neutron [req-d3fb6646-bf85-4e4e-b265-13a42f294caa req-42af3014-4590-4fd1-9635-93d9dede2c7e service nova] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Refreshing network info cache for port 491104c5-2c05-4523-950e-937667f5e91f {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 19:59:36 user nova-compute[75066]: DEBUG nova.network.neutron [req-d3fb6646-bf85-4e4e-b265-13a42f294caa req-42af3014-4590-4fd1-9635-93d9dede2c7e service nova] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Updated VIF entry in instance network info cache for port 491104c5-2c05-4523-950e-937667f5e91f. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 19:59:36 user nova-compute[75066]: DEBUG nova.network.neutron [req-d3fb6646-bf85-4e4e-b265-13a42f294caa req-42af3014-4590-4fd1-9635-93d9dede2c7e service nova] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Updating instance_info_cache with network_info: [{"id": "491104c5-2c05-4523-950e-937667f5e91f", "address": "fa:16:3e:a8:15:f8", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491104c5-2c", "ovs_interfaceid": "491104c5-2c05-4523-950e-937667f5e91f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:59:36 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-d3fb6646-bf85-4e4e-b265-13a42f294caa req-42af3014-4590-4fd1-9635-93d9dede2c7e service nova] Releasing lock "refresh_cache-999f9881-40ae-46bf-8d74-00745516af80" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:59:38 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:59:40 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG nova.compute.manager [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Start spawning the instance on the hypervisor. {{(pid=75066) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Creating instance directory {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Dec 01 19:59:43 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Creating image(s)
Dec 01 19:59:43 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Did not create local disks {{(pid=75066) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4859}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Ensure instance console log exists: /opt/stack/data/nova/instances/999f9881-40ae-46bf-8d74-00745516af80/console.log {{(pid=75066) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4609}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Start _get_guest_xml network_info=[{"id": "491104c5-2c05-4523-950e-937667f5e91f", "address": "fa:16:3e:a8:15:f8", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491104c5-2c", "ovs_interfaceid": "491104c5-2c05-4523-950e-937667f5e91f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'mount_device': '/dev/vda', 'guest_format': None, 'delete_on_termination': False, 'attachment_id': '22383613-e39e-4268-aed9-cf93cd459cdf', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8eccd526-eb00-4206-ba93-59abc84663dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'znaBOVWv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '999f9881-40ae-46bf-8d74-00745516af80', 'attached_at': '', 'detached_at': '', 'volume_id': '8eccd526-eb00-4206-ba93-59abc84663dd', 'serial': '8eccd526-eb00-4206-ba93-59abc84663dd'}, 'device_type': 'disk', 'volume_type': None} {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7558}}
Dec 01 19:59:43 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:59:43 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:59:43 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1652}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] CPU controller missing on host. {{(pid=75066) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1662}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1671}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG nova.virt.libvirt.host [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] CPU controller found on host. {{(pid=75066) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1678}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75066) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5396}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-12-01T19:11:10Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Flavor limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Image limits 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Flavor pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Image pref 0:0:0 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Got 1 possible topologies {{(pid=75066) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG nova.virt.hardware [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75066) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Calling os-brick to attach iSCSI Volume {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8eccd526-eb00-4206-ba93-59abc84663dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'znaBOVWv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 19:59:43 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:59:43 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:59:43 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 19:59:43 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8eccd526-eb00-4206-ba93-59abc84663dd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8eccd526-eb00-4206-ba93-59abc84663dd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 19:59:43 user nova-compute[75066]: INFO os_brick.initiator.connectors.iscsi [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Dec 01 19:59:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8eccd526-eb00-4206-ba93-59abc84663dd -p 172.16.0.220:3260 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8eccd526-eb00-4206-ba93-59abc84663dd -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[8334288f-9384-4657-8c9d-386b722ecd07]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Dec 01 19:59:43 user nova-compute[75066]:  {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8eccd526-eb00-4206-ba93-59abc84663dd -p 172.16.0.220:3260 --interface default --op new {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8eccd526-eb00-4206-ba93-59abc84663dd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85eee54-0675-4db9-87e4-6e08453c2b25]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8eccd526-eb00-4206-ba93-59abc84663dd] added\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8eccd526-eb00-4206-ba93-59abc84663dd] added
Dec 01 19:59:43 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8eccd526-eb00-4206-ba93-59abc84663dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8eccd526-eb00-4206-ba93-59abc84663dd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9d6660-c7eb-46e7-91e8-a61cd71fa5b3]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8eccd526-eb00-4206-ba93-59abc84663dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8eccd526-eb00-4206-ba93-59abc84663dd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[5241f14d-2ed3-4957-82d0-baedd3d0ff49]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8eccd526-eb00-4206-ba93-59abc84663dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v znaBOVWv {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8eccd526-eb00-4206-ba93-59abc84663dd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v znaBOVWv" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da97b07-08d7-44f8-883c-a288bf8fde4c]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'znaBOVWv'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8eccd526-eb00-4206-ba93-59abc84663dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8eccd526-eb00-4206-ba93-59abc84663dd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5a58b1-5628-40e4-b668-6b14a83433a0]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ccea59-df25-40ae-a207-755fafff3117]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637 (non-flash)
Dec 01 19:59:43 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637 (non-flash)
Dec 01 19:59:43 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8eccd526-eb00-4206-ba93-59abc84663dd -p 172.16.0.220:3260 --login {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8eccd526-eb00-4206-ba93-59abc84663dd -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a714d2-5cdb-48bc-a255-f276ca654c26]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8eccd526-eb00-4206-ba93-59abc84663dd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8eccd526-eb00-4206-ba93-59abc84663dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8eccd526-eb00-4206-ba93-59abc84663dd, portal: 172.16.0.220,3260]
Dec 01 19:59:43 user nova-compute[75066]: Login to [iface: default, target: iqn.2010-10.org.openstack:8eccd526-eb00-4206-ba93-59abc84663dd, portal: 172.16.0.220,3260] successful.
Dec 01 19:59:43 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8eccd526-eb00-4206-ba93-59abc84663dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8eccd526-eb00-4206-ba93-59abc84663dd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d1ca9f-fc1a-4367-a03b-e7d0ab5d5688]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6d79bd-9fa0-4892-8af9-38e0bb9968fe]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eccd526-eb00-4206-ba93-59abc84663dd (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637 (non-flash)
Dec 01 19:59:43 user nova-compute[75066]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eccd526-eb00-4206-ba93-59abc84663dd (non-flash)
Dec 01 19:59:43 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637 (non-flash)
Dec 01 19:59:43 user nova-compute[75066]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eccd526-eb00-4206-ba93-59abc84663dd (non-flash)
Dec 01 19:59:43 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8eccd526-eb00-4206-ba93-59abc84663dd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.255s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Connected to 172.16.0.220:3260 {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] HCTL ('34', '-', '-', 0) found on session 60 with lun 0 {{(pid=75066) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75066) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c2e2b0-0377-4283-97d2-c8730340236f]: (4, ('- - 0', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75066) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Dec 01 19:59:43 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8eccd526-eb00-4206-ba93-59abc84663dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'znaBOVWv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75066) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Dec 01 19:59:44 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:59:44 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:59:44 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:59:44 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:59:44 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75066) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 19:59:44 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 19:59:44 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:59:44 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 19:59:44 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Hypervisor/Node resource view: name=user free_ram=8975MB free_disk=24.88528060913086GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75066) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 19:59:44 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:59:44 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:59:44 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance fbfd4364-9b46-4b2b-9f20-e8593c85ead9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:59:44 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 999f9881-40ae-46bf-8d74-00745516af80 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 19:59:44 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 19:59:44 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 19:59:44 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 19:59:44 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '26433366466376433', 'path': '/dev/sdc'} {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 19:59:44 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26433366466376433', 'path': '/dev/sdc'} {{(pid=75066) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Dec 01 19:59:44 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:59:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2104794859',display_name='tempest-TestVolumeBootPattern-server-2104794859',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2104794859',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZcmGQdNdh6+W54hnJSMhAIooZ4bmsPXXZPcCaY7NKHvMIJlYzKiEjMggTY/19P2NraKOnZ+VbgwHFLbwZLt3G3n793gjxICMApkHMa4sEV8tQKTYNdlc+ayjZ4vJIxug==',key_name='tempest-TestVolumeBootPattern-959495540',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ecd2a37ec7e4dbbbe53ed6ba9ff45bb',ramdisk_id='',reservation_id='r-j0zt7b21',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-384255364',owner_user_name='tempest-TestVolumeBootPattern-384255364-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:59:34Z,user_data=None,user_id='e30df6ccb83b4e8daaed0970c4b423d3',uuid=999f9881-40ae-46bf-8d74-00745516af80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "491104c5-2c05-4523-950e-937667f5e91f", "address": "fa:16:3e:a8:15:f8", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491104c5-2c", "ovs_interfaceid": "491104c5-2c05-4523-950e-937667f5e91f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75066) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:572}}
Dec 01 19:59:44 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Converting VIF {"id": "491104c5-2c05-4523-950e-937667f5e91f", "address": "fa:16:3e:a8:15:f8", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491104c5-2c", "ovs_interfaceid": "491104c5-2c05-4523-950e-937667f5e91f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:59:44 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:15:f8,bridge_name='br-int',has_traffic_filtering=True,id=491104c5-2c05-4523-950e-937667f5e91f,network=Network(2a39f486-871f-4115-88cb-176e846fe4f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap491104c5-2c') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:59:44 user nova-compute[75066]: DEBUG nova.objects.instance [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lazy-loading 'pci_devices' on Instance uuid 999f9881-40ae-46bf-8d74-00745516af80 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:59:44 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 19:59:44 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 999f9881-40ae-46bf-8d74-00745516af80] End _get_guest_xml xml=<domain type="kvm">
Dec 01 19:59:44 user nova-compute[75066]:   <uuid>999f9881-40ae-46bf-8d74-00745516af80</uuid>
Dec 01 19:59:44 user nova-compute[75066]:   <name>instance-00000034</name>
Dec 01 19:59:44 user nova-compute[75066]:   <memory>524288</memory>
Dec 01 19:59:44 user nova-compute[75066]:   <vcpu>1</vcpu>
Dec 01 19:59:44 user nova-compute[75066]:   <metadata>
Dec 01 19:59:44 user nova-compute[75066]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Dec 01 19:59:44 user nova-compute[75066]:       <nova:package version="0.0.0"/>
Dec 01 19:59:44 user nova-compute[75066]:       <nova:name>tempest-TestVolumeBootPattern-server-2104794859</nova:name>
Dec 01 19:59:44 user nova-compute[75066]:       <nova:creationTime>2023-12-01 19:59:43</nova:creationTime>
Dec 01 19:59:44 user nova-compute[75066]:       <nova:flavor name="m1.tiny">
Dec 01 19:59:44 user nova-compute[75066]:         <nova:memory>512</nova:memory>
Dec 01 19:59:44 user nova-compute[75066]:         <nova:disk>1</nova:disk>
Dec 01 19:59:44 user nova-compute[75066]:         <nova:swap>0</nova:swap>
Dec 01 19:59:44 user nova-compute[75066]:         <nova:ephemeral>0</nova:ephemeral>
Dec 01 19:59:44 user nova-compute[75066]:         <nova:vcpus>1</nova:vcpus>
Dec 01 19:59:44 user nova-compute[75066]:       </nova:flavor>
Dec 01 19:59:44 user nova-compute[75066]:       <nova:owner>
Dec 01 19:59:44 user nova-compute[75066]:         <nova:user uuid="e30df6ccb83b4e8daaed0970c4b423d3">tempest-TestVolumeBootPattern-384255364-project-member</nova:user>
Dec 01 19:59:44 user nova-compute[75066]:         <nova:project uuid="9ecd2a37ec7e4dbbbe53ed6ba9ff45bb">tempest-TestVolumeBootPattern-384255364</nova:project>
Dec 01 19:59:44 user nova-compute[75066]:       </nova:owner>
Dec 01 19:59:44 user nova-compute[75066]:       <nova:ports>
Dec 01 19:59:44 user nova-compute[75066]:         <nova:port uuid="491104c5-2c05-4523-950e-937667f5e91f">
Dec 01 19:59:44 user nova-compute[75066]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Dec 01 19:59:44 user nova-compute[75066]:         </nova:port>
Dec 01 19:59:44 user nova-compute[75066]:       </nova:ports>
Dec 01 19:59:44 user nova-compute[75066]:     </nova:instance>
Dec 01 19:59:44 user nova-compute[75066]:   </metadata>
Dec 01 19:59:44 user nova-compute[75066]:   <sysinfo type="smbios">
Dec 01 19:59:44 user nova-compute[75066]:     <system>
Dec 01 19:59:44 user nova-compute[75066]:       <entry name="manufacturer">OpenStack Foundation</entry>
Dec 01 19:59:44 user nova-compute[75066]:       <entry name="product">OpenStack Nova</entry>
Dec 01 19:59:44 user nova-compute[75066]:       <entry name="version">0.0.0</entry>
Dec 01 19:59:44 user nova-compute[75066]:       <entry name="serial">999f9881-40ae-46bf-8d74-00745516af80</entry>
Dec 01 19:59:44 user nova-compute[75066]:       <entry name="uuid">999f9881-40ae-46bf-8d74-00745516af80</entry>
Dec 01 19:59:44 user nova-compute[75066]:       <entry name="family">Virtual Machine</entry>
Dec 01 19:59:44 user nova-compute[75066]:     </system>
Dec 01 19:59:44 user nova-compute[75066]:   </sysinfo>
Dec 01 19:59:44 user nova-compute[75066]:   <os>
Dec 01 19:59:44 user nova-compute[75066]:     <type arch="x86_64" machine="pc">hvm</type>
Dec 01 19:59:44 user nova-compute[75066]:     <boot dev="hd"/>
Dec 01 19:59:44 user nova-compute[75066]:     <smbios mode="sysinfo"/>
Dec 01 19:59:44 user nova-compute[75066]:   </os>
Dec 01 19:59:44 user nova-compute[75066]:   <features>
Dec 01 19:59:44 user nova-compute[75066]:     <acpi/>
Dec 01 19:59:44 user nova-compute[75066]:     <apic/>
Dec 01 19:59:44 user nova-compute[75066]:     <vmcoreinfo/>
Dec 01 19:59:44 user nova-compute[75066]:   </features>
Dec 01 19:59:44 user nova-compute[75066]:   <clock offset="utc">
Dec 01 19:59:44 user nova-compute[75066]:     <timer name="pit" tickpolicy="delay"/>
Dec 01 19:59:44 user nova-compute[75066]:     <timer name="rtc" tickpolicy="catchup"/>
Dec 01 19:59:44 user nova-compute[75066]:     <timer name="hpet" present="no"/>
Dec 01 19:59:44 user nova-compute[75066]:   </clock>
Dec 01 19:59:44 user nova-compute[75066]:   <cpu mode="custom" match="exact">
Dec 01 19:59:44 user nova-compute[75066]:     <model>Nehalem</model>
Dec 01 19:59:44 user nova-compute[75066]:     <topology sockets="1" cores="1" threads="1"/>
Dec 01 19:59:44 user nova-compute[75066]:   </cpu>
Dec 01 19:59:44 user nova-compute[75066]:   <devices>
Dec 01 19:59:44 user nova-compute[75066]:     <disk type="block" device="disk">
Dec 01 19:59:44 user nova-compute[75066]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Dec 01 19:59:44 user nova-compute[75066]:       <source dev="/dev/sdc"/>
Dec 01 19:59:44 user nova-compute[75066]:       <target dev="vda" bus="virtio"/>
Dec 01 19:59:44 user nova-compute[75066]:       <serial>8eccd526-eb00-4206-ba93-59abc84663dd</serial>
Dec 01 19:59:44 user nova-compute[75066]:     </disk>
Dec 01 19:59:44 user nova-compute[75066]:     <interface type="ethernet">
Dec 01 19:59:44 user nova-compute[75066]:       <mac address="fa:16:3e:a8:15:f8"/>
Dec 01 19:59:44 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:59:44 user nova-compute[75066]:       <mtu size="1442"/>
Dec 01 19:59:44 user nova-compute[75066]:       <target dev="tap491104c5-2c"/>
Dec 01 19:59:44 user nova-compute[75066]:     </interface>
Dec 01 19:59:44 user nova-compute[75066]:     <serial type="pty">
Dec 01 19:59:44 user nova-compute[75066]:       <log file="/opt/stack/data/nova/instances/999f9881-40ae-46bf-8d74-00745516af80/console.log" append="off"/>
Dec 01 19:59:44 user nova-compute[75066]:     </serial>
Dec 01 19:59:44 user nova-compute[75066]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Dec 01 19:59:44 user nova-compute[75066]:     <video>
Dec 01 19:59:44 user nova-compute[75066]:       <model type="virtio"/>
Dec 01 19:59:44 user nova-compute[75066]:     </video>
Dec 01 19:59:44 user nova-compute[75066]:     <rng model="virtio">
Dec 01 19:59:44 user nova-compute[75066]:       <backend model="random">/dev/urandom</backend>
Dec 01 19:59:44 user nova-compute[75066]:     </rng>
Dec 01 19:59:44 user nova-compute[75066]:     <controller type="usb" index="0" model="none"/>
Dec 01 19:59:44 user nova-compute[75066]:     <memballoon model="virtio">
Dec 01 19:59:44 user nova-compute[75066]:       <stats period="10"/>
Dec 01 19:59:44 user nova-compute[75066]:     </memballoon>
Dec 01 19:59:44 user nova-compute[75066]:   </devices>
Dec 01 19:59:44 user nova-compute[75066]: </domain>
Dec 01 19:59:44 user nova-compute[75066]:  {{(pid=75066) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7564}}
Dec 01 19:59:44 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:59:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2104794859',display_name='tempest-TestVolumeBootPattern-server-2104794859',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2104794859',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZcmGQdNdh6+W54hnJSMhAIooZ4bmsPXXZPcCaY7NKHvMIJlYzKiEjMggTY/19P2NraKOnZ+VbgwHFLbwZLt3G3n793gjxICMApkHMa4sEV8tQKTYNdlc+ayjZ4vJIxug==',key_name='tempest-TestVolumeBootPattern-959495540',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9ecd2a37ec7e4dbbbe53ed6ba9ff45bb',ramdisk_id='',reservation_id='r-j0zt7b21',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-384255364',owner_user_name='tempest-TestVolumeBootPattern-384255364-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-12-01T19:59:34Z,user_data=None,user_id='e30df6ccb83b4e8daaed0970c4b423d3',uuid=999f9881-40ae-46bf-8d74-00745516af80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "491104c5-2c05-4523-950e-937667f5e91f", "address": "fa:16:3e:a8:15:f8", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491104c5-2c", "ovs_interfaceid": "491104c5-2c05-4523-950e-937667f5e91f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) plug /opt/stack/nova/nova/virt/libvirt/vif.py:719}}
Dec 01 19:59:44 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Converting VIF {"id": "491104c5-2c05-4523-950e-937667f5e91f", "address": "fa:16:3e:a8:15:f8", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491104c5-2c", "ovs_interfaceid": "491104c5-2c05-4523-950e-937667f5e91f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 19:59:44 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:15:f8,bridge_name='br-int',has_traffic_filtering=True,id=491104c5-2c05-4523-950e-937667f5e91f,network=Network(2a39f486-871f-4115-88cb-176e846fe4f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap491104c5-2c') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 19:59:44 user nova-compute[75066]: DEBUG os_vif [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:15:f8,bridge_name='br-int',has_traffic_filtering=True,id=491104c5-2c05-4523-950e-937667f5e91f,network=Network(2a39f486-871f-4115-88cb-176e846fe4f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap491104c5-2c') {{(pid=75066) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Dec 01 19:59:44 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:59:44 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:59:44 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Dec 01 19:59:44 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 19:59:44 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:59:44 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3f2b22ca-257e-5955-b31a-628b20092bc1', '_type': 'linux-noop'}}, row=False) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:59:44 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:59:44 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:59:44 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:59:44 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap491104c5-2c, may_exist=True, interface_attrs={}) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:59:44 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap491104c5-2c, col_values=(('qos', UUID('1d1a995e-1af9-45da-a551-45f15785f44d')),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:59:44 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap491104c5-2c, col_values=(('external_ids', {'iface-id': '491104c5-2c05-4523-950e-937667f5e91f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:15:f8', 'vm-uuid': '999f9881-40ae-46bf-8d74-00745516af80'}),), if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 19:59:44 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:59:44 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 19:59:44 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Compute_service record updated for user:user {{(pid=75066) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 19:59:44 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.219s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:59:44 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:59:45 user nova-compute[75066]: INFO os_vif [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:15:f8,bridge_name='br-int',has_traffic_filtering=True,id=491104c5-2c05-4523-950e-937667f5e91f,network=Network(2a39f486-871f-4115-88cb-176e846fe4f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap491104c5-2c')
Dec 01 19:59:45 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] No BDM found with device name vda, not building metadata. {{(pid=75066) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12086}}
Dec 01 19:59:45 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] No VIF found with MAC fa:16:3e:a8:15:f8, not building metadata {{(pid=75066) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12062}}
Dec 01 19:59:46 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:59:46 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:59:46 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:59:46 user nova-compute[75066]: DEBUG nova.compute.manager [req-7376fc5a-60d8-4bbd-96ba-e5366b26ee95 req-eb300201-b404-4798-9eed-90cdfd03cbe1 service nova] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Received event network-vif-plugged-491104c5-2c05-4523-950e-937667f5e91f {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:59:46 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-7376fc5a-60d8-4bbd-96ba-e5366b26ee95 req-eb300201-b404-4798-9eed-90cdfd03cbe1 service nova] Acquiring lock "999f9881-40ae-46bf-8d74-00745516af80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:59:46 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-7376fc5a-60d8-4bbd-96ba-e5366b26ee95 req-eb300201-b404-4798-9eed-90cdfd03cbe1 service nova] Lock "999f9881-40ae-46bf-8d74-00745516af80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:59:46 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-7376fc5a-60d8-4bbd-96ba-e5366b26ee95 req-eb300201-b404-4798-9eed-90cdfd03cbe1 service nova] Lock "999f9881-40ae-46bf-8d74-00745516af80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:59:46 user nova-compute[75066]: DEBUG nova.compute.manager [req-7376fc5a-60d8-4bbd-96ba-e5366b26ee95 req-eb300201-b404-4798-9eed-90cdfd03cbe1 service nova] [instance: 999f9881-40ae-46bf-8d74-00745516af80] No waiting events found dispatching network-vif-plugged-491104c5-2c05-4523-950e-937667f5e91f {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:59:46 user nova-compute[75066]: WARNING nova.compute.manager [req-7376fc5a-60d8-4bbd-96ba-e5366b26ee95 req-eb300201-b404-4798-9eed-90cdfd03cbe1 service nova] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Received unexpected event network-vif-plugged-491104c5-2c05-4523-950e-937667f5e91f for instance with vm_state building and task_state spawning.
Dec 01 19:59:46 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:59:46 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:59:46 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Starting heal instance info cache {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 19:59:47 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Rebuilding the list of instances to heal {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 19:59:47 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Skipping network cache update for instance because it is Building. {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Dec 01 19:59:47 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "refresh_cache-fbfd4364-9b46-4b2b-9f20-e8593c85ead9" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 19:59:47 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquired lock "refresh_cache-fbfd4364-9b46-4b2b-9f20-e8593c85ead9" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 19:59:47 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Forcefully refreshing network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 19:59:47 user nova-compute[75066]: DEBUG nova.objects.instance [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lazy-loading 'info_cache' on Instance uuid fbfd4364-9b46-4b2b-9f20-e8593c85ead9 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 19:59:47 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Updating instance_info_cache with network_info: [{"id": "c013f887-6106-4298-84be-4305658e94a4", "address": "fa:16:3e:b0:b9:57", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc013f887-61", "ovs_interfaceid": "c013f887-6106-4298-84be-4305658e94a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 19:59:47 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Releasing lock "refresh_cache-fbfd4364-9b46-4b2b-9f20-e8593c85ead9" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 19:59:47 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Updated the network info_cache for instance {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 19:59:47 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:59:48 user nova-compute[75066]: DEBUG nova.compute.manager [req-12e4d2ef-9a29-4735-8873-d17e5ce093be req-b71b86b2-78ff-485b-a3b0-4685cead355a service nova] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Received event network-vif-plugged-491104c5-2c05-4523-950e-937667f5e91f {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 19:59:48 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-12e4d2ef-9a29-4735-8873-d17e5ce093be req-b71b86b2-78ff-485b-a3b0-4685cead355a service nova] Acquiring lock "999f9881-40ae-46bf-8d74-00745516af80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 19:59:48 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-12e4d2ef-9a29-4735-8873-d17e5ce093be req-b71b86b2-78ff-485b-a3b0-4685cead355a service nova] Lock "999f9881-40ae-46bf-8d74-00745516af80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 19:59:48 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-12e4d2ef-9a29-4735-8873-d17e5ce093be req-b71b86b2-78ff-485b-a3b0-4685cead355a service nova] Lock "999f9881-40ae-46bf-8d74-00745516af80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:59:48 user nova-compute[75066]: DEBUG nova.compute.manager [req-12e4d2ef-9a29-4735-8873-d17e5ce093be req-b71b86b2-78ff-485b-a3b0-4685cead355a service nova] [instance: 999f9881-40ae-46bf-8d74-00745516af80] No waiting events found dispatching network-vif-plugged-491104c5-2c05-4523-950e-937667f5e91f {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 19:59:48 user nova-compute[75066]: WARNING nova.compute.manager [req-12e4d2ef-9a29-4735-8873-d17e5ce093be req-b71b86b2-78ff-485b-a3b0-4685cead355a service nova] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Received unexpected event network-vif-plugged-491104c5-2c05-4523-950e-937667f5e91f for instance with vm_state building and task_state spawning.
Dec 01 19:59:48 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:59:48 user nova-compute[75066]: DEBUG nova.compute.manager [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Instance event wait completed in 0 seconds for  {{(pid=75066) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Dec 01 19:59:48 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Guest created on hypervisor {{(pid=75066) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4417}}
Dec 01 19:59:48 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Instance spawned successfully.
Dec 01 19:59:48 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:900}}
Dec 01 19:59:48 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Found default for hw_cdrom_bus of ide {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:59:48 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Found default for hw_disk_bus of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:59:48 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Found default for hw_input_bus of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:59:48 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Found default for hw_pointer_model of None {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:59:48 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Found default for hw_video_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:59:48 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Found default for hw_vif_model of virtio {{(pid=75066) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:929}}
Dec 01 19:59:48 user nova-compute[75066]: INFO nova.compute.manager [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Took 5.37 seconds to spawn the instance on the hypervisor.
Dec 01 19:59:48 user nova-compute[75066]: DEBUG nova.compute.manager [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Checking state {{(pid=75066) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Dec 01 19:59:49 user nova-compute[75066]: INFO nova.compute.manager [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Took 15.12 seconds to build instance.
Dec 01 19:59:49 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-6e8484ca-f8ba-4add-8efc-797eff8b1db2 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "999f9881-40ae-46bf-8d74-00745516af80" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.222s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 19:59:49 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:59:51 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:59:53 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:59:54 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 19:59:54 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 19:59:59 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:00:03 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:00:04 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:00:08 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:00:09 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:00:13 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:00:14 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:00:18 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:00:19 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:00:25 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:00:29 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 20:00:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:00:31 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 20:00:31 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75066) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 20:00:35 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:00:35 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 20:00:36 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 20:00:40 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:00:41 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 20:00:44 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 20:00:44 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 20:00:44 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 20:00:44 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 20:00:44 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 20:00:44 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75066) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 20:00:44 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 20:00:44 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 20:00:44 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 20:00:44 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 20:00:44 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Hypervisor/Node resource view: name=user free_ram=8937MB free_disk=24.876007080078125GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75066) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 20:00:44 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 20:00:44 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 20:00:44 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance fbfd4364-9b46-4b2b-9f20-e8593c85ead9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 20:00:44 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance 999f9881-40ae-46bf-8d74-00745516af80 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 20:00:44 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 20:00:44 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 20:00:45 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:00:45 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 20:00:45 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 20:00:45 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Compute_service record updated for user:user {{(pid=75066) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 20:00:45 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.218s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 20:00:49 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 20:00:49 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Starting heal instance info cache {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 20:00:49 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Rebuilding the list of instances to heal {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 20:00:49 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "refresh_cache-fbfd4364-9b46-4b2b-9f20-e8593c85ead9" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 20:00:49 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquired lock "refresh_cache-fbfd4364-9b46-4b2b-9f20-e8593c85ead9" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 20:00:49 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Forcefully refreshing network info cache for instance {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Dec 01 20:00:49 user nova-compute[75066]: DEBUG nova.objects.instance [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lazy-loading 'info_cache' on Instance uuid fbfd4364-9b46-4b2b-9f20-e8593c85ead9 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 20:00:49 user nova-compute[75066]: DEBUG nova.network.neutron [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Updating instance_info_cache with network_info: [{"id": "c013f887-6106-4298-84be-4305658e94a4", "address": "fa:16:3e:b0:b9:57", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc013f887-61", "ovs_interfaceid": "c013f887-6106-4298-84be-4305658e94a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 20:00:49 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Releasing lock "refresh_cache-fbfd4364-9b46-4b2b-9f20-e8593c85ead9" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 20:00:49 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Updated the network info_cache for instance {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Dec 01 20:00:49 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 20:00:50 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:00:55 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:01:00 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:01:05 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:01:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:01:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 20:01:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 20:01:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:01:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75066) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 20:01:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 20:01:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 20:01:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:01:24 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:01:25 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:01:25 user nova-compute[75066]: DEBUG nova.compute.manager [req-8c3c6a56-72f1-4a8d-8dc7-e4aad7c5583c req-b73d89c7-482a-4fd4-a848-1f88a1852dca service nova] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Received event network-changed-491104c5-2c05-4523-950e-937667f5e91f {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 20:01:25 user nova-compute[75066]: DEBUG nova.compute.manager [req-8c3c6a56-72f1-4a8d-8dc7-e4aad7c5583c req-b73d89c7-482a-4fd4-a848-1f88a1852dca service nova] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Refreshing instance network info cache due to event network-changed-491104c5-2c05-4523-950e-937667f5e91f. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 20:01:25 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-8c3c6a56-72f1-4a8d-8dc7-e4aad7c5583c req-b73d89c7-482a-4fd4-a848-1f88a1852dca service nova] Acquiring lock "refresh_cache-999f9881-40ae-46bf-8d74-00745516af80" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 20:01:25 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-8c3c6a56-72f1-4a8d-8dc7-e4aad7c5583c req-b73d89c7-482a-4fd4-a848-1f88a1852dca service nova] Acquired lock "refresh_cache-999f9881-40ae-46bf-8d74-00745516af80" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 20:01:25 user nova-compute[75066]: DEBUG nova.network.neutron [req-8c3c6a56-72f1-4a8d-8dc7-e4aad7c5583c req-b73d89c7-482a-4fd4-a848-1f88a1852dca service nova] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Refreshing network info cache for port 491104c5-2c05-4523-950e-937667f5e91f {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 20:01:25 user nova-compute[75066]: DEBUG nova.network.neutron [req-8c3c6a56-72f1-4a8d-8dc7-e4aad7c5583c req-b73d89c7-482a-4fd4-a848-1f88a1852dca service nova] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Updated VIF entry in instance network info cache for port 491104c5-2c05-4523-950e-937667f5e91f. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 20:01:25 user nova-compute[75066]: DEBUG nova.network.neutron [req-8c3c6a56-72f1-4a8d-8dc7-e4aad7c5583c req-b73d89c7-482a-4fd4-a848-1f88a1852dca service nova] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Updating instance_info_cache with network_info: [{"id": "491104c5-2c05-4523-950e-937667f5e91f", "address": "fa:16:3e:a8:15:f8", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491104c5-2c", "ovs_interfaceid": "491104c5-2c05-4523-950e-937667f5e91f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 20:01:25 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-8c3c6a56-72f1-4a8d-8dc7-e4aad7c5583c req-b73d89c7-482a-4fd4-a848-1f88a1852dca service nova] Releasing lock "refresh_cache-999f9881-40ae-46bf-8d74-00745516af80" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 20:01:26 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-2a091f90-8c20-4cb3-b53a-7e2b4032ef58 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Acquiring lock "999f9881-40ae-46bf-8d74-00745516af80" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 20:01:26 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-2a091f90-8c20-4cb3-b53a-7e2b4032ef58 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "999f9881-40ae-46bf-8d74-00745516af80" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 20:01:26 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-2a091f90-8c20-4cb3-b53a-7e2b4032ef58 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Acquiring lock "999f9881-40ae-46bf-8d74-00745516af80-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 20:01:26 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-2a091f90-8c20-4cb3-b53a-7e2b4032ef58 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "999f9881-40ae-46bf-8d74-00745516af80-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 20:01:26 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-2a091f90-8c20-4cb3-b53a-7e2b4032ef58 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "999f9881-40ae-46bf-8d74-00745516af80-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 20:01:26 user nova-compute[75066]: INFO nova.compute.manager [None req-2a091f90-8c20-4cb3-b53a-7e2b4032ef58 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Terminating instance
Dec 01 20:01:26 user nova-compute[75066]: DEBUG nova.compute.manager [None req-2a091f90-8c20-4cb3-b53a-7e2b4032ef58 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Start destroying the instance on the hypervisor. {{(pid=75066) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 20:01:26 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:01:26 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:01:26 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:01:26 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:01:27 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Instance destroyed successfully.
Dec 01 20:01:27 user nova-compute[75066]: DEBUG nova.objects.instance [None req-2a091f90-8c20-4cb3-b53a-7e2b4032ef58 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lazy-loading 'resources' on Instance uuid 999f9881-40ae-46bf-8d74-00745516af80 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-2a091f90-8c20-4cb3-b53a-7e2b4032ef58 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:59:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2104794859',display_name='tempest-TestVolumeBootPattern-server-2104794859',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2104794859',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZcmGQdNdh6+W54hnJSMhAIooZ4bmsPXXZPcCaY7NKHvMIJlYzKiEjMggTY/19P2NraKOnZ+VbgwHFLbwZLt3G3n793gjxICMApkHMa4sEV8tQKTYNdlc+ayjZ4vJIxug==',key_name='tempest-TestVolumeBootPattern-959495540',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:59:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ecd2a37ec7e4dbbbe53ed6ba9ff45bb',ramdisk_id='',reservation_id='r-j0zt7b21',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-384255364',owner_user_name='tempest-TestVolumeBootPattern-384255364-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:59:49Z,user_data=None,user_id='e30df6ccb83b4e8daaed0970c4b423d3',uuid=999f9881-40ae-46bf-8d74-00745516af80,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "491104c5-2c05-4523-950e-937667f5e91f", "address": "fa:16:3e:a8:15:f8", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491104c5-2c", "ovs_interfaceid": "491104c5-2c05-4523-950e-937667f5e91f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-2a091f90-8c20-4cb3-b53a-7e2b4032ef58 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Converting VIF {"id": "491104c5-2c05-4523-950e-937667f5e91f", "address": "fa:16:3e:a8:15:f8", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491104c5-2c", "ovs_interfaceid": "491104c5-2c05-4523-950e-937667f5e91f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-2a091f90-8c20-4cb3-b53a-7e2b4032ef58 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:15:f8,bridge_name='br-int',has_traffic_filtering=True,id=491104c5-2c05-4523-950e-937667f5e91f,network=Network(2a39f486-871f-4115-88cb-176e846fe4f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap491104c5-2c') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG os_vif [None req-2a091f90-8c20-4cb3-b53a-7e2b4032ef58 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:15:f8,bridge_name='br-int',has_traffic_filtering=True,id=491104c5-2c05-4523-950e-937667f5e91f,network=Network(2a39f486-871f-4115-88cb-176e846fe4f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap491104c5-2c') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap491104c5-2c, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1d1a995e-1af9-45da-a551-45f15785f44d) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 20:01:27 user nova-compute[75066]: INFO os_vif [None req-2a091f90-8c20-4cb3-b53a-7e2b4032ef58 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:15:f8,bridge_name='br-int',has_traffic_filtering=True,id=491104c5-2c05-4523-950e-937667f5e91f,network=Network(2a39f486-871f-4115-88cb-176e846fe4f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap491104c5-2c')
Dec 01 20:01:27 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a091f90-8c20-4cb3-b53a-7e2b4032ef58 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 999f9881-40ae-46bf-8d74-00745516af80] calling os-brick to detach iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a091f90-8c20-4cb3-b53a-7e2b4032ef58 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, {'target_iqn': 'iqn.2010-10.org.openstack:8eccd526-eb00-4206-ba93-59abc84663dd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'znaBOVWv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 20:01:27 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-2a091f90-8c20-4cb3-b53a-7e2b4032ef58 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 20:01:27 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-2a091f90-8c20-4cb3-b53a-7e2b4032ef58 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-2a091f90-8c20-4cb3-b53a-7e2b4032ef58 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a779c4-2115-4b41-bc8c-491ddfb99413]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8eccd526-eb00-4206-ba93-59abc84663dd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a091f90-8c20-4cb3-b53a-7e2b4032ef58 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 20:01:27 user nova-compute[75066]: No targets found.
Dec 01 20:01:27 user nova-compute[75066]: iSNS:
Dec 01 20:01:27 user nova-compute[75066]: No targets found.
Dec 01 20:01:27 user nova-compute[75066]: STATIC:
Dec 01 20:01:27 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:8eccd526-eb00-4206-ba93-59abc84663dd
Dec 01 20:01:27 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 20:01:27 user nova-compute[75066]:                 Iface Name: default
Dec 01 20:01:27 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637
Dec 01 20:01:27 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 20:01:27 user nova-compute[75066]:                 Iface Name: default
Dec 01 20:01:27 user nova-compute[75066]: FIRMWARE:
Dec 01 20:01:27 user nova-compute[75066]: No targets found.
Dec 01 20:01:27 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a091f90-8c20-4cb3-b53a-7e2b4032ef58 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 20:01:27 user nova-compute[75066]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 20:01:27 user nova-compute[75066]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75066) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a091f90-8c20-4cb3-b53a-7e2b4032ef58 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8eccd526-eb00-4206-ba93-59abc84663dd', 0)] {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad6e680-a7de-4455-be7b-4195f8e2beb3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8eccd526-eb00-4206-ba93-59abc84663dd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e603a4-f41c-4c22-88df-089efe484f1a]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eccd526-eb00-4206-ba93-59abc84663dd (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a091f90-8c20-4cb3-b53a-7e2b4032ef58 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637 (non-flash)
Dec 01 20:01:27 user nova-compute[75066]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eccd526-eb00-4206-ba93-59abc84663dd (non-flash)
Dec 01 20:01:27 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a091f90-8c20-4cb3-b53a-7e2b4032ef58 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637 (non-flash)
Dec 01 20:01:27 user nova-compute[75066]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8eccd526-eb00-4206-ba93-59abc84663dd (non-flash)
Dec 01 20:01:27 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a091f90-8c20-4cb3-b53a-7e2b4032ef58 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f9190169240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8eccd526-eb00-4206-ba93-59abc84663dd'): ({'sdc'}, set())}) {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-2a091f90-8c20-4cb3-b53a-7e2b4032ef58 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Removing single pathed devices sdc {{(pid=75066) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f3e78c-5f6d-455c-bbc3-cba019fc0a6a]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[8929782d-caed-4314-9b6f-8b8152389b95]: (4, ('ok\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-2a091f90-8c20-4cb3-b53a-7e2b4032ef58 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Flushing IO for device /dev/sdc {{(pid=75066) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c590a02-1f4d-4f87-9596-067bedd9f7df]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-2a091f90-8c20-4cb3-b53a-7e2b4032ef58 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75066) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.088s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4935a7-fad8-4898-b287-56972197653e]: (4, ('1', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-2a091f90-8c20-4cb3-b53a-7e2b4032ef58 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-2a091f90-8c20-4cb3-b53a-7e2b4032ef58 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] SCSI volumes sdc have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a091f90-8c20-4cb3-b53a-7e2b4032ef58 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8eccd526-eb00-4206-ba93-59abc84663dd')] {{(pid=75066) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8eccd526-eb00-4206-ba93-59abc84663dd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8eccd526-eb00-4206-ba93-59abc84663dd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[601ff3fe-227b-446b-a5f7-403c178dfad3]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a091f90-8c20-4cb3-b53a-7e2b4032ef58 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8eccd526-eb00-4206-ba93-59abc84663dd -p 172.16.0.220:3260 --logout {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG nova.compute.manager [req-742c5b90-9a6f-4327-859a-cd0538812717 req-1b88a304-7519-4870-860b-49a69e28bfab service nova] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Received event network-changed-491104c5-2c05-4523-950e-937667f5e91f {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG nova.compute.manager [req-742c5b90-9a6f-4327-859a-cd0538812717 req-1b88a304-7519-4870-860b-49a69e28bfab service nova] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Refreshing instance network info cache due to event network-changed-491104c5-2c05-4523-950e-937667f5e91f. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-742c5b90-9a6f-4327-859a-cd0538812717 req-1b88a304-7519-4870-860b-49a69e28bfab service nova] Acquiring lock "refresh_cache-999f9881-40ae-46bf-8d74-00745516af80" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-742c5b90-9a6f-4327-859a-cd0538812717 req-1b88a304-7519-4870-860b-49a69e28bfab service nova] Acquired lock "refresh_cache-999f9881-40ae-46bf-8d74-00745516af80" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG nova.network.neutron [req-742c5b90-9a6f-4327-859a-cd0538812717 req-1b88a304-7519-4870-860b-49a69e28bfab service nova] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Refreshing network info cache for port 491104c5-2c05-4523-950e-937667f5e91f {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8eccd526-eb00-4206-ba93-59abc84663dd -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[7207ddf3-21b1-4577-90db-65991311901c]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:8eccd526-eb00-4206-ba93-59abc84663dd, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:8eccd526-eb00-4206-ba93-59abc84663dd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a091f90-8c20-4cb3-b53a-7e2b4032ef58 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:8eccd526-eb00-4206-ba93-59abc84663dd, portal: 172.16.0.220,3260]
Dec 01 20:01:27 user nova-compute[75066]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:8eccd526-eb00-4206-ba93-59abc84663dd, portal: 172.16.0.220,3260] successful.
Dec 01 20:01:27 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8eccd526-eb00-4206-ba93-59abc84663dd -p 172.16.0.220:3260 --op delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8eccd526-eb00-4206-ba93-59abc84663dd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e278db-3534-4192-95c1-b7758ce71ec8]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a091f90-8c20-4cb3-b53a-7e2b4032ef58 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-2a091f90-8c20-4cb3-b53a-7e2b4032ef58 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a091f90-8c20-4cb3-b53a-7e2b4032ef58 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] <== disconnect_volume: return (357ms) None {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a091f90-8c20-4cb3-b53a-7e2b4032ef58 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Disconnected iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 20:01:27 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-2a091f90-8c20-4cb3-b53a-7e2b4032ef58 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Deleting instance files /opt/stack/data/nova/instances/999f9881-40ae-46bf-8d74-00745516af80_del
Dec 01 20:01:27 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-2a091f90-8c20-4cb3-b53a-7e2b4032ef58 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Deletion of /opt/stack/data/nova/instances/999f9881-40ae-46bf-8d74-00745516af80_del complete
Dec 01 20:01:27 user nova-compute[75066]: INFO nova.compute.manager [None req-2a091f90-8c20-4cb3-b53a-7e2b4032ef58 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Took 1.19 seconds to destroy the instance on the hypervisor.
Dec 01 20:01:27 user nova-compute[75066]: DEBUG oslo.service.loopingcall [None req-2a091f90-8c20-4cb3-b53a-7e2b4032ef58 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75066) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG nova.compute.manager [-] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Deallocating network for instance {{(pid=75066) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: 999f9881-40ae-46bf-8d74-00745516af80] deallocate_for_instance() {{(pid=75066) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG nova.network.neutron [req-742c5b90-9a6f-4327-859a-cd0538812717 req-1b88a304-7519-4870-860b-49a69e28bfab service nova] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Updated VIF entry in instance network info cache for port 491104c5-2c05-4523-950e-937667f5e91f. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG nova.network.neutron [req-742c5b90-9a6f-4327-859a-cd0538812717 req-1b88a304-7519-4870-860b-49a69e28bfab service nova] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Updating instance_info_cache with network_info: [{"id": "491104c5-2c05-4523-950e-937667f5e91f", "address": "fa:16:3e:a8:15:f8", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap491104c5-2c", "ovs_interfaceid": "491104c5-2c05-4523-950e-937667f5e91f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-742c5b90-9a6f-4327-859a-cd0538812717 req-1b88a304-7519-4870-860b-49a69e28bfab service nova] Releasing lock "refresh_cache-999f9881-40ae-46bf-8d74-00745516af80" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG nova.compute.manager [req-742c5b90-9a6f-4327-859a-cd0538812717 req-1b88a304-7519-4870-860b-49a69e28bfab service nova] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Received event network-vif-unplugged-491104c5-2c05-4523-950e-937667f5e91f {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-742c5b90-9a6f-4327-859a-cd0538812717 req-1b88a304-7519-4870-860b-49a69e28bfab service nova] Acquiring lock "999f9881-40ae-46bf-8d74-00745516af80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-742c5b90-9a6f-4327-859a-cd0538812717 req-1b88a304-7519-4870-860b-49a69e28bfab service nova] Lock "999f9881-40ae-46bf-8d74-00745516af80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-742c5b90-9a6f-4327-859a-cd0538812717 req-1b88a304-7519-4870-860b-49a69e28bfab service nova] Lock "999f9881-40ae-46bf-8d74-00745516af80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG nova.compute.manager [req-742c5b90-9a6f-4327-859a-cd0538812717 req-1b88a304-7519-4870-860b-49a69e28bfab service nova] [instance: 999f9881-40ae-46bf-8d74-00745516af80] No waiting events found dispatching network-vif-unplugged-491104c5-2c05-4523-950e-937667f5e91f {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG nova.compute.manager [req-742c5b90-9a6f-4327-859a-cd0538812717 req-1b88a304-7519-4870-860b-49a69e28bfab service nova] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Received event network-vif-unplugged-491104c5-2c05-4523-950e-937667f5e91f for instance with task_state deleting. {{(pid=75066) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG nova.compute.manager [req-742c5b90-9a6f-4327-859a-cd0538812717 req-1b88a304-7519-4870-860b-49a69e28bfab service nova] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Received event network-vif-plugged-491104c5-2c05-4523-950e-937667f5e91f {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-742c5b90-9a6f-4327-859a-cd0538812717 req-1b88a304-7519-4870-860b-49a69e28bfab service nova] Acquiring lock "999f9881-40ae-46bf-8d74-00745516af80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-742c5b90-9a6f-4327-859a-cd0538812717 req-1b88a304-7519-4870-860b-49a69e28bfab service nova] Lock "999f9881-40ae-46bf-8d74-00745516af80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-742c5b90-9a6f-4327-859a-cd0538812717 req-1b88a304-7519-4870-860b-49a69e28bfab service nova] Lock "999f9881-40ae-46bf-8d74-00745516af80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 20:01:27 user nova-compute[75066]: DEBUG nova.compute.manager [req-742c5b90-9a6f-4327-859a-cd0538812717 req-1b88a304-7519-4870-860b-49a69e28bfab service nova] [instance: 999f9881-40ae-46bf-8d74-00745516af80] No waiting events found dispatching network-vif-plugged-491104c5-2c05-4523-950e-937667f5e91f {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 20:01:27 user nova-compute[75066]: WARNING nova.compute.manager [req-742c5b90-9a6f-4327-859a-cd0538812717 req-1b88a304-7519-4870-860b-49a69e28bfab service nova] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Received unexpected event network-vif-plugged-491104c5-2c05-4523-950e-937667f5e91f for instance with vm_state active and task_state deleting.
Dec 01 20:01:28 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 20:01:28 user nova-compute[75066]: INFO nova.compute.manager [-] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Took 0.59 seconds to deallocate network for instance.
Dec 01 20:01:28 user nova-compute[75066]: DEBUG nova.compute.manager [req-30cdf470-1445-451b-8ead-641ea3a9a706 req-816a9b0a-8c2e-423f-9eab-f707529a2518 service nova] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Received event network-vif-deleted-491104c5-2c05-4523-950e-937667f5e91f {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 20:01:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:01:29 user nova-compute[75066]: INFO nova.compute.manager [None req-2a091f90-8c20-4cb3-b53a-7e2b4032ef58 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: 999f9881-40ae-46bf-8d74-00745516af80] Took 0.81 seconds to detach 1 volumes for instance.
Dec 01 20:01:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-2a091f90-8c20-4cb3-b53a-7e2b4032ef58 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 20:01:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-2a091f90-8c20-4cb3-b53a-7e2b4032ef58 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 20:01:29 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-2a091f90-8c20-4cb3-b53a-7e2b4032ef58 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 20:01:29 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-2a091f90-8c20-4cb3-b53a-7e2b4032ef58 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 20:01:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-2a091f90-8c20-4cb3-b53a-7e2b4032ef58 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.126s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 20:01:29 user nova-compute[75066]: INFO nova.scheduler.client.report [None req-2a091f90-8c20-4cb3-b53a-7e2b4032ef58 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Deleted allocations for instance 999f9881-40ae-46bf-8d74-00745516af80
Dec 01 20:01:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-2a091f90-8c20-4cb3-b53a-7e2b4032ef58 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "999f9881-40ae-46bf-8d74-00745516af80" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.886s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 20:01:30 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 20:01:31 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 20:01:31 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75066) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 20:01:31 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 20:01:31 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75066) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Dec 01 20:01:32 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:01:37 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 20:01:37 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 20:01:37 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 20:01:41 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 20:01:42 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:01:46 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 20:01:46 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 20:01:46 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 20:01:46 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 20:01:46 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 20:01:46 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75066) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 20:01:46 user nova-compute[75066]: DEBUG nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75066) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11210}}
Dec 01 20:01:46 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 20:01:46 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 20:01:46 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Hypervisor/Node resource view: name=user free_ram=9026MB free_disk=24.87512969970703GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75066) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 20:01:46 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 20:01:46 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 20:01:47 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Instance fbfd4364-9b46-4b2b-9f20-e8593c85ead9 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75066) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Dec 01 20:01:47 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 20:01:47 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 20:01:47 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Refreshing inventories for resource provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Dec 01 20:01:47 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Updating ProviderTree inventory for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Dec 01 20:01:47 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Updating inventory in ProviderTree for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Dec 01 20:01:47 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Refreshing aggregate associations for resource provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62, aggregates: None {{(pid=75066) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Dec 01 20:01:47 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Refreshing trait associations for resource provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62, traits: COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_IDE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_STORAGE_BUS_FDC,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_IMAGE_TYPE_QCOW2,HW_CPU_X86_SSSE3,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSE42,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_DEVICE_TAGGING,COMPUTE_VOLUME_ATTACH_WITH_TAG,HW_CPU_X86_SSE41,COMPUTE_RESCUE_BFV,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SECURITY_UEFI_SECURE_BOOT {{(pid=75066) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Dec 01 20:01:47 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:01:47 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 20:01:47 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 20:01:47 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Compute_service record updated for user:user {{(pid=75066) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 20:01:47 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.450s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 20:01:50 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 20:01:50 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 20:01:50 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Starting heal instance info cache {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 20:01:50 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Didn't find any instances for network info cache update. {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 01 20:01:50 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 20:01:52 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 20:01:57 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:01:58 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 20:02:02 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 20:02:07 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:02:12 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:02:17 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:02:18 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 20:02:18 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Cleaning up deleted instances {{(pid=75066) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Dec 01 20:02:18 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] There are 0 instances to clean {{(pid=75066) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Dec 01 20:02:22 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 20:02:27 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:02:29 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:02:29 user nova-compute[75066]: DEBUG nova.compute.manager [req-033886dd-2c80-466e-a707-e25d6b4d522d req-93ef0301-de63-4e3d-87fb-1d5562978a02 service nova] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Received event network-changed-c013f887-6106-4298-84be-4305658e94a4 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 20:02:29 user nova-compute[75066]: DEBUG nova.compute.manager [req-033886dd-2c80-466e-a707-e25d6b4d522d req-93ef0301-de63-4e3d-87fb-1d5562978a02 service nova] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Refreshing instance network info cache due to event network-changed-c013f887-6106-4298-84be-4305658e94a4. {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Dec 01 20:02:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-033886dd-2c80-466e-a707-e25d6b4d522d req-93ef0301-de63-4e3d-87fb-1d5562978a02 service nova] Acquiring lock "refresh_cache-fbfd4364-9b46-4b2b-9f20-e8593c85ead9" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Dec 01 20:02:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-033886dd-2c80-466e-a707-e25d6b4d522d req-93ef0301-de63-4e3d-87fb-1d5562978a02 service nova] Acquired lock "refresh_cache-fbfd4364-9b46-4b2b-9f20-e8593c85ead9" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Dec 01 20:02:29 user nova-compute[75066]: DEBUG nova.network.neutron [req-033886dd-2c80-466e-a707-e25d6b4d522d req-93ef0301-de63-4e3d-87fb-1d5562978a02 service nova] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Refreshing network info cache for port c013f887-6106-4298-84be-4305658e94a4 {{(pid=75066) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Dec 01 20:02:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dca9a91f-e903-4919-b299-4d7b35841928 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Acquiring lock "fbfd4364-9b46-4b2b-9f20-e8593c85ead9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 20:02:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dca9a91f-e903-4919-b299-4d7b35841928 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "fbfd4364-9b46-4b2b-9f20-e8593c85ead9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 20:02:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dca9a91f-e903-4919-b299-4d7b35841928 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Acquiring lock "fbfd4364-9b46-4b2b-9f20-e8593c85ead9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 20:02:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dca9a91f-e903-4919-b299-4d7b35841928 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "fbfd4364-9b46-4b2b-9f20-e8593c85ead9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 20:02:29 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dca9a91f-e903-4919-b299-4d7b35841928 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "fbfd4364-9b46-4b2b-9f20-e8593c85ead9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 20:02:29 user nova-compute[75066]: INFO nova.compute.manager [None req-dca9a91f-e903-4919-b299-4d7b35841928 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Terminating instance
Dec 01 20:02:29 user nova-compute[75066]: DEBUG nova.compute.manager [None req-dca9a91f-e903-4919-b299-4d7b35841928 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Start destroying the instance on the hypervisor. {{(pid=75066) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Dec 01 20:02:29 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:02:29 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:02:29 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:02:29 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:02:29 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG nova.network.neutron [req-033886dd-2c80-466e-a707-e25d6b4d522d req-93ef0301-de63-4e3d-87fb-1d5562978a02 service nova] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Updated VIF entry in instance network info cache for port c013f887-6106-4298-84be-4305658e94a4. {{(pid=75066) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG nova.network.neutron [req-033886dd-2c80-466e-a707-e25d6b4d522d req-93ef0301-de63-4e3d-87fb-1d5562978a02 service nova] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Updating instance_info_cache with network_info: [{"id": "c013f887-6106-4298-84be-4305658e94a4", "address": "fa:16:3e:b0:b9:57", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc013f887-61", "ovs_interfaceid": "c013f887-6106-4298-84be-4305658e94a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-033886dd-2c80-466e-a707-e25d6b4d522d req-93ef0301-de63-4e3d-87fb-1d5562978a02 service nova] Releasing lock "refresh_cache-fbfd4364-9b46-4b2b-9f20-e8593c85ead9" {{(pid=75066) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:02:30 user nova-compute[75066]: INFO nova.virt.libvirt.driver [-] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Instance destroyed successfully.
Dec 01 20:02:30 user nova-compute[75066]: DEBUG nova.objects.instance [None req-dca9a91f-e903-4919-b299-4d7b35841928 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lazy-loading 'resources' on Instance uuid fbfd4364-9b46-4b2b-9f20-e8593c85ead9 {{(pid=75066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG nova.virt.libvirt.vif [None req-dca9a91f-e903-4919-b299-4d7b35841928 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-12-01T19:57:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-686358611',display_name='tempest-TestVolumeBootPattern-server-686358611',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-686358611',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHZcmGQdNdh6+W54hnJSMhAIooZ4bmsPXXZPcCaY7NKHvMIJlYzKiEjMggTY/19P2NraKOnZ+VbgwHFLbwZLt3G3n793gjxICMApkHMa4sEV8tQKTYNdlc+ayjZ4vJIxug==',key_name='tempest-TestVolumeBootPattern-959495540',keypairs=<?>,launch_index=0,launched_at=2023-12-01T19:57:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9ecd2a37ec7e4dbbbe53ed6ba9ff45bb',ramdisk_id='',reservation_id='r-vln4zy9d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-384255364',owner_user_name='tempest-TestVolumeBootPattern-384255364-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-12-01T19:57:44Z,user_data=None,user_id='e30df6ccb83b4e8daaed0970c4b423d3',uuid=fbfd4364-9b46-4b2b-9f20-e8593c85ead9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c013f887-6106-4298-84be-4305658e94a4", "address": "fa:16:3e:b0:b9:57", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc013f887-61", "ovs_interfaceid": "c013f887-6106-4298-84be-4305658e94a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:837}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-dca9a91f-e903-4919-b299-4d7b35841928 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Converting VIF {"id": "c013f887-6106-4298-84be-4305658e94a4", "address": "fa:16:3e:b0:b9:57", "network": {"id": "2a39f486-871f-4115-88cb-176e846fe4f3", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-595904639-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.126", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9ecd2a37ec7e4dbbbe53ed6ba9ff45bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc013f887-61", "ovs_interfaceid": "c013f887-6106-4298-84be-4305658e94a4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG nova.network.os_vif_util [None req-dca9a91f-e903-4919-b299-4d7b35841928 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b0:b9:57,bridge_name='br-int',has_traffic_filtering=True,id=c013f887-6106-4298-84be-4305658e94a4,network=Network(2a39f486-871f-4115-88cb-176e846fe4f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc013f887-61') {{(pid=75066) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG os_vif [None req-dca9a91f-e903-4919-b299-4d7b35841928 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:b9:57,bridge_name='br-int',has_traffic_filtering=True,id=c013f887-6106-4298-84be-4305658e94a4,network=Network(2a39f486-871f-4115-88cb-176e846fe4f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc013f887-61') {{(pid=75066) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc013f887-61, bridge=br-int, if_exists=True) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=21d29ada-ec1e-41d2-9ad5-c71a0b3057d0) {{(pid=75066) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 20:02:30 user nova-compute[75066]: INFO os_vif [None req-dca9a91f-e903-4919-b299-4d7b35841928 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b0:b9:57,bridge_name='br-int',has_traffic_filtering=True,id=c013f887-6106-4298-84be-4305658e94a4,network=Network(2a39f486-871f-4115-88cb-176e846fe4f3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc013f887-61')
Dec 01 20:02:30 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dca9a91f-e903-4919-b299-4d7b35841928 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] calling os-brick to detach iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca9a91f-e903-4919-b299-4d7b35841928 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f9190625c90>, {'target_iqn': 'iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jRnTPfIF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Dec 01 20:02:30 user nova-compute[75066]: WARNING os_brick.initiator.connectors.base [None req-dca9a91f-e903-4919-b299-4d7b35841928 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Dec 01 20:02:30 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-dca9a91f-e903-4919-b299-4d7b35841928 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-dca9a91f-e903-4919-b299-4d7b35841928 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[1165cd94-5059-445c-a091-faee9801ffcb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca9a91f-e903-4919-b299-4d7b35841928 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Dec 01 20:02:30 user nova-compute[75066]: No targets found.
Dec 01 20:02:30 user nova-compute[75066]: iSNS:
Dec 01 20:02:30 user nova-compute[75066]: No targets found.
Dec 01 20:02:30 user nova-compute[75066]: STATIC:
Dec 01 20:02:30 user nova-compute[75066]: Target: iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637
Dec 01 20:02:30 user nova-compute[75066]:         Portal: 172.16.0.220:3260,-1
Dec 01 20:02:30 user nova-compute[75066]:                 Iface Name: default
Dec 01 20:02:30 user nova-compute[75066]: FIRMWARE:
Dec 01 20:02:30 user nova-compute[75066]: No targets found.
Dec 01 20:02:30 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca9a91f-e903-4919-b299-4d7b35841928 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Dec 01 20:02:30 user nova-compute[75066]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Dec 01 20:02:30 user nova-compute[75066]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75066) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca9a91f-e903-4919-b299-4d7b35841928 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637', 0)] {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[988289aa-2a48-4531-b20e-03e9d12da6ca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa59678b-7c03-4f8d-92ae-b540f68f89c4]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637 (non-flash)\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca9a91f-e903-4919-b299-4d7b35841928 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637 (non-flash)
Dec 01 20:02:30 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca9a91f-e903-4919-b299-4d7b35841928 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637 (non-flash)
Dec 01 20:02:30 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca9a91f-e903-4919-b299-4d7b35841928 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f91707f12d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637'): ({'sdb'}, set())}) {{(pid=75066) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-dca9a91f-e903-4919-b299-4d7b35841928 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Removing single pathed devices sdb {{(pid=75066) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5f6697-4297-4a74-a80c-07b8d741f831]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7e3c70-208b-4c54-8753-43f6505e465c]: (4, ('ok\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-dca9a91f-e903-4919-b299-4d7b35841928 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Flushing IO for device /dev/sdb {{(pid=75066) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e76972-ce42-4534-a2bc-8a8bee825af0]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-dca9a91f-e903-4919-b299-4d7b35841928 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75066) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8dd603a-d1c5-4a1b-a397-a955048be272]: (4, ('1', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-dca9a91f-e903-4919-b299-4d7b35841928 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG os_brick.initiator.linuxscsi [None req-dca9a91f-e903-4919-b299-4d7b35841928 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] SCSI volumes sdb have been removed. {{(pid=75066) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca9a91f-e903-4919-b299-4d7b35841928 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637')] {{(pid=75066) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[eccb5672-3a9c-44f5-b871-8d9343d58e1c]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca9a91f-e903-4919-b299-4d7b35841928 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637 -p 172.16.0.220:3260 --logout {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[37382de5-36db-460e-9d35-4647bda9e994]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca9a91f-e903-4919-b299-4d7b35841928 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637, portal: 172.16.0.220,3260]
Dec 01 20:02:30 user nova-compute[75066]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637, portal: 172.16.0.220,3260] successful.
Dec 01 20:02:30 user nova-compute[75066]:  stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637 -p 172.16.0.220:3260 --op delete {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c4546286-72f1-4c81-ab90-f4ac1b75d637 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86136) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d4fe14-08d9-4dc6-920c-16fce74f42fc]: (4, ('', '')) {{(pid=86136) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca9a91f-e903-4919-b299-4d7b35841928 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75066) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.base [None req-dca9a91f-e903-4919-b299-4d7b35841928 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.293s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG os_brick.initiator.connectors.iscsi [None req-dca9a91f-e903-4919-b299-4d7b35841928 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] <== disconnect_volume: return (295ms) None {{(pid=75066) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dca9a91f-e903-4919-b299-4d7b35841928 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Disconnected iSCSI Volume {{(pid=75066) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Dec 01 20:02:30 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-dca9a91f-e903-4919-b299-4d7b35841928 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Deleting instance files /opt/stack/data/nova/instances/fbfd4364-9b46-4b2b-9f20-e8593c85ead9_del
Dec 01 20:02:30 user nova-compute[75066]: INFO nova.virt.libvirt.driver [None req-dca9a91f-e903-4919-b299-4d7b35841928 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Deletion of /opt/stack/data/nova/instances/fbfd4364-9b46-4b2b-9f20-e8593c85ead9_del complete
Dec 01 20:02:30 user nova-compute[75066]: INFO nova.compute.manager [None req-dca9a91f-e903-4919-b299-4d7b35841928 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Took 1.19 seconds to destroy the instance on the hypervisor.
Dec 01 20:02:30 user nova-compute[75066]: DEBUG oslo.service.loopingcall [None req-dca9a91f-e903-4919-b299-4d7b35841928 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75066) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG nova.compute.manager [-] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Deallocating network for instance {{(pid=75066) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Dec 01 20:02:30 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] deallocate_for_instance() {{(pid=75066) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Dec 01 20:02:31 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 20:02:31 user nova-compute[75066]: DEBUG nova.network.neutron [-] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Updating instance_info_cache with network_info: [] {{(pid=75066) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Dec 01 20:02:31 user nova-compute[75066]: INFO nova.compute.manager [-] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Took 0.44 seconds to deallocate network for instance.
Dec 01 20:02:31 user nova-compute[75066]: DEBUG nova.compute.manager [req-612dc5c6-0cee-4135-9689-23b162f52ba6 req-1e3eb7c6-67ff-412f-b1cc-eaab5e5a2a56 service nova] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Received event network-vif-unplugged-c013f887-6106-4298-84be-4305658e94a4 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 20:02:31 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-612dc5c6-0cee-4135-9689-23b162f52ba6 req-1e3eb7c6-67ff-412f-b1cc-eaab5e5a2a56 service nova] Acquiring lock "fbfd4364-9b46-4b2b-9f20-e8593c85ead9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 20:02:31 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-612dc5c6-0cee-4135-9689-23b162f52ba6 req-1e3eb7c6-67ff-412f-b1cc-eaab5e5a2a56 service nova] Lock "fbfd4364-9b46-4b2b-9f20-e8593c85ead9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 20:02:31 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-612dc5c6-0cee-4135-9689-23b162f52ba6 req-1e3eb7c6-67ff-412f-b1cc-eaab5e5a2a56 service nova] Lock "fbfd4364-9b46-4b2b-9f20-e8593c85ead9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 20:02:31 user nova-compute[75066]: DEBUG nova.compute.manager [req-612dc5c6-0cee-4135-9689-23b162f52ba6 req-1e3eb7c6-67ff-412f-b1cc-eaab5e5a2a56 service nova] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] No waiting events found dispatching network-vif-unplugged-c013f887-6106-4298-84be-4305658e94a4 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 20:02:31 user nova-compute[75066]: DEBUG nova.compute.manager [req-612dc5c6-0cee-4135-9689-23b162f52ba6 req-1e3eb7c6-67ff-412f-b1cc-eaab5e5a2a56 service nova] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Received event network-vif-unplugged-c013f887-6106-4298-84be-4305658e94a4 for instance with task_state deleting. {{(pid=75066) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Dec 01 20:02:31 user nova-compute[75066]: DEBUG nova.compute.manager [req-612dc5c6-0cee-4135-9689-23b162f52ba6 req-1e3eb7c6-67ff-412f-b1cc-eaab5e5a2a56 service nova] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Received event network-vif-plugged-c013f887-6106-4298-84be-4305658e94a4 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 20:02:31 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-612dc5c6-0cee-4135-9689-23b162f52ba6 req-1e3eb7c6-67ff-412f-b1cc-eaab5e5a2a56 service nova] Acquiring lock "fbfd4364-9b46-4b2b-9f20-e8593c85ead9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 20:02:31 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-612dc5c6-0cee-4135-9689-23b162f52ba6 req-1e3eb7c6-67ff-412f-b1cc-eaab5e5a2a56 service nova] Lock "fbfd4364-9b46-4b2b-9f20-e8593c85ead9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 20:02:31 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [req-612dc5c6-0cee-4135-9689-23b162f52ba6 req-1e3eb7c6-67ff-412f-b1cc-eaab5e5a2a56 service nova] Lock "fbfd4364-9b46-4b2b-9f20-e8593c85ead9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 20:02:31 user nova-compute[75066]: DEBUG nova.compute.manager [req-612dc5c6-0cee-4135-9689-23b162f52ba6 req-1e3eb7c6-67ff-412f-b1cc-eaab5e5a2a56 service nova] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] No waiting events found dispatching network-vif-plugged-c013f887-6106-4298-84be-4305658e94a4 {{(pid=75066) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Dec 01 20:02:31 user nova-compute[75066]: WARNING nova.compute.manager [req-612dc5c6-0cee-4135-9689-23b162f52ba6 req-1e3eb7c6-67ff-412f-b1cc-eaab5e5a2a56 service nova] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Received unexpected event network-vif-plugged-c013f887-6106-4298-84be-4305658e94a4 for instance with vm_state active and task_state deleting.
Dec 01 20:02:31 user nova-compute[75066]: DEBUG nova.compute.manager [req-612dc5c6-0cee-4135-9689-23b162f52ba6 req-1e3eb7c6-67ff-412f-b1cc-eaab5e5a2a56 service nova] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Received event network-vif-deleted-c013f887-6106-4298-84be-4305658e94a4 {{(pid=75066) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Dec 01 20:02:32 user nova-compute[75066]: INFO nova.compute.manager [None req-dca9a91f-e903-4919-b299-4d7b35841928 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] [instance: fbfd4364-9b46-4b2b-9f20-e8593c85ead9] Took 0.77 seconds to detach 1 volumes for instance.
Dec 01 20:02:32 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dca9a91f-e903-4919-b299-4d7b35841928 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 20:02:32 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dca9a91f-e903-4919-b299-4d7b35841928 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 20:02:32 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-dca9a91f-e903-4919-b299-4d7b35841928 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 20:02:32 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-dca9a91f-e903-4919-b299-4d7b35841928 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 20:02:32 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 20:02:32 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75066) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 20:02:32 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dca9a91f-e903-4919-b299-4d7b35841928 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.121s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 20:02:32 user nova-compute[75066]: INFO nova.scheduler.client.report [None req-dca9a91f-e903-4919-b299-4d7b35841928 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Deleted allocations for instance fbfd4364-9b46-4b2b-9f20-e8593c85ead9
Dec 01 20:02:32 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-dca9a91f-e903-4919-b299-4d7b35841928 tempest-TestVolumeBootPattern-384255364 tempest-TestVolumeBootPattern-384255364-project-member] Lock "fbfd4364-9b46-4b2b-9f20-e8593c85ead9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.703s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 20:02:35 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:02:37 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 20:02:38 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 20:02:40 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:02:40 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 20:02:43 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 20:02:45 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:02:47 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 20:02:47 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 20:02:47 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 20:02:47 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 20:02:47 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 20:02:47 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75066) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 20:02:47 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 20:02:47 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 20:02:47 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Hypervisor/Node resource view: name=user free_ram=9165MB free_disk=24.874244689941406GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75066) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 20:02:47 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 20:02:47 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 20:02:47 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 20:02:47 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 20:02:47 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 20:02:47 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 20:02:47 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Compute_service record updated for user:user {{(pid=75066) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 20:02:47 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.151s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 20:02:49 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 20:02:50 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:02:52 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 20:02:52 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Starting heal instance info cache {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 20:02:52 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Rebuilding the list of instances to heal {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 20:02:52 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Didn't find any instances for network info cache update. {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 01 20:02:55 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:03:00 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 20:03:05 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 20:03:05 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:03:05 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75066) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 20:03:05 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 20:03:05 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 20:03:05 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 20:03:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 20:03:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 20:03:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 20:03:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:03:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75066) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 20:03:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 20:03:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 20:03:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:03:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:03:25 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:03:28 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:03:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:03:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:03:32 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 20:03:34 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 20:03:34 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75066) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 20:03:35 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:03:38 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 20:03:39 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 20:03:40 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 20:03:43 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 20:03:45 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:03:47 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 20:03:49 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 20:03:49 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 20:03:49 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 20:03:49 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 20:03:49 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75066) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 20:03:49 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 20:03:49 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 20:03:49 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Hypervisor/Node resource view: name=user free_ram=9160MB free_disk=24.872425079345703GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75066) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 20:03:49 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 20:03:49 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 20:03:49 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 20:03:49 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 20:03:49 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 20:03:49 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 20:03:49 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Compute_service record updated for user:user {{(pid=75066) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 20:03:49 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.113s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 20:03:50 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:03:50 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 20:03:52 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 20:03:52 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Starting heal instance info cache {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 20:03:52 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Rebuilding the list of instances to heal {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 20:03:52 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Didn't find any instances for network info cache update. {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 01 20:03:55 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:03:59 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 20:04:00 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 20:04:00 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:04:00 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75066) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 20:04:00 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 20:04:00 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 20:04:00 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:04:05 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:04:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 20:04:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 20:04:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:04:25 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 20:04:25 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:04:25 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75066) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 20:04:25 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 20:04:25 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 20:04:25 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:04:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 20:04:33 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 20:04:35 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:04:36 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 20:04:36 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75066) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 20:04:39 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 20:04:39 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 20:04:40 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:04:45 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 20:04:45 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 20:04:49 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 20:04:49 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 20:04:49 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 20:04:49 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 20:04:49 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 20:04:49 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75066) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 20:04:49 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 20:04:49 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 20:04:49 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Hypervisor/Node resource view: name=user free_ram=9292MB free_disk=24.864776611328125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75066) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 20:04:49 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 20:04:49 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 20:04:49 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 20:04:49 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 20:04:49 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 20:04:49 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 20:04:49 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Compute_service record updated for user:user {{(pid=75066) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 20:04:49 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.106s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 20:04:50 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 20:04:50 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:04:50 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75066) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 20:04:50 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 20:04:50 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 20:04:50 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 20:04:50 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 20:04:52 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 20:04:52 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Starting heal instance info cache {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 20:04:52 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Rebuilding the list of instances to heal {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 20:04:52 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Didn't find any instances for network info cache update. {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Dec 01 20:04:55 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:05:00 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 20:05:05 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 20:05:05 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:05:05 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75066) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 20:05:05 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 20:05:05 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 20:05:05 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 20:05:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 20:05:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:05:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75066) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Dec 01 20:05:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 20:05:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75066) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Dec 01 20:05:10 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:05:15 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 20:05:20 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 20:05:25 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 20:05:30 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 20:05:33 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 20:05:35 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:05:37 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 20:05:37 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75066) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Dec 01 20:05:39 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 20:05:40 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 20:05:40 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Dec 01 20:05:45 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:05:47 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 20:05:50 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 20:05:50 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 20:05:50 user nova-compute[75066]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 27 {{(pid=75066) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Dec 01 20:05:51 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 20:05:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 20:05:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 20:05:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 20:05:51 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Auditing locally available compute resources for user (node: user) {{(pid=75066) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Dec 01 20:05:51 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 20:05:51 user nova-compute[75066]: WARNING nova.virt.libvirt.driver [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Dec 01 20:05:51 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Hypervisor/Node resource view: name=user free_ram=9298MB free_disk=24.863773345947266GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75066) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Dec 01 20:05:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Dec 01 20:05:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Dec 01 20:05:51 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Dec 01 20:05:51 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75066) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Dec 01 20:05:51 user nova-compute[75066]: DEBUG nova.compute.provider_tree [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed in ProviderTree for provider: 8f57eb82-1921-43e1-b4a8-f85f2894ae62 {{(pid=75066) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Dec 01 20:05:51 user nova-compute[75066]: DEBUG nova.scheduler.client.report [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Inventory has not changed for provider 8f57eb82-1921-43e1-b4a8-f85f2894ae62 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75066) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Dec 01 20:05:51 user nova-compute[75066]: DEBUG nova.compute.resource_tracker [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Compute_service record updated for user:user {{(pid=75066) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Dec 01 20:05:51 user nova-compute[75066]: DEBUG oslo_concurrency.lockutils [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.136s {{(pid=75066) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Dec 01 20:05:52 user nova-compute[75066]: DEBUG oslo_service.periodic_task [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75066) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Dec 01 20:05:52 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Starting heal instance info cache {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Dec 01 20:05:52 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Rebuilding the list of instances to heal {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Dec 01 20:05:52 user nova-compute[75066]: DEBUG nova.compute.manager [None req-ed998fc1-bfd5-47e5-96df-8cf80d6edc36 None None] Didn't find any instances for network info cache update. {{(pid=75066) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}